[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:01:39.106640 14139 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.206.254:45877
I20260709 13:01:39.108299 14139 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:01:39.109421 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:39.127303 14146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:39.127306 14145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:39.128682 14139 server_base.cc:1061] running on GCE node
W20260709 13:01:39.127422 14148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:40.318653 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:40.318957 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:40.319190 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602100319167 us; error 0 us; skew 500 ppm
I20260709 13:01:40.320055 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:40.325692 14139 webserver.cc:533] Webserver started at http://127.13.206.254:33877/ using document root <none> and password file <none>
I20260709 13:01:40.326742 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:40.327011 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:40.327499 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:40.333591 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/master-0-root/instance:
uuid: "9539cd5378f44e67b57f85c26f8bf8af"
format_stamp: "Formatted at 2026-07-09 13:01:40 on dist-test-slave-ml7r"
I20260709 13:01:40.342147 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:01:40.347762 14154 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:40.349041 14139 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:40.349478 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/master-0-root
uuid: "9539cd5378f44e67b57f85c26f8bf8af"
format_stamp: "Formatted at 2026-07-09 13:01:40 on dist-test-slave-ml7r"
I20260709 13:01:40.349879 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:40.415047 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:40.416667 14139 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:01:40.417173 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:40.490981 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.254:45877
I20260709 13:01:40.491056 14205 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.254:45877 every 8 connection(s)
I20260709 13:01:40.499477 14206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:40.522017 14206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af: Bootstrap starting.
I20260709 13:01:40.528563 14206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:40.530599 14206 log.cc:826] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af: Log is configured to *not* fsync() on all Append() calls
I20260709 13:01:40.535501 14206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af: No bootstrap required, opened a new log
I20260709 13:01:40.556599 14206 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9539cd5378f44e67b57f85c26f8bf8af" member_type: VOTER }
I20260709 13:01:40.557173 14206 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:40.557374 14206 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9539cd5378f44e67b57f85c26f8bf8af, State: Initialized, Role: FOLLOWER
I20260709 13:01:40.558288 14206 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9539cd5378f44e67b57f85c26f8bf8af" member_type: VOTER }
I20260709 13:01:40.558804 14206 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:40.559072 14206 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:40.559384 14206 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:40.563771 14206 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9539cd5378f44e67b57f85c26f8bf8af" member_type: VOTER }
I20260709 13:01:40.564550 14206 leader_election.cc:304] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9539cd5378f44e67b57f85c26f8bf8af; no voters: 
I20260709 13:01:40.566433 14206 leader_election.cc:290] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:40.566789 14209 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:40.569708 14209 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 1 LEADER]: Becoming Leader. State: Replica: 9539cd5378f44e67b57f85c26f8bf8af, State: Running, Role: LEADER
I20260709 13:01:40.570729 14209 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9539cd5378f44e67b57f85c26f8bf8af" member_type: VOTER }
I20260709 13:01:40.571890 14206 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:40.583184 14210 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9539cd5378f44e67b57f85c26f8bf8af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9539cd5378f44e67b57f85c26f8bf8af" member_type: VOTER } }
I20260709 13:01:40.584244 14210 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:40.583984 14211 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9539cd5378f44e67b57f85c26f8bf8af. Latest consensus state: current_term: 1 leader_uuid: "9539cd5378f44e67b57f85c26f8bf8af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9539cd5378f44e67b57f85c26f8bf8af" member_type: VOTER } }
I20260709 13:01:40.584930 14211 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:40.587466 14219 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:40.600557 14219 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:40.603147 14139 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:40.621850 14219 catalog_manager.cc:1383] Generated new cluster ID: ebafbbf6b26f4ed195e3895e975e9f8a
I20260709 13:01:40.622140 14219 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:40.647454 14219 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:40.649022 14219 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:40.664119 14219 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af: Generated new TSK 0
I20260709 13:01:40.665133 14219 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:40.734814 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:40.745584 14228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:40.747017 14229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:40.752584 14231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:40.753489 14139 server_base.cc:1061] running on GCE node
I20260709 13:01:40.754622 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:40.754942 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:40.755190 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602100755169 us; error 0 us; skew 500 ppm
I20260709 13:01:40.756088 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:40.760843 14139 webserver.cc:533] Webserver started at http://127.13.206.193:34137/ using document root <none> and password file <none>
I20260709 13:01:40.761711 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:40.762029 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:40.762444 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:40.764192 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-0-root/instance:
uuid: "010946bc445d41db9f6eae574a5355d8"
format_stamp: "Formatted at 2026-07-09 13:01:40 on dist-test-slave-ml7r"
I20260709 13:01:40.772169 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:01:40.778177 14236 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:40.779294 14139 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:01:40.779723 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-0-root
uuid: "010946bc445d41db9f6eae574a5355d8"
format_stamp: "Formatted at 2026-07-09 13:01:40 on dist-test-slave-ml7r"
I20260709 13:01:40.780187 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:40.846560 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:40.848001 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:40.850157 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:40.855002 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:40.855304 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:40.855594 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:40.855791 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:40.965370 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.193:39681
I20260709 13:01:40.965559 14298 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.193:39681 every 8 connection(s)
I20260709 13:01:40.973021 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:40.983258 14303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:40.992915 14304 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:40.999143 14306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:41.000267 14139 server_base.cc:1061] running on GCE node
I20260709 13:01:41.001351 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:41.001662 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:41.001792 14299 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45877
I20260709 13:01:41.001900 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602101001879 us; error 0 us; skew 500 ppm
I20260709 13:01:41.002436 14299 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:41.002677 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:41.003844 14299 heartbeater.cc:507] Master 127.13.206.254:45877 requested a full tablet report, sending...
I20260709 13:01:41.005824 14139 webserver.cc:533] Webserver started at http://127.13.206.194:43515/ using document root <none> and password file <none>
I20260709 13:01:41.006510 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:41.006774 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:41.007117 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:41.008054 14171 ts_manager.cc:194] Registered new tserver with Master: 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681)
I20260709 13:01:41.008751 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-1-root/instance:
uuid: "d2cbcf4c50f145d7a5495f0284602dda"
format_stamp: "Formatted at 2026-07-09 13:01:41 on dist-test-slave-ml7r"
I20260709 13:01:41.011258 14171 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55072
I20260709 13:01:41.016769 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.006s
I20260709 13:01:41.021981 14311 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.022971 14139 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:01:41.023285 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-1-root
uuid: "d2cbcf4c50f145d7a5495f0284602dda"
format_stamp: "Formatted at 2026-07-09 13:01:41 on dist-test-slave-ml7r"
I20260709 13:01:41.023576 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:41.045679 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:41.047086 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:41.048676 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:41.051774 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:41.051985 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.052309 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:41.052460 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.148885 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.194:45399
I20260709 13:01:41.149111 14373 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.194:45399 every 8 connection(s)
I20260709 13:01:41.160017 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:41.168953 14377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:41.176167 14378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:41.176930 14380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:41.179659 14139 server_base.cc:1061] running on GCE node
I20260709 13:01:41.180824 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:01:41.180780 14374 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45877
W20260709 13:01:41.181206 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:41.181439 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602101181422 us; error 0 us; skew 500 ppm
I20260709 13:01:41.181428 14374 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:41.182278 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:41.182726 14374 heartbeater.cc:507] Master 127.13.206.254:45877 requested a full tablet report, sending...
I20260709 13:01:41.185415 14139 webserver.cc:533] Webserver started at http://127.13.206.195:44175/ using document root <none> and password file <none>
I20260709 13:01:41.185527 14171 ts_manager.cc:194] Registered new tserver with Master: d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:41.186144 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:41.186538 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:41.186918 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:41.187433 14171 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55074
I20260709 13:01:41.188375 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-2-root/instance:
uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
format_stamp: "Formatted at 2026-07-09 13:01:41 on dist-test-slave-ml7r"
I20260709 13:01:41.193913 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:01:41.197605 14385 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.198563 14139 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:01:41.198885 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-2-root
uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
format_stamp: "Formatted at 2026-07-09 13:01:41 on dist-test-slave-ml7r"
I20260709 13:01:41.199226 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602098938719-14139-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:41.214063 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:41.215507 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:41.218091 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:41.221184 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:41.221438 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.221736 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:41.221989 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:41.325872 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.195:41707
I20260709 13:01:41.326052 14447 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.195:41707 every 8 connection(s)
I20260709 13:01:41.345294 14448 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45877
I20260709 13:01:41.345710 14448 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:41.346709 14448 heartbeater.cc:507] Master 127.13.206.254:45877 requested a full tablet report, sending...
I20260709 13:01:41.348881 14171 ts_manager.cc:194] Registered new tserver with Master: b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:41.348999 14139 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017924858s
I20260709 13:01:41.350807 14171 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55086
I20260709 13:01:41.418118 14171 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55098:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:41.423872 14171 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:41.552523 14413 tablet_service.cc:1511] Processing CreateTablet for tablet 335d70603bae4194b21639fb9927c1c8 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:41.552966 14410 tablet_service.cc:1511] Processing CreateTablet for tablet bd4d72f3714c45b3a7962e8cc30ee57b (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:41.555264 14411 tablet_service.cc:1511] Processing CreateTablet for tablet aeb0a6cdc2564075a1268db82c6e67c2 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:41.555696 14409 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6e5c3e817f4a9e86fa5ccc4e80291e (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:41.557683 14408 tablet_service.cc:1511] Processing CreateTablet for tablet cacf9d7cbfbc4716bd64f06b78bdb954 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:41.559559 14412 tablet_service.cc:1511] Processing CreateTablet for tablet 834142f59f7d48fc8b69a844e5d46a0c (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:41.557826 14407 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd10b72e0da41498b6b288c7fd40921 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:41.560609 14406 tablet_service.cc:1511] Processing CreateTablet for tablet 85366769d9ff4c7aa26a3c0e05456e53 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:41.563411 14405 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf4583f117a49ed89b1c07c539c4e5d (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:41.565591 14411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb0a6cdc2564075a1268db82c6e67c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.569175 14264 tablet_service.cc:1511] Processing CreateTablet for tablet 335d70603bae4194b21639fb9927c1c8 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:41.569633 14263 tablet_service.cc:1511] Processing CreateTablet for tablet 834142f59f7d48fc8b69a844e5d46a0c (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:41.570721 14264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335d70603bae4194b21639fb9927c1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.572611 14258 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd10b72e0da41498b6b288c7fd40921 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:41.580416 14258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd10b72e0da41498b6b288c7fd40921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.573911 14406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85366769d9ff4c7aa26a3c0e05456e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.585223 14263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 834142f59f7d48fc8b69a844e5d46a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.586382 14408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cacf9d7cbfbc4716bd64f06b78bdb954. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:41.588361 14218 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:41.571913 14256 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf4583f117a49ed89b1c07c539c4e5d (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:41.590396 14256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf4583f117a49ed89b1c07c539c4e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.594698 14409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6e5c3e817f4a9e86fa5ccc4e80291e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.577246 14259 tablet_service.cc:1511] Processing CreateTablet for tablet cacf9d7cbfbc4716bd64f06b78bdb954 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:41.595952 14259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cacf9d7cbfbc4716bd64f06b78bdb954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.574452 14261 tablet_service.cc:1511] Processing CreateTablet for tablet bd4d72f3714c45b3a7962e8cc30ee57b (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:41.578671 14257 tablet_service.cc:1511] Processing CreateTablet for tablet 85366769d9ff4c7aa26a3c0e05456e53 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:41.573040 14262 tablet_service.cc:1511] Processing CreateTablet for tablet aeb0a6cdc2564075a1268db82c6e67c2 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:41.575825 14260 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6e5c3e817f4a9e86fa5ccc4e80291e (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:41.603670 14261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd4d72f3714c45b3a7962e8cc30ee57b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.606101 14257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85366769d9ff4c7aa26a3c0e05456e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.604346 14405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf4583f117a49ed89b1c07c539c4e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.612227 14407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd10b72e0da41498b6b288c7fd40921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.611732 14262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb0a6cdc2564075a1268db82c6e67c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.619766 14410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd4d72f3714c45b3a7962e8cc30ee57b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.624167 14339 tablet_service.cc:1511] Processing CreateTablet for tablet 335d70603bae4194b21639fb9927c1c8 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:01:41.625792 14339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335d70603bae4194b21639fb9927c1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.645277 14260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6e5c3e817f4a9e86fa5ccc4e80291e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.656495 14412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 834142f59f7d48fc8b69a844e5d46a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.667132 14335 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6e5c3e817f4a9e86fa5ccc4e80291e (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:01:41.667171 14332 tablet_service.cc:1511] Processing CreateTablet for tablet 85366769d9ff4c7aa26a3c0e05456e53 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:01:41.669674 14335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6e5c3e817f4a9e86fa5ccc4e80291e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.667407 14337 tablet_service.cc:1511] Processing CreateTablet for tablet aeb0a6cdc2564075a1268db82c6e67c2 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:01:41.671289 14337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb0a6cdc2564075a1268db82c6e67c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.678860 14334 tablet_service.cc:1511] Processing CreateTablet for tablet cacf9d7cbfbc4716bd64f06b78bdb954 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:01:41.689764 14338 tablet_service.cc:1511] Processing CreateTablet for tablet 834142f59f7d48fc8b69a844e5d46a0c (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:01:41.674129 14336 tablet_service.cc:1511] Processing CreateTablet for tablet bd4d72f3714c45b3a7962e8cc30ee57b (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:01:41.676760 14413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 335d70603bae4194b21639fb9927c1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.715790 14331 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf4583f117a49ed89b1c07c539c4e5d (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:01:41.712426 14332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85366769d9ff4c7aa26a3c0e05456e53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.684266 14333 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd10b72e0da41498b6b288c7fd40921 (DEFAULT_TABLE table=test-workload [id=17f8293656b04f169049770f617c9d1b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:01:41.756330 14338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 834142f59f7d48fc8b69a844e5d46a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.759598 14334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cacf9d7cbfbc4716bd64f06b78bdb954. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.762352 14333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd10b72e0da41498b6b288c7fd40921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.775045 14331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf4583f117a49ed89b1c07c539c4e5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.789547 14466 tablet_bootstrap.cc:492] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8: Bootstrap starting.
I20260709 13:01:41.819833 14336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd4d72f3714c45b3a7962e8cc30ee57b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:41.858940 14467 tablet_bootstrap.cc:492] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac: Bootstrap starting.
I20260709 13:01:41.906059 14466 tablet_bootstrap.cc:654] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.918000 14468 tablet_bootstrap.cc:492] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda: Bootstrap starting.
I20260709 13:01:41.922734 14467 tablet_bootstrap.cc:654] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.940997 14468 tablet_bootstrap.cc:654] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:41.961751 14466 tablet_bootstrap.cc:492] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8: No bootstrap required, opened a new log
I20260709 13:01:41.964745 14466 ts_tablet_manager.cc:1403] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.008s
I20260709 13:01:41.979727 14467 tablet_bootstrap.cc:492] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac: No bootstrap required, opened a new log
I20260709 13:01:41.980198 14467 ts_tablet_manager.cc:1403] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac: Time spent bootstrapping tablet: real 0.155s	user 0.017s	sys 0.013s
I20260709 13:01:41.981240 14466 raft_consensus.cc:359] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:41.982091 14466 raft_consensus.cc:385] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.990347 14466 raft_consensus.cc:740] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.982647 14467 raft_consensus.cc:359] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:41.991074 14467 raft_consensus.cc:385] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:41.991526 14467 raft_consensus.cc:740] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Initialized, Role: FOLLOWER
I20260709 13:01:41.991245 14466 consensus_queue.cc:260] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:41.992641 14467 consensus_queue.cc:260] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:41.996703 14467 ts_tablet_manager.cc:1434] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac: Time spent starting tablet: real 0.016s	user 0.013s	sys 0.004s
I20260709 13:01:41.997462 14468 tablet_bootstrap.cc:492] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda: No bootstrap required, opened a new log
I20260709 13:01:41.997848 14468 ts_tablet_manager.cc:1403] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.013s
I20260709 13:01:41.998950 14448 heartbeater.cc:499] Master 127.13.206.254:45877 was elected leader, sending a full tablet report...
I20260709 13:01:42.001267 14468 raft_consensus.cc:359] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:42.001751 14467 tablet_bootstrap.cc:492] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac: Bootstrap starting.
I20260709 13:01:42.002053 14468 raft_consensus.cc:385] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.002415 14468 raft_consensus.cc:740] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.003314 14468 consensus_queue.cc:260] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:42.015591 14299 heartbeater.cc:499] Master 127.13.206.254:45877 was elected leader, sending a full tablet report...
I20260709 13:01:42.019572 14466 ts_tablet_manager.cc:1434] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8: Time spent starting tablet: real 0.054s	user 0.015s	sys 0.015s
I20260709 13:01:42.020612 14466 tablet_bootstrap.cc:492] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8: Bootstrap starting.
I20260709 13:01:42.021694 14467 tablet_bootstrap.cc:654] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.027520 14466 tablet_bootstrap.cc:654] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.035220 14374 heartbeater.cc:499] Master 127.13.206.254:45877 was elected leader, sending a full tablet report...
I20260709 13:01:42.035807 14468 ts_tablet_manager.cc:1434] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda: Time spent starting tablet: real 0.038s	user 0.014s	sys 0.018s
I20260709 13:01:42.036857 14468 tablet_bootstrap.cc:492] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda: Bootstrap starting.
I20260709 13:01:42.044019 14468 tablet_bootstrap.cc:654] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.045820 14467 tablet_bootstrap.cc:492] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac: No bootstrap required, opened a new log
I20260709 13:01:42.046394 14467 ts_tablet_manager.cc:1403] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.000s
I20260709 13:01:42.050184 14467 raft_consensus.cc:359] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.051343 14467 raft_consensus.cc:385] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.051798 14467 raft_consensus.cc:740] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.053411 14467 consensus_queue.cc:260] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.056047 14466 tablet_bootstrap.cc:492] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8: No bootstrap required, opened a new log
I20260709 13:01:42.056718 14466 ts_tablet_manager.cc:1403] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.008s
I20260709 13:01:42.056959 14467 ts_tablet_manager.cc:1434] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:01:42.056082 14468 tablet_bootstrap.cc:492] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda: No bootstrap required, opened a new log
I20260709 13:01:42.057624 14468 ts_tablet_manager.cc:1403] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.002s
I20260709 13:01:42.057994 14467 tablet_bootstrap.cc:492] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac: Bootstrap starting.
I20260709 13:01:42.060659 14468 raft_consensus.cc:359] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.063958 14466 raft_consensus.cc:359] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.067472 14466 raft_consensus.cc:385] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.067947 14466 raft_consensus.cc:740] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.068858 14466 consensus_queue.cc:260] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.071267 14466 ts_tablet_manager.cc:1434] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:01:42.066450 14468 raft_consensus.cc:385] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.071811 14468 raft_consensus.cc:740] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.072628 14468 consensus_queue.cc:260] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.074951 14468 ts_tablet_manager.cc:1434] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:01:42.075997 14468 tablet_bootstrap.cc:492] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda: Bootstrap starting.
I20260709 13:01:42.082463 14468 tablet_bootstrap.cc:654] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:42.082504 14449 tablet.cc:2406] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:42.083530 14467 tablet_bootstrap.cc:654] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.083902 14466 tablet_bootstrap.cc:492] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8: Bootstrap starting.
I20260709 13:01:42.091238 14466 tablet_bootstrap.cc:654] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.091260 14473 raft_consensus.cc:493] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.092042 14473 raft_consensus.cc:515] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.104079 14473 leader_election.cc:290] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:42.111716 14474 raft_consensus.cc:493] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.112329 14474 raft_consensus.cc:515] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.115024 14474 leader_election.cc:290] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.125810 14466 tablet_bootstrap.cc:492] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8: No bootstrap required, opened a new log
I20260709 13:01:42.126519 14466 ts_tablet_manager.cc:1403] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.002s
I20260709 13:01:42.130605 14466 raft_consensus.cc:359] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.131634 14466 raft_consensus.cc:385] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.132014 14466 raft_consensus.cc:740] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.132946 14466 consensus_queue.cc:260] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.126519 14467 tablet_bootstrap.cc:492] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac: No bootstrap required, opened a new log
I20260709 13:01:42.134785 14467 ts_tablet_manager.cc:1403] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.008s
I20260709 13:01:42.140443 14466 ts_tablet_manager.cc:1434] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:01:42.141772 14466 tablet_bootstrap.cc:492] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8: Bootstrap starting.
I20260709 13:01:42.145411 14467 raft_consensus.cc:359] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.151018 14467 raft_consensus.cc:385] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.151451 14467 raft_consensus.cc:740] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.152525 14467 consensus_queue.cc:260] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.160121 14423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd10b72e0da41498b6b288c7fd40921" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
W20260709 13:01:42.162602 14315 leader_election.cc:343] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.169351 14468 tablet_bootstrap.cc:492] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda: No bootstrap required, opened a new log
I20260709 13:01:42.169842 14468 ts_tablet_manager.cc:1403] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda: Time spent bootstrapping tablet: real 0.094s	user 0.021s	sys 0.032s
I20260709 13:01:42.173061 14468 raft_consensus.cc:359] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.173893 14468 raft_consensus.cc:385] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.174203 14468 raft_consensus.cc:740] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.174700 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd10b72e0da41498b6b288c7fd40921" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8" is_pre_election: true
I20260709 13:01:42.175503 14274 raft_consensus.cc:2468] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 0.
I20260709 13:01:42.175879 14467 ts_tablet_manager.cc:1434] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.002s
I20260709 13:01:42.176940 14467 tablet_bootstrap.cc:492] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac: Bootstrap starting.
I20260709 13:01:42.179636 14468 consensus_queue.cc:260] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.180251 14315 leader_election.cc:304] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: b87c4ad779d04ddba17dbeab7f19ceac
I20260709 13:01:42.182417 14474 raft_consensus.cc:2804] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.182819 14474 raft_consensus.cc:493] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.183156 14474 raft_consensus.cc:3060] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.189409 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cacf9d7cbfbc4716bd64f06b78bdb954" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8" is_pre_election: true
I20260709 13:01:42.191805 14468 ts_tablet_manager.cc:1434] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.003s
W20260709 13:01:42.192781 14389 leader_election.cc:343] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.192920 14468 tablet_bootstrap.cc:492] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda: Bootstrap starting.
I20260709 13:01:42.196405 14474 raft_consensus.cc:515] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.199235 14474 leader_election.cc:290] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.202852 14466 tablet_bootstrap.cc:654] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.203940 14468 tablet_bootstrap.cc:654] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.203742 14423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd10b72e0da41498b6b288c7fd40921" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:42.204669 14472 raft_consensus.cc:493] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.208734 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cacf9d7cbfbc4716bd64f06b78bdb954" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
I20260709 13:01:42.209414 14472 raft_consensus.cc:515] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
W20260709 13:01:42.210294 14315 leader_election.cc:343] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.205298 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd10b72e0da41498b6b288c7fd40921" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8"
W20260709 13:01:42.210693 14387 leader_election.cc:343] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.211053 14274 raft_consensus.cc:3060] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.211222 14387 leader_election.cc:304] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87c4ad779d04ddba17dbeab7f19ceac; no voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:42.210886 14467 tablet_bootstrap.cc:654] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.212143 14473 raft_consensus.cc:2749] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.212531 14472 leader_election.cc:290] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.225932 14274 raft_consensus.cc:2468] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 1.
I20260709 13:01:42.239709 14473 raft_consensus.cc:493] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.239797 14315 leader_election.cc:304] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: b87c4ad779d04ddba17dbeab7f19ceac
I20260709 13:01:42.240480 14473 raft_consensus.cc:515] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.241294 14474 raft_consensus.cc:2804] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.242029 14474 raft_consensus.cc:697] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Becoming Leader. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:42.246188 14474 consensus_queue.cc:237] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.254117 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8" is_pre_election: true
W20260709 13:01:42.258816 14389 leader_election.cc:343] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.259896 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
W20260709 13:01:42.261875 14387 leader_election.cc:343] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.261157 14473 leader_election.cc:290] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:42.262600 14387 leader_election.cc:304] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87c4ad779d04ddba17dbeab7f19ceac; no voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:42.264670 14473 raft_consensus.cc:2749] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.270134 14468 tablet_bootstrap.cc:492] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda: No bootstrap required, opened a new log
I20260709 13:01:42.271193 14468 ts_tablet_manager.cc:1403] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.009s
I20260709 13:01:42.277377 14467 tablet_bootstrap.cc:492] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac: No bootstrap required, opened a new log
I20260709 13:01:42.277879 14467 ts_tablet_manager.cc:1403] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac: Time spent bootstrapping tablet: real 0.101s	user 0.021s	sys 0.008s
I20260709 13:01:42.278385 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf4583f117a49ed89b1c07c539c4e5d" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
I20260709 13:01:42.278345 14466 tablet_bootstrap.cc:492] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8: No bootstrap required, opened a new log
I20260709 13:01:42.279470 14466 ts_tablet_manager.cc:1403] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8: Time spent bootstrapping tablet: real 0.138s	user 0.016s	sys 0.014s
W20260709 13:01:42.280362 14238 leader_election.cc:343] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.280324 14468 raft_consensus.cc:359] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.276943 14170 catalog_manager.cc:5697] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda reported cstate change: term changed from 0 to 1, leader changed from <none> to d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194). New cstate: current_term: 1 leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.282256 14468 raft_consensus.cc:385] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.282626 14468 raft_consensus.cc:740] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.283375 14468 consensus_queue.cc:260] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.283548 14466 raft_consensus.cc:359] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.284977 14466 raft_consensus.cc:385] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.285429 14466 raft_consensus.cc:740] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.287648 14467 raft_consensus.cc:359] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.288710 14467 raft_consensus.cc:385] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.289115 14467 raft_consensus.cc:740] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.286967 14466 consensus_queue.cc:260] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.291330 14468 ts_tablet_manager.cc:1434] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:01:42.295416 14466 ts_tablet_manager.cc:1434] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:01:42.295452 14468 tablet_bootstrap.cc:492] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda: Bootstrap starting.
I20260709 13:01:42.296954 14466 tablet_bootstrap.cc:492] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8: Bootstrap starting.
I20260709 13:01:42.290565 14467 consensus_queue.cc:260] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.300266 14467 ts_tablet_manager.cc:1434] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.005s
I20260709 13:01:42.301261 14467 tablet_bootstrap.cc:492] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac: Bootstrap starting.
I20260709 13:01:42.307220 14473 raft_consensus.cc:493] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.308256 14473 raft_consensus.cc:515] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.309968 14468 tablet_bootstrap.cc:654] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.312067 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf4583f117a49ed89b1c07c539c4e5d" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8" is_pre_election: true
I20260709 13:01:42.312747 14274 raft_consensus.cc:2468] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 0.
I20260709 13:01:42.313287 14466 tablet_bootstrap.cc:654] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.310521 14473 leader_election.cc:290] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:42.320581 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf4583f117a49ed89b1c07c539c4e5d" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
I20260709 13:01:42.320312 14389 leader_election.cc:304] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:42.323555 14473 raft_consensus.cc:2804] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.323470 14423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf4583f117a49ed89b1c07c539c4e5d" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
I20260709 13:01:42.324051 14473 raft_consensus.cc:493] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:42.324102 14387 leader_election.cc:343] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.324510 14473 raft_consensus.cc:3060] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.342576 14474 raft_consensus.cc:493] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.343317 14474 raft_consensus.cc:515] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:42.348337 14473 raft_consensus.cc:515] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.350281 14467 tablet_bootstrap.cc:654] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.356793 14474 leader_election.cc:290] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707), 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681)
I20260709 13:01:42.361981 14423 raft_consensus.cc:2393] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 010946bc445d41db9f6eae574a5355d8 in current term 1: Already voted for candidate b87c4ad779d04ddba17dbeab7f19ceac in this term.
I20260709 13:01:42.361697 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8" is_pre_election: true
W20260709 13:01:42.363828 14315 leader_election.cc:343] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.359228 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
I20260709 13:01:42.367502 14473 leader_election.cc:290] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:42.368135 14468 tablet_bootstrap.cc:492] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda: No bootstrap required, opened a new log
W20260709 13:01:42.368438 14315 leader_election.cc:343] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.368884 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf4583f117a49ed89b1c07c539c4e5d" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:42.368944 14240 leader_election.cc:304] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8; no voters: b87c4ad779d04ddba17dbeab7f19ceac, d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:42.371115 14315 leader_election.cc:304] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2cbcf4c50f145d7a5495f0284602dda; no voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac
I20260709 13:01:42.374213 14474 raft_consensus.cc:2749] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.372082 14468 ts_tablet_manager.cc:1403] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.011s
I20260709 13:01:42.374861 14466 tablet_bootstrap.cc:492] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8: No bootstrap required, opened a new log
I20260709 13:01:42.375079 14274 raft_consensus.cc:3060] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.375599 14466 ts_tablet_manager.cc:1403] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.009s
I20260709 13:01:42.380331 14466 raft_consensus.cc:359] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.381444 14466 raft_consensus.cc:385] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.374908 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf4583f117a49ed89b1c07c539c4e5d" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
W20260709 13:01:42.384231 14387 leader_election.cc:343] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.381991 14466 raft_consensus.cc:740] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.387252 14274 raft_consensus.cc:2468] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 1.
I20260709 13:01:42.387881 14472 raft_consensus.cc:2749] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.388478 14389 leader_election.cc:304] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:42.388844 14466 consensus_queue.cc:260] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.389720 14473 raft_consensus.cc:2804] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.392264 14468 raft_consensus.cc:359] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.393100 14468 raft_consensus.cc:385] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.393448 14468 raft_consensus.cc:740] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.394497 14468 consensus_queue.cc:260] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.430641 14467 tablet_bootstrap.cc:492] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac: No bootstrap required, opened a new log
I20260709 13:01:42.433265 14466 ts_tablet_manager.cc:1434] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8: Time spent starting tablet: real 0.057s	user 0.013s	sys 0.028s
I20260709 13:01:42.434849 14466 tablet_bootstrap.cc:492] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8: Bootstrap starting.
I20260709 13:01:42.435405 14468 ts_tablet_manager.cc:1434] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda: Time spent starting tablet: real 0.060s	user 0.012s	sys 0.007s
I20260709 13:01:42.438717 14468 tablet_bootstrap.cc:492] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda: Bootstrap starting.
I20260709 13:01:42.444228 14466 tablet_bootstrap.cc:654] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.445815 14468 tablet_bootstrap.cc:654] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.431248 14467 ts_tablet_manager.cc:1403] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac: Time spent bootstrapping tablet: real 0.130s	user 0.011s	sys 0.020s
I20260709 13:01:42.460112 14466 tablet_bootstrap.cc:492] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8: No bootstrap required, opened a new log
I20260709 13:01:42.460970 14466 ts_tablet_manager.cc:1403] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.003s
I20260709 13:01:42.464499 14474 raft_consensus.cc:493] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.465097 14474 raft_consensus.cc:515] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.465443 14473 raft_consensus.cc:697] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 1 LEADER]: Becoming Leader. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Running, Role: LEADER
I20260709 13:01:42.449621 14467 raft_consensus.cc:359] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.466320 14467 raft_consensus.cc:385] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.466673 14467 raft_consensus.cc:740] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.466686 14466 raft_consensus.cc:359] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:42.467403 14474 leader_election.cc:290] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.467682 14466 raft_consensus.cc:385] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.468596 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8" is_pre_election: true
I20260709 13:01:42.469059 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
I20260709 13:01:42.469010 14467 consensus_queue.cc:260] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.468158 14466 raft_consensus.cc:740] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.470304 14468 tablet_bootstrap.cc:492] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda: No bootstrap required, opened a new log
W20260709 13:01:42.470603 14315 leader_election.cc:343] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.470805 14468 ts_tablet_manager.cc:1403] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.005s
W20260709 13:01:42.471305 14315 leader_election.cc:343] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.470975 14466 consensus_queue.cc:260] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:42.471968 14467 ts_tablet_manager.cc:1434] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:01:42.471765 14315 leader_election.cc:304] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d2cbcf4c50f145d7a5495f0284602dda; no voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac
I20260709 13:01:42.472610 14474 raft_consensus.cc:2749] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.466439 14473 consensus_queue.cc:237] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.473546 14474 raft_consensus.cc:493] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.474154 14466 ts_tablet_manager.cc:1434] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:01:42.474025 14474 raft_consensus.cc:515] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.475432 14466 tablet_bootstrap.cc:492] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8: Bootstrap starting.
I20260709 13:01:42.476148 14474 leader_election.cc:290] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.477676 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8" is_pre_election: true
I20260709 13:01:42.478276 14468 raft_consensus.cc:359] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.479033 14468 raft_consensus.cc:385] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.479347 14468 raft_consensus.cc:740] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Initialized, Role: FOLLOWER
W20260709 13:01:42.479586 14315 leader_election.cc:343] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.480129 14468 consensus_queue.cc:260] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.484278 14466 tablet_bootstrap.cc:654] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.485168 14468 ts_tablet_manager.cc:1434] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:01:42.486296 14468 tablet_bootstrap.cc:492] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda: Bootstrap starting.
I20260709 13:01:42.493395 14468 tablet_bootstrap.cc:654] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.495218 14472 raft_consensus.cc:493] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.495719 14472 raft_consensus.cc:515] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.499022 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
I20260709 13:01:42.499537 14467 tablet_bootstrap.cc:492] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac: Bootstrap starting.
I20260709 13:01:42.499795 14349 raft_consensus.cc:2468] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 0.
I20260709 13:01:42.500890 14423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
I20260709 13:01:42.501585 14423 raft_consensus.cc:2468] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 0.
I20260709 13:01:42.504781 14240 leader_election.cc:304] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:42.505007 14468 tablet_bootstrap.cc:492] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda: No bootstrap required, opened a new log
I20260709 13:01:42.505620 14468 ts_tablet_manager.cc:1403] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.001s
I20260709 13:01:42.498956 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
I20260709 13:01:42.507925 14422 raft_consensus.cc:2468] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 0.
I20260709 13:01:42.508972 14468 raft_consensus.cc:359] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.509346 14315 leader_election.cc:304] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b87c4ad779d04ddba17dbeab7f19ceac, d2cbcf4c50f145d7a5495f0284602dda; no voters: 010946bc445d41db9f6eae574a5355d8
I20260709 13:01:42.509853 14468 raft_consensus.cc:385] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.510190 14467 tablet_bootstrap.cc:654] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.510190 14474 raft_consensus.cc:2804] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.497901 14472 leader_election.cc:290] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.511283 14474 raft_consensus.cc:493] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.511683 14507 raft_consensus.cc:2804] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.511770 14474 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.512213 14507 raft_consensus.cc:493] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.512612 14507 raft_consensus.cc:3060] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.514766 14170 catalog_manager.cc:5697] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac reported cstate change: term changed from 0 to 1, leader changed from <none> to b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195). New cstate: current_term: 1 leader_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.516036 14466 tablet_bootstrap.cc:492] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8: No bootstrap required, opened a new log
I20260709 13:01:42.516526 14466 ts_tablet_manager.cc:1403] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.001s
I20260709 13:01:42.519747 14507 raft_consensus.cc:515] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.520689 14466 raft_consensus.cc:359] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.521749 14466 raft_consensus.cc:385] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.522164 14466 raft_consensus.cc:740] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.522957 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:42.523555 14349 raft_consensus.cc:3060] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.523178 14466 consensus_queue.cc:260] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.526079 14466 ts_tablet_manager.cc:1434] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:01:42.527136 14466 tablet_bootstrap.cc:492] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8: Bootstrap starting.
I20260709 13:01:42.527351 14474 raft_consensus.cc:515] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.529458 14474 leader_election.cc:290] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.510263 14468 raft_consensus.cc:740] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.530505 14468 consensus_queue.cc:260] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.531643 14349 raft_consensus.cc:2468] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 1.
I20260709 13:01:42.532506 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:42.532915 14238 leader_election.cc:304] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:42.533959 14466 tablet_bootstrap.cc:654] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.534461 14472 raft_consensus.cc:2804] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.534822 14507 leader_election.cc:290] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 election: Requested vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.537648 14423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:42.538412 14423 raft_consensus.cc:3060] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.533773 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:42.538966 14422 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.540351 14466 tablet_bootstrap.cc:492] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8: No bootstrap required, opened a new log
I20260709 13:01:42.540803 14466 ts_tablet_manager.cc:1403] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:01:42.532915 14468 ts_tablet_manager.cc:1434] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:01:42.543303 14468 tablet_bootstrap.cc:492] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda: Bootstrap starting.
I20260709 13:01:42.545779 14423 raft_consensus.cc:2468] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 1.
W20260709 13:01:42.546573 14315 leader_election.cc:343] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.547564 14466 raft_consensus.cc:359] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.548281 14466 raft_consensus.cc:385] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.548586 14466 raft_consensus.cc:740] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.549520 14466 consensus_queue.cc:260] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.551919 14466 ts_tablet_manager.cc:1434] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:01:42.552678 14468 tablet_bootstrap.cc:654] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.552872 14466 tablet_bootstrap.cc:492] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8: Bootstrap starting.
I20260709 13:01:42.557214 14422 raft_consensus.cc:2468] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 1.
I20260709 13:01:42.557437 14474 raft_consensus.cc:493] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.562467 14474 raft_consensus.cc:515] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.563351 14315 leader_election.cc:304] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b87c4ad779d04ddba17dbeab7f19ceac, d2cbcf4c50f145d7a5495f0284602dda; no voters: 010946bc445d41db9f6eae574a5355d8
I20260709 13:01:42.564395 14488 raft_consensus.cc:2804] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.559306 14466 tablet_bootstrap.cc:654] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.564709 14474 leader_election.cc:290] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.566548 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cacf9d7cbfbc4716bd64f06b78bdb954" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8" is_pre_election: true
I20260709 13:01:42.567421 14274 raft_consensus.cc:2468] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 0.
I20260709 13:01:42.569900 14315 leader_election.cc:304] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:42.571106 14474 raft_consensus.cc:2804] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.571664 14474 raft_consensus.cc:493] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.572098 14507 raft_consensus.cc:493] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.571728 14423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cacf9d7cbfbc4716bd64f06b78bdb954" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
I20260709 13:01:42.572614 14507 raft_consensus.cc:515] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.572883 14423 raft_consensus.cc:2468] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 0.
I20260709 13:01:42.573143 14468 tablet_bootstrap.cc:492] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda: No bootstrap required, opened a new log
I20260709 13:01:42.573899 14468 ts_tablet_manager.cc:1403] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.005s
I20260709 13:01:42.574857 14507 leader_election.cc:290] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.576550 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
I20260709 13:01:42.577230 14349 raft_consensus.cc:2468] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 0.
I20260709 13:01:42.577296 14423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
I20260709 13:01:42.572266 14474 raft_consensus.cc:3060] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:42.578619 14240 leader_election.cc:343] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.576696 14488 raft_consensus.cc:697] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Becoming Leader. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:42.579212 14238 leader_election.cc:304] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: b87c4ad779d04ddba17dbeab7f19ceac
I20260709 13:01:42.580446 14507 raft_consensus.cc:2804] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.579953 14488 consensus_queue.cc:237] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.580884 14507 raft_consensus.cc:493] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.581374 14507 raft_consensus.cc:3060] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.577785 14468 raft_consensus.cc:359] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.586827 14468 raft_consensus.cc:385] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.587082 14467 tablet_bootstrap.cc:492] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac: No bootstrap required, opened a new log
I20260709 13:01:42.587316 14468 raft_consensus.cc:740] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.587666 14467 ts_tablet_manager.cc:1403] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.011s
I20260709 13:01:42.588346 14468 consensus_queue.cc:260] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.589483 14472 raft_consensus.cc:697] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Becoming Leader. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
W20260709 13:01:42.590708 14218 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:42.590596 14472 consensus_queue.cc:237] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.591703 14507 raft_consensus.cc:515] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.594820 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:42.595440 14349 raft_consensus.cc:3060] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.595978 14474 raft_consensus.cc:515] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.595988 14467 raft_consensus.cc:359] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.599382 14467 raft_consensus.cc:385] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.599728 14467 raft_consensus.cc:740] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.604418 14468 ts_tablet_manager.cc:1434] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:01:42.604682 14467 consensus_queue.cc:260] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.605746 14468 tablet_bootstrap.cc:492] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda: Bootstrap starting.
I20260709 13:01:42.607592 14349 raft_consensus.cc:2468] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 1.
I20260709 13:01:42.608827 14238 leader_election.cc:304] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:42.612179 14474 leader_election.cc:290] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.612922 14466 tablet_bootstrap.cc:492] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8: No bootstrap required, opened a new log
I20260709 13:01:42.612843 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cacf9d7cbfbc4716bd64f06b78bdb954" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:42.613435 14466 ts_tablet_manager.cc:1403] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8: Time spent bootstrapping tablet: real 0.061s	user 0.033s	sys 0.019s
I20260709 13:01:42.613499 14274 raft_consensus.cc:3060] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.615162 14170 catalog_manager.cc:5697] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda reported cstate change: term changed from 0 to 1, leader changed from <none> to d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194). New cstate: current_term: 1 leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.616647 14466 raft_consensus.cc:359] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.617311 14466 raft_consensus.cc:385] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.617601 14466 raft_consensus.cc:740] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.618371 14509 raft_consensus.cc:2804] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.618583 14466 consensus_queue.cc:260] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.619935 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cacf9d7cbfbc4716bd64f06b78bdb954" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:42.620561 14422 raft_consensus.cc:3060] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.611387 14423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
W20260709 13:01:42.626488 14240 leader_election.cc:343] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.628618 14467 ts_tablet_manager.cc:1434] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.002s
I20260709 13:01:42.630307 14509 raft_consensus.cc:697] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Becoming Leader. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:42.631302 14274 raft_consensus.cc:2468] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 1.
I20260709 13:01:42.633102 14468 tablet_bootstrap.cc:654] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.633831 14315 leader_election.cc:304] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:42.631302 14509 consensus_queue.cc:237] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.634608 14474 raft_consensus.cc:2804] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.634949 14422 raft_consensus.cc:2468] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 1.
I20260709 13:01:42.635337 14474 raft_consensus.cc:697] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Becoming Leader. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:42.633137 14467 tablet_bootstrap.cc:492] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac: Bootstrap starting.
I20260709 13:01:42.636237 14474 consensus_queue.cc:237] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.638720 14507 leader_election.cc:290] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 election: Requested vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.631913 14466 ts_tablet_manager.cc:1434] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.010s
I20260709 13:01:42.644218 14467 tablet_bootstrap.cc:654] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.649420 14170 catalog_manager.cc:5697] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda reported cstate change: term changed from 0 to 1, leader changed from <none> to d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194). New cstate: current_term: 1 leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.651154 14507 raft_consensus.cc:493] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.651926 14507 raft_consensus.cc:515] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.656302 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
W20260709 13:01:42.658646 14238 leader_election.cc:343] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:42.661691 14507 leader_election.cc:290] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.661957 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
I20260709 13:01:42.662700 14422 raft_consensus.cc:2468] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 0.
I20260709 13:01:42.669023 14468 tablet_bootstrap.cc:492] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda: No bootstrap required, opened a new log
I20260709 13:01:42.673099 14468 ts_tablet_manager.cc:1403] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.020s
I20260709 13:01:42.673195 14168 catalog_manager.cc:5697] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 010946bc445d41db9f6eae574a5355d8 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "010946bc445d41db9f6eae574a5355d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.672024 14240 leader_election.cc:304] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:42.675467 14509 raft_consensus.cc:2804] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.675909 14509 raft_consensus.cc:493] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.676278 14509 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.675397 14168 catalog_manager.cc:5697] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 010946bc445d41db9f6eae574a5355d8 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "010946bc445d41db9f6eae574a5355d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.676208 14468 raft_consensus.cc:359] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.676896 14468 raft_consensus.cc:385] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.677212 14468 raft_consensus.cc:740] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.677973 14468 consensus_queue.cc:260] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.680330 14468 ts_tablet_manager.cc:1434] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:42.682754 14467 tablet_bootstrap.cc:492] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac: No bootstrap required, opened a new log
I20260709 13:01:42.683317 14467 ts_tablet_manager.cc:1403] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.013s
I20260709 13:01:42.683779 14509 raft_consensus.cc:515] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.686456 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:42.686904 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:42.686954 14509 leader_election.cc:290] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 election: Requested vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.687531 14422 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.687090 14349 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.693682 14422 raft_consensus.cc:2468] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 1.
I20260709 13:01:42.694705 14349 raft_consensus.cc:2468] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 1.
I20260709 13:01:42.694839 14240 leader_election.cc:304] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:42.695734 14509 raft_consensus.cc:2804] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.696448 14509 raft_consensus.cc:697] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Becoming Leader. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:42.697336 14509 consensus_queue.cc:237] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.700409 14467 raft_consensus.cc:359] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.701210 14467 raft_consensus.cc:385] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.701645 14467 raft_consensus.cc:740] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.702426 14467 consensus_queue.cc:260] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.707676 14467 ts_tablet_manager.cc:1434] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:01:42.708808 14467 tablet_bootstrap.cc:492] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac: Bootstrap starting.
I20260709 13:01:42.718510 14467 tablet_bootstrap.cc:654] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.718685 14170 catalog_manager.cc:5697] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 010946bc445d41db9f6eae574a5355d8 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "010946bc445d41db9f6eae574a5355d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.726485 14467 tablet_bootstrap.cc:492] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac: No bootstrap required, opened a new log
I20260709 13:01:42.726980 14467 ts_tablet_manager.cc:1403] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.007s
I20260709 13:01:42.729530 14467 raft_consensus.cc:359] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.730214 14467 raft_consensus.cc:385] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.730581 14467 raft_consensus.cc:740] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.731230 14467 consensus_queue.cc:260] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.734519 14467 ts_tablet_manager.cc:1434] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:42.736191 14467 tablet_bootstrap.cc:492] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac: Bootstrap starting.
I20260709 13:01:42.740943 14467 tablet_bootstrap.cc:654] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:42.743518 14473 raft_consensus.cc:493] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.744210 14473 raft_consensus.cc:515] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.748201 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8" is_pre_election: true
I20260709 13:01:42.749006 14274 raft_consensus.cc:2468] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 0.
I20260709 13:01:42.750331 14389 leader_election.cc:304] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:42.750895 14467 tablet_bootstrap.cc:492] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac: No bootstrap required, opened a new log
I20260709 13:01:42.751108 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
I20260709 13:01:42.751299 14501 raft_consensus.cc:2804] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.751748 14501 raft_consensus.cc:493] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.751879 14349 raft_consensus.cc:2468] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 0.
I20260709 13:01:42.752146 14501 raft_consensus.cc:3060] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.752722 14473 leader_election.cc:290] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:42.751358 14467 ts_tablet_manager.cc:1403] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac: Time spent bootstrapping tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 13:01:42.756134 14467 raft_consensus.cc:359] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:42.756870 14467 raft_consensus.cc:385] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:42.757153 14467 raft_consensus.cc:740] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Initialized, Role: FOLLOWER
I20260709 13:01:42.757874 14467 consensus_queue.cc:260] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:42.759603 14501 raft_consensus.cc:515] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.762128 14467 ts_tablet_manager.cc:1434] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:01:42.762634 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:42.763232 14274 raft_consensus.cc:3060] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.763418 14501 leader_election.cc:290] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:42.765241 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:42.765892 14349 raft_consensus.cc:3060] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.770833 14274 raft_consensus.cc:2468] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 1.
I20260709 13:01:42.772351 14389 leader_election.cc:304] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:42.773130 14349 raft_consensus.cc:2468] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 1.
I20260709 13:01:42.773679 14501 raft_consensus.cc:2804] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.774295 14501 raft_consensus.cc:697] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 1 LEADER]: Becoming Leader. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Running, Role: LEADER
I20260709 13:01:42.775288 14501 consensus_queue.cc:237] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.783221 14170 catalog_manager.cc:5697] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac reported cstate change: term changed from 0 to 1, leader changed from <none> to b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195). New cstate: current_term: 1 leader_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:42.784757 14474 consensus_queue.cc:1048] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.795217 14422 raft_consensus.cc:3060] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.806409 14488 consensus_queue.cc:1048] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:42.823442 14509 raft_consensus.cc:493] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.823994 14509 raft_consensus.cc:515] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.827581 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
I20260709 13:01:42.827811 14509 leader_election.cc:290] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:42.828713 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
I20260709 13:01:42.829984 14422 raft_consensus.cc:2393] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 010946bc445d41db9f6eae574a5355d8 in current term 1: Already voted for candidate d2cbcf4c50f145d7a5495f0284602dda in this term.
I20260709 13:01:42.831394 14240 leader_election.cc:304] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8; no voters: b87c4ad779d04ddba17dbeab7f19ceac, d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:42.832517 14509 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.834025 14507 raft_consensus.cc:493] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.834565 14507 raft_consensus.cc:515] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:42.836736 14507 leader_election.cc:290] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:42.838418 14509 raft_consensus.cc:2749] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.838388 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
I20260709 13:01:42.838925 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" is_pre_election: true
I20260709 13:01:42.839387 14349 raft_consensus.cc:2468] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 0.
I20260709 13:01:42.839582 14422 raft_consensus.cc:2468] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 0.
I20260709 13:01:42.840560 14238 leader_election.cc:304] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:42.841367 14509 raft_consensus.cc:2804] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:42.841750 14509 raft_consensus.cc:493] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.842067 14509 raft_consensus.cc:3060] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.847252 14509 raft_consensus.cc:515] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:42.849361 14509 leader_election.cc:290] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 election: Requested vote from peers b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:42.850987 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:42.851063 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:42.851794 14349 raft_consensus.cc:3060] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.855557 14422 raft_consensus.cc:3060] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.855324 14501 consensus_queue.cc:1048] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.858567 14349 raft_consensus.cc:2468] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 1.
I20260709 13:01:42.860477 14238 leader_election.cc:304] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:42.861745 14507 raft_consensus.cc:2804] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:42.869690 14507 raft_consensus.cc:697] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Becoming Leader. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:42.870770 14507 consensus_queue.cc:237] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:42.879139 14501 raft_consensus.cc:493] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.879765 14501 raft_consensus.cc:515] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:42.882519 14168 catalog_manager.cc:5697] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 010946bc445d41db9f6eae574a5355d8 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "010946bc445d41db9f6eae574a5355d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:42.884959 14501 leader_election.cc:290] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:42.885984 14349 raft_consensus.cc:3060] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.889190 14422 raft_consensus.cc:2468] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 1.
I20260709 13:01:42.889396 14348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda" is_pre_election: true
I20260709 13:01:42.890456 14348 raft_consensus.cc:2393] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b87c4ad779d04ddba17dbeab7f19ceac in current term 1: Already voted for candidate 010946bc445d41db9f6eae574a5355d8 in this term.
I20260709 13:01:42.893010 14273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "010946bc445d41db9f6eae574a5355d8" is_pre_election: true
I20260709 13:01:42.894658 14389 leader_election.cc:304] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b87c4ad779d04ddba17dbeab7f19ceac; no voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:42.895493 14501 raft_consensus.cc:3060] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:42.901547 14501 raft_consensus.cc:2749] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:42.905148 14501 consensus_queue.cc:1048] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.984498 14507 consensus_queue.cc:1048] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:42.997754 14517 consensus_queue.cc:1048] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:43.018604 14474 consensus_queue.cc:1048] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.031576 14512 consensus_queue.cc:1048] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:43.055388 14512 consensus_queue.cc:1048] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.067754 14488 consensus_queue.cc:1048] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.096448 14349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
mode: GRACEFUL
new_leader_uuid: "010946bc445d41db9f6eae574a5355d8"
 from {username='slave'} at 127.0.0.1:55482
I20260709 13:01:43.097064 14349 raft_consensus.cc:606] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Received request to transfer leadership to TS 010946bc445d41db9f6eae574a5355d8
I20260709 13:01:43.102815 14517 consensus_queue.cc:1048] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.127353 14517 consensus_queue.cc:1048] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.128773 14517 consensus_queue.cc:1048] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.135375 14516 consensus_queue.cc:1048] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.139645 14423 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b"
dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
mode: GRACEFUL
new_leader_uuid: "010946bc445d41db9f6eae574a5355d8"
 from {username='slave'} at 127.0.0.1:35558
I20260709 13:01:43.140254 14423 raft_consensus.cc:606] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 1 LEADER]: Received request to transfer leadership to TS 010946bc445d41db9f6eae574a5355d8
I20260709 13:01:43.183647 14273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
mode: GRACEFUL
new_leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:59280
I20260709 13:01:43.184273 14273 raft_consensus.cc:606] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Received request to transfer leadership to TS d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:43.196146 14273 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
mode: GRACEFUL
new_leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:59280
I20260709 13:01:43.196676 14273 raft_consensus.cc:606] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Received request to transfer leadership to TS d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:43.268967 14517 consensus_queue.cc:1048] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.282291 14501 consensus_queue.cc:1048] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.282956 14509 consensus_queue.cc:1048] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.302541 14532 raft_consensus.cc:993] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac: : Instructing follower 010946bc445d41db9f6eae574a5355d8 to start an election
I20260709 13:01:43.303035 14532 raft_consensus.cc:1081] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 1 LEADER]: Signalling peer 010946bc445d41db9f6eae574a5355d8 to start an election
I20260709 13:01:43.306511 14274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
 from {username='slave'} at 127.0.0.1:52486
I20260709 13:01:43.309775 14473 consensus_queue.cc:1048] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:43.310155 14274 raft_consensus.cc:493] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.310637 14274 raft_consensus.cc:3060] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.318367 14274 raft_consensus.cc:515] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.330437 14274 leader_election.cc:290] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 2 election: Requested vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:43.333078 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:43.333652 14349 raft_consensus.cc:3060] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.332886 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:43.336954 14422 raft_consensus.cc:3055] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.337718 14422 raft_consensus.cc:740] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Running, Role: LEADER
I20260709 13:01:43.338578 14422 consensus_queue.cc:260] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.340011 14422 raft_consensus.cc:3060] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.340626 14349 raft_consensus.cc:2468] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 2.
I20260709 13:01:43.342096 14238 leader_election.cc:304] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:43.342975 14509 raft_consensus.cc:2804] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.343472 14509 raft_consensus.cc:697] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Becoming Leader. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:43.344265 14509 consensus_queue.cc:237] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.346076 14422 raft_consensus.cc:2468] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 2.
I20260709 13:01:43.351948 14171 catalog_manager.cc:5697] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 reported cstate change: term changed from 1 to 2, leader changed from b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195) to 010946bc445d41db9f6eae574a5355d8 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "010946bc445d41db9f6eae574a5355d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.396950 14507 raft_consensus.cc:993] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8: : Instructing follower d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:43.397416 14509 raft_consensus.cc:1081] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Signalling peer d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:43.399042 14349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:49616
I20260709 13:01:43.399621 14349 raft_consensus.cc:493] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.399982 14349 raft_consensus.cc:3060] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.408030 14349 raft_consensus.cc:515] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.410156 14349 leader_election.cc:290] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 2 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:43.411453 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:43.411559 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:43.412083 14274 raft_consensus.cc:3055] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.412201 14422 raft_consensus.cc:3060] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.412436 14274 raft_consensus.cc:740] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:43.413312 14274 consensus_queue.cc:260] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.414332 14274 raft_consensus.cc:3060] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.418872 14274 raft_consensus.cc:2468] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 2.
I20260709 13:01:43.419373 14422 raft_consensus.cc:2468] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 2.
I20260709 13:01:43.420233 14315 leader_election.cc:304] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:43.421125 14488 raft_consensus.cc:2804] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.421629 14488 raft_consensus.cc:697] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Becoming Leader. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:43.422501 14488 consensus_queue.cc:237] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.429559 14171 catalog_manager.cc:5697] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda reported cstate change: term changed from 1 to 2, leader changed from 010946bc445d41db9f6eae574a5355d8 (127.13.206.193) to d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194). New cstate: current_term: 2 leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.572800 14512 raft_consensus.cc:993] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda: : Instructing follower 010946bc445d41db9f6eae574a5355d8 to start an election
I20260709 13:01:43.573268 14474 raft_consensus.cc:1081] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Signalling peer 010946bc445d41db9f6eae574a5355d8 to start an election
I20260709 13:01:43.575045 14274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
 from {username='slave'} at 127.0.0.1:52490
I20260709 13:01:43.575562 14274 raft_consensus.cc:493] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.575894 14274 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.580705 14274 raft_consensus.cc:515] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.582619 14274 leader_election.cc:290] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 2 election: Requested vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:43.584048 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:43.584368 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:43.584666 14422 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.584977 14349 raft_consensus.cc:3055] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.585296 14349 raft_consensus.cc:740] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:43.586292 14349 consensus_queue.cc:260] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.587553 14349 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.590209 14422 raft_consensus.cc:2468] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 2.
I20260709 13:01:43.591681 14240 leader_election.cc:304] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:43.592622 14509 raft_consensus.cc:2804] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.593119 14509 raft_consensus.cc:697] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Becoming Leader. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:43.594817 14349 raft_consensus.cc:2468] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 2.
I20260709 13:01:43.593961 14509 consensus_queue.cc:237] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.604564 14168 catalog_manager.cc:5697] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 reported cstate change: term changed from 1 to 2, leader changed from d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194) to 010946bc445d41db9f6eae574a5355d8 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "010946bc445d41db9f6eae574a5355d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.756686 14507 raft_consensus.cc:993] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8: : Instructing follower d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:43.757378 14509 raft_consensus.cc:1081] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Signalling peer d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:43.759455 14349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:49616
I20260709 13:01:43.760070 14349 raft_consensus.cc:493] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:43.760461 14349 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.767210 14349 raft_consensus.cc:515] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.770129 14349 leader_election.cc:290] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 2 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:43.769984 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:43.771195 14274 raft_consensus.cc:3055] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:43.771562 14274 raft_consensus.cc:740] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:43.771521 14422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:43.772320 14422 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.772540 14274 consensus_queue.cc:260] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.773695 14274 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.778909 14274 raft_consensus.cc:2468] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 2.
I20260709 13:01:43.779021 14422 raft_consensus.cc:2468] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 2.
I20260709 13:01:43.780259 14315 leader_election.cc:304] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:43.780977 14474 raft_consensus.cc:2804] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:43.781442 14474 raft_consensus.cc:697] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Becoming Leader. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:43.782263 14474 consensus_queue.cc:237] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:43.790269 14168 catalog_manager.cc:5697] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda reported cstate change: term changed from 1 to 2, leader changed from 010946bc445d41db9f6eae574a5355d8 (127.13.206.193) to d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194). New cstate: current_term: 2 leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:43.867211 14349 raft_consensus.cc:1275] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Refusing update from remote peer 010946bc445d41db9f6eae574a5355d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.868501 14509 consensus_queue.cc:1048] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.880155 14422 raft_consensus.cc:1275] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Refusing update from remote peer 010946bc445d41db9f6eae574a5355d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.881444 14516 consensus_queue.cc:1048] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.987344 14422 raft_consensus.cc:1275] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.988646 14474 consensus_queue.cc:1048] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:43.997363 14274 raft_consensus.cc:1275] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:43.998956 14488 consensus_queue.cc:1048] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:44.040738 14349 raft_consensus.cc:1275] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Refusing update from remote peer 010946bc445d41db9f6eae574a5355d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:44.042090 14509 consensus_queue.cc:1048] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:44.050709 14422 raft_consensus.cc:1275] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Refusing update from remote peer 010946bc445d41db9f6eae574a5355d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:44.052032 14516 consensus_queue.cc:1048] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:44.287843 14422 raft_consensus.cc:1275] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:44.289050 14488 consensus_queue.cc:1048] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:44.298270 14274 raft_consensus.cc:1275] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:44.299902 14512 consensus_queue.cc:1048] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:46.229522 14139 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:01:46.230686 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:46.250797 14349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
mode: GRACEFUL
new_leader_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
 from {username='slave'} at 127.0.0.1:55494
I20260709 13:01:46.251343 14349 raft_consensus.cc:606] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Received request to transfer leadership to TS b87c4ad779d04ddba17dbeab7f19ceac
I20260709 13:01:46.261744 14274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
mode: GRACEFUL
new_leader_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
 from {username='slave'} at 127.0.0.1:59290
I20260709 13:01:46.262356 14274 raft_consensus.cc:606] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Received request to transfer leadership to TS b87c4ad779d04ddba17dbeab7f19ceac
I20260709 13:01:46.263558 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:46.264035 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:46.529870 14509 raft_consensus.cc:993] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8: : Instructing follower b87c4ad779d04ddba17dbeab7f19ceac to start an election
I20260709 13:01:46.530331 14564 raft_consensus.cc:1081] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Signalling peer b87c4ad779d04ddba17dbeab7f19ceac to start an election
I20260709 13:01:46.531818 14422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c"
dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
 from {username='slave'} at 127.0.0.1:53038
I20260709 13:01:46.532306 14422 raft_consensus.cc:493] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:46.532614 14422 raft_consensus.cc:3060] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:46.536581 14422 raft_consensus.cc:515] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:46.537999 14422 leader_election.cc:290] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 2 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:46.539119 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:46.539119 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:46.539945 14349 raft_consensus.cc:3060] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:46.539958 14274 raft_consensus.cc:3055] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:46.540496 14274 raft_consensus.cc:740] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:46.541316 14274 consensus_queue.cc:260] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:46.542570 14274 raft_consensus.cc:3060] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:46.546480 14349 raft_consensus.cc:2468] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 2.
I20260709 13:01:46.547756 14387 leader_election.cc:304] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87c4ad779d04ddba17dbeab7f19ceac, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:46.548508 14473 raft_consensus.cc:2804] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:46.548872 14274 raft_consensus.cc:2468] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 2.
I20260709 13:01:46.549742 14473 raft_consensus.cc:697] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 2 LEADER]: Becoming Leader. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Running, Role: LEADER
I20260709 13:01:46.550689 14473 consensus_queue.cc:237] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:46.561023 14171 catalog_manager.cc:5697] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac reported cstate change: term changed from 1 to 2, leader changed from 010946bc445d41db9f6eae574a5355d8 (127.13.206.193) to b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195). New cstate: current_term: 2 leader_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:46.577374 14571 raft_consensus.cc:993] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda: : Instructing follower b87c4ad779d04ddba17dbeab7f19ceac to start an election
I20260709 13:01:46.577829 14474 raft_consensus.cc:1081] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Signalling peer b87c4ad779d04ddba17dbeab7f19ceac to start an election
I20260709 13:01:46.579368 14421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e"
dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
 from {username='slave'} at 127.0.0.1:53034
I20260709 13:01:46.579804 14421 raft_consensus.cc:493] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:46.580070 14421 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.586149 14421 raft_consensus.cc:515] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:46.588068 14421 leader_election.cc:290] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 3 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:46.588847 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:46.589161 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:46.589469 14274 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.589697 14349 raft_consensus.cc:3055] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:46.590026 14349 raft_consensus.cc:740] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:46.590709 14349 consensus_queue.cc:260] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:46.591560 14349 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:46.594476 14274 raft_consensus.cc:2468] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 3.
I20260709 13:01:46.595647 14389 leader_election.cc:304] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:46.595731 14349 raft_consensus.cc:2468] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 3.
I20260709 13:01:46.596442 14473 raft_consensus.cc:2804] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:46.596904 14473 raft_consensus.cc:697] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 3 LEADER]: Becoming Leader. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Running, Role: LEADER
I20260709 13:01:46.597626 14473 consensus_queue.cc:237] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:46.606096 14171 catalog_manager.cc:5697] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac reported cstate change: term changed from 2 to 3, leader changed from d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194) to b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195). New cstate: current_term: 3 leader_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:46.977566 14349 raft_consensus.cc:1275] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Refusing update from remote peer b87c4ad779d04ddba17dbeab7f19ceac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:46.978856 14473 consensus_queue.cc:1048] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:46.988747 14274 raft_consensus.cc:1275] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Refusing update from remote peer b87c4ad779d04ddba17dbeab7f19ceac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:46.990192 14473 consensus_queue.cc:1048] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:47.089903 14274 raft_consensus.cc:1275] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Refusing update from remote peer b87c4ad779d04ddba17dbeab7f19ceac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:47.091068 14473 consensus_queue.cc:1048] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:47.099109 14349 raft_consensus.cc:1275] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Refusing update from remote peer b87c4ad779d04ddba17dbeab7f19ceac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:47.101847 14473 consensus_queue.cc:1048] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:47.264896 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:47.275238 14274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
mode: GRACEFUL
new_leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:59280
I20260709 13:01:47.275710 14274 raft_consensus.cc:606] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Received request to transfer leadership to TS d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:47.280411 14421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c"
dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
mode: GRACEFUL
new_leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:35558
I20260709 13:01:47.280897 14421 raft_consensus.cc:606] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 2 LEADER]: Received request to transfer leadership to TS d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:47.285770 14274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
mode: GRACEFUL
new_leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:59280
I20260709 13:01:47.286330 14274 raft_consensus.cc:606] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Received request to transfer leadership to TS d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:47.290875 14274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
mode: GRACEFUL
new_leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:59280
I20260709 13:01:47.291298 14274 raft_consensus.cc:606] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Received request to transfer leadership to TS d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:47.295972 14421 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e"
dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
mode: GRACEFUL
new_leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:35558
I20260709 13:01:47.296442 14421 raft_consensus.cc:606] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 3 LEADER]: Received request to transfer leadership to TS d2cbcf4c50f145d7a5495f0284602dda
I20260709 13:01:47.392452 14579 raft_consensus.cc:993] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac: : Instructing follower d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:47.392892 14473 raft_consensus.cc:1081] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 3 LEADER]: Signalling peer d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:47.394344 14349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:49604
I20260709 13:01:47.394757 14349 raft_consensus.cc:493] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.395051 14349 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.399019 14349 raft_consensus.cc:515] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.400548 14349 leader_election.cc:290] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 4 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:47.401715 14421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:47.401710 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6e5c3e817f4a9e86fa5ccc4e80291e" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:47.402455 14421 raft_consensus.cc:3055] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:47.402550 14274 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.402787 14421 raft_consensus.cc:740] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Running, Role: LEADER
I20260709 13:01:47.403651 14421 consensus_queue.cc:260] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.404841 14421 raft_consensus.cc:3060] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.409099 14274 raft_consensus.cc:2468] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 4.
I20260709 13:01:47.410365 14315 leader_election.cc:304] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:47.411149 14474 raft_consensus.cc:2804] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:47.412104 14421 raft_consensus.cc:2468] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 4.
I20260709 13:01:47.412273 14474 raft_consensus.cc:697] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 4 LEADER]: Becoming Leader. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:47.413156 14474 consensus_queue.cc:237] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.419030 14171 catalog_manager.cc:5697] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda reported cstate change: term changed from 3 to 4, leader changed from b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195) to d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194). New cstate: current_term: 4 leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.434517 14586 raft_consensus.cc:993] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8: : Instructing follower d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:47.434979 14509 raft_consensus.cc:1081] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Signalling peer d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:47.436425 14349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:49616
I20260709 13:01:47.436909 14349 raft_consensus.cc:493] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.437247 14349 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.441718 14349 raft_consensus.cc:515] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.443261 14349 leader_election.cc:290] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 3 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:47.444085 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:47.444383 14421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:47.444631 14274 raft_consensus.cc:3055] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:47.444937 14274 raft_consensus.cc:740] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:47.444953 14421 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.445595 14274 consensus_queue.cc:260] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.446480 14274 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.450069 14421 raft_consensus.cc:2468] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 3.
I20260709 13:01:47.450501 14274 raft_consensus.cc:2468] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 3.
I20260709 13:01:47.451478 14315 leader_election.cc:304] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87c4ad779d04ddba17dbeab7f19ceac, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:47.452180 14474 raft_consensus.cc:2804] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:47.452626 14474 raft_consensus.cc:697] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 3 LEADER]: Becoming Leader. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:47.453336 14474 consensus_queue.cc:237] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.459352 14171 catalog_manager.cc:5697] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda reported cstate change: term changed from 2 to 3, leader changed from 010946bc445d41db9f6eae574a5355d8 (127.13.206.193) to d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194). New cstate: current_term: 3 leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.556771 14565 raft_consensus.cc:993] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac: : Instructing follower d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:47.557300 14473 raft_consensus.cc:1081] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 2 LEADER]: Signalling peer d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:47.559041 14349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:49604
I20260709 13:01:47.559655 14349 raft_consensus.cc:493] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.559959 14349 raft_consensus.cc:3060] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.564661 14349 raft_consensus.cc:515] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.566581 14349 leader_election.cc:290] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 3 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:47.567389 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:47.567981 14274 raft_consensus.cc:3060] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.567842 14421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "834142f59f7d48fc8b69a844e5d46a0c" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:47.568529 14421 raft_consensus.cc:3055] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:47.568868 14421 raft_consensus.cc:740] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Running, Role: LEADER
I20260709 13:01:47.569660 14421 consensus_queue.cc:260] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.570875 14421 raft_consensus.cc:3060] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.574568 14274 raft_consensus.cc:2468] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 3.
I20260709 13:01:47.575805 14315 leader_election.cc:304] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:47.576579 14474 raft_consensus.cc:2804] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:47.577044 14474 raft_consensus.cc:697] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 3 LEADER]: Becoming Leader. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:47.577356 14421 raft_consensus.cc:2468] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 3.
I20260709 13:01:47.577823 14474 consensus_queue.cc:237] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.583678 14171 catalog_manager.cc:5697] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda reported cstate change: term changed from 2 to 3, leader changed from b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195) to d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194). New cstate: current_term: 3 leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.670931 14585 raft_consensus.cc:993] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8: : Instructing follower d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:47.671352 14509 raft_consensus.cc:1081] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Signalling peer d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:47.672770 14349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:49616
I20260709 13:01:47.673197 14349 raft_consensus.cc:493] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.673434 14349 raft_consensus.cc:3060] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.677449 14349 raft_consensus.cc:515] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.679000 14349 leader_election.cc:290] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 3 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:47.680006 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:47.680313 14421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd4d72f3714c45b3a7962e8cc30ee57b" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:47.680526 14274 raft_consensus.cc:3055] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:47.680913 14421 raft_consensus.cc:3060] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.680909 14274 raft_consensus.cc:740] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:47.681876 14274 consensus_queue.cc:260] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.682904 14274 raft_consensus.cc:3060] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:47.686097 14421 raft_consensus.cc:2468] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 3.
I20260709 13:01:47.686975 14274 raft_consensus.cc:2468] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 3.
I20260709 13:01:47.687268 14315 leader_election.cc:304] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87c4ad779d04ddba17dbeab7f19ceac, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:47.688047 14474 raft_consensus.cc:2804] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:47.688480 14474 raft_consensus.cc:697] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 3 LEADER]: Becoming Leader. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:47.689162 14474 consensus_queue.cc:237] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:47.695000 14171 catalog_manager.cc:5697] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda reported cstate change: term changed from 2 to 3, leader changed from 010946bc445d41db9f6eae574a5355d8 (127.13.206.193) to d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194). New cstate: current_term: 3 leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:47.701704 14585 raft_consensus.cc:993] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8: : Instructing follower d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:47.702215 14509 raft_consensus.cc:1081] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Signalling peer d2cbcf4c50f145d7a5495f0284602dda to start an election
I20260709 13:01:47.703737 14349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
 from {username='slave'} at 127.0.0.1:49616
I20260709 13:01:47.704157 14349 raft_consensus.cc:493] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:47.704392 14349 raft_consensus.cc:3060] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.708400 14349 raft_consensus.cc:515] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:47.709882 14349 leader_election.cc:290] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 2 election: Requested vote from peers b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707), 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681)
I20260709 13:01:47.710875 14421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:47.711042 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8" candidate_uuid: "d2cbcf4c50f145d7a5495f0284602dda" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:47.711417 14421 raft_consensus.cc:3060] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.711553 14274 raft_consensus.cc:3055] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:47.711889 14274 raft_consensus.cc:740] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:47.712527 14274 consensus_queue.cc:260] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:47.713351 14274 raft_consensus.cc:3060] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.716423 14421 raft_consensus.cc:2468] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 2.
I20260709 13:01:47.717522 14274 raft_consensus.cc:2468] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2cbcf4c50f145d7a5495f0284602dda in term 2.
I20260709 13:01:47.717515 14315 leader_election.cc:304] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b87c4ad779d04ddba17dbeab7f19ceac, d2cbcf4c50f145d7a5495f0284602dda; no voters: 
I20260709 13:01:47.718461 14474 raft_consensus.cc:2804] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:47.718936 14474 raft_consensus.cc:697] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Becoming Leader. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:47.719560 14474 consensus_queue.cc:237] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:47.725980 14171 catalog_manager.cc:5697] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda reported cstate change: term changed from 1 to 2, leader changed from 010946bc445d41db9f6eae574a5355d8 (127.13.206.193) to d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194). New cstate: current_term: 2 leader_uuid: "d2cbcf4c50f145d7a5495f0284602dda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:47.796862 14421 raft_consensus.cc:1275] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 4 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:47.798087 14474 consensus_queue.cc:1048] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:47.806669 14274 raft_consensus.cc:1275] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 4 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:47.808674 14474 consensus_queue.cc:1048] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:47.852725 14274 raft_consensus.cc:1275] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:47.853857 14474 consensus_queue.cc:1048] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:47.862160 14421 raft_consensus.cc:1275] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:47.863516 14581 consensus_queue.cc:1048] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:48.099356 14274 raft_consensus.cc:1275] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:48.100813 14581 consensus_queue.cc:1048] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:48.103454 14421 raft_consensus.cc:1275] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:48.104945 14581 consensus_queue.cc:1048] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:48.107223 14421 raft_consensus.cc:1275] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.114702 14474 consensus_queue.cc:1048] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.119033 14274 raft_consensus.cc:1275] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.120688 14581 consensus_queue.cc:1048] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:48.148450 14274 raft_consensus.cc:1275] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:48.149708 14591 consensus_queue.cc:1048] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:48.158442 14421 raft_consensus.cc:1275] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Refusing update from remote peer d2cbcf4c50f145d7a5495f0284602dda: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:48.160264 14581 consensus_queue.cc:1048] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:50.308820 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:50.316176 14349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
mode: GRACEFUL
new_leader_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
 from {username='slave'} at 127.0.0.1:55494
I20260709 13:01:50.316802 14349 raft_consensus.cc:606] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Received request to transfer leadership to TS b87c4ad779d04ddba17dbeab7f19ceac
I20260709 13:01:50.319278 14349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
mode: GRACEFUL
new_leader_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
 from {username='slave'} at 127.0.0.1:55494
I20260709 13:01:50.319682 14349 raft_consensus.cc:606] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Received request to transfer leadership to TS b87c4ad779d04ddba17dbeab7f19ceac
I20260709 13:01:50.321789 14349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dd10b72e0da41498b6b288c7fd40921"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
mode: GRACEFUL
new_leader_uuid: "010946bc445d41db9f6eae574a5355d8"
 from {username='slave'} at 127.0.0.1:55494
I20260709 13:01:50.322202 14349 raft_consensus.cc:606] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Received request to transfer leadership to TS 010946bc445d41db9f6eae574a5355d8
I20260709 13:01:50.324388 14349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
mode: GRACEFUL
new_leader_uuid: "010946bc445d41db9f6eae574a5355d8"
 from {username='slave'} at 127.0.0.1:55494
I20260709 13:01:50.324784 14349 raft_consensus.cc:606] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 3 LEADER]: Received request to transfer leadership to TS 010946bc445d41db9f6eae574a5355d8
I20260709 13:01:50.327133 14349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cacf9d7cbfbc4716bd64f06b78bdb954"
dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
mode: GRACEFUL
new_leader_uuid: "010946bc445d41db9f6eae574a5355d8"
 from {username='slave'} at 127.0.0.1:55494
I20260709 13:01:50.327533 14349 raft_consensus.cc:606] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Received request to transfer leadership to TS 010946bc445d41db9f6eae574a5355d8
I20260709 13:01:50.328648 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:50.329239 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:50.574937 14602 raft_consensus.cc:993] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda: : Instructing follower b87c4ad779d04ddba17dbeab7f19ceac to start an election
I20260709 13:01:50.575462 14581 raft_consensus.cc:1081] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Signalling peer b87c4ad779d04ddba17dbeab7f19ceac to start an election
I20260709 13:01:50.577162 14422 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53"
dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
 from {username='slave'} at 127.0.0.1:53034
I20260709 13:01:50.577782 14422 raft_consensus.cc:493] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:50.578220 14422 raft_consensus.cc:3060] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.583617 14422 raft_consensus.cc:515] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.585320 14422 leader_election.cc:290] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 3 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:50.586799 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:50.586664 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85366769d9ff4c7aa26a3c0e05456e53" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:50.587332 14349 raft_consensus.cc:3055] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:50.587389 14274 raft_consensus.cc:3060] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.587603 14349 raft_consensus.cc:740] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:50.588367 14349 consensus_queue.cc:260] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.589246 14349 raft_consensus.cc:3060] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.592870 14274 raft_consensus.cc:2468] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 3.
I20260709 13:01:50.594359 14349 raft_consensus.cc:2468] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 3.
I20260709 13:01:50.594457 14389 leader_election.cc:304] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:50.595582 14473 raft_consensus.cc:2804] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:50.596587 14473 raft_consensus.cc:697] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 LEADER]: Becoming Leader. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Running, Role: LEADER
I20260709 13:01:50.597478 14473 consensus_queue.cc:237] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.605669 14170 catalog_manager.cc:5697] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac reported cstate change: term changed from 2 to 3, leader changed from d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194) to b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195). New cstate: current_term: 3 leader_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.658931 14602 raft_consensus.cc:993] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda: : Instructing follower 010946bc445d41db9f6eae574a5355d8 to start an election
I20260709 13:01:50.659333 14581 raft_consensus.cc:1081] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Signalling peer 010946bc445d41db9f6eae574a5355d8 to start an election
I20260709 13:01:50.660696 14274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cacf9d7cbfbc4716bd64f06b78bdb954"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
 from {username='slave'} at 127.0.0.1:52490
I20260709 13:01:50.661096 14274 raft_consensus.cc:493] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:50.661315 14274 raft_consensus.cc:3060] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.665303 14274 raft_consensus.cc:515] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.666837 14274 leader_election.cc:290] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 2 election: Requested vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:50.667802 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cacf9d7cbfbc4716bd64f06b78bdb954" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:50.668139 14421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cacf9d7cbfbc4716bd64f06b78bdb954" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:50.668361 14349 raft_consensus.cc:3055] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:50.668680 14349 raft_consensus.cc:740] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:50.668700 14421 raft_consensus.cc:3060] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.669411 14349 consensus_queue.cc:260] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.670282 14349 raft_consensus.cc:3060] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.674304 14421 raft_consensus.cc:2468] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 2.
I20260709 13:01:50.674533 14349 raft_consensus.cc:2468] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 2.
I20260709 13:01:50.675966 14240 leader_election.cc:304] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:50.677976 14611 raft_consensus.cc:2804] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.679538 14602 raft_consensus.cc:993] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda: : Instructing follower 010946bc445d41db9f6eae574a5355d8 to start an election
I20260709 13:01:50.679924 14611 raft_consensus.cc:697] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Becoming Leader. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:50.680116 14602 raft_consensus.cc:1081] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 3 LEADER]: Signalling peer 010946bc445d41db9f6eae574a5355d8 to start an election
I20260709 13:01:50.680971 14611 consensus_queue.cc:237] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.682098 14274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
 from {username='slave'} at 127.0.0.1:52490
I20260709 13:01:50.682665 14274 raft_consensus.cc:493] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:50.683008 14274 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.689586 14274 raft_consensus.cc:515] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.689572 14170 catalog_manager.cc:5697] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 reported cstate change: term changed from 1 to 2, leader changed from d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194) to 010946bc445d41db9f6eae574a5355d8 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "010946bc445d41db9f6eae574a5355d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.691852 14274 leader_election.cc:290] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 4 election: Requested vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:50.692215 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:50.692785 14349 raft_consensus.cc:3055] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:50.692843 14421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb0a6cdc2564075a1268db82c6e67c2" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:50.693189 14349 raft_consensus.cc:740] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:50.693564 14421 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.694039 14349 consensus_queue.cc:260] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.695096 14349 raft_consensus.cc:3060] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:50.700071 14421 raft_consensus.cc:2468] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 4.
I20260709 13:01:50.700392 14349 raft_consensus.cc:2468] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 4.
I20260709 13:01:50.701184 14240 leader_election.cc:304] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:50.702018 14611 raft_consensus.cc:2804] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:50.702435 14611 raft_consensus.cc:697] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 4 LEADER]: Becoming Leader. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:50.703114 14611 consensus_queue.cc:237] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.709946 14170 catalog_manager.cc:5697] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 reported cstate change: term changed from 3 to 4, leader changed from d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194) to 010946bc445d41db9f6eae574a5355d8 (127.13.206.193). New cstate: current_term: 4 leader_uuid: "010946bc445d41db9f6eae574a5355d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.761345 14602 raft_consensus.cc:993] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda: : Instructing follower b87c4ad779d04ddba17dbeab7f19ceac to start an election
I20260709 13:01:50.761788 14581 raft_consensus.cc:1081] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Signalling peer b87c4ad779d04ddba17dbeab7f19ceac to start an election
I20260709 13:01:50.763275 14421 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8"
dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
 from {username='slave'} at 127.0.0.1:53034
I20260709 13:01:50.763823 14421 raft_consensus.cc:493] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:50.764137 14421 raft_consensus.cc:3060] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.768841 14421 raft_consensus.cc:515] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:50.770354 14421 leader_election.cc:290] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 3 election: Requested vote from peers 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681), d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399)
I20260709 13:01:50.771313 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:50.771313 14274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "335d70603bae4194b21639fb9927c1c8" candidate_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "010946bc445d41db9f6eae574a5355d8"
I20260709 13:01:50.772091 14274 raft_consensus.cc:3060] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.772086 14349 raft_consensus.cc:3055] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:50.772614 14349 raft_consensus.cc:740] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:50.773456 14349 consensus_queue.cc:260] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:50.774573 14349 raft_consensus.cc:3060] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.778613 14274 raft_consensus.cc:2468] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 3.
I20260709 13:01:50.779752 14389 leader_election.cc:304] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:50.780378 14349 raft_consensus.cc:2468] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b87c4ad779d04ddba17dbeab7f19ceac in term 3.
I20260709 13:01:50.780490 14473 raft_consensus.cc:2804] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:50.781040 14473 raft_consensus.cc:697] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 LEADER]: Becoming Leader. State: Replica: b87c4ad779d04ddba17dbeab7f19ceac, State: Running, Role: LEADER
I20260709 13:01:50.781934 14473 consensus_queue.cc:237] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } }
I20260709 13:01:50.786831 14602 raft_consensus.cc:993] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda: : Instructing follower 010946bc445d41db9f6eae574a5355d8 to start an election
I20260709 13:01:50.787389 14581 raft_consensus.cc:1081] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Signalling peer 010946bc445d41db9f6eae574a5355d8 to start an election
I20260709 13:01:50.788940 14274 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dd10b72e0da41498b6b288c7fd40921"
dest_uuid: "010946bc445d41db9f6eae574a5355d8"
 from {username='slave'} at 127.0.0.1:52490
I20260709 13:01:50.789403 14274 raft_consensus.cc:493] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:50.789693 14274 raft_consensus.cc:3060] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.790145 14170 catalog_manager.cc:5697] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac reported cstate change: term changed from 2 to 3, leader changed from d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194) to b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195). New cstate: current_term: 3 leader_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:50.795311 14274 raft_consensus.cc:515] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.797706 14274 leader_election.cc:290] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 2 election: Requested vote from peers d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399), b87c4ad779d04ddba17dbeab7f19ceac (127.13.206.195:41707)
I20260709 13:01:50.797948 14349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd10b72e0da41498b6b288c7fd40921" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d2cbcf4c50f145d7a5495f0284602dda"
I20260709 13:01:50.798424 14421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd10b72e0da41498b6b288c7fd40921" candidate_uuid: "010946bc445d41db9f6eae574a5355d8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b87c4ad779d04ddba17dbeab7f19ceac"
I20260709 13:01:50.798609 14349 raft_consensus.cc:3055] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:50.799005 14421 raft_consensus.cc:3060] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.798997 14349 raft_consensus.cc:740] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d2cbcf4c50f145d7a5495f0284602dda, State: Running, Role: LEADER
I20260709 13:01:50.799995 14349 consensus_queue.cc:260] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.800848 14349 raft_consensus.cc:3060] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.804008 14421 raft_consensus.cc:2468] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 2.
I20260709 13:01:50.805052 14349 raft_consensus.cc:2468] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 010946bc445d41db9f6eae574a5355d8 in term 2.
I20260709 13:01:50.805043 14240 leader_election.cc:304] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 010946bc445d41db9f6eae574a5355d8, b87c4ad779d04ddba17dbeab7f19ceac; no voters: 
I20260709 13:01:50.806062 14611 raft_consensus.cc:2804] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:50.806557 14611 raft_consensus.cc:697] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Becoming Leader. State: Replica: 010946bc445d41db9f6eae574a5355d8, State: Running, Role: LEADER
I20260709 13:01:50.807456 14611 consensus_queue.cc:237] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } }
I20260709 13:01:50.814679 14170 catalog_manager.cc:5697] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 reported cstate change: term changed from 1 to 2, leader changed from d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194) to 010946bc445d41db9f6eae574a5355d8 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "010946bc445d41db9f6eae574a5355d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.084409 14349 raft_consensus.cc:1275] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 4 FOLLOWER]: Refusing update from remote peer 010946bc445d41db9f6eae574a5355d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:51.085695 14611 consensus_queue.cc:1048] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:51.096056 14421 raft_consensus.cc:1275] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 4 FOLLOWER]: Refusing update from remote peer 010946bc445d41db9f6eae574a5355d8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:51.098345 14612 consensus_queue.cc:1048] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:51.142194 14349 raft_consensus.cc:1275] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Refusing update from remote peer b87c4ad779d04ddba17dbeab7f19ceac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:51.143520 14473 consensus_queue.cc:1048] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:51.152683 14274 raft_consensus.cc:1275] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Refusing update from remote peer b87c4ad779d04ddba17dbeab7f19ceac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:51.154321 14473 consensus_queue.cc:1048] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:51.181044 14274 raft_consensus.cc:1275] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Refusing update from remote peer b87c4ad779d04ddba17dbeab7f19ceac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:51.182305 14605 consensus_queue.cc:1048] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "010946bc445d41db9f6eae574a5355d8" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:51.192682 14349 raft_consensus.cc:1275] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Refusing update from remote peer b87c4ad779d04ddba17dbeab7f19ceac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:51.194180 14421 raft_consensus.cc:1275] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Refusing update from remote peer 010946bc445d41db9f6eae574a5355d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.195073 14624 consensus_queue.cc:1048] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:51.196013 14612 consensus_queue.cc:1048] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.210786 14349 raft_consensus.cc:1275] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Refusing update from remote peer 010946bc445d41db9f6eae574a5355d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.211788 14348 raft_consensus.cc:1275] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Refusing update from remote peer 010946bc445d41db9f6eae574a5355d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.212532 14629 consensus_queue.cc:1048] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:51.213238 14612 consensus_queue.cc:1048] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2cbcf4c50f145d7a5495f0284602dda" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.231067 14421 raft_consensus.cc:1275] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Refusing update from remote peer 010946bc445d41db9f6eae574a5355d8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:51.232715 14611 consensus_queue.cc:1048] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b87c4ad779d04ddba17dbeab7f19ceac" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.330169 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:51.335574 14139 tablet_server.cc:179] TabletServer@127.13.206.193:0 shutting down...
I20260709 13:01:51.361236 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:51.361987 14139 tablet_replica.cc:333] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8: stopping tablet replica
I20260709 13:01:51.362706 14139 raft_consensus.cc:2243] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.363520 14139 raft_consensus.cc:2272] T aeb0a6cdc2564075a1268db82c6e67c2 P 010946bc445d41db9f6eae574a5355d8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.365890 14139 tablet_replica.cc:333] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8: stopping tablet replica
I20260709 13:01:51.366447 14139 raft_consensus.cc:2243] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.366813 14139 raft_consensus.cc:2272] T bd4d72f3714c45b3a7962e8cc30ee57b P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.368474 14139 tablet_replica.cc:333] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8: stopping tablet replica
I20260709 13:01:51.368911 14139 raft_consensus.cc:2243] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.369266 14139 raft_consensus.cc:2272] T 834142f59f7d48fc8b69a844e5d46a0c P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.370949 14139 tablet_replica.cc:333] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8: stopping tablet replica
I20260709 13:01:51.371379 14139 raft_consensus.cc:2243] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.371759 14139 raft_consensus.cc:2272] T 335d70603bae4194b21639fb9927c1c8 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.373926 14139 tablet_replica.cc:333] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8: stopping tablet replica
I20260709 13:01:51.374478 14139 raft_consensus.cc:2243] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.374866 14139 raft_consensus.cc:2272] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P 010946bc445d41db9f6eae574a5355d8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.376466 14139 tablet_replica.cc:333] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8: stopping tablet replica
I20260709 13:01:51.376888 14139 raft_consensus.cc:2243] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.377559 14139 raft_consensus.cc:2272] T cacf9d7cbfbc4716bd64f06b78bdb954 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.379454 14139 tablet_replica.cc:333] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8: stopping tablet replica
I20260709 13:01:51.379892 14139 raft_consensus.cc:2243] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.380252 14139 raft_consensus.cc:2272] T 85366769d9ff4c7aa26a3c0e05456e53 P 010946bc445d41db9f6eae574a5355d8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.382217 14139 tablet_replica.cc:333] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8: stopping tablet replica
I20260709 13:01:51.382802 14139 raft_consensus.cc:2243] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.383234 14139 raft_consensus.cc:2272] T 7bf4583f117a49ed89b1c07c539c4e5d P 010946bc445d41db9f6eae574a5355d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.384893 14139 tablet_replica.cc:333] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8: stopping tablet replica
I20260709 13:01:51.385360 14139 raft_consensus.cc:2243] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.386272 14139 raft_consensus.cc:2272] T 9dd10b72e0da41498b6b288c7fd40921 P 010946bc445d41db9f6eae574a5355d8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:51.492110 14315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.206.193:39681: connect: Connection refused (error 111)
I20260709 13:01:51.493734 14139 tablet_server.cc:196] TabletServer@127.13.206.193:0 shutdown complete.
W20260709 13:01:51.496264 14315 consensus_peers.cc:597] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda -> Peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Couldn't send request to peer 010946bc445d41db9f6eae574a5355d8. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:39681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.513234 14139 tablet_server.cc:179] TabletServer@127.13.206.194:0 shutting down...
W20260709 13:01:51.532364 14315 consensus_peers.cc:597] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda -> Peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Couldn't send request to peer 010946bc445d41db9f6eae574a5355d8. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:39681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.539547 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:51.540175 14139 tablet_replica.cc:333] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda: stopping tablet replica
I20260709 13:01:51.540683 14139 raft_consensus.cc:2243] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.541445 14139 raft_consensus.cc:2272] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P d2cbcf4c50f145d7a5495f0284602dda [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.543252 14139 tablet_replica.cc:333] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda: stopping tablet replica
I20260709 13:01:51.543722 14139 raft_consensus.cc:2243] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.544090 14139 raft_consensus.cc:2272] T 7bf4583f117a49ed89b1c07c539c4e5d P d2cbcf4c50f145d7a5495f0284602dda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.545717 14139 tablet_replica.cc:333] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda: stopping tablet replica
I20260709 13:01:51.546169 14139 raft_consensus.cc:2243] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.546953 14139 raft_consensus.cc:2272] T 834142f59f7d48fc8b69a844e5d46a0c P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.548516 14139 tablet_replica.cc:333] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda: stopping tablet replica
I20260709 13:01:51.548952 14139 raft_consensus.cc:2243] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.549290 14139 raft_consensus.cc:2272] T 85366769d9ff4c7aa26a3c0e05456e53 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.551270 14139 tablet_replica.cc:333] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda: stopping tablet replica
I20260709 13:01:51.551724 14139 raft_consensus.cc:2243] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.552065 14139 raft_consensus.cc:2272] T cacf9d7cbfbc4716bd64f06b78bdb954 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.553864 14139 tablet_replica.cc:333] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda: stopping tablet replica
I20260709 13:01:51.554394 14139 raft_consensus.cc:2243] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.554762 14139 raft_consensus.cc:2272] T aeb0a6cdc2564075a1268db82c6e67c2 P d2cbcf4c50f145d7a5495f0284602dda [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.556856 14139 tablet_replica.cc:333] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda: stopping tablet replica
I20260709 13:01:51.557353 14139 raft_consensus.cc:2243] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.558076 14139 raft_consensus.cc:2272] T bd4d72f3714c45b3a7962e8cc30ee57b P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.559763 14139 tablet_replica.cc:333] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda: stopping tablet replica
I20260709 13:01:51.560232 14139 raft_consensus.cc:2243] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.560629 14139 raft_consensus.cc:2272] T 9dd10b72e0da41498b6b288c7fd40921 P d2cbcf4c50f145d7a5495f0284602dda [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.562611 14139 tablet_replica.cc:333] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda: stopping tablet replica
I20260709 13:01:51.563079 14139 raft_consensus.cc:2243] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.563470 14139 raft_consensus.cc:2272] T 335d70603bae4194b21639fb9927c1c8 P d2cbcf4c50f145d7a5495f0284602dda [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.591854 14139 tablet_server.cc:196] TabletServer@127.13.206.194:0 shutdown complete.
W20260709 13:01:51.594826 14389 consensus_peers.cc:597] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac -> Peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Couldn't send request to peer 010946bc445d41db9f6eae574a5355d8. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:39681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.609236 14139 tablet_server.cc:179] TabletServer@127.13.206.195:0 shutting down...
W20260709 13:01:51.628456 14387 consensus_peers.cc:597] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac -> Peer d2cbcf4c50f145d7a5495f0284602dda (127.13.206.194:45399): Couldn't send request to peer d2cbcf4c50f145d7a5495f0284602dda. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:45399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.644831 14389 consensus_peers.cc:597] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac -> Peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Couldn't send request to peer 010946bc445d41db9f6eae574a5355d8. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:39681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.647339 14389 consensus_peers.cc:597] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac -> Peer 010946bc445d41db9f6eae574a5355d8 (127.13.206.193:39681): Couldn't send request to peer 010946bc445d41db9f6eae574a5355d8. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:39681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.648036 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:51.648789 14139 tablet_replica.cc:333] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac: stopping tablet replica
I20260709 13:01:51.649668 14139 raft_consensus.cc:2243] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.650713 14139 raft_consensus.cc:2272] T 335d70603bae4194b21639fb9927c1c8 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.652817 14139 tablet_replica.cc:333] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac: stopping tablet replica
I20260709 13:01:51.653307 14139 raft_consensus.cc:2243] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.653676 14139 raft_consensus.cc:2272] T 834142f59f7d48fc8b69a844e5d46a0c P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.655349 14139 tablet_replica.cc:333] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac: stopping tablet replica
I20260709 13:01:51.655805 14139 raft_consensus.cc:2243] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.656163 14139 raft_consensus.cc:2272] T bd4d72f3714c45b3a7962e8cc30ee57b P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.657675 14139 tablet_replica.cc:333] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac: stopping tablet replica
I20260709 13:01:51.658110 14139 raft_consensus.cc:2243] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.658586 14139 raft_consensus.cc:2272] T 9dd10b72e0da41498b6b288c7fd40921 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.660615 14139 tablet_replica.cc:333] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac: stopping tablet replica
I20260709 13:01:51.661175 14139 raft_consensus.cc:2243] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.661972 14139 raft_consensus.cc:2272] T 85366769d9ff4c7aa26a3c0e05456e53 P b87c4ad779d04ddba17dbeab7f19ceac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.664160 14139 tablet_replica.cc:333] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac: stopping tablet replica
I20260709 13:01:51.664816 14139 raft_consensus.cc:2243] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.665704 14139 raft_consensus.cc:2272] T 7bf4583f117a49ed89b1c07c539c4e5d P b87c4ad779d04ddba17dbeab7f19ceac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.667341 14139 tablet_replica.cc:333] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac: stopping tablet replica
I20260709 13:01:51.667765 14139 raft_consensus.cc:2243] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.668115 14139 raft_consensus.cc:2272] T aeb0a6cdc2564075a1268db82c6e67c2 P b87c4ad779d04ddba17dbeab7f19ceac [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.669967 14139 tablet_replica.cc:333] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac: stopping tablet replica
I20260709 13:01:51.670470 14139 raft_consensus.cc:2243] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.670827 14139 raft_consensus.cc:2272] T 4a6e5c3e817f4a9e86fa5ccc4e80291e P b87c4ad779d04ddba17dbeab7f19ceac [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.672421 14139 tablet_replica.cc:333] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac: stopping tablet replica
I20260709 13:01:51.672818 14139 raft_consensus.cc:2243] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:51.673194 14139 raft_consensus.cc:2272] T cacf9d7cbfbc4716bd64f06b78bdb954 P b87c4ad779d04ddba17dbeab7f19ceac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.703545 14139 tablet_server.cc:196] TabletServer@127.13.206.195:0 shutdown complete.
I20260709 13:01:51.720131 14139 master.cc:562] Master@127.13.206.254:45877 shutting down...
I20260709 13:01:51.931068 14139 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:51.931663 14139 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:51.932029 14139 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9539cd5378f44e67b57f85c26f8bf8af: stopping tablet replica
I20260709 13:01:51.950838 14139 master.cc:584] Master@127.13.206.254:45877 shutdown complete.
010946bc445d41db9f6eae574a5355d8  4
b87c4ad779d04ddba17dbeab7f19ceac  1
d2cbcf4c50f145d7a5495f0284602dda  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12887 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:01:51.990800 14139 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.206.254:35051
I20260709 13:01:51.991997 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:51.997357 14637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:51.998682 14638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:51.999089 14640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:51.999405 14139 server_base.cc:1061] running on GCE node
I20260709 13:01:52.000232 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:52.000406 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:52.000522 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602112000511 us; error 0 us; skew 500 ppm
I20260709 13:01:52.000965 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:52.003489 14139 webserver.cc:533] Webserver started at http://127.13.206.254:45257/ using document root <none> and password file <none>
I20260709 13:01:52.003973 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:52.004128 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:52.004343 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:52.005424 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/master-0-root/instance:
uuid: "5d9fd5adf0e246f2a532168ee1aca332"
format_stamp: "Formatted at 2026-07-09 13:01:52 on dist-test-slave-ml7r"
I20260709 13:01:52.010125 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:01:52.013510 14645 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:52.014320 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:52.014587 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/master-0-root
uuid: "5d9fd5adf0e246f2a532168ee1aca332"
format_stamp: "Formatted at 2026-07-09 13:01:52 on dist-test-slave-ml7r"
I20260709 13:01:52.014832 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:52.028323 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:52.029537 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:52.068133 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.254:35051
I20260709 13:01:52.068222 14696 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.254:35051 every 8 connection(s)
I20260709 13:01:52.072079 14697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.081758 14697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332: Bootstrap starting.
I20260709 13:01:52.086345 14697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.090631 14697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332: No bootstrap required, opened a new log
I20260709 13:01:52.092697 14697 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9fd5adf0e246f2a532168ee1aca332" member_type: VOTER }
I20260709 13:01:52.093080 14697 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.093248 14697 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d9fd5adf0e246f2a532168ee1aca332, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.093732 14697 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9fd5adf0e246f2a532168ee1aca332" member_type: VOTER }
I20260709 13:01:52.094157 14697 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:52.094373 14697 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:52.094592 14697 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:52.098567 14697 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9fd5adf0e246f2a532168ee1aca332" member_type: VOTER }
I20260709 13:01:52.099064 14697 leader_election.cc:304] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d9fd5adf0e246f2a532168ee1aca332; no voters: 
I20260709 13:01:52.100073 14697 leader_election.cc:290] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:52.100499 14700 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:52.101789 14700 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 1 LEADER]: Becoming Leader. State: Replica: 5d9fd5adf0e246f2a532168ee1aca332, State: Running, Role: LEADER
I20260709 13:01:52.102556 14700 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9fd5adf0e246f2a532168ee1aca332" member_type: VOTER }
I20260709 13:01:52.103031 14697 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:52.107300 14702 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d9fd5adf0e246f2a532168ee1aca332. Latest consensus state: current_term: 1 leader_uuid: "5d9fd5adf0e246f2a532168ee1aca332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9fd5adf0e246f2a532168ee1aca332" member_type: VOTER } }
I20260709 13:01:52.108552 14702 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:52.108171 14701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d9fd5adf0e246f2a532168ee1aca332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d9fd5adf0e246f2a532168ee1aca332" member_type: VOTER } }
I20260709 13:01:52.109921 14701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:52.111590 14706 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:52.120036 14706 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:52.123776 14139 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:52.130573 14706 catalog_manager.cc:1383] Generated new cluster ID: bb081446b174496abcf95eecb7483ab4
I20260709 13:01:52.130887 14706 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:52.150592 14706 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:52.151849 14706 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:52.163748 14706 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332: Generated new TSK 0
I20260709 13:01:52.164393 14706 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:52.193789 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:52.201135 14718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:52.202143 14719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:52.204200 14721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:52.204460 14139 server_base.cc:1061] running on GCE node
I20260709 13:01:52.205471 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:52.205655 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:52.205878 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602112205843 us; error 0 us; skew 500 ppm
I20260709 13:01:52.206552 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:52.209882 14139 webserver.cc:533] Webserver started at http://127.13.206.193:36661/ using document root <none> and password file <none>
I20260709 13:01:52.210670 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:52.210952 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:52.211316 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:52.212834 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-0-root/instance:
uuid: "0d01e950508a4f3e8d29412070983231"
format_stamp: "Formatted at 2026-07-09 13:01:52 on dist-test-slave-ml7r"
I20260709 13:01:52.217743 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:52.221153 14726 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:52.221915 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:01:52.222277 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-0-root
uuid: "0d01e950508a4f3e8d29412070983231"
format_stamp: "Formatted at 2026-07-09 13:01:52 on dist-test-slave-ml7r"
I20260709 13:01:52.222599 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:52.256100 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:52.257407 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:52.259008 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:52.261443 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:52.261691 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:52.261962 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:52.262158 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:52.302336 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.193:39179
I20260709 13:01:52.302409 14788 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.193:39179 every 8 connection(s)
I20260709 13:01:52.307636 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:52.314965 14793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:52.315999 14794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:52.320070 14139 server_base.cc:1061] running on GCE node
W20260709 13:01:52.320585 14796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:52.321504 14789 heartbeater.cc:344] Connected to a master server at 127.13.206.254:35051
I20260709 13:01:52.321650 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:01:52.321861 14789 heartbeater.cc:461] Registering TS with master...
W20260709 13:01:52.321962 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:52.322258 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602112322211 us; error 0 us; skew 500 ppm
I20260709 13:01:52.322777 14789 heartbeater.cc:507] Master 127.13.206.254:35051 requested a full tablet report, sending...
I20260709 13:01:52.322844 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:52.325212 14662 ts_manager.cc:194] Registered new tserver with Master: 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179)
I20260709 13:01:52.325788 14139 webserver.cc:533] Webserver started at http://127.13.206.194:45957/ using document root <none> and password file <none>
I20260709 13:01:52.326370 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:52.326591 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:52.326910 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:52.327296 14662 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37030
I20260709 13:01:52.328183 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-1-root/instance:
uuid: "7444f38413bf49d398511d290ed2fab4"
format_stamp: "Formatted at 2026-07-09 13:01:52 on dist-test-slave-ml7r"
I20260709 13:01:52.332890 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:01:52.336236 14801 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:52.337030 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:01:52.337363 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-1-root
uuid: "7444f38413bf49d398511d290ed2fab4"
format_stamp: "Formatted at 2026-07-09 13:01:52 on dist-test-slave-ml7r"
I20260709 13:01:52.337661 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:52.352694 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:52.353956 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:52.355504 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:52.357820 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:52.358053 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:52.358333 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:52.358517 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:52.398473 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.194:44125
I20260709 13:01:52.398581 14863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.194:44125 every 8 connection(s)
I20260709 13:01:52.403267 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:52.410516 14867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:52.412312 14868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:52.415197 14139 server_base.cc:1061] running on GCE node
W20260709 13:01:52.415720 14870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:52.416610 14864 heartbeater.cc:344] Connected to a master server at 127.13.206.254:35051
I20260709 13:01:52.416821 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:01:52.417083 14864 heartbeater.cc:461] Registering TS with master...
W20260709 13:01:52.417127 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:52.417486 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602112417466 us; error 0 us; skew 500 ppm
I20260709 13:01:52.418121 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:52.418102 14864 heartbeater.cc:507] Master 127.13.206.254:35051 requested a full tablet report, sending...
I20260709 13:01:52.420583 14662 ts_manager.cc:194] Registered new tserver with Master: 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:52.421030 14139 webserver.cc:533] Webserver started at http://127.13.206.195:40157/ using document root <none> and password file <none>
I20260709 13:01:52.421557 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:52.421756 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:52.422046 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:52.422130 14662 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37032
I20260709 13:01:52.423444 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-2-root/instance:
uuid: "1dce1eb31065474bb897d748972441dd"
format_stamp: "Formatted at 2026-07-09 13:01:52 on dist-test-slave-ml7r"
I20260709 13:01:52.427968 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:01:52.431293 14875 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:52.432056 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:52.432371 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-2-root
uuid: "1dce1eb31065474bb897d748972441dd"
format_stamp: "Formatted at 2026-07-09 13:01:52 on dist-test-slave-ml7r"
I20260709 13:01:52.432679 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602098938719-14139-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:52.450232 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:52.451530 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:52.452965 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:52.455219 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:52.455469 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:52.455737 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:52.455911 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:52.495599 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.195:33199
I20260709 13:01:52.495693 14937 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.195:33199 every 8 connection(s)
I20260709 13:01:52.509482 14938 heartbeater.cc:344] Connected to a master server at 127.13.206.254:35051
I20260709 13:01:52.509860 14938 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:52.510653 14938 heartbeater.cc:507] Master 127.13.206.254:35051 requested a full tablet report, sending...
I20260709 13:01:52.512658 14662 ts_manager.cc:194] Registered new tserver with Master: 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:52.513446 14139 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014647844s
I20260709 13:01:52.514099 14662 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37046
I20260709 13:01:52.539541 14662 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37050:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:01:52.542606 14662 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:01:52.614926 14754 tablet_service.cc:1511] Processing CreateTablet for tablet 089a725a01014aa6a7fec7a2781368c9 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:52.616539 14754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089a725a01014aa6a7fec7a2781368c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.617218 14902 tablet_service.cc:1511] Processing CreateTablet for tablet fa57e74723d745f8bd98874a45edfebe (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:52.618744 14902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa57e74723d745f8bd98874a45edfebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.618503 14903 tablet_service.cc:1511] Processing CreateTablet for tablet 089a725a01014aa6a7fec7a2781368c9 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:52.619865 14903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089a725a01014aa6a7fec7a2781368c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.620030 14753 tablet_service.cc:1511] Processing CreateTablet for tablet fa57e74723d745f8bd98874a45edfebe (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:52.621369 14753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa57e74723d745f8bd98874a45edfebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.620991 14901 tablet_service.cc:1511] Processing CreateTablet for tablet 3411ca70fe5d43148b1489d4de8ad52b (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:52.622430 14901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3411ca70fe5d43148b1489d4de8ad52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.623636 14751 tablet_service.cc:1511] Processing CreateTablet for tablet c6efb443e67d44aabcff652bf9368058 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:52.623979 14829 tablet_service.cc:1511] Processing CreateTablet for tablet 089a725a01014aa6a7fec7a2781368c9 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:01:52.618777 14752 tablet_service.cc:1511] Processing CreateTablet for tablet 3411ca70fe5d43148b1489d4de8ad52b (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:52.625021 14751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6efb443e67d44aabcff652bf9368058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.625319 14829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 089a725a01014aa6a7fec7a2781368c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.628191 14752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3411ca70fe5d43148b1489d4de8ad52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.629922 14828 tablet_service.cc:1511] Processing CreateTablet for tablet fa57e74723d745f8bd98874a45edfebe (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:01:52.631320 14828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa57e74723d745f8bd98874a45edfebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.631502 14827 tablet_service.cc:1511] Processing CreateTablet for tablet 3411ca70fe5d43148b1489d4de8ad52b (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:01:52.632825 14827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3411ca70fe5d43148b1489d4de8ad52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.635082 14900 tablet_service.cc:1511] Processing CreateTablet for tablet c6efb443e67d44aabcff652bf9368058 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:52.636912 14900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6efb443e67d44aabcff652bf9368058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.639434 14899 tablet_service.cc:1511] Processing CreateTablet for tablet 28a0d512534a45bab54738ea782939dc (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:52.641116 14899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a0d512534a45bab54738ea782939dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.652595 14898 tablet_service.cc:1511] Processing CreateTablet for tablet e5b48bf2d68d47b98242b9e78c2b3476 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:52.654073 14898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b48bf2d68d47b98242b9e78c2b3476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.658138 14896 tablet_service.cc:1511] Processing CreateTablet for tablet 738139e73582476cadfa825dd9dd869e (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:52.659632 14896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738139e73582476cadfa825dd9dd869e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.659487 14897 tablet_service.cc:1511] Processing CreateTablet for tablet 0264f4a931b94c4fad7f3451eb161827 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:52.660857 14897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0264f4a931b94c4fad7f3451eb161827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.667161 14895 tablet_service.cc:1511] Processing CreateTablet for tablet 141705eb8daa48a6a7efa2795e679eb9 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:52.667667 14894 tablet_service.cc:1511] Processing CreateTablet for tablet 563e5a0670694086b94dcd13d37572aa (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:52.668691 14895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141705eb8daa48a6a7efa2795e679eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.669353 14894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563e5a0670694086b94dcd13d37572aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.669984 14826 tablet_service.cc:1511] Processing CreateTablet for tablet c6efb443e67d44aabcff652bf9368058 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:01:52.671330 14826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6efb443e67d44aabcff652bf9368058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.677502 14750 tablet_service.cc:1511] Processing CreateTablet for tablet 28a0d512534a45bab54738ea782939dc (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:52.679570 14749 tablet_service.cc:1511] Processing CreateTablet for tablet e5b48bf2d68d47b98242b9e78c2b3476 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:52.680950 14749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b48bf2d68d47b98242b9e78c2b3476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.683542 14748 tablet_service.cc:1511] Processing CreateTablet for tablet 0264f4a931b94c4fad7f3451eb161827 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:52.687920 14746 tablet_service.cc:1511] Processing CreateTablet for tablet 141705eb8daa48a6a7efa2795e679eb9 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:52.691816 14746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141705eb8daa48a6a7efa2795e679eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.691861 14745 tablet_service.cc:1511] Processing CreateTablet for tablet 563e5a0670694086b94dcd13d37572aa (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:52.685942 14747 tablet_service.cc:1511] Processing CreateTablet for tablet 738139e73582476cadfa825dd9dd869e (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:52.694694 14748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0264f4a931b94c4fad7f3451eb161827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.696398 14825 tablet_service.cc:1511] Processing CreateTablet for tablet 28a0d512534a45bab54738ea782939dc (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:01:52.697893 14750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a0d512534a45bab54738ea782939dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.697817 14822 tablet_service.cc:1511] Processing CreateTablet for tablet 738139e73582476cadfa825dd9dd869e (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:01:52.711462 14824 tablet_service.cc:1511] Processing CreateTablet for tablet e5b48bf2d68d47b98242b9e78c2b3476 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:01:52.697860 14825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28a0d512534a45bab54738ea782939dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.723027 14820 tablet_service.cc:1511] Processing CreateTablet for tablet 563e5a0670694086b94dcd13d37572aa (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:01:52.701001 14821 tablet_service.cc:1511] Processing CreateTablet for tablet 141705eb8daa48a6a7efa2795e679eb9 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:01:52.731282 14823 tablet_service.cc:1511] Processing CreateTablet for tablet 0264f4a931b94c4fad7f3451eb161827 (DEFAULT_TABLE table=test-workload [id=eaed1bf416fb4a67ace2f8315bb28b90]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:01:52.769016 14745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563e5a0670694086b94dcd13d37572aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.771941 14747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738139e73582476cadfa825dd9dd869e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.780841 14820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563e5a0670694086b94dcd13d37572aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.781735 14823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0264f4a931b94c4fad7f3451eb161827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.786716 14821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 141705eb8daa48a6a7efa2795e679eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.791491 14822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738139e73582476cadfa825dd9dd869e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.792202 14953 tablet_bootstrap.cc:492] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd: Bootstrap starting.
I20260709 13:01:52.794682 14824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b48bf2d68d47b98242b9e78c2b3476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:52.854713 14954 tablet_bootstrap.cc:492] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4: Bootstrap starting.
I20260709 13:01:52.861476 14954 tablet_bootstrap.cc:654] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.865473 14955 tablet_bootstrap.cc:492] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231: Bootstrap starting.
I20260709 13:01:52.877007 14953 tablet_bootstrap.cc:654] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.894908 14955 tablet_bootstrap.cc:654] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.899103 14954 tablet_bootstrap.cc:492] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4: No bootstrap required, opened a new log
I20260709 13:01:52.899541 14954 ts_tablet_manager.cc:1403] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4: Time spent bootstrapping tablet: real 0.045s	user 0.026s	sys 0.006s
I20260709 13:01:52.900839 14953 tablet_bootstrap.cc:492] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd: No bootstrap required, opened a new log
I20260709 13:01:52.901297 14953 ts_tablet_manager.cc:1403] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.005s
I20260709 13:01:52.901883 14954 raft_consensus.cc:359] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:52.902560 14954 raft_consensus.cc:385] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.902902 14954 raft_consensus.cc:740] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.903730 14954 consensus_queue.cc:260] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:52.903868 14953 raft_consensus.cc:359] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:52.904512 14955 tablet_bootstrap.cc:492] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231: No bootstrap required, opened a new log
I20260709 13:01:52.904698 14953 raft_consensus.cc:385] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.905120 14953 raft_consensus.cc:740] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.906388 14864 heartbeater.cc:499] Master 127.13.206.254:35051 was elected leader, sending a full tablet report...
I20260709 13:01:52.905148 14955 ts_tablet_manager.cc:1403] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.004s
I20260709 13:01:52.906857 14954 ts_tablet_manager.cc:1434] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:52.907821 14954 tablet_bootstrap.cc:492] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4: Bootstrap starting.
I20260709 13:01:52.909024 14953 consensus_queue.cc:260] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:52.909729 14955 raft_consensus.cc:359] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:52.910537 14955 raft_consensus.cc:385] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.910857 14955 raft_consensus.cc:740] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.911872 14955 consensus_queue.cc:260] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:52.915263 14954 tablet_bootstrap.cc:654] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.919031 14953 ts_tablet_manager.cc:1434] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.005s
I20260709 13:01:52.920075 14938 heartbeater.cc:499] Master 127.13.206.254:35051 was elected leader, sending a full tablet report...
I20260709 13:01:52.923802 14789 heartbeater.cc:499] Master 127.13.206.254:35051 was elected leader, sending a full tablet report...
I20260709 13:01:52.924176 14955 ts_tablet_manager.cc:1434] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:01:52.926716 14955 tablet_bootstrap.cc:492] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231: Bootstrap starting.
I20260709 13:01:52.925112 14953 tablet_bootstrap.cc:492] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd: Bootstrap starting.
I20260709 13:01:52.937894 14953 tablet_bootstrap.cc:654] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.938302 14955 tablet_bootstrap.cc:654] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.940856 14954 tablet_bootstrap.cc:492] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4: No bootstrap required, opened a new log
I20260709 13:01:52.941579 14954 ts_tablet_manager.cc:1403] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.011s
I20260709 13:01:52.945204 14954 raft_consensus.cc:359] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:52.945904 14953 tablet_bootstrap.cc:492] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd: No bootstrap required, opened a new log
I20260709 13:01:52.946075 14954 raft_consensus.cc:385] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.946491 14953 ts_tablet_manager.cc:1403] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.006s
I20260709 13:01:52.946607 14954 raft_consensus.cc:740] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.947965 14954 consensus_queue.cc:260] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:52.948788 14960 raft_consensus.cc:493] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.949266 14960 raft_consensus.cc:515] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:52.951403 14954 ts_tablet_manager.cc:1434] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:01:52.951869 14960 leader_election.cc:290] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:52.952845 14954 tablet_bootstrap.cc:492] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4: Bootstrap starting.
I20260709 13:01:52.959800 14953 raft_consensus.cc:359] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:52.960589 14953 raft_consensus.cc:385] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:52.960911 14953 raft_consensus.cc:740] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Initialized, Role: FOLLOWER
I20260709 13:01:52.962414 14954 tablet_bootstrap.cc:654] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:52.964682 14953 consensus_queue.cc:260] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:52.968575 14953 ts_tablet_manager.cc:1434] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:01:52.969561 14953 tablet_bootstrap.cc:492] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd: Bootstrap starting.
I20260709 13:01:52.984304 14953 tablet_bootstrap.cc:654] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.011683 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa57e74723d745f8bd98874a45edfebe" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.011683 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa57e74723d745f8bd98874a45edfebe" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
W20260709 13:01:53.014846 14878 leader_election.cc:343] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.015094 14959 raft_consensus.cc:493] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.015569 14878 leader_election.cc:343] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.015986 14878 leader_election.cc:304] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1dce1eb31065474bb897d748972441dd; no voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4
I20260709 13:01:53.015724 14959 raft_consensus.cc:515] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.017006 14960 raft_consensus.cc:2749] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:53.020370 14955 tablet_bootstrap.cc:492] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231: No bootstrap required, opened a new log
I20260709 13:01:53.020882 14955 ts_tablet_manager.cc:1403] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231: Time spent bootstrapping tablet: real 0.094s	user 0.026s	sys 0.046s
I20260709 13:01:53.025063 14955 raft_consensus.cc:359] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.025852 14955 raft_consensus.cc:385] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.026180 14955 raft_consensus.cc:740] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.036207 14954 tablet_bootstrap.cc:492] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4: No bootstrap required, opened a new log
I20260709 13:01:53.027113 14959 leader_election.cc:290] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.040185 14954 ts_tablet_manager.cc:1403] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4: Time spent bootstrapping tablet: real 0.088s	user 0.027s	sys 0.034s
I20260709 13:01:53.030742 14955 consensus_queue.cc:260] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.041980 14955 ts_tablet_manager.cc:1434] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:01:53.042882 14955 tablet_bootstrap.cc:492] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231: Bootstrap starting.
I20260709 13:01:53.043838 14954 raft_consensus.cc:359] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.044708 14954 raft_consensus.cc:385] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.045097 14954 raft_consensus.cc:740] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.046466 14953 tablet_bootstrap.cc:492] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd: No bootstrap required, opened a new log
I20260709 13:01:53.046028 14954 consensus_queue.cc:260] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.046983 14953 ts_tablet_manager.cc:1403] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.012s
I20260709 13:01:53.048326 14955 tablet_bootstrap.cc:654] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.051740 14954 ts_tablet_manager.cc:1434] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:01:53.052932 14954 tablet_bootstrap.cc:492] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4: Bootstrap starting.
I20260709 13:01:53.050040 14953 raft_consensus.cc:359] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.055033 14953 raft_consensus.cc:385] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.055377 14953 raft_consensus.cc:740] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.059662 14954 tablet_bootstrap.cc:654] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.060137 14953 consensus_queue.cc:260] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.065963 14961 raft_consensus.cc:493] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.066531 14961 raft_consensus.cc:515] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.067889 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd" is_pre_election: true
I20260709 13:01:53.069599 14955 tablet_bootstrap.cc:492] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231: No bootstrap required, opened a new log
W20260709 13:01:53.069689 14803 leader_election.cc:343] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.070482 14955 ts_tablet_manager.cc:1403] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.004s
I20260709 13:01:53.071899 14953 ts_tablet_manager.cc:1434] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:01:53.072999 14953 tablet_bootstrap.cc:492] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd: Bootstrap starting.
I20260709 13:01:53.074800 14955 raft_consensus.cc:359] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.075860 14955 raft_consensus.cc:385] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.076309 14955 raft_consensus.cc:740] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.077518 14955 consensus_queue.cc:260] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.078598 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.079322 14764 raft_consensus.cc:2468] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 0.
I20260709 13:01:53.080853 14804 leader_election.cc:304] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4; no voters: 1dce1eb31065474bb897d748972441dd
I20260709 13:01:53.081837 14959 raft_consensus.cc:2804] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.082285 14959 raft_consensus.cc:493] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.082629 14959 raft_consensus.cc:3060] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.087591 14961 leader_election.cc:290] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.096179 14953 tablet_bootstrap.cc:654] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.103971 14954 tablet_bootstrap.cc:492] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4: No bootstrap required, opened a new log
I20260709 13:01:53.106544 14954 ts_tablet_manager.cc:1403] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.026s
I20260709 13:01:53.107348 14961 raft_consensus.cc:493] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.108129 14961 raft_consensus.cc:515] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.110523 14954 raft_consensus.cc:359] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.111340 14954 raft_consensus.cc:385] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.111644 14954 raft_consensus.cc:740] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.112159 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd" is_pre_election: true
I20260709 13:01:53.112404 14954 consensus_queue.cc:260] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.112708 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa57e74723d745f8bd98874a45edfebe" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd" is_pre_election: true
I20260709 13:01:53.113662 14912 raft_consensus.cc:2468] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 0.
W20260709 13:01:53.114615 14728 leader_election.cc:343] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.106211 14959 raft_consensus.cc:515] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.116362 14728 leader_election.cc:304] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:53.114708 14961 leader_election.cc:290] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.117748 14961 raft_consensus.cc:2804] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.118171 14961 raft_consensus.cc:493] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.118614 14961 raft_consensus.cc:3060] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:01:53.118772 14710 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:53.120896 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:53.121742 14764 raft_consensus.cc:3060] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.128774 14961 raft_consensus.cc:515] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.132887 14764 raft_consensus.cc:2468] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 1.
I20260709 13:01:53.139312 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.133510 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa57e74723d745f8bd98874a45edfebe" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:53.140444 14839 raft_consensus.cc:2393] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d01e950508a4f3e8d29412070983231 in current term 1: Already voted for candidate 7444f38413bf49d398511d290ed2fab4 in this term.
I20260709 13:01:53.140735 14912 raft_consensus.cc:3060] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.142684 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa57e74723d745f8bd98874a45edfebe" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.143695 14839 raft_consensus.cc:2468] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 0.
I20260709 13:01:53.137193 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:53.146713 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa57e74723d745f8bd98874a45edfebe" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:53.133107 14961 leader_election.cc:290] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 election: Requested vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.150391 14839 raft_consensus.cc:3060] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.135586 14959 leader_election.cc:290] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.153869 14912 raft_consensus.cc:2468] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 1.
I20260709 13:01:53.147260 14729 leader_election.cc:304] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d01e950508a4f3e8d29412070983231; no voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4
I20260709 13:01:53.155736 14728 leader_election.cc:304] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:53.156647 14961 raft_consensus.cc:2749] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:53.146198 14804 leader_election.cc:304] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4; no voters: 
W20260709 13:01:53.157902 14803 leader_election.cc:343] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.160104 14953 tablet_bootstrap.cc:492] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd: No bootstrap required, opened a new log
I20260709 13:01:53.160676 14953 ts_tablet_manager.cc:1403] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd: Time spent bootstrapping tablet: real 0.088s	user 0.017s	sys 0.014s
I20260709 13:01:53.161453 14961 raft_consensus.cc:2804] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.163733 14953 raft_consensus.cc:359] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.166992 14953 raft_consensus.cc:385] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.167133 14961 raft_consensus.cc:697] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 1 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:53.167363 14953 raft_consensus.cc:740] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.168251 14961 consensus_queue.cc:237] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.169420 14976 raft_consensus.cc:2804] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.170179 14976 raft_consensus.cc:697] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 1 LEADER]: Becoming Leader. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:01:53.170835 14954 ts_tablet_manager.cc:1434] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4: Time spent starting tablet: real 0.064s	user 0.014s	sys 0.015s
I20260709 13:01:53.172029 14954 tablet_bootstrap.cc:492] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4: Bootstrap starting.
I20260709 13:01:53.174641 14839 raft_consensus.cc:2468] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 1.
I20260709 13:01:53.168313 14953 consensus_queue.cc:260] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.178448 14977 raft_consensus.cc:493] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.179005 14977 raft_consensus.cc:515] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.182911 14953 ts_tablet_manager.cc:1434] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.006s
I20260709 13:01:53.183447 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd" is_pre_election: true
I20260709 13:01:53.184012 14953 tablet_bootstrap.cc:492] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd: Bootstrap starting.
W20260709 13:01:53.185046 14803 leader_election.cc:343] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.185726 14977 leader_election.cc:290] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.191226 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.192037 14953 tablet_bootstrap.cc:654] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:53.192786 14804 leader_election.cc:343] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.193293 14804 leader_election.cc:304] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7444f38413bf49d398511d290ed2fab4; no voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd
I20260709 13:01:53.194523 14954 tablet_bootstrap.cc:654] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.168327 14959 raft_consensus.cc:493] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.195446 14959 raft_consensus.cc:515] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:53.196877 14977 raft_consensus.cc:2749] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:53.196043 14660 catalog_manager.cc:5697] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.198743 14960 raft_consensus.cc:493] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.199405 14960 raft_consensus.cc:515] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.203526 14960 leader_election.cc:290] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.205768 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.207502 14953 tablet_bootstrap.cc:492] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd: No bootstrap required, opened a new log
W20260709 13:01:53.207640 14878 leader_election.cc:343] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.208036 14953 ts_tablet_manager.cc:1403] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 13:01:53.209051 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.209930 14764 raft_consensus.cc:2468] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 0.
I20260709 13:01:53.212643 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd" is_pre_election: true
I20260709 13:01:53.213222 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.213474 14878 leader_election.cc:304] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 7444f38413bf49d398511d290ed2fab4
W20260709 13:01:53.214592 14803 leader_election.cc:343] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:53.215447 14804 leader_election.cc:343] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.216120 14960 raft_consensus.cc:2804] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.216012 14804 leader_election.cc:304] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7444f38413bf49d398511d290ed2fab4; no voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd
I20260709 13:01:53.216622 14960 raft_consensus.cc:493] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.217188 14977 raft_consensus.cc:2749] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:53.217238 14960 raft_consensus.cc:3060] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.222759 14959 leader_election.cc:290] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199), 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179)
I20260709 13:01:53.224515 14976 consensus_queue.cc:237] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.226739 14953 raft_consensus.cc:359] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:53.227713 14953 raft_consensus.cc:385] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.228154 14953 raft_consensus.cc:740] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.229647 14955 ts_tablet_manager.cc:1434] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231: Time spent starting tablet: real 0.159s	user 0.064s	sys 0.082s
I20260709 13:01:53.229359 14953 consensus_queue.cc:260] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:53.230759 14955 tablet_bootstrap.cc:492] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231: Bootstrap starting.
I20260709 13:01:53.232638 14960 raft_consensus.cc:515] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.237824 14955 tablet_bootstrap.cc:654] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.240006 14954 tablet_bootstrap.cc:492] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4: No bootstrap required, opened a new log
I20260709 13:01:53.240670 14954 ts_tablet_manager.cc:1403] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4: Time spent bootstrapping tablet: real 0.069s	user 0.004s	sys 0.020s
I20260709 13:01:53.241822 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:53.243017 14764 raft_consensus.cc:3060] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.247511 14953 ts_tablet_manager.cc:1434] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.016s
I20260709 13:01:53.248613 14953 tablet_bootstrap.cc:492] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd: Bootstrap starting.
I20260709 13:01:53.249747 14955 tablet_bootstrap.cc:492] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231: No bootstrap required, opened a new log
I20260709 13:01:53.250265 14955 ts_tablet_manager.cc:1403] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:01:53.253010 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:53.253250 14955 raft_consensus.cc:359] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:53.253978 14955 raft_consensus.cc:385] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.254428 14955 raft_consensus.cc:740] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Initialized, Role: FOLLOWER
W20260709 13:01:53.254546 14878 leader_election.cc:343] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.255492 14960 leader_election.cc:290] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.255760 14953 tablet_bootstrap.cc:654] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.255340 14955 consensus_queue.cc:260] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:53.258077 14955 ts_tablet_manager.cc:1434] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:01:53.259155 14955 tablet_bootstrap.cc:492] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231: Bootstrap starting.
I20260709 13:01:53.265733 14955 tablet_bootstrap.cc:654] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.266161 14764 raft_consensus.cc:2468] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 1.
I20260709 13:01:53.267482 14878 leader_election.cc:304] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 7444f38413bf49d398511d290ed2fab4
I20260709 13:01:53.268692 14960 raft_consensus.cc:2804] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.278270 14955 tablet_bootstrap.cc:492] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231: No bootstrap required, opened a new log
I20260709 13:01:53.278801 14955 ts_tablet_manager.cc:1403] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:01:53.278782 14660 catalog_manager.cc:5697] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7444f38413bf49d398511d290ed2fab4 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "7444f38413bf49d398511d290ed2fab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.244721 14954 raft_consensus.cc:359] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.280835 14954 raft_consensus.cc:385] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.281286 14954 raft_consensus.cc:740] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.281988 14955 raft_consensus.cc:359] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.282812 14955 raft_consensus.cc:385] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.283144 14955 raft_consensus.cc:740] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.282523 14954 consensus_queue.cc:260] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.284013 14989 raft_consensus.cc:493] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.284512 14989 raft_consensus.cc:515] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.285233 14960 raft_consensus.cc:697] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:53.286540 14960 consensus_queue.cc:237] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.288705 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738139e73582476cadfa825dd9dd869e" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.289358 14989 leader_election.cc:290] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.289574 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738139e73582476cadfa825dd9dd869e" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
W20260709 13:01:53.291183 14878 leader_election.cc:343] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.290148 14955 consensus_queue.cc:260] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
W20260709 13:01:53.292645 14878 leader_election.cc:343] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.293140 14878 leader_election.cc:304] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1dce1eb31065474bb897d748972441dd; no voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4
I20260709 13:01:53.293954 14989 raft_consensus.cc:2749] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:53.294251 14954 ts_tablet_manager.cc:1434] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.003s
I20260709 13:01:53.294735 14955 ts_tablet_manager.cc:1434] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:01:53.295692 14954 tablet_bootstrap.cc:492] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4: Bootstrap starting.
I20260709 13:01:53.295842 14955 tablet_bootstrap.cc:492] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231: Bootstrap starting.
I20260709 13:01:53.306432 14955 tablet_bootstrap.cc:654] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.320709 14955 tablet_bootstrap.cc:492] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231: No bootstrap required, opened a new log
I20260709 13:01:53.321286 14955 ts_tablet_manager.cc:1403] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.000s
I20260709 13:01:53.321691 14659 catalog_manager.cc:5697] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 1 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.324684 14955 raft_consensus.cc:359] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.325469 14955 raft_consensus.cc:385] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.325784 14955 raft_consensus.cc:740] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.326736 14955 consensus_queue.cc:260] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.331882 14955 ts_tablet_manager.cc:1434] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:01:53.333024 14955 tablet_bootstrap.cc:492] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231: Bootstrap starting.
I20260709 13:01:53.337352 14953 tablet_bootstrap.cc:492] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd: No bootstrap required, opened a new log
I20260709 13:01:53.337839 14953 ts_tablet_manager.cc:1403] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd: Time spent bootstrapping tablet: real 0.089s	user 0.034s	sys 0.049s
I20260709 13:01:53.340304 14953 raft_consensus.cc:359] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.340580 14955 tablet_bootstrap.cc:654] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.340924 14953 raft_consensus.cc:385] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.341281 14953 raft_consensus.cc:740] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.342165 14953 consensus_queue.cc:260] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.343688 14954 tablet_bootstrap.cc:654] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.344844 14953 ts_tablet_manager.cc:1434] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:01:53.345846 14953 tablet_bootstrap.cc:492] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd: Bootstrap starting.
I20260709 13:01:53.352247 14953 tablet_bootstrap.cc:654] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.357999 14954 tablet_bootstrap.cc:492] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4: No bootstrap required, opened a new log
I20260709 13:01:53.358811 14954 ts_tablet_manager.cc:1403] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.009s
I20260709 13:01:53.365571 14953 tablet_bootstrap.cc:492] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd: No bootstrap required, opened a new log
I20260709 13:01:53.366107 14953 ts_tablet_manager.cc:1403] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:01:53.365806 14954 raft_consensus.cc:359] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.367106 14954 raft_consensus.cc:385] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.367591 14954 raft_consensus.cc:740] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.368765 14954 consensus_queue.cc:260] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.369485 14953 raft_consensus.cc:359] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.370232 14953 raft_consensus.cc:385] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.370565 14953 raft_consensus.cc:740] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.371136 14954 ts_tablet_manager.cc:1434] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:01:53.371152 14955 tablet_bootstrap.cc:492] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231: No bootstrap required, opened a new log
I20260709 13:01:53.371285 14953 consensus_queue.cc:260] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.371943 14955 ts_tablet_manager.cc:1403] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.019s
I20260709 13:01:53.372686 14954 tablet_bootstrap.cc:492] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4: Bootstrap starting.
I20260709 13:01:53.373907 14953 ts_tablet_manager.cc:1434] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:53.374933 14953 tablet_bootstrap.cc:492] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd: Bootstrap starting.
I20260709 13:01:53.376933 14960 raft_consensus.cc:493] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.377478 14960 raft_consensus.cc:515] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.379637 14960 leader_election.cc:290] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.379622 14954 tablet_bootstrap.cc:654] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.374946 14955 raft_consensus.cc:359] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.381121 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.381121 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.381973 14953 tablet_bootstrap.cc:654] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.381861 14839 raft_consensus.cc:2468] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 0.
I20260709 13:01:53.383036 14955 raft_consensus.cc:385] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:01:53.382982 14878 leader_election.cc:343] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.383919 14878 leader_election.cc:304] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 0d01e950508a4f3e8d29412070983231
I20260709 13:01:53.387120 14960 raft_consensus.cc:2804] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.387521 14960 raft_consensus.cc:493] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.387876 14960 raft_consensus.cc:3060] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.392064 14955 raft_consensus.cc:740] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.393013 14955 consensus_queue.cc:260] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.393712 14953 tablet_bootstrap.cc:492] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd: No bootstrap required, opened a new log
I20260709 13:01:53.394918 14953 ts_tablet_manager.cc:1403] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 13:01:53.395727 14955 ts_tablet_manager.cc:1434] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:01:53.395321 14960 raft_consensus.cc:515] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.396936 14955 tablet_bootstrap.cc:492] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231: Bootstrap starting.
I20260709 13:01:53.397641 14953 raft_consensus.cc:359] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.398332 14953 raft_consensus.cc:385] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.398631 14953 raft_consensus.cc:740] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.399361 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:53.399921 14953 consensus_queue.cc:260] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
W20260709 13:01:53.400890 14878 leader_election.cc:343] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:53.401994 14953 ts_tablet_manager.cc:1434] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:01:53.402951 14953 tablet_bootstrap.cc:492] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd: Bootstrap starting.
I20260709 13:01:53.404768 14955 tablet_bootstrap.cc:654] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.405239 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:53.405848 14839 raft_consensus.cc:3060] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.408838 14953 tablet_bootstrap.cc:654] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.414850 14954 tablet_bootstrap.cc:492] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4: No bootstrap required, opened a new log
I20260709 13:01:53.415380 14954 ts_tablet_manager.cc:1403] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.004s
I20260709 13:01:53.416992 14960 leader_election.cc:290] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.417912 14955 tablet_bootstrap.cc:492] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231: No bootstrap required, opened a new log
I20260709 13:01:53.418215 14839 raft_consensus.cc:2468] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 1.
I20260709 13:01:53.418458 14955 ts_tablet_manager.cc:1403] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.003s
I20260709 13:01:53.419494 14878 leader_election.cc:304] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 0d01e950508a4f3e8d29412070983231
I20260709 13:01:53.419968 14953 tablet_bootstrap.cc:492] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd: No bootstrap required, opened a new log
I20260709 13:01:53.420439 14953 ts_tablet_manager.cc:1403] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:01:53.420594 14960 raft_consensus.cc:2804] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.421293 14960 raft_consensus.cc:697] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:53.421471 14955 raft_consensus.cc:359] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.422119 14955 raft_consensus.cc:385] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.422535 14955 raft_consensus.cc:740] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.422158 14960 consensus_queue.cc:237] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.423019 14953 raft_consensus.cc:359] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.423594 14953 raft_consensus.cc:385] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.423183 14955 consensus_queue.cc:260] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.423830 14953 raft_consensus.cc:740] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.424588 14953 consensus_queue.cc:260] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.425189 14955 ts_tablet_manager.cc:1434] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:01:53.425417 14954 raft_consensus.cc:359] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.426131 14955 tablet_bootstrap.cc:492] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231: Bootstrap starting.
I20260709 13:01:53.426867 14953 ts_tablet_manager.cc:1434] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:53.426090 14954 raft_consensus.cc:385] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.428401 14953 tablet_bootstrap.cc:492] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd: Bootstrap starting.
I20260709 13:01:53.428640 14954 raft_consensus.cc:740] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.429423 14954 consensus_queue.cc:260] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.432020 14954 ts_tablet_manager.cc:1434] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:01:53.433024 14954 tablet_bootstrap.cc:492] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4: Bootstrap starting.
I20260709 13:01:53.434613 14953 tablet_bootstrap.cc:654] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.441978 14954 tablet_bootstrap.cc:654] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.442623 14953 tablet_bootstrap.cc:492] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd: No bootstrap required, opened a new log
I20260709 13:01:53.443356 14953 ts_tablet_manager.cc:1403] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:01:53.444129 14955 tablet_bootstrap.cc:654] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.446518 14953 raft_consensus.cc:359] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.447206 14953 raft_consensus.cc:385] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.447530 14953 raft_consensus.cc:740] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.448488 14953 consensus_queue.cc:260] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.449990 14960 raft_consensus.cc:493] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.451367 14953 ts_tablet_manager.cc:1434] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:01:53.450668 14960 raft_consensus.cc:515] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.454036 14960 leader_election.cc:290] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.454615 14954 tablet_bootstrap.cc:492] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4: No bootstrap required, opened a new log
I20260709 13:01:53.454743 14955 tablet_bootstrap.cc:492] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231: No bootstrap required, opened a new log
I20260709 13:01:53.455101 14954 ts_tablet_manager.cc:1403] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.014s
I20260709 13:01:53.455195 14955 ts_tablet_manager.cc:1403] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.002s
I20260709 13:01:53.455458 14659 catalog_manager.cc:5697] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 1 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.456415 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.457052 14764 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 0.
I20260709 13:01:53.457392 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.457990 14839 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 0.
I20260709 13:01:53.457777 14954 raft_consensus.cc:359] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.458847 14954 raft_consensus.cc:385] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.459148 14954 raft_consensus.cc:740] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.459154 14974 raft_consensus.cc:493] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.459626 14955 raft_consensus.cc:359] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.459816 14954 consensus_queue.cc:260] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.459914 14974 raft_consensus.cc:515] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.460441 14955 raft_consensus.cc:385] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.460881 14955 raft_consensus.cc:740] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.461920 14954 ts_tablet_manager.cc:1434] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:01:53.462327 14974 leader_election.cc:290] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.462846 14954 tablet_bootstrap.cc:492] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4: Bootstrap starting.
I20260709 13:01:53.464176 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563e5a0670694086b94dcd13d37572aa" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd" is_pre_election: true
I20260709 13:01:53.464792 14912 raft_consensus.cc:2468] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 0.
I20260709 13:01:53.461732 14955 consensus_queue.cc:260] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.466137 14728 leader_election.cc:304] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:53.466712 14955 ts_tablet_manager.cc:1434] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:01:53.467034 14961 raft_consensus.cc:2804] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.467397 14961 raft_consensus.cc:493] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.467562 14955 tablet_bootstrap.cc:492] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231: Bootstrap starting.
I20260709 13:01:53.467732 14961 raft_consensus.cc:3060] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.468604 14954 tablet_bootstrap.cc:654] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.473838 14955 tablet_bootstrap.cc:654] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.475885 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563e5a0670694086b94dcd13d37572aa" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.476809 14839 raft_consensus.cc:2468] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 0.
I20260709 13:01:53.458366 14878 leader_election.cc:304] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:53.491202 14960 raft_consensus.cc:2804] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.491947 14960 raft_consensus.cc:493] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.494424 14960 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.500200 14961 raft_consensus.cc:515] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.502915 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563e5a0670694086b94dcd13d37572aa" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:53.503046 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563e5a0670694086b94dcd13d37572aa" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:53.503578 14912 raft_consensus.cc:3060] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.503578 14839 raft_consensus.cc:3060] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.509248 14954 tablet_bootstrap.cc:492] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4: No bootstrap required, opened a new log
I20260709 13:01:53.509608 14954 ts_tablet_manager.cc:1403] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.031s
I20260709 13:01:53.509779 14912 raft_consensus.cc:2468] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 1.
I20260709 13:01:53.511114 14728 leader_election.cc:304] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:53.512315 14974 raft_consensus.cc:2804] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.512835 14955 tablet_bootstrap.cc:492] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231: No bootstrap required, opened a new log
I20260709 13:01:53.513445 14955 ts_tablet_manager.cc:1403] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231: Time spent bootstrapping tablet: real 0.046s	user 0.031s	sys 0.002s
I20260709 13:01:53.520861 14839 raft_consensus.cc:2468] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 1.
I20260709 13:01:53.523780 14974 raft_consensus.cc:697] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 1 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:53.525831 14961 leader_election.cc:290] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 election: Requested vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.526899 14974 consensus_queue.cc:237] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.529335 14954 raft_consensus.cc:359] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.528599 14955 raft_consensus.cc:359] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.530062 14954 raft_consensus.cc:385] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.530202 14955 raft_consensus.cc:385] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.530426 14954 raft_consensus.cc:740] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.530612 14955 raft_consensus.cc:740] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.531148 14954 consensus_queue.cc:260] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.531424 14955 consensus_queue.cc:260] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.532624 14960 raft_consensus.cc:515] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.533818 14955 ts_tablet_manager.cc:1434] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.012s
I20260709 13:01:53.534981 14960 leader_election.cc:290] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.537496 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:53.538097 14839 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.538398 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:53.538982 14764 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.541796 14974 raft_consensus.cc:493] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.542424 14974 raft_consensus.cc:515] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:53.543928 14661 catalog_manager.cc:5697] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.543955 14954 ts_tablet_manager.cc:1434] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:01:53.546981 14764 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 1.
I20260709 13:01:53.547143 14839 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 1.
I20260709 13:01:53.548256 14878 leader_election.cc:304] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:53.549268 14974 leader_election.cc:290] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.549682 14954 tablet_bootstrap.cc:492] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4: Bootstrap starting.
I20260709 13:01:53.549901 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd" is_pre_election: true
I20260709 13:01:53.549691 14989 raft_consensus.cc:493] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.551045 14989 raft_consensus.cc:515] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:53.552692 14912 raft_consensus.cc:2468] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 0.
I20260709 13:01:53.553120 14989 leader_election.cc:290] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.553750 14989 raft_consensus.cc:2804] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.556108 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.557062 14954 tablet_bootstrap.cc:654] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:53.556748 14728 leader_election.cc:304] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:53.556073 14989 raft_consensus.cc:697] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:53.557796 14974 raft_consensus.cc:2804] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.556795 14838 raft_consensus.cc:2468] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 0.
I20260709 13:01:53.558169 14974 raft_consensus.cc:493] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.558645 14974 raft_consensus.cc:3060] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.559285 14878 leader_election.cc:304] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:53.561949 14960 raft_consensus.cc:2804] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.563485 14960 raft_consensus.cc:493] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.563982 14960 raft_consensus.cc:3060] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.558176 14989 consensus_queue.cc:237] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.566270 14974 raft_consensus.cc:515] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:53.568087 14984 raft_consensus.cc:493] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.568621 14984 raft_consensus.cc:515] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.568924 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.569597 14839 raft_consensus.cc:2468] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 0.
I20260709 13:01:53.570775 14984 leader_election.cc:290] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.571514 14984 raft_consensus.cc:493] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.571445 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.572145 14984 raft_consensus.cc:515] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.572201 14960 raft_consensus.cc:515] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:53.572690 14764 raft_consensus.cc:2393] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1dce1eb31065474bb897d748972441dd in current term 1: Already voted for candidate 0d01e950508a4f3e8d29412070983231 in this term.
I20260709 13:01:53.574167 14984 leader_election.cc:290] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.574257 14960 leader_election.cc:290] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.576531 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a0d512534a45bab54738ea782939dc" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.577462 14763 raft_consensus.cc:2468] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 0.
I20260709 13:01:53.579370 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:53.579581 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:53.580236 14837 raft_consensus.cc:3060] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.580611 14912 raft_consensus.cc:2393] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0d01e950508a4f3e8d29412070983231 in current term 1: Already voted for candidate 1dce1eb31065474bb897d748972441dd in this term.
I20260709 13:01:53.582209 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a0d512534a45bab54738ea782939dc" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.583134 14838 raft_consensus.cc:2468] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 0.
I20260709 13:01:53.584585 14878 leader_election.cc:304] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:53.584955 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:53.585634 14974 leader_election.cc:290] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 election: Requested vote from peers 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.586059 14763 raft_consensus.cc:2393] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1dce1eb31065474bb897d748972441dd in current term 1: Already voted for candidate 0d01e950508a4f3e8d29412070983231 in this term.
I20260709 13:01:53.586167 14960 raft_consensus.cc:2804] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.586463 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141705eb8daa48a6a7efa2795e679eb9" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.586803 14960 raft_consensus.cc:493] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.587080 14839 raft_consensus.cc:2468] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 0.
I20260709 13:01:53.587280 14960 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.587944 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:53.588068 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141705eb8daa48a6a7efa2795e679eb9" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.588321 14878 leader_election.cc:304] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:53.588948 14764 raft_consensus.cc:2468] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 0.
I20260709 13:01:53.589260 14984 raft_consensus.cc:2804] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.589594 14984 raft_consensus.cc:493] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.589931 14984 raft_consensus.cc:3060] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.590652 14729 leader_election.cc:304] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d01e950508a4f3e8d29412070983231; no voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4
I20260709 13:01:53.591789 14974 raft_consensus.cc:2749] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:53.597597 14984 raft_consensus.cc:515] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.598042 14837 raft_consensus.cc:2468] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 1.
I20260709 13:01:53.598562 14954 tablet_bootstrap.cc:492] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4: No bootstrap required, opened a new log
I20260709 13:01:53.599043 14954 ts_tablet_manager.cc:1403] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.023s
I20260709 13:01:53.599331 14878 leader_election.cc:304] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 0d01e950508a4f3e8d29412070983231
I20260709 13:01:53.600687 14984 leader_election.cc:290] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.601591 14954 raft_consensus.cc:359] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.601920 14984 raft_consensus.cc:2804] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.602850 14984 raft_consensus.cc:697] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:53.602319 14954 raft_consensus.cc:385] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:53.604394 14954 raft_consensus.cc:740] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Initialized, Role: FOLLOWER
I20260709 13:01:53.604801 14960 raft_consensus.cc:515] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.605403 14954 consensus_queue.cc:260] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.607887 14764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141705eb8daa48a6a7efa2795e679eb9" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:53.603964 14984 consensus_queue.cc:237] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:53.608500 14764 raft_consensus.cc:3060] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.608156 14661 catalog_manager.cc:5697] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 1 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.605782 14974 consensus_queue.cc:1048] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:01:53.612769 14960 leader_election.cc:290] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:53.608263 14954 ts_tablet_manager.cc:1434] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:01:53.618356 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141705eb8daa48a6a7efa2795e679eb9" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:53.618988 14837 raft_consensus.cc:3060] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.620018 14976 consensus_queue.cc:1048] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.625221 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a0d512534a45bab54738ea782939dc" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:53.625855 14763 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.628775 14838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a0d512534a45bab54738ea782939dc" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:53.629397 14838 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.629724 14961 raft_consensus.cc:493] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.630455 14961 raft_consensus.cc:515] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.632498 14764 raft_consensus.cc:2468] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 1.
I20260709 13:01:53.626019 14837 raft_consensus.cc:2468] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 1.
I20260709 13:01:53.633327 14961 leader_election.cc:290] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.634547 14878 leader_election.cc:304] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:53.636137 15010 raft_consensus.cc:2804] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.636628 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd" is_pre_election: true
I20260709 13:01:53.636643 15010 raft_consensus.cc:697] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:53.638490 14838 raft_consensus.cc:2468] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 1.
I20260709 13:01:53.639567 15010 consensus_queue.cc:237] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.640183 14878 leader_election.cc:304] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:53.641273 14960 raft_consensus.cc:2804] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.641794 14960 raft_consensus.cc:697] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:53.642688 14960 consensus_queue.cc:237] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.644383 14763 raft_consensus.cc:2468] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 1.
I20260709 13:01:53.648267 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7444f38413bf49d398511d290ed2fab4" is_pre_election: true
I20260709 13:01:53.649151 14837 raft_consensus.cc:2393] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d01e950508a4f3e8d29412070983231 in current term 1: Already voted for candidate 1dce1eb31065474bb897d748972441dd in this term.
I20260709 13:01:53.650305 14729 leader_election.cc:304] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d01e950508a4f3e8d29412070983231; no voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4
I20260709 13:01:53.652900 14974 raft_consensus.cc:3060] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.667723 14974 raft_consensus.cc:2749] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:53.676683 14913 raft_consensus.cc:3060] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.682940 14660 catalog_manager.cc:5697] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 1 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.690557 15006 consensus_queue.cc:1048] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:53.690920 14977 consensus_queue.cc:1048] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.730583 14984 consensus_queue.cc:1048] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:53.732826 14660 catalog_manager.cc:5697] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 1 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.734759 14660 catalog_manager.cc:5697] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 1 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:53.747701 14837 raft_consensus.cc:3060] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.759794 15010 consensus_queue.cc:1048] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.843344 14977 raft_consensus.cc:493] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.843832 14977 raft_consensus.cc:515] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.845587 14977 leader_election.cc:290] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.846604 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738139e73582476cadfa825dd9dd869e" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231" is_pre_election: true
I20260709 13:01:53.846630 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738139e73582476cadfa825dd9dd869e" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd" is_pre_election: true
I20260709 13:01:53.847277 14762 raft_consensus.cc:2468] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 0.
I20260709 13:01:53.847337 14912 raft_consensus.cc:2468] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 0.
I20260709 13:01:53.848361 14804 leader_election.cc:304] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:53.849045 14977 raft_consensus.cc:2804] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:53.849364 14977 raft_consensus.cc:493] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.849578 14977 raft_consensus.cc:3060] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.854215 14977 raft_consensus.cc:515] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.855855 14977 leader_election.cc:290] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:53.856882 14762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738139e73582476cadfa825dd9dd869e" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:53.856877 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738139e73582476cadfa825dd9dd869e" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:53.857515 14762 raft_consensus.cc:3060] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.857586 14912 raft_consensus.cc:3060] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:53.862223 14912 raft_consensus.cc:2468] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 1.
I20260709 13:01:53.862224 14762 raft_consensus.cc:2468] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 1.
I20260709 13:01:53.863510 14803 leader_election.cc:304] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:53.864230 14977 raft_consensus.cc:2804] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:53.864703 14977 raft_consensus.cc:697] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 1 LEADER]: Becoming Leader. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:01:53.865339 14977 consensus_queue.cc:237] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:53.872922 14661 catalog_manager.cc:5697] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7444f38413bf49d398511d290ed2fab4 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "7444f38413bf49d398511d290ed2fab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:53.985582 15018 consensus_queue.cc:1048] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:53.995391 14974 consensus_queue.cc:1048] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.012926 15010 consensus_queue.cc:1048] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.023324 14984 consensus_queue.cc:1048] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.043289 14984 consensus_queue.cc:1048] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.048936 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
mode: GRACEFUL
new_leader_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:40920
I20260709 13:01:54.049594 14912 raft_consensus.cc:606] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Received request to transfer leadership to TS 0d01e950508a4f3e8d29412070983231
I20260709 13:01:54.054315 14984 consensus_queue.cc:1048] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.064260 15010 consensus_queue.cc:1048] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.080107 14838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b"
dest_uuid: "7444f38413bf49d398511d290ed2fab4"
mode: GRACEFUL
new_leader_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:39242
I20260709 13:01:54.080754 14838 raft_consensus.cc:606] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 1 LEADER]: Received request to transfer leadership to TS 0d01e950508a4f3e8d29412070983231
I20260709 13:01:54.086514 15010 consensus_queue.cc:1048] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:54.088781 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
mode: GRACEFUL
new_leader_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:40920
I20260709 13:01:54.089519 14912 raft_consensus.cc:606] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Received request to transfer leadership to TS 0d01e950508a4f3e8d29412070983231
I20260709 13:01:54.096872 14959 raft_consensus.cc:993] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4: : Instructing follower 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:54.097373 14976 raft_consensus.cc:1081] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 1 LEADER]: Signalling peer 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:54.099267 14762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:33628
I20260709 13:01:54.099891 14762 raft_consensus.cc:493] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.100275 14762 raft_consensus.cc:3060] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.100144 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28a0d512534a45bab54738ea782939dc"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
mode: GRACEFUL
new_leader_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:40920
I20260709 13:01:54.100821 14912 raft_consensus.cc:606] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Received request to transfer leadership to TS 0d01e950508a4f3e8d29412070983231
I20260709 13:01:54.107028 14762 raft_consensus.cc:515] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.107281 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
mode: GRACEFUL
new_leader_uuid: "7444f38413bf49d398511d290ed2fab4"
 from {username='slave'} at 127.0.0.1:40920
I20260709 13:01:54.107903 14912 raft_consensus.cc:606] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Received request to transfer leadership to TS 7444f38413bf49d398511d290ed2fab4
I20260709 13:01:54.109140 14762 leader_election.cc:290] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 2 election: Requested vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:54.110211 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:54.110973 14913 raft_consensus.cc:3060] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.114029 14911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
mode: GRACEFUL
new_leader_uuid: "7444f38413bf49d398511d290ed2fab4"
 from {username='slave'} at 127.0.0.1:40920
I20260709 13:01:54.110172 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:54.114778 14911 raft_consensus.cc:606] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Received request to transfer leadership to TS 7444f38413bf49d398511d290ed2fab4
I20260709 13:01:54.114970 14837 raft_consensus.cc:3055] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.115408 14837 raft_consensus.cc:740] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:01:54.117211 14837 consensus_queue.cc:260] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.118418 14837 raft_consensus.cc:3060] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.119949 14913 raft_consensus.cc:2468] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 2.
I20260709 13:01:54.121177 14728 leader_election.cc:304] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:54.122092 15006 raft_consensus.cc:2804] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.122601 15006 raft_consensus.cc:697] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:54.123440 15006 consensus_queue.cc:237] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.125545 14912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "141705eb8daa48a6a7efa2795e679eb9"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
mode: GRACEFUL
new_leader_uuid: "7444f38413bf49d398511d290ed2fab4"
 from {username='slave'} at 127.0.0.1:40920
I20260709 13:01:54.125859 14837 raft_consensus.cc:2468] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 2.
I20260709 13:01:54.126327 14912 raft_consensus.cc:606] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Received request to transfer leadership to TS 7444f38413bf49d398511d290ed2fab4
I20260709 13:01:54.131556 14659 catalog_manager.cc:5697] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 1 to 2, leader changed from 7444f38413bf49d398511d290ed2fab4 (127.13.206.194) to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.147138 14762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "563e5a0670694086b94dcd13d37572aa"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
mode: GRACEFUL
new_leader_uuid: "1dce1eb31065474bb897d748972441dd"
 from {username='slave'} at 127.0.0.1:33640
I20260709 13:01:54.147693 14762 raft_consensus.cc:606] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 1 LEADER]: Received request to transfer leadership to TS 1dce1eb31065474bb897d748972441dd
I20260709 13:01:54.158728 14960 raft_consensus.cc:993] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd: : Instructing follower 7444f38413bf49d398511d290ed2fab4 to start an election
I20260709 13:01:54.159227 15010 raft_consensus.cc:1081] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Signalling peer 7444f38413bf49d398511d290ed2fab4 to start an election
I20260709 13:01:54.160858 14837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476"
dest_uuid: "7444f38413bf49d398511d290ed2fab4"
 from {username='slave'} at 127.0.0.1:39214
I20260709 13:01:54.161388 14837 raft_consensus.cc:493] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.161706 14837 raft_consensus.cc:3060] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.165345 15010 consensus_queue.cc:1048] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.168035 14837 raft_consensus.cc:515] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.170495 14837 leader_election.cc:290] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 2 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:54.171231 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:54.171876 14763 raft_consensus.cc:3060] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.172048 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:54.172626 14913 raft_consensus.cc:3055] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.172986 14913 raft_consensus.cc:740] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:54.173791 14913 consensus_queue.cc:260] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.174937 14960 raft_consensus.cc:993] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd: : Instructing follower 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:54.175379 14960 raft_consensus.cc:1081] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Signalling peer 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:54.192245 14913 raft_consensus.cc:3060] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.194470 14763 raft_consensus.cc:2468] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 2.
I20260709 13:01:54.195788 14804 leader_election.cc:304] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:54.196681 14976 raft_consensus.cc:2804] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.197154 14976 raft_consensus.cc:697] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Becoming Leader. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:01:54.197542 14764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:33614
I20260709 13:01:54.198117 14764 raft_consensus.cc:493] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.198547 14764 raft_consensus.cc:3060] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.197942 14976 consensus_queue.cc:237] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.199118 14984 consensus_queue.cc:1048] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.206202 14913 raft_consensus.cc:2468] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 2.
I20260709 13:01:54.207016 14984 consensus_queue.cc:1048] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.209496 14764 raft_consensus.cc:515] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:54.211058 14661 catalog_manager.cc:5697] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 reported cstate change: term changed from 1 to 2, leader changed from 1dce1eb31065474bb897d748972441dd (127.13.206.195) to 7444f38413bf49d398511d290ed2fab4 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "7444f38413bf49d398511d290ed2fab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.218030 14764 leader_election.cc:290] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 2 election: Requested vote from peers 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:54.219066 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:54.221621 14984 consensus_queue.cc:1048] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.223366 14984 raft_consensus.cc:993] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd: : Instructing follower 7444f38413bf49d398511d290ed2fab4 to start an election
I20260709 13:01:54.223819 14984 raft_consensus.cc:1081] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Signalling peer 7444f38413bf49d398511d290ed2fab4 to start an election
I20260709 13:01:54.225204 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:54.225859 14913 raft_consensus.cc:3055] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.226219 14913 raft_consensus.cc:740] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:54.227167 14913 consensus_queue.cc:260] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:54.227835 14839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "141705eb8daa48a6a7efa2795e679eb9"
dest_uuid: "7444f38413bf49d398511d290ed2fab4"
 from {username='slave'} at 127.0.0.1:39214
I20260709 13:01:54.228425 14839 raft_consensus.cc:493] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.228823 14839 raft_consensus.cc:3060] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.228879 14913 raft_consensus.cc:3060] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.236244 14913 raft_consensus.cc:2468] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 2.
I20260709 13:01:54.237370 14728 leader_election.cc:304] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 7444f38413bf49d398511d290ed2fab4
I20260709 13:01:54.238289 15006 raft_consensus.cc:2804] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.238811 15006 raft_consensus.cc:697] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:54.239698 15006 consensus_queue.cc:237] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:01:54.239961 14839 raft_consensus.cc:515] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.241147 14837 raft_consensus.cc:1240] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Rejecting Update request from peer 1dce1eb31065474bb897d748972441dd for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:54.246112 14984 consensus_queue.cc:1059] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.247231 14984 raft_consensus.cc:3055] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.247601 14984 raft_consensus.cc:740] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:54.248561 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141705eb8daa48a6a7efa2795e679eb9" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:54.249161 14763 raft_consensus.cc:3060] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.249738 14839 leader_election.cc:290] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 2 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:54.250854 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "141705eb8daa48a6a7efa2795e679eb9" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:54.251622 14984 consensus_queue.cc:260] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.252570 14984 raft_consensus.cc:3060] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.255997 14763 raft_consensus.cc:2468] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 2.
I20260709 13:01:54.257175 14804 leader_election.cc:304] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:54.258013 14976 raft_consensus.cc:2804] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.258546 14976 raft_consensus.cc:697] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Becoming Leader. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:01:54.259374 14976 consensus_queue.cc:237] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.264258 14913 raft_consensus.cc:2468] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 2.
I20260709 13:01:54.264683 14661 catalog_manager.cc:5697] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 1 to 2, leader changed from 1dce1eb31065474bb897d748972441dd (127.13.206.195) to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.272801 14660 catalog_manager.cc:5697] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 reported cstate change: term changed from 1 to 2, leader changed from 1dce1eb31065474bb897d748972441dd (127.13.206.195) to 7444f38413bf49d398511d290ed2fab4 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "7444f38413bf49d398511d290ed2fab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.439644 14976 consensus_queue.cc:1048] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.449956 14976 consensus_queue.cc:1048] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:54.454661 15010 raft_consensus.cc:993] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd: : Instructing follower 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:54.455227 14984 raft_consensus.cc:1081] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Signalling peer 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:54.457142 14763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:33614
I20260709 13:01:54.457842 14763 raft_consensus.cc:493] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.458317 14763 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.464522 14763 raft_consensus.cc:515] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.466426 14763 leader_election.cc:290] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 2 election: Requested vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:54.467278 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:54.467747 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:54.467873 14839 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.468375 14913 raft_consensus.cc:3055] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.468708 14913 raft_consensus.cc:740] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:54.469502 14913 consensus_queue.cc:260] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.470772 14913 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.473874 14839 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 2.
I20260709 13:01:54.474998 14729 leader_election.cc:304] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:54.475695 15006 raft_consensus.cc:2804] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.475960 14913 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 2.
I20260709 13:01:54.476152 15006 raft_consensus.cc:697] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:54.477023 15006 consensus_queue.cc:237] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.483206 14661 catalog_manager.cc:5697] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 1 to 2, leader changed from 1dce1eb31065474bb897d748972441dd (127.13.206.195) to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.519127 14913 raft_consensus.cc:1275] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:54.520480 15006 consensus_queue.cc:1048] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:54.523808 15018 raft_consensus.cc:993] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231: : Instructing follower 1dce1eb31065474bb897d748972441dd to start an election
I20260709 13:01:54.524279 15018 raft_consensus.cc:1081] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 1 LEADER]: Signalling peer 1dce1eb31065474bb897d748972441dd to start an election
I20260709 13:01:54.526317 14912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "563e5a0670694086b94dcd13d37572aa"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
 from {username='slave'} at 127.0.0.1:40910
I20260709 13:01:54.526943 14912 raft_consensus.cc:493] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.527356 14912 raft_consensus.cc:3060] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.531423 14839 raft_consensus.cc:1275] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:54.532871 14961 consensus_queue.cc:1048] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:54.535840 14912 raft_consensus.cc:515] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.538161 14912 leader_election.cc:290] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 2 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:54.540349 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563e5a0670694086b94dcd13d37572aa" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:54.541069 14837 raft_consensus.cc:3060] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.542092 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563e5a0670694086b94dcd13d37572aa" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:54.542726 14763 raft_consensus.cc:3055] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.543073 14763 raft_consensus.cc:740] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:54.543872 14763 consensus_queue.cc:260] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.545125 14763 raft_consensus.cc:3060] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.548049 14837 raft_consensus.cc:2468] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 2.
I20260709 13:01:54.549311 14878 leader_election.cc:304] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:54.550148 14984 raft_consensus.cc:2804] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.550628 14984 raft_consensus.cc:697] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 2 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:54.551519 14763 raft_consensus.cc:2468] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 2.
I20260709 13:01:54.551415 14984 consensus_queue.cc:237] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.557972 14659 catalog_manager.cc:5697] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 1 to 2, leader changed from 0d01e950508a4f3e8d29412070983231 (127.13.206.193) to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 2 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:54.619760 15010 raft_consensus.cc:993] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd: : Instructing follower 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:54.620198 14984 raft_consensus.cc:1081] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Signalling peer 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:54.621654 14763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28a0d512534a45bab54738ea782939dc"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:33614
I20260709 13:01:54.622149 14763 raft_consensus.cc:493] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.622506 14763 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.627700 14763 raft_consensus.cc:515] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.629779 14763 leader_election.cc:290] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 2 election: Requested vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:54.630518 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a0d512534a45bab54738ea782939dc" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:54.631126 14837 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.631274 14912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a0d512534a45bab54738ea782939dc" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:54.632143 14989 raft_consensus.cc:993] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd: : Instructing follower 7444f38413bf49d398511d290ed2fab4 to start an election
I20260709 13:01:54.632598 14984 raft_consensus.cc:1081] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Signalling peer 7444f38413bf49d398511d290ed2fab4 to start an election
I20260709 13:01:54.632615 14912 raft_consensus.cc:3055] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.633222 14912 raft_consensus.cc:740] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:54.634567 14839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827"
dest_uuid: "7444f38413bf49d398511d290ed2fab4"
 from {username='slave'} at 127.0.0.1:39214
I20260709 13:01:54.635051 14839 raft_consensus.cc:493] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.635351 14839 raft_consensus.cc:3060] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.637228 14837 raft_consensus.cc:2468] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 2.
I20260709 13:01:54.634182 14912 consensus_queue.cc:260] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.638295 14729 leader_election.cc:304] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:54.638710 14912 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.639021 14961 raft_consensus.cc:2804] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.639564 14961 raft_consensus.cc:697] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:54.640439 14961 consensus_queue.cc:237] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.641395 14839 raft_consensus.cc:515] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.644681 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:54.645280 14763 raft_consensus.cc:3060] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.645107 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:54.647185 14912 raft_consensus.cc:2468] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 2.
I20260709 13:01:54.647397 14913 raft_consensus.cc:3055] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.647711 14913 raft_consensus.cc:740] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:54.646890 14911 raft_consensus.cc:1275] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:54.648501 14913 consensus_queue.cc:260] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.649430 14839 leader_election.cc:290] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 2 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:54.649595 14913 raft_consensus.cc:3060] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.649132 14659 catalog_manager.cc:5697] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 1 to 2, leader changed from 1dce1eb31065474bb897d748972441dd (127.13.206.195) to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.652737 14961 consensus_queue.cc:1048] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:54.653621 14763 raft_consensus.cc:2468] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 2.
I20260709 13:01:54.655007 14804 leader_election.cc:304] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:54.655874 14959 raft_consensus.cc:2804] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:54.656353 14959 raft_consensus.cc:697] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Becoming Leader. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:01:54.657171 14959 consensus_queue.cc:237] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:54.658768 14913 raft_consensus.cc:2468] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 2.
I20260709 13:01:54.663508 14839 raft_consensus.cc:3060] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.670038 14661 catalog_manager.cc:5697] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 reported cstate change: term changed from 1 to 2, leader changed from 1dce1eb31065474bb897d748972441dd (127.13.206.195) to 7444f38413bf49d398511d290ed2fab4 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "7444f38413bf49d398511d290ed2fab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:54.670718 14839 raft_consensus.cc:1275] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:54.676208 14763 raft_consensus.cc:1275] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Refusing update from remote peer 7444f38413bf49d398511d290ed2fab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:54.675999 14961 consensus_queue.cc:1048] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:54.677556 14959 consensus_queue.cc:1048] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:54.686647 14913 raft_consensus.cc:1275] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Refusing update from remote peer 7444f38413bf49d398511d290ed2fab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:54.688040 14959 consensus_queue.cc:1048] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:54.726300 14913 raft_consensus.cc:1275] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Refusing update from remote peer 7444f38413bf49d398511d290ed2fab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:54.727662 14959 consensus_queue.cc:1048] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:54.735440 14763 raft_consensus.cc:1275] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Refusing update from remote peer 7444f38413bf49d398511d290ed2fab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:54.737684 14959 consensus_queue.cc:1048] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.016803 14839 raft_consensus.cc:1275] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Refusing update from remote peer 1dce1eb31065474bb897d748972441dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.018312 14984 consensus_queue.cc:1048] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.027336 14763 raft_consensus.cc:1275] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Refusing update from remote peer 1dce1eb31065474bb897d748972441dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.030445 14989 consensus_queue.cc:1048] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.079195 14839 raft_consensus.cc:1275] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.080494 14961 consensus_queue.cc:1048] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.088315 14911 raft_consensus.cc:1275] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.090072 15006 consensus_queue.cc:1048] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.175112 14911 raft_consensus.cc:1275] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Refusing update from remote peer 7444f38413bf49d398511d290ed2fab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.176573 15043 consensus_queue.cc:1048] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.185223 14763 raft_consensus.cc:1275] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Refusing update from remote peer 7444f38413bf49d398511d290ed2fab4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.187041 15043 consensus_queue.cc:1048] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:55.228472 14839 raft_consensus.cc:1275] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.229732 14961 consensus_queue.cc:1048] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:55.238248 14911 raft_consensus.cc:1275] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.240607 14974 consensus_queue.cc:1048] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:57.181706 14139 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:01:57.182749 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:57.208269 14763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28a0d512534a45bab54738ea782939dc"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
mode: GRACEFUL
new_leader_uuid: "1dce1eb31065474bb897d748972441dd"
 from {username='slave'} at 127.0.0.1:33648
I20260709 13:01:57.208824 14763 raft_consensus.cc:606] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Received request to transfer leadership to TS 1dce1eb31065474bb897d748972441dd
I20260709 13:01:57.211508 14763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
mode: GRACEFUL
new_leader_uuid: "1dce1eb31065474bb897d748972441dd"
 from {username='slave'} at 127.0.0.1:33648
I20260709 13:01:57.212113 14763 raft_consensus.cc:606] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Received request to transfer leadership to TS 1dce1eb31065474bb897d748972441dd
I20260709 13:01:57.213171 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:01:57.213619 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:57.292126 15055 raft_consensus.cc:993] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231: : Instructing follower 1dce1eb31065474bb897d748972441dd to start an election
I20260709 13:01:57.292673 15052 raft_consensus.cc:1081] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Signalling peer 1dce1eb31065474bb897d748972441dd to start an election
I20260709 13:01:57.294345 14913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
 from {username='slave'} at 127.0.0.1:40910
I20260709 13:01:57.294937 14913 raft_consensus.cc:493] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:57.295280 14913 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:57.300129 14913 raft_consensus.cc:515] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:57.301909 14913 leader_election.cc:290] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 3 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:57.302778 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:57.303146 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:57.303397 14763 raft_consensus.cc:3055] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:57.303701 14839 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:57.303733 14763 raft_consensus.cc:740] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:57.304711 14763 consensus_queue.cc:260] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:57.305945 14763 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:57.310998 14839 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 3.
I20260709 13:01:57.312348 14878 leader_election.cc:304] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:57.312914 14763 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 3.
I20260709 13:01:57.313210 14989 raft_consensus.cc:2804] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:57.314349 14989 raft_consensus.cc:697] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:57.315213 14989 consensus_queue.cc:237] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:57.322062 14659 catalog_manager.cc:5697] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 2 to 3, leader changed from 0d01e950508a4f3e8d29412070983231 (127.13.206.193) to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 3 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.462466 15055 raft_consensus.cc:993] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231: : Instructing follower 1dce1eb31065474bb897d748972441dd to start an election
I20260709 13:01:57.462927 15052 raft_consensus.cc:1081] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Signalling peer 1dce1eb31065474bb897d748972441dd to start an election
I20260709 13:01:57.464434 14913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28a0d512534a45bab54738ea782939dc"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
 from {username='slave'} at 127.0.0.1:40910
I20260709 13:01:57.464888 14913 raft_consensus.cc:493] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:57.465138 14913 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:57.470075 14913 raft_consensus.cc:515] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:57.471870 14913 leader_election.cc:290] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 3 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:01:57.472599 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a0d512534a45bab54738ea782939dc" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:01:57.473021 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a0d512534a45bab54738ea782939dc" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:57.473196 14763 raft_consensus.cc:3055] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:57.473547 14763 raft_consensus.cc:740] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:57.473562 14839 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:57.474372 14763 consensus_queue.cc:260] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:57.475288 14763 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:57.478564 14839 raft_consensus.cc:2468] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 3.
I20260709 13:01:57.479687 14878 leader_election.cc:304] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:57.480288 14763 raft_consensus.cc:2468] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 3.
I20260709 13:01:57.480433 14989 raft_consensus.cc:2804] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:57.480965 14989 raft_consensus.cc:697] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:57.481732 14989 consensus_queue.cc:237] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:57.487933 14659 catalog_manager.cc:5697] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 2 to 3, leader changed from 0d01e950508a4f3e8d29412070983231 (127.13.206.193) to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 3 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:57.889407 14764 raft_consensus.cc:1275] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Refusing update from remote peer 1dce1eb31065474bb897d748972441dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.890738 14989 consensus_queue.cc:1048] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.905494 14839 raft_consensus.cc:1275] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Refusing update from remote peer 1dce1eb31065474bb897d748972441dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.907788 15056 consensus_queue.cc:1048] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.965695 14839 raft_consensus.cc:1275] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Refusing update from remote peer 1dce1eb31065474bb897d748972441dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.966984 15056 consensus_queue.cc:1048] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.975136 14763 raft_consensus.cc:1275] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Refusing update from remote peer 1dce1eb31065474bb897d748972441dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:57.976605 15068 consensus_queue.cc:1048] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:58.214519 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:58.233120 14913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
mode: GRACEFUL
new_leader_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:40920
I20260709 13:01:58.233683 14913 raft_consensus.cc:606] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Received request to transfer leadership to TS 0d01e950508a4f3e8d29412070983231
I20260709 13:01:58.238338 14913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28a0d512534a45bab54738ea782939dc"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
mode: GRACEFUL
new_leader_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:40920
I20260709 13:01:58.238860 14913 raft_consensus.cc:606] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Received request to transfer leadership to TS 0d01e950508a4f3e8d29412070983231
I20260709 13:01:58.243523 14839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476"
dest_uuid: "7444f38413bf49d398511d290ed2fab4"
mode: GRACEFUL
new_leader_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:39242
I20260709 13:01:58.243960 14839 raft_consensus.cc:606] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Received request to transfer leadership to TS 0d01e950508a4f3e8d29412070983231
I20260709 13:01:58.248824 14839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827"
dest_uuid: "7444f38413bf49d398511d290ed2fab4"
mode: GRACEFUL
new_leader_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:39242
I20260709 13:01:58.249272 14839 raft_consensus.cc:606] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Received request to transfer leadership to TS 0d01e950508a4f3e8d29412070983231
I20260709 13:01:58.253728 14839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738139e73582476cadfa825dd9dd869e"
dest_uuid: "7444f38413bf49d398511d290ed2fab4"
mode: GRACEFUL
new_leader_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:39242
I20260709 13:01:58.254261 14839 raft_consensus.cc:606] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 1 LEADER]: Received request to transfer leadership to TS 0d01e950508a4f3e8d29412070983231
I20260709 13:01:58.324258 15056 raft_consensus.cc:993] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd: : Instructing follower 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:58.324662 15068 raft_consensus.cc:1081] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Signalling peer 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:58.326040 14763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:33614
I20260709 13:01:58.326543 14763 raft_consensus.cc:493] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:58.326825 14763 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.331086 14763 raft_consensus.cc:515] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.332578 14763 leader_election.cc:290] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 4 election: Requested vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:58.333537 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:58.333622 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:58.334200 14839 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.334316 14913 raft_consensus.cc:3055] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:58.334867 14913 raft_consensus.cc:740] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:58.335644 14913 consensus_queue.cc:260] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.337482 14913 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.339114 14839 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 4.
I20260709 13:01:58.340361 14729 leader_election.cc:304] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:58.341142 15052 raft_consensus.cc:2804] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:58.342185 15052 raft_consensus.cc:697] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 4 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:58.342429 14913 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 4.
I20260709 13:01:58.343080 15052 consensus_queue.cc:237] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.349498 14660 catalog_manager.cc:5697] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 3 to 4, leader changed from 1dce1eb31065474bb897d748972441dd (127.13.206.195) to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 4 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.365453 15063 raft_consensus.cc:993] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4: : Instructing follower 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:58.365922 15077 raft_consensus.cc:1081] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Signalling peer 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:58.367640 14763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:33628
I20260709 13:01:58.368188 14763 raft_consensus.cc:493] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:58.368505 14763 raft_consensus.cc:3060] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.372591 14763 raft_consensus.cc:515] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.373947 14763 leader_election.cc:290] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 3 election: Requested vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:58.374900 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:58.374970 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5b48bf2d68d47b98242b9e78c2b3476" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:58.375422 14839 raft_consensus.cc:3055] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:58.375500 14913 raft_consensus.cc:3060] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.375653 14839 raft_consensus.cc:740] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:01:58.376428 14839 consensus_queue.cc:260] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.377274 14839 raft_consensus.cc:3060] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.379997 14913 raft_consensus.cc:2468] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 3.
I20260709 13:01:58.380993 14728 leader_election.cc:304] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:58.381279 14839 raft_consensus.cc:2468] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 3.
I20260709 13:01:58.381834 15073 raft_consensus.cc:2804] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:58.382351 15073 raft_consensus.cc:697] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 3 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:58.383165 15073 consensus_queue.cc:237] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.389575 14660 catalog_manager.cc:5697] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 2 to 3, leader changed from 7444f38413bf49d398511d290ed2fab4 (127.13.206.194) to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 3 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.483592 15079 raft_consensus.cc:993] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd: : Instructing follower 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:58.484094 15068 raft_consensus.cc:1081] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Signalling peer 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:58.485570 14763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28a0d512534a45bab54738ea782939dc"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:33614
I20260709 13:01:58.486027 14763 raft_consensus.cc:493] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:58.486339 14763 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.490630 14763 raft_consensus.cc:515] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.492182 14763 leader_election.cc:290] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 4 election: Requested vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:58.493171 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a0d512534a45bab54738ea782939dc" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:58.493556 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28a0d512534a45bab54738ea782939dc" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:58.493635 14913 raft_consensus.cc:3055] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:58.494043 14839 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.494051 14913 raft_consensus.cc:740] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:01:58.494905 14913 consensus_queue.cc:260] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.495739 14913 raft_consensus.cc:3060] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.498638 14839 raft_consensus.cc:2468] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 4.
I20260709 13:01:58.499663 14729 leader_election.cc:304] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:01:58.500118 14913 raft_consensus.cc:2468] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 4.
I20260709 13:01:58.500404 15073 raft_consensus.cc:2804] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:58.500897 15073 raft_consensus.cc:697] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 4 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:58.501627 15073 consensus_queue.cc:237] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.507789 14660 catalog_manager.cc:5697] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 3 to 4, leader changed from 1dce1eb31065474bb897d748972441dd (127.13.206.195) to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 4 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.539088 15063 raft_consensus.cc:993] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4: : Instructing follower 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:58.539556 15077 raft_consensus.cc:1081] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 1 LEADER]: Signalling peer 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:58.541021 14763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "738139e73582476cadfa825dd9dd869e"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:33628
I20260709 13:01:58.541505 14763 raft_consensus.cc:493] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:58.541800 14763 raft_consensus.cc:3060] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:58.545889 14763 raft_consensus.cc:515] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.547505 14763 leader_election.cc:290] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 2 election: Requested vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:58.548388 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738139e73582476cadfa825dd9dd869e" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:58.548547 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738139e73582476cadfa825dd9dd869e" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:58.549005 14913 raft_consensus.cc:3060] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:58.549005 14839 raft_consensus.cc:3055] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:58.549552 14839 raft_consensus.cc:740] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:01:58.550304 14839 consensus_queue.cc:260] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.551401 14839 raft_consensus.cc:3060] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:58.555586 14913 raft_consensus.cc:2468] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 2.
I20260709 13:01:58.556748 14728 leader_election.cc:304] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:58.557507 15073 raft_consensus.cc:2804] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:58.557647 14839 raft_consensus.cc:2468] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 2.
I20260709 13:01:58.557945 15073 raft_consensus.cc:697] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:58.558851 15073 consensus_queue.cc:237] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.565039 14660 catalog_manager.cc:5697] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 1 to 2, leader changed from 7444f38413bf49d398511d290ed2fab4 (127.13.206.194) to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.687083 15063 raft_consensus.cc:993] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4: : Instructing follower 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:58.687528 15077 raft_consensus.cc:1081] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Signalling peer 0d01e950508a4f3e8d29412070983231 to start an election
I20260709 13:01:58.689055 14763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
 from {username='slave'} at 127.0.0.1:33628
I20260709 13:01:58.689534 14763 raft_consensus.cc:493] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:58.689824 14763 raft_consensus.cc:3060] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.694129 14763 raft_consensus.cc:515] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.695746 14763 leader_election.cc:290] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 3 election: Requested vote from peers 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:01:58.696718 14839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:01:58.696765 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0264f4a931b94c4fad7f3451eb161827" candidate_uuid: "0d01e950508a4f3e8d29412070983231" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:01:58.697299 14839 raft_consensus.cc:3055] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:58.697388 14913 raft_consensus.cc:3060] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.697613 14839 raft_consensus.cc:740] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:01:58.698324 14839 consensus_queue.cc:260] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.699134 14839 raft_consensus.cc:3060] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:58.701756 14913 raft_consensus.cc:2468] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 3.
I20260709 13:01:58.702786 14728 leader_election.cc:304] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d01e950508a4f3e8d29412070983231, 1dce1eb31065474bb897d748972441dd; no voters: 
I20260709 13:01:58.703512 15073 raft_consensus.cc:2804] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:58.703481 14839 raft_consensus.cc:2468] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d01e950508a4f3e8d29412070983231 in term 3.
I20260709 13:01:58.704082 15073 raft_consensus.cc:697] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 3 LEADER]: Becoming Leader. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:01:58.704881 15073 consensus_queue.cc:237] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:01:58.711144 14660 catalog_manager.cc:5697] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 reported cstate change: term changed from 2 to 3, leader changed from 7444f38413bf49d398511d290ed2fab4 (127.13.206.194) to 0d01e950508a4f3e8d29412070983231 (127.13.206.193). New cstate: current_term: 3 leader_uuid: "0d01e950508a4f3e8d29412070983231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.780313 14913 raft_consensus.cc:1275] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 4 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:58.781476 15073 consensus_queue.cc:1048] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:58.790072 14839 raft_consensus.cc:1275] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 4 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:58.791597 15073 consensus_queue.cc:1048] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:58.959468 14911 raft_consensus.cc:1275] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:58.960932 15073 consensus_queue.cc:1048] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:58.964360 14839 raft_consensus.cc:1275] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 4 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:58.965780 15073 consensus_queue.cc:1048] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:58.972095 14839 raft_consensus.cc:1275] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:58.976300 15073 consensus_queue.cc:1048] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:58.977700 14911 raft_consensus.cc:1275] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 4 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:58.979665 15086 consensus_queue.cc:1048] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:58.989061 14913 raft_consensus.cc:1275] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:58.990656 15052 consensus_queue.cc:1048] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:59.000825 14839 raft_consensus.cc:1275] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:59.003262 15073 consensus_queue.cc:1048] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:59.168870 14839 raft_consensus.cc:1275] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:59.171458 15073 consensus_queue.cc:1048] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:59.231674 14913 raft_consensus.cc:1275] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Refusing update from remote peer 0d01e950508a4f3e8d29412070983231: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:59.235415 15086 consensus_queue.cc:1048] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:01.261404 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:01.269454 14763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
mode: GRACEFUL
new_leader_uuid: "1dce1eb31065474bb897d748972441dd"
 from {username='slave'} at 127.0.0.1:33648
I20260709 13:02:01.270284 14763 raft_consensus.cc:606] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Received request to transfer leadership to TS 1dce1eb31065474bb897d748972441dd
I20260709 13:02:01.272946 14763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
mode: GRACEFUL
new_leader_uuid: "7444f38413bf49d398511d290ed2fab4"
 from {username='slave'} at 127.0.0.1:33648
I20260709 13:02:01.273380 14763 raft_consensus.cc:606] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Received request to transfer leadership to TS 7444f38413bf49d398511d290ed2fab4
I20260709 13:02:01.275555 14763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
mode: GRACEFUL
new_leader_uuid: "7444f38413bf49d398511d290ed2fab4"
 from {username='slave'} at 127.0.0.1:33648
I20260709 13:02:01.275959 14763 raft_consensus.cc:606] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 4 LEADER]: Received request to transfer leadership to TS 7444f38413bf49d398511d290ed2fab4
I20260709 13:02:01.278065 14763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa57e74723d745f8bd98874a45edfebe"
dest_uuid: "0d01e950508a4f3e8d29412070983231"
mode: GRACEFUL
new_leader_uuid: "1dce1eb31065474bb897d748972441dd"
 from {username='slave'} at 127.0.0.1:33648
I20260709 13:02:01.278558 14763 raft_consensus.cc:606] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 1 LEADER]: Received request to transfer leadership to TS 1dce1eb31065474bb897d748972441dd
I20260709 13:02:01.279524 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:01.280007 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:01.488236 15095 raft_consensus.cc:993] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231: : Instructing follower 7444f38413bf49d398511d290ed2fab4 to start an election
I20260709 13:02:01.488695 15086 raft_consensus.cc:1081] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 4 LEADER]: Signalling peer 7444f38413bf49d398511d290ed2fab4 to start an election
I20260709 13:02:01.490353 14837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058"
dest_uuid: "7444f38413bf49d398511d290ed2fab4"
 from {username='slave'} at 127.0.0.1:39226
I20260709 13:02:01.490866 14837 raft_consensus.cc:493] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.491211 14837 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.497205 14837 raft_consensus.cc:515] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:02:01.499099 14837 leader_election.cc:290] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 5 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:02:01.500006 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:02:01.500634 14763 raft_consensus.cc:3055] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:01.500550 14911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6efb443e67d44aabcff652bf9368058" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:02:01.500921 14763 raft_consensus.cc:740] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:02:01.501087 14911 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.501802 14763 consensus_queue.cc:260] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:02:01.502817 14763 raft_consensus.cc:3060] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.507591 14911 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 5.
I20260709 13:02:01.509040 14763 raft_consensus.cc:2468] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 5.
I20260709 13:02:01.508975 14803 leader_election.cc:304] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:02:01.510085 15063 raft_consensus.cc:2804] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:01.511011 15063 raft_consensus.cc:697] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 5 LEADER]: Becoming Leader. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:02:01.511945 15063 consensus_queue.cc:237] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:02:01.518944 14661 catalog_manager.cc:5697] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 reported cstate change: term changed from 4 to 5, leader changed from 0d01e950508a4f3e8d29412070983231 (127.13.206.193) to 7444f38413bf49d398511d290ed2fab4 (127.13.206.194). New cstate: current_term: 5 leader_uuid: "7444f38413bf49d398511d290ed2fab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.535991 15095 raft_consensus.cc:993] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231: : Instructing follower 1dce1eb31065474bb897d748972441dd to start an election
I20260709 13:02:01.536432 15086 raft_consensus.cc:1081] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Signalling peer 1dce1eb31065474bb897d748972441dd to start an election
I20260709 13:02:01.537949 14911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
 from {username='slave'} at 127.0.0.1:40910
I20260709 13:02:01.538416 14911 raft_consensus.cc:493] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.538664 14911 raft_consensus.cc:3060] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.543906 14911 raft_consensus.cc:515] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:02:01.545540 14911 leader_election.cc:290] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 3 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:02:01.546468 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:02:01.546701 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "089a725a01014aa6a7fec7a2781368c9" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:02:01.547021 14763 raft_consensus.cc:3055] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:01.547304 14837 raft_consensus.cc:3060] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.547331 14763 raft_consensus.cc:740] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:02:01.548297 14763 consensus_queue.cc:260] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:02:01.549170 14763 raft_consensus.cc:3060] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.552469 14837 raft_consensus.cc:2468] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 3.
I20260709 13:02:01.553622 14763 raft_consensus.cc:2468] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 3.
I20260709 13:02:01.553809 14878 leader_election.cc:304] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:02:01.554762 15096 raft_consensus.cc:2804] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:01.555907 15096 raft_consensus.cc:697] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:02:01.556800 15096 consensus_queue.cc:237] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } }
I20260709 13:02:01.564172 14661 catalog_manager.cc:5697] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 2 to 3, leader changed from 0d01e950508a4f3e8d29412070983231 (127.13.206.193) to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 3 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.612758 15095 raft_consensus.cc:993] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231: : Instructing follower 1dce1eb31065474bb897d748972441dd to start an election
I20260709 13:02:01.613268 15095 raft_consensus.cc:1081] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 1 LEADER]: Signalling peer 1dce1eb31065474bb897d748972441dd to start an election
I20260709 13:02:01.614878 14913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa57e74723d745f8bd98874a45edfebe"
dest_uuid: "1dce1eb31065474bb897d748972441dd"
 from {username='slave'} at 127.0.0.1:40910
I20260709 13:02:01.615379 14913 raft_consensus.cc:493] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.615728 14913 raft_consensus.cc:3060] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.620524 14913 raft_consensus.cc:515] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:02:01.622452 14913 leader_election.cc:290] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 2 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125)
I20260709 13:02:01.623247 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa57e74723d745f8bd98874a45edfebe" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:02:01.623847 14763 raft_consensus.cc:3055] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:01.623811 14837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa57e74723d745f8bd98874a45edfebe" candidate_uuid: "1dce1eb31065474bb897d748972441dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7444f38413bf49d398511d290ed2fab4"
I20260709 13:02:01.624219 14763 raft_consensus.cc:740] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:02:01.624475 14837 raft_consensus.cc:3060] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.625026 14763 consensus_queue.cc:260] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:02:01.625888 14763 raft_consensus.cc:3060] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:01.630249 14837 raft_consensus.cc:2468] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 2.
I20260709 13:02:01.631903 14878 leader_election.cc:304] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:02:01.633127 14763 raft_consensus.cc:2468] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1dce1eb31065474bb897d748972441dd in term 2.
I20260709 13:02:01.634176 15096 raft_consensus.cc:2804] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:01.634794 15096 raft_consensus.cc:697] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 2 LEADER]: Becoming Leader. State: Replica: 1dce1eb31065474bb897d748972441dd, State: Running, Role: LEADER
I20260709 13:02:01.635805 15096 consensus_queue.cc:237] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:02:01.643786 14661 catalog_manager.cc:5697] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd reported cstate change: term changed from 1 to 2, leader changed from 0d01e950508a4f3e8d29412070983231 (127.13.206.193) to 1dce1eb31065474bb897d748972441dd (127.13.206.195). New cstate: current_term: 2 leader_uuid: "1dce1eb31065474bb897d748972441dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.807397 15106 raft_consensus.cc:993] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231: : Instructing follower 7444f38413bf49d398511d290ed2fab4 to start an election
I20260709 13:02:01.807852 15095 raft_consensus.cc:1081] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Signalling peer 7444f38413bf49d398511d290ed2fab4 to start an election
I20260709 13:02:01.809388 14837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b"
dest_uuid: "7444f38413bf49d398511d290ed2fab4"
 from {username='slave'} at 127.0.0.1:39226
I20260709 13:02:01.809890 14837 raft_consensus.cc:493] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:01.810209 14837 raft_consensus.cc:3060] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.815013 14837 raft_consensus.cc:515] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:02:01.817018 14837 leader_election.cc:290] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 3 election: Requested vote from peers 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179), 1dce1eb31065474bb897d748972441dd (127.13.206.195:33199)
I20260709 13:02:01.817795 14763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d01e950508a4f3e8d29412070983231"
I20260709 13:02:01.818034 14913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3411ca70fe5d43148b1489d4de8ad52b" candidate_uuid: "7444f38413bf49d398511d290ed2fab4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1dce1eb31065474bb897d748972441dd"
I20260709 13:02:01.818430 14763 raft_consensus.cc:3055] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:01.818681 14913 raft_consensus.cc:3060] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.818781 14763 raft_consensus.cc:740] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d01e950508a4f3e8d29412070983231, State: Running, Role: LEADER
I20260709 13:02:01.819526 14763 consensus_queue.cc:260] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:02:01.820389 14763 raft_consensus.cc:3060] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.823451 14913 raft_consensus.cc:2468] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 3.
I20260709 13:02:01.824615 14803 leader_election.cc:304] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dce1eb31065474bb897d748972441dd, 7444f38413bf49d398511d290ed2fab4; no voters: 
I20260709 13:02:01.824856 14763 raft_consensus.cc:2468] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7444f38413bf49d398511d290ed2fab4 in term 3.
I20260709 13:02:01.825347 15063 raft_consensus.cc:2804] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:01.825855 15063 raft_consensus.cc:697] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 3 LEADER]: Becoming Leader. State: Replica: 7444f38413bf49d398511d290ed2fab4, State: Running, Role: LEADER
I20260709 13:02:01.826634 15063 consensus_queue.cc:237] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } }
I20260709 13:02:01.833607 14661 catalog_manager.cc:5697] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 reported cstate change: term changed from 2 to 3, leader changed from 0d01e950508a4f3e8d29412070983231 (127.13.206.193) to 7444f38413bf49d398511d290ed2fab4 (127.13.206.194). New cstate: current_term: 3 leader_uuid: "7444f38413bf49d398511d290ed2fab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.971688 14837 raft_consensus.cc:1275] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Refusing update from remote peer 1dce1eb31065474bb897d748972441dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:01.973022 15096 consensus_queue.cc:1048] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:01.983767 14763 raft_consensus.cc:1275] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Refusing update from remote peer 1dce1eb31065474bb897d748972441dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:01.985766 15103 consensus_queue.cc:1048] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:02.005208 14763 raft_consensus.cc:1275] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 5 FOLLOWER]: Refusing update from remote peer 7444f38413bf49d398511d290ed2fab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:02.006528 15063 consensus_queue.cc:1048] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:02.016956 14913 raft_consensus.cc:1275] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 5 FOLLOWER]: Refusing update from remote peer 7444f38413bf49d398511d290ed2fab4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:02.019586 15097 consensus_queue.cc:1048] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:02.021245 14763 raft_consensus.cc:1275] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Refusing update from remote peer 1dce1eb31065474bb897d748972441dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.023151 15104 consensus_queue.cc:1048] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d01e950508a4f3e8d29412070983231" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:02.034986 14839 raft_consensus.cc:1275] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Refusing update from remote peer 1dce1eb31065474bb897d748972441dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:02.037292 15103 consensus_queue.cc:1048] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7444f38413bf49d398511d290ed2fab4" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 44125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:02.280969 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:02.286759 14139 tablet_server.cc:179] TabletServer@127.13.206.193:0 shutting down...
I20260709 13:02:02.315798 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:02.316567 14139 tablet_replica.cc:333] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231: stopping tablet replica
I20260709 13:02:02.317348 14139 raft_consensus.cc:2243] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:02.318331 14139 raft_consensus.cc:2272] T 28a0d512534a45bab54738ea782939dc P 0d01e950508a4f3e8d29412070983231 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.320214 14139 tablet_replica.cc:333] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231: stopping tablet replica
I20260709 13:02:02.320781 14139 raft_consensus.cc:2243] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.321233 14139 raft_consensus.cc:2272] T 563e5a0670694086b94dcd13d37572aa P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.323096 14139 tablet_replica.cc:333] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231: stopping tablet replica
I20260709 13:02:02.323634 14139 raft_consensus.cc:2243] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.324075 14139 raft_consensus.cc:2272] T 141705eb8daa48a6a7efa2795e679eb9 P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.325709 14139 tablet_replica.cc:333] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231: stopping tablet replica
I20260709 13:02:02.326272 14139 raft_consensus.cc:2243] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.326701 14139 raft_consensus.cc:2272] T c6efb443e67d44aabcff652bf9368058 P 0d01e950508a4f3e8d29412070983231 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.329206 14139 tablet_replica.cc:333] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231: stopping tablet replica
I20260709 13:02:02.329974 14139 raft_consensus.cc:2243] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:02.330914 14139 raft_consensus.cc:2272] T e5b48bf2d68d47b98242b9e78c2b3476 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.332665 14139 tablet_replica.cc:333] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231: stopping tablet replica
I20260709 13:02:02.333197 14139 raft_consensus.cc:2243] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.333595 14139 raft_consensus.cc:2272] T fa57e74723d745f8bd98874a45edfebe P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.335777 14139 tablet_replica.cc:333] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231: stopping tablet replica
I20260709 13:02:02.336306 14139 raft_consensus.cc:2243] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:02.337054 14139 raft_consensus.cc:2272] T 738139e73582476cadfa825dd9dd869e P 0d01e950508a4f3e8d29412070983231 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.338845 14139 tablet_replica.cc:333] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231: stopping tablet replica
I20260709 13:02:02.339326 14139 raft_consensus.cc:2243] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.339795 14139 raft_consensus.cc:2272] T 3411ca70fe5d43148b1489d4de8ad52b P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.341673 14139 tablet_replica.cc:333] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231: stopping tablet replica
I20260709 13:02:02.342154 14139 raft_consensus.cc:2243] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:02.342922 14139 raft_consensus.cc:2272] T 0264f4a931b94c4fad7f3451eb161827 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.344550 14139 tablet_replica.cc:333] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231: stopping tablet replica
I20260709 13:02:02.345112 14139 raft_consensus.cc:2243] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.345580 14139 raft_consensus.cc:2272] T 089a725a01014aa6a7fec7a2781368c9 P 0d01e950508a4f3e8d29412070983231 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.349133 14911 raft_consensus.cc:1275] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Refusing update from remote peer 7444f38413bf49d398511d290ed2fab4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:02.350497 15097 consensus_queue.cc:1048] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dce1eb31065474bb897d748972441dd" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 33199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:02.360505 14804 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:02:02.365438 14804 consensus_peers.cc:597] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 -> Peer 0d01e950508a4f3e8d29412070983231 (127.13.206.193:39179): Couldn't send request to peer 0d01e950508a4f3e8d29412070983231. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:02.384279 14139 tablet_server.cc:196] TabletServer@127.13.206.193:0 shutdown complete.
I20260709 13:02:02.403240 14139 tablet_server.cc:179] TabletServer@127.13.206.194:0 shutting down...
I20260709 13:02:02.426369 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:02.427048 14139 tablet_replica.cc:333] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4: stopping tablet replica
I20260709 13:02:02.427709 14139 raft_consensus.cc:2243] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.428233 14139 raft_consensus.cc:2272] T 28a0d512534a45bab54738ea782939dc P 7444f38413bf49d398511d290ed2fab4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.430071 14139 tablet_replica.cc:333] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4: stopping tablet replica
I20260709 13:02:02.430642 14139 raft_consensus.cc:2243] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.431113 14139 raft_consensus.cc:2272] T 563e5a0670694086b94dcd13d37572aa P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.432866 14139 tablet_replica.cc:333] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4: stopping tablet replica
I20260709 13:02:02.433379 14139 raft_consensus.cc:2243] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:02.434196 14139 raft_consensus.cc:2272] T 141705eb8daa48a6a7efa2795e679eb9 P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.436075 14139 tablet_replica.cc:333] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4: stopping tablet replica
I20260709 13:02:02.436610 14139 raft_consensus.cc:2243] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:02:02.437355 14139 raft_consensus.cc:2272] T c6efb443e67d44aabcff652bf9368058 P 7444f38413bf49d398511d290ed2fab4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.439713 14139 tablet_replica.cc:333] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4: stopping tablet replica
I20260709 13:02:02.440270 14139 raft_consensus.cc:2243] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.440730 14139 raft_consensus.cc:2272] T e5b48bf2d68d47b98242b9e78c2b3476 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.442459 14139 tablet_replica.cc:333] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4: stopping tablet replica
I20260709 13:02:02.442957 14139 raft_consensus.cc:2243] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.443356 14139 raft_consensus.cc:2272] T fa57e74723d745f8bd98874a45edfebe P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.445396 14139 tablet_replica.cc:333] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4: stopping tablet replica
I20260709 13:02:02.445940 14139 raft_consensus.cc:2243] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.446440 14139 raft_consensus.cc:2272] T 738139e73582476cadfa825dd9dd869e P 7444f38413bf49d398511d290ed2fab4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.448056 14139 tablet_replica.cc:333] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4: stopping tablet replica
I20260709 13:02:02.448554 14139 raft_consensus.cc:2243] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:02.449326 14139 raft_consensus.cc:2272] T 3411ca70fe5d43148b1489d4de8ad52b P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.451367 14139 tablet_replica.cc:333] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4: stopping tablet replica
I20260709 13:02:02.451890 14139 raft_consensus.cc:2243] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.452322 14139 raft_consensus.cc:2272] T 0264f4a931b94c4fad7f3451eb161827 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.453893 14139 tablet_replica.cc:333] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4: stopping tablet replica
I20260709 13:02:02.454385 14139 raft_consensus.cc:2243] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.454806 14139 raft_consensus.cc:2272] T 089a725a01014aa6a7fec7a2781368c9 P 7444f38413bf49d398511d290ed2fab4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.484185 14139 tablet_server.cc:196] TabletServer@127.13.206.194:0 shutdown complete.
I20260709 13:02:02.501910 14139 tablet_server.cc:179] TabletServer@127.13.206.195:0 shutting down...
I20260709 13:02:02.524545 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:02.525499 14139 tablet_replica.cc:333] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd: stopping tablet replica
I20260709 13:02:02.526075 14139 raft_consensus.cc:2243] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.526679 14139 raft_consensus.cc:2272] T 28a0d512534a45bab54738ea782939dc P 1dce1eb31065474bb897d748972441dd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.529313 14139 tablet_replica.cc:333] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd: stopping tablet replica
I20260709 13:02:02.529879 14139 raft_consensus.cc:2243] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:02:02.530138 14878 consensus_peers.cc:597] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd -> Peer 7444f38413bf49d398511d290ed2fab4 (127.13.206.194:44125): Couldn't send request to peer 7444f38413bf49d398511d290ed2fab4. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:44125: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:02.530891 14139 raft_consensus.cc:2272] T 563e5a0670694086b94dcd13d37572aa P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.532940 14139 tablet_replica.cc:333] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd: stopping tablet replica
I20260709 13:02:02.533803 14139 raft_consensus.cc:2243] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.534452 14139 raft_consensus.cc:2272] T 141705eb8daa48a6a7efa2795e679eb9 P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.536252 14139 tablet_replica.cc:333] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd: stopping tablet replica
I20260709 13:02:02.536756 14139 raft_consensus.cc:2243] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.537200 14139 raft_consensus.cc:2272] T c6efb443e67d44aabcff652bf9368058 P 1dce1eb31065474bb897d748972441dd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.539286 14139 tablet_replica.cc:333] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd: stopping tablet replica
I20260709 13:02:02.539740 14139 raft_consensus.cc:2243] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.540155 14139 raft_consensus.cc:2272] T 3411ca70fe5d43148b1489d4de8ad52b P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.542124 14139 tablet_replica.cc:333] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd: stopping tablet replica
I20260709 13:02:02.542666 14139 raft_consensus.cc:2243] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.543074 14139 raft_consensus.cc:2272] T 738139e73582476cadfa825dd9dd869e P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.544713 14139 tablet_replica.cc:333] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd: stopping tablet replica
I20260709 13:02:02.545173 14139 raft_consensus.cc:2243] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:02.545876 14139 raft_consensus.cc:2272] T 089a725a01014aa6a7fec7a2781368c9 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.547889 14139 tablet_replica.cc:333] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd: stopping tablet replica
I20260709 13:02:02.548379 14139 raft_consensus.cc:2243] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.548749 14139 raft_consensus.cc:2272] T 0264f4a931b94c4fad7f3451eb161827 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.550408 14139 tablet_replica.cc:333] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd: stopping tablet replica
I20260709 13:02:02.550838 14139 raft_consensus.cc:2243] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:02.551219 14139 raft_consensus.cc:2272] T e5b48bf2d68d47b98242b9e78c2b3476 P 1dce1eb31065474bb897d748972441dd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.552771 14139 tablet_replica.cc:333] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd: stopping tablet replica
I20260709 13:02:02.553176 14139 raft_consensus.cc:2243] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:02.553843 14139 raft_consensus.cc:2272] T fa57e74723d745f8bd98874a45edfebe P 1dce1eb31065474bb897d748972441dd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.581002 14139 tablet_server.cc:196] TabletServer@127.13.206.195:0 shutdown complete.
I20260709 13:02:02.598803 14139 master.cc:562] Master@127.13.206.254:35051 shutting down...
I20260709 13:02:02.618266 14139 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:02.618841 14139 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:02.619210 14139 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5d9fd5adf0e246f2a532168ee1aca332: stopping tablet replica
I20260709 13:02:02.640239 14139 master.cc:584] Master@127.13.206.254:35051 shutdown complete.
0d01e950508a4f3e8d29412070983231  5
1dce1eb31065474bb897d748972441dd  1
7444f38413bf49d398511d290ed2fab4  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10689 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:02:02.680835 14139 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.206.254:45539
I20260709 13:02:02.681941 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:02.687872 15123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:02.688814 15126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:02.689040 15124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:02.689416 14139 server_base.cc:1061] running on GCE node
I20260709 13:02:02.690214 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:02.690493 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:02.690668 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602122690646 us; error 0 us; skew 500 ppm
I20260709 13:02:02.691226 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:02.693667 14139 webserver.cc:533] Webserver started at http://127.13.206.254:34307/ using document root <none> and password file <none>
I20260709 13:02:02.694185 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:02.694470 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:02.694770 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:02.695933 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/master-0-root/instance:
uuid: "6c48b19b0ac74d678c9f752e98013b9a"
format_stamp: "Formatted at 2026-07-09 13:02:02 on dist-test-slave-ml7r"
I20260709 13:02:02.700479 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:02.703914 15131 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:02.704843 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:02.705118 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/master-0-root
uuid: "6c48b19b0ac74d678c9f752e98013b9a"
format_stamp: "Formatted at 2026-07-09 13:02:02 on dist-test-slave-ml7r"
I20260709 13:02:02.705379 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:02.720902 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:02.722131 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:02.760917 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.254:45539
I20260709 13:02:02.761003 15182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.254:45539 every 8 connection(s)
I20260709 13:02:02.765344 15183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:02.775664 15183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Bootstrap starting.
I20260709 13:02:02.780323 15183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.784658 15183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: No bootstrap required, opened a new log
I20260709 13:02:02.786828 15183 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c48b19b0ac74d678c9f752e98013b9a" member_type: VOTER }
I20260709 13:02:02.787271 15183 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.787510 15183 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c48b19b0ac74d678c9f752e98013b9a, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.788184 15183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c48b19b0ac74d678c9f752e98013b9a" member_type: VOTER }
I20260709 13:02:02.788648 15183 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:02.788897 15183 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:02.789175 15183 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.793473 15183 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c48b19b0ac74d678c9f752e98013b9a" member_type: VOTER }
I20260709 13:02:02.794055 15183 leader_election.cc:304] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c48b19b0ac74d678c9f752e98013b9a; no voters: 
I20260709 13:02:02.795212 15183 leader_election.cc:290] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:02.795590 15186 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:02.796943 15186 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 1 LEADER]: Becoming Leader. State: Replica: 6c48b19b0ac74d678c9f752e98013b9a, State: Running, Role: LEADER
I20260709 13:02:02.797571 15186 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c48b19b0ac74d678c9f752e98013b9a" member_type: VOTER }
I20260709 13:02:02.798221 15183 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:02.802537 15187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c48b19b0ac74d678c9f752e98013b9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c48b19b0ac74d678c9f752e98013b9a" member_type: VOTER } }
I20260709 13:02:02.802822 15188 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c48b19b0ac74d678c9f752e98013b9a. Latest consensus state: current_term: 1 leader_uuid: "6c48b19b0ac74d678c9f752e98013b9a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c48b19b0ac74d678c9f752e98013b9a" member_type: VOTER } }
I20260709 13:02:02.803397 15187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:02.803869 15188 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:02.806630 15193 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:02.811805 15193 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:02.819917 14139 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:02.821835 15193 catalog_manager.cc:1383] Generated new cluster ID: c52418344aa84e918a50a38be64f9e4f
I20260709 13:02:02.822088 15193 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:02.848848 15193 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:02.850106 15193 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:02.867880 15193 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Generated new TSK 0
I20260709 13:02:02.868508 15193 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:02.886628 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:02.892421 15204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:02.893659 15205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:02.895391 15207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:02.895531 14139 server_base.cc:1061] running on GCE node
I20260709 13:02:02.896587 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:02.896782 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:02.896910 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602122896898 us; error 0 us; skew 500 ppm
I20260709 13:02:02.897384 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:02.899746 14139 webserver.cc:533] Webserver started at http://127.13.206.193:43629/ using document root <none> and password file <none>
I20260709 13:02:02.900310 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:02.900537 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:02.900823 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:02.901937 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/instance:
uuid: "89940175e5444593aab6b3a025624b5b"
format_stamp: "Formatted at 2026-07-09 13:02:02 on dist-test-slave-ml7r"
I20260709 13:02:02.906724 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:02:02.910321 15212 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:02.911115 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:02.911482 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root
uuid: "89940175e5444593aab6b3a025624b5b"
format_stamp: "Formatted at 2026-07-09 13:02:02 on dist-test-slave-ml7r"
I20260709 13:02:02.911806 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:02.928176 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:02.929481 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:02.931015 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:02.933418 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:02.933641 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:02.933902 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:02.934099 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:02.975978 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.193:43213
I20260709 13:02:02.976087 15274 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.193:43213 every 8 connection(s)
I20260709 13:02:02.980938 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:02.987947 15279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:02.988302 15280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:02.991803 15282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:02.992605 14139 server_base.cc:1061] running on GCE node
I20260709 13:02:02.993672 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:02.993878 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:02.994282 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602122994261 us; error 0 us; skew 500 ppm
I20260709 13:02:02.995015 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:02.997146 15275 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45539
I20260709 13:02:02.997509 15275 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:02.998289 14139 webserver.cc:533] Webserver started at http://127.13.206.194:36813/ using document root <none> and password file <none>
I20260709 13:02:02.998299 15275 heartbeater.cc:507] Master 127.13.206.254:45539 requested a full tablet report, sending...
I20260709 13:02:02.998943 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:02.999163 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:02.999476 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:03.000670 15148 ts_manager.cc:194] Registered new tserver with Master: 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:03.000710 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/instance:
uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
format_stamp: "Formatted at 2026-07-09 13:02:02 on dist-test-slave-ml7r"
I20260709 13:02:03.002630 15148 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49174
I20260709 13:02:03.005702 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:03.009135 15287 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:03.010010 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:03.010404 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root
uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
format_stamp: "Formatted at 2026-07-09 13:02:02 on dist-test-slave-ml7r"
I20260709 13:02:03.010725 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:03.026473 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:03.027675 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:03.029141 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:03.031522 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:03.031754 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:03.032008 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:03.032177 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:03.072232 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.194:34635
I20260709 13:02:03.072340 15349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.194:34635 every 8 connection(s)
I20260709 13:02:03.076891 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:03.084028 15353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:03.086011 15354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:03.089104 14139 server_base.cc:1061] running on GCE node
W20260709 13:02:03.089653 15357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:03.090221 15350 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45539
I20260709 13:02:03.090685 15350 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:03.090734 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:03.091049 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:03.091225 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602123091193 us; error 0 us; skew 500 ppm
I20260709 13:02:03.091612 15350 heartbeater.cc:507] Master 127.13.206.254:45539 requested a full tablet report, sending...
I20260709 13:02:03.091826 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:03.093885 15148 ts_manager.cc:194] Registered new tserver with Master: 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:03.095350 15148 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49180
I20260709 13:02:03.096292 14139 webserver.cc:533] Webserver started at http://127.13.206.195:34951/ using document root <none> and password file <none>
I20260709 13:02:03.096946 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:03.097208 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:03.097563 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:03.098886 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/instance:
uuid: "ee9654803379434388de45d4693e6b16"
format_stamp: "Formatted at 2026-07-09 13:02:03 on dist-test-slave-ml7r"
I20260709 13:02:03.103472 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:03.106827 15361 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:03.107621 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 13:02:03.107975 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root
uuid: "ee9654803379434388de45d4693e6b16"
format_stamp: "Formatted at 2026-07-09 13:02:03 on dist-test-slave-ml7r"
I20260709 13:02:03.108251 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:03.129186 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:03.130475 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:03.132002 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:03.134393 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:03.134645 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:03.134905 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:03.135082 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:03.175153 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.195:44417
I20260709 13:02:03.175242 15423 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.195:44417 every 8 connection(s)
I20260709 13:02:03.189144 15424 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45539
I20260709 13:02:03.189559 15424 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:03.190332 15424 heartbeater.cc:507] Master 127.13.206.254:45539 requested a full tablet report, sending...
I20260709 13:02:03.192390 15148 ts_manager.cc:194] Registered new tserver with Master: ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:03.193053 14139 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014564807s
I20260709 13:02:03.193976 15148 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49186
I20260709 13:02:03.220345 15148 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49194:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:03.227252 15148 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:03.430208 15240 tablet_service.cc:1511] Processing CreateTablet for tablet 5704803490ae4e7bb7f8229734bd20df (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:03.431789 15240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5704803490ae4e7bb7f8229734bd20df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.433355 15235 tablet_service.cc:1511] Processing CreateTablet for tablet 4fca62166204465d888036a111b60b66 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:03.434953 15235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fca62166204465d888036a111b60b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.434863 15237 tablet_service.cc:1511] Processing CreateTablet for tablet 705321025dc74b199219f4e541a68efa (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:03.436368 15237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705321025dc74b199219f4e541a68efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.436745 15310 tablet_service.cc:1511] Processing CreateTablet for tablet 4fca62166204465d888036a111b60b66 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:03.439431 15314 tablet_service.cc:1511] Processing CreateTablet for tablet abeddff35e5145ef927db00bd12f7cff (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:03.440660 15239 tablet_service.cc:1511] Processing CreateTablet for tablet abeddff35e5145ef927db00bd12f7cff (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:03.441175 15309 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6ca66a81d04e56bccbc22cab55f4de (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:03.442085 15239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abeddff35e5145ef927db00bd12f7cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.442409 15313 tablet_service.cc:1511] Processing CreateTablet for tablet 525e3bab033946a090787fa86d1292aa (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:03.444660 15312 tablet_service.cc:1511] Processing CreateTablet for tablet 705321025dc74b199219f4e541a68efa (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:03.447096 15311 tablet_service.cc:1511] Processing CreateTablet for tablet 13d6106766cf4009837f848b4f8cbb1f (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:03.449465 15234 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6ca66a81d04e56bccbc22cab55f4de (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:03.449540 15232 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:03.451052 15234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6ca66a81d04e56bccbc22cab55f4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.450874 15389 tablet_service.cc:1511] Processing CreateTablet for tablet 5704803490ae4e7bb7f8229734bd20df (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:03.452250 15389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5704803490ae4e7bb7f8229734bd20df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.453861 15307 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:03.456123 15233 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4a8d6a569c4998877fabab1b180c59 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:03.457413 15231 tablet_service.cc:1511] Processing CreateTablet for tablet 87a9a9eccfa9436c993e85bfe0343332 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:03.458185 15308 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4a8d6a569c4998877fabab1b180c59 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:03.459729 15388 tablet_service.cc:1511] Processing CreateTablet for tablet abeddff35e5145ef927db00bd12f7cff (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:03.460424 15306 tablet_service.cc:1511] Processing CreateTablet for tablet 87a9a9eccfa9436c993e85bfe0343332 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:03.461082 15388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abeddff35e5145ef927db00bd12f7cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.433355 15236 tablet_service.cc:1511] Processing CreateTablet for tablet 13d6106766cf4009837f848b4f8cbb1f (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:03.439431 15238 tablet_service.cc:1511] Processing CreateTablet for tablet 525e3bab033946a090787fa86d1292aa (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:03.434940 15315 tablet_service.cc:1511] Processing CreateTablet for tablet 5704803490ae4e7bb7f8229734bd20df (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:03.467568 15231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a9a9eccfa9436c993e85bfe0343332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.438094 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fca62166204465d888036a111b60b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.468451 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6ca66a81d04e56bccbc22cab55f4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.470572 15311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d6106766cf4009837f848b4f8cbb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.470851 15236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d6106766cf4009837f848b4f8cbb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.471174 15312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705321025dc74b199219f4e541a68efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.474090 15238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525e3bab033946a090787fa86d1292aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.474571 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.475502 15233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4a8d6a569c4998877fabab1b180c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.477878 15232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.478688 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a9a9eccfa9436c993e85bfe0343332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.482625 15313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525e3bab033946a090787fa86d1292aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.486656 15315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5704803490ae4e7bb7f8229734bd20df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.490638 15314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abeddff35e5145ef927db00bd12f7cff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.494549 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4a8d6a569c4998877fabab1b180c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.498504 15387 tablet_service.cc:1511] Processing CreateTablet for tablet 525e3bab033946a090787fa86d1292aa (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:03.499925 15387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 525e3bab033946a090787fa86d1292aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.507484 15386 tablet_service.cc:1511] Processing CreateTablet for tablet 705321025dc74b199219f4e541a68efa (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:03.508980 15386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705321025dc74b199219f4e541a68efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.527937 15385 tablet_service.cc:1511] Processing CreateTablet for tablet 13d6106766cf4009837f848b4f8cbb1f (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:03.529466 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d6106766cf4009837f848b4f8cbb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.543453 15384 tablet_service.cc:1511] Processing CreateTablet for tablet 4fca62166204465d888036a111b60b66 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:03.545014 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fca62166204465d888036a111b60b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.559894 15383 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6ca66a81d04e56bccbc22cab55f4de (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:03.561401 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6ca66a81d04e56bccbc22cab55f4de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.569169 15237 tablet_service.cc:1511] Processing CreateTablet for tablet 4143f8a30ca74db8afb568dd88a99bc0 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:03.571679 15382 tablet_service.cc:1511] Processing CreateTablet for tablet 3b4a8d6a569c4998877fabab1b180c59 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:03.573181 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4a8d6a569c4998877fabab1b180c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.575798 15381 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:03.577391 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.579929 15380 tablet_service.cc:1511] Processing CreateTablet for tablet 87a9a9eccfa9436c993e85bfe0343332 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:03.581369 15439 tablet_bootstrap.cc:492] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:03.581475 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a9a9eccfa9436c993e85bfe0343332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.586038 15231 tablet_service.cc:1511] Processing CreateTablet for tablet 521a10ac7e184bf1978bbe6947d0ca8d (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:03.587489 15231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521a10ac7e184bf1978bbe6947d0ca8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.592176 15239 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac2109e25f8401baf7141ea474e8bc4 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:03.593650 15239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac2109e25f8401baf7141ea474e8bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.604171 15232 tablet_service.cc:1511] Processing CreateTablet for tablet 88815123db2d4b648ca4b8cc3257aa37 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:03.605621 15232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88815123db2d4b648ca4b8cc3257aa37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.606597 15237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4143f8a30ca74db8afb568dd88a99bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.615931 15233 tablet_service.cc:1511] Processing CreateTablet for tablet f3f21223b98c4cc6b8699008b5c6edc8 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:03.612218 15382 tablet_service.cc:1511] Processing CreateTablet for tablet 521a10ac7e184bf1978bbe6947d0ca8d (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:03.617283 15233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f21223b98c4cc6b8699008b5c6edc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.617865 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521a10ac7e184bf1978bbe6947d0ca8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.619408 15236 tablet_service.cc:1511] Processing CreateTablet for tablet a6d786e7c4904b39b63a5862d5a7e6f4 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:03.620757 15236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d786e7c4904b39b63a5862d5a7e6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.623430 15238 tablet_service.cc:1511] Processing CreateTablet for tablet 68e68ea4eb05497288804ad7aefb241e (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:03.624804 15238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e68ea4eb05497288804ad7aefb241e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.627086 15439 tablet_bootstrap.cc:654] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.627413 15234 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3be1966cf543b3b9832118d5f11aa2 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:03.628737 15234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3be1966cf543b3b9832118d5f11aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.629770 15384 tablet_service.cc:1511] Processing CreateTablet for tablet 4143f8a30ca74db8afb568dd88a99bc0 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:03.631247 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4143f8a30ca74db8afb568dd88a99bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.615823 15383 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac2109e25f8401baf7141ea474e8bc4 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:03.635946 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac2109e25f8401baf7141ea474e8bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.647468 15235 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3760e6bdc5424685fc319a53f0c819 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:03.650656 15381 tablet_service.cc:1511] Processing CreateTablet for tablet 88815123db2d4b648ca4b8cc3257aa37 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:03.658844 15440 tablet_bootstrap.cc:492] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:03.661585 15382 tablet_service.cc:1511] Processing CreateTablet for tablet a6d786e7c4904b39b63a5862d5a7e6f4 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:03.663296 15312 tablet_service.cc:1511] Processing CreateTablet for tablet 4143f8a30ca74db8afb568dd88a99bc0 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:03.664952 15312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4143f8a30ca74db8afb568dd88a99bc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.669001 15310 tablet_service.cc:1511] Processing CreateTablet for tablet 521a10ac7e184bf1978bbe6947d0ca8d (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:03.670454 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521a10ac7e184bf1978bbe6947d0ca8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.670063 15385 tablet_service.cc:1511] Processing CreateTablet for tablet 68e68ea4eb05497288804ad7aefb241e (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:03.657697 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88815123db2d4b648ca4b8cc3257aa37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.657078 15235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3760e6bdc5424685fc319a53f0c819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.693452 15311 tablet_service.cc:1511] Processing CreateTablet for tablet a6d786e7c4904b39b63a5862d5a7e6f4 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:03.694958 15311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d786e7c4904b39b63a5862d5a7e6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.697991 15386 tablet_service.cc:1511] Processing CreateTablet for tablet c377e25836b14680beed769c143a593c (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:03.698364 15313 tablet_service.cc:1511] Processing CreateTablet for tablet 88815123db2d4b648ca4b8cc3257aa37 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:03.678174 15389 tablet_service.cc:1511] Processing CreateTablet for tablet f72ca1a62ac74338a0ec5abd5a427bbf (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:03.699702 15313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88815123db2d4b648ca4b8cc3257aa37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.699134 15231 tablet_service.cc:1511] Processing CreateTablet for tablet c377e25836b14680beed769c143a593c (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:03.707070 15308 tablet_service.cc:1511] Processing CreateTablet for tablet 68e68ea4eb05497288804ad7aefb241e (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:03.708520 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e68ea4eb05497288804ad7aefb241e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.711165 15240 tablet_service.cc:1511] Processing CreateTablet for tablet f72ca1a62ac74338a0ec5abd5a427bbf (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:03.687614 15380 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3760e6bdc5424685fc319a53f0c819 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:03.686841 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d786e7c4904b39b63a5862d5a7e6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.711094 15237 tablet_service.cc:1511] Processing CreateTablet for tablet 99211c99c0ce4c1cb82fa7cea0ab410a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:03.729081 15440 tablet_bootstrap.cc:654] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.683351 15307 tablet_service.cc:1511] Processing CreateTablet for tablet f3f21223b98c4cc6b8699008b5c6edc8 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:03.733529 15387 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3be1966cf543b3b9832118d5f11aa2 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:03.734737 15441 tablet_bootstrap.cc:492] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:03.735371 15388 tablet_service.cc:1511] Processing CreateTablet for tablet f3f21223b98c4cc6b8699008b5c6edc8 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:03.735893 15240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72ca1a62ac74338a0ec5abd5a427bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.751776 15384 tablet_service.cc:1511] Processing CreateTablet for tablet 99211c99c0ce4c1cb82fa7cea0ab410a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:03.755640 15231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c377e25836b14680beed769c143a593c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.727332 15314 tablet_service.cc:1511] Processing CreateTablet for tablet 6b3be1966cf543b3b9832118d5f11aa2 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:03.751776 15309 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3760e6bdc5424685fc319a53f0c819 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:03.760286 15238 tablet_service.cc:1511] Processing CreateTablet for tablet a64e06dc30ff4dfebdb052a6f7228046 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:03.760879 15239 tablet_service.cc:1511] Processing CreateTablet for tablet f20d2caf56534c1ebcf23935582a5f03 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:03.740125 15306 tablet_service.cc:1511] Processing CreateTablet for tablet f72ca1a62ac74338a0ec5abd5a427bbf (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:03.740571 15439 tablet_bootstrap.cc:492] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:03.737658 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e68ea4eb05497288804ad7aefb241e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.769068 15439 ts_tablet_manager.cc:1403] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.188s	user 0.027s	sys 0.014s
I20260709 13:02:03.769274 15389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72ca1a62ac74338a0ec5abd5a427bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.713296 15315 tablet_service.cc:1511] Processing CreateTablet for tablet 7ac2109e25f8401baf7141ea474e8bc4 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:03.736945 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f21223b98c4cc6b8699008b5c6edc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.770116 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3760e6bdc5424685fc319a53f0c819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.773605 15388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f21223b98c4cc6b8699008b5c6edc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.775002 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72ca1a62ac74338a0ec5abd5a427bbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.778585 15315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac2109e25f8401baf7141ea474e8bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.779844 15314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3be1966cf543b3b9832118d5f11aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.781354 15387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3be1966cf543b3b9832118d5f11aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.779475 15439 raft_consensus.cc:359] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:03.783090 15439 raft_consensus.cc:385] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.783413 15439 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.784391 15439 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:03.785295 15386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c377e25836b14680beed769c143a593c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.785846 15237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99211c99c0ce4c1cb82fa7cea0ab410a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.786531 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3760e6bdc5424685fc319a53f0c819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.792136 15239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20d2caf56534c1ebcf23935582a5f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.779465 15236 tablet_service.cc:1511] Processing CreateTablet for tablet 79fb071c9f56456cade8cf3a14c85fc3 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:03.795156 15236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fb071c9f56456cade8cf3a14c85fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.806164 15308 tablet_service.cc:1511] Processing CreateTablet for tablet c377e25836b14680beed769c143a593c (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:03.797061 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99211c99c0ce4c1cb82fa7cea0ab410a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:03.815788 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:03.816076 15440 tablet_bootstrap.cc:492] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:03.816597 15440 ts_tablet_manager.cc:1403] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.158s	user 0.004s	sys 0.011s
I20260709 13:02:03.821671 15386 tablet_service.cc:1511] Processing CreateTablet for tablet f20d2caf56534c1ebcf23935582a5f03 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:03.829160 15233 tablet_service.cc:1511] Processing CreateTablet for tablet 2a96142637d944dd8747c019a86e4864 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:03.835860 15441 tablet_bootstrap.cc:654] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.847373 15383 tablet_service.cc:1511] Processing CreateTablet for tablet a64e06dc30ff4dfebdb052a6f7228046 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:03.863528 15234 tablet_service.cc:1511] Processing CreateTablet for tablet 49a44991403a4f8a851f90729c6ca783 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:03.864965 15386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20d2caf56534c1ebcf23935582a5f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.865643 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64e06dc30ff4dfebdb052a6f7228046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.866351 15311 tablet_service.cc:1511] Processing CreateTablet for tablet a64e06dc30ff4dfebdb052a6f7228046 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:03.867668 15311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64e06dc30ff4dfebdb052a6f7228046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.870349 15238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64e06dc30ff4dfebdb052a6f7228046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.871073 15233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a96142637d944dd8747c019a86e4864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.875015 15234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a44991403a4f8a851f90729c6ca783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.875497 15314 tablet_service.cc:1511] Processing CreateTablet for tablet f20d2caf56534c1ebcf23935582a5f03 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:03.876821 15314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20d2caf56534c1ebcf23935582a5f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.879902 15313 tablet_service.cc:1511] Processing CreateTablet for tablet 79fb071c9f56456cade8cf3a14c85fc3 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:03.881335 15313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fb071c9f56456cade8cf3a14c85fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.884850 15237 tablet_service.cc:1511] Processing CreateTablet for tablet de7f843f60914a58b8b7e5a4a5e2ea6a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:03.886198 15237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de7f843f60914a58b8b7e5a4a5e2ea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.861974 15382 tablet_service.cc:1511] Processing CreateTablet for tablet 79fb071c9f56456cade8cf3a14c85fc3 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:03.915443 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fb071c9f56456cade8cf3a14c85fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.923678 15440 raft_consensus.cc:359] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:03.924482 15440 raft_consensus.cc:385] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.924950 15440 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.925915 15440 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:03.926734 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c377e25836b14680beed769c143a593c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.928166 15306 tablet_service.cc:1511] Processing CreateTablet for tablet 2a96142637d944dd8747c019a86e4864 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:03.929903 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a96142637d944dd8747c019a86e4864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.935475 15383 tablet_service.cc:1511] Processing CreateTablet for tablet 2a96142637d944dd8747c019a86e4864 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:03.937107 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a96142637d944dd8747c019a86e4864. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.938539 15312 tablet_service.cc:1511] Processing CreateTablet for tablet 99211c99c0ce4c1cb82fa7cea0ab410a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:03.939993 15312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99211c99c0ce4c1cb82fa7cea0ab410a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.949846 15309 tablet_service.cc:1511] Processing CreateTablet for tablet 49a44991403a4f8a851f90729c6ca783 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:03.951475 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a44991403a4f8a851f90729c6ca783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.956799 15385 tablet_service.cc:1511] Processing CreateTablet for tablet 49a44991403a4f8a851f90729c6ca783 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:03.967427 15381 tablet_service.cc:1511] Processing CreateTablet for tablet de7f843f60914a58b8b7e5a4a5e2ea6a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:03.979275 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a44991403a4f8a851f90729c6ca783. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:03.985888 15439 ts_tablet_manager.cc:1434] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.216s	user 0.034s	sys 0.041s
I20260709 13:02:03.989995 15275 heartbeater.cc:499] Master 127.13.206.254:45539 was elected leader, sending a full tablet report...
I20260709 13:02:03.999496 15307 tablet_service.cc:1511] Processing CreateTablet for tablet f537e87ec99a4032a677e62627c567e2 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:04.001020 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f537e87ec99a4032a677e62627c567e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.007745 15424 heartbeater.cc:499] Master 127.13.206.254:45539 was elected leader, sending a full tablet report...
I20260709 13:02:04.009135 15386 tablet_service.cc:1511] Processing CreateTablet for tablet f537e87ec99a4032a677e62627c567e2 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:04.011338 15233 tablet_service.cc:1511] Processing CreateTablet for tablet f537e87ec99a4032a677e62627c567e2 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:04.012750 15233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f537e87ec99a4032a677e62627c567e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.013897 15439 tablet_bootstrap.cc:492] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:04.020107 15380 tablet_service.cc:1511] Processing CreateTablet for tablet 41098c861400432692b47f484ad4dd2d (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:04.032125 15440 ts_tablet_manager.cc:1434] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.215s	user 0.009s	sys 0.003s
I20260709 13:02:04.033214 15440 tablet_bootstrap.cc:492] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:04.029312 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de7f843f60914a58b8b7e5a4a5e2ea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.040364 15386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f537e87ec99a4032a677e62627c567e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.040524 15441 tablet_bootstrap.cc:492] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:04.041013 15441 ts_tablet_manager.cc:1403] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.307s	user 0.006s	sys 0.016s
I20260709 13:02:04.043958 15441 raft_consensus.cc:359] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.044754 15441 raft_consensus.cc:385] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.045080 15441 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.046089 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41098c861400432692b47f484ad4dd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.048111 15236 tablet_service.cc:1511] Processing CreateTablet for tablet fad3ad4002954af28c1eccdf62948088 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:04.049515 15236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad3ad4002954af28c1eccdf62948088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.055032 15440 tablet_bootstrap.cc:654] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.056072 15389 tablet_service.cc:1511] Processing CreateTablet for tablet 5db51018c5b04518b8cb7f3e5f2ca694 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:04.057418 15389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db51018c5b04518b8cb7f3e5f2ca694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.048153 15384 tablet_service.cc:1511] Processing CreateTablet for tablet fad3ad4002954af28c1eccdf62948088 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:04.060149 15232 tablet_service.cc:1511] Processing CreateTablet for tablet 5db51018c5b04518b8cb7f3e5f2ca694 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:04.061538 15232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db51018c5b04518b8cb7f3e5f2ca694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.063488 15306 tablet_service.cc:1511] Processing CreateTablet for tablet 4365018e298c4531b7d90e25d9d6d144 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:04.064966 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4365018e298c4531b7d90e25d9d6d144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.065223 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad3ad4002954af28c1eccdf62948088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.045887 15441 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.046115 15308 tablet_service.cc:1511] Processing CreateTablet for tablet 41098c861400432692b47f484ad4dd2d (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:04.069165 15234 tablet_service.cc:1511] Processing CreateTablet for tablet 41098c861400432692b47f484ad4dd2d (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:04.074183 15313 tablet_service.cc:1511] Processing CreateTablet for tablet de7f843f60914a58b8b7e5a4a5e2ea6a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:04.083063 15234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41098c861400432692b47f484ad4dd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.086755 15315 tablet_service.cc:1511] Processing CreateTablet for tablet 66ab819064aa4b6faba9dff78296aa66 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:04.087656 15309 tablet_service.cc:1511] Processing CreateTablet for tablet da67615b960b446d8df50fe1de2a0b3e (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:04.093888 15439 tablet_bootstrap.cc:654] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.049554 15311 tablet_service.cc:1511] Processing CreateTablet for tablet 5db51018c5b04518b8cb7f3e5f2ca694 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:04.098212 15350 heartbeater.cc:499] Master 127.13.206.254:45539 was elected leader, sending a full tablet report...
I20260709 13:02:04.102418 15314 tablet_service.cc:1511] Processing CreateTablet for tablet fad3ad4002954af28c1eccdf62948088 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:04.105257 15440 tablet_bootstrap.cc:492] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:04.105846 15440 ts_tablet_manager.cc:1403] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.000s
I20260709 13:02:04.077845 15238 tablet_service.cc:1511] Processing CreateTablet for tablet 4365018e298c4531b7d90e25d9d6d144 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:04.107933 15238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4365018e298c4531b7d90e25d9d6d144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.077967 15310 tablet_service.cc:1511] Processing CreateTablet for tablet d44715ddcb564012b7a6c6eedb94b8e2 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:04.082095 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41098c861400432692b47f484ad4dd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.109050 15440 raft_consensus.cc:359] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.109838 15440 raft_consensus.cc:385] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.110565 15313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de7f843f60914a58b8b7e5a4a5e2ea6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.112267 15314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fad3ad4002954af28c1eccdf62948088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.113013 15315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ab819064aa4b6faba9dff78296aa66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.115087 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44715ddcb564012b7a6c6eedb94b8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.116824 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da67615b960b446d8df50fe1de2a0b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.117568 15311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db51018c5b04518b8cb7f3e5f2ca694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.135836 15312 tablet_service.cc:1511] Processing CreateTablet for tablet 195ee90b7e844a81920e312f95fdda67 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:04.125191 15387 tablet_service.cc:1511] Processing CreateTablet for tablet 4365018e298c4531b7d90e25d9d6d144 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:04.110142 15440 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.137408 15440 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.137431 15387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4365018e298c4531b7d90e25d9d6d144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.151615 15240 tablet_service.cc:1511] Processing CreateTablet for tablet d44715ddcb564012b7a6c6eedb94b8e2 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:04.147377 15388 tablet_service.cc:1511] Processing CreateTablet for tablet d44715ddcb564012b7a6c6eedb94b8e2 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:04.149577 15382 tablet_service.cc:1511] Processing CreateTablet for tablet da67615b960b446d8df50fe1de2a0b3e (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:04.147488 15383 tablet_service.cc:1511] Processing CreateTablet for tablet 66ab819064aa4b6faba9dff78296aa66 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:04.160794 15388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44715ddcb564012b7a6c6eedb94b8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.164353 15231 tablet_service.cc:1511] Processing CreateTablet for tablet 66ab819064aa4b6faba9dff78296aa66 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:04.167235 15235 tablet_service.cc:1511] Processing CreateTablet for tablet da67615b960b446d8df50fe1de2a0b3e (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:04.171460 15440 ts_tablet_manager.cc:1434] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 13:02:04.172355 15312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195ee90b7e844a81920e312f95fdda67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.173164 15237 tablet_service.cc:1511] Processing CreateTablet for tablet 76857f06f24d4d9183e84f52d83bf070 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:04.175400 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ab819064aa4b6faba9dff78296aa66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.175276 15239 tablet_service.cc:1511] Processing CreateTablet for tablet b9e997bc5c2942178cde4c670df97100 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:04.175937 15233 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcb1955ebaf442cb75dba3471600141 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:04.153303 15240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d44715ddcb564012b7a6c6eedb94b8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.181764 15235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da67615b960b446d8df50fe1de2a0b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.182852 15239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e997bc5c2942178cde4c670df97100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.183604 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da67615b960b446d8df50fe1de2a0b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.183781 15440 tablet_bootstrap.cc:492] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:04.199342 15441 ts_tablet_manager.cc:1434] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.158s	user 0.012s	sys 0.005s
I20260709 13:02:04.200500 15441 tablet_bootstrap.cc:492] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:04.213620 15231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ab819064aa4b6faba9dff78296aa66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.216163 15237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76857f06f24d4d9183e84f52d83bf070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.209899 15380 tablet_service.cc:1511] Processing CreateTablet for tablet 195ee90b7e844a81920e312f95fdda67 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:04.216893 15233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcb1955ebaf442cb75dba3471600141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.217792 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195ee90b7e844a81920e312f95fdda67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.234920 15236 tablet_service.cc:1511] Processing CreateTablet for tablet 195ee90b7e844a81920e312f95fdda67 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:04.245908 15307 tablet_service.cc:1511] Processing CreateTablet for tablet 76857f06f24d4d9183e84f52d83bf070 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:04.247607 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76857f06f24d4d9183e84f52d83bf070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.231359 15444 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.254189 15444 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.256857 15444 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:04.245882 15450 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.257252 15315 tablet_service.cc:1511] Processing CreateTablet for tablet b9e997bc5c2942178cde4c670df97100 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:04.271286 15439 tablet_bootstrap.cc:492] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:04.272109 15439 ts_tablet_manager.cc:1403] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.258s	user 0.015s	sys 0.006s
I20260709 13:02:04.272735 15236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195ee90b7e844a81920e312f95fdda67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.273236 15445 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.292241 15306 tablet_service.cc:1511] Processing CreateTablet for tablet 1389463201b74b128d916816a1d7c24c (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:04.293601 15313 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcb1955ebaf442cb75dba3471600141 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:04.264765 15450 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.282718 15445 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.309067 15315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e997bc5c2942178cde4c670df97100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.323460 15450 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:04.322748 15389 tablet_service.cc:1511] Processing CreateTablet for tablet 76857f06f24d4d9183e84f52d83bf070 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:04.350915 15313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcb1955ebaf442cb75dba3471600141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.364300 15389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76857f06f24d4d9183e84f52d83bf070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.364581 15234 tablet_service.cc:1511] Processing CreateTablet for tablet 1389463201b74b128d916816a1d7c24c (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:04.365931 15234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1389463201b74b128d916816a1d7c24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.368120 15309 tablet_service.cc:1511] Processing CreateTablet for tablet e82f23e062ad47fe80fac622dd633649 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:04.333254 15310 tablet_service.cc:1511] Processing CreateTablet for tablet 4342f068b244466e9d599b81fd154374 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:04.388938 15441 tablet_bootstrap.cc:654] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.406780 15386 tablet_service.cc:1511] Processing CreateTablet for tablet b9e997bc5c2942178cde4c670df97100 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:04.408319 15386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e997bc5c2942178cde4c670df97100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.414572 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82f23e062ad47fe80fac622dd633649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.415324 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1389463201b74b128d916816a1d7c24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.378580 15232 tablet_service.cc:1511] Processing CreateTablet for tablet 4342f068b244466e9d599b81fd154374 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:04.420818 15232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4342f068b244466e9d599b81fd154374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.441046 15314 tablet_service.cc:1511] Processing CreateTablet for tablet e5288c8dc0fe4b7aabc37377e0bc0371 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:04.444064 15308 tablet_service.cc:1511] Processing CreateTablet for tablet c0024621f21043e889d114f180f1dccb (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:04.446525 15388 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcb1955ebaf442cb75dba3471600141 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:04.448910 15384 tablet_service.cc:1511] Processing CreateTablet for tablet 4342f068b244466e9d599b81fd154374 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:04.449646 15440 tablet_bootstrap.cc:654] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.450413 15310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4342f068b244466e9d599b81fd154374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.458698 15439 raft_consensus.cc:359] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.466684 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0024621f21043e889d114f180f1dccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.466979 15439 raft_consensus.cc:385] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.467345 15439 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.467442 15385 tablet_service.cc:1511] Processing CreateTablet for tablet 1389463201b74b128d916816a1d7c24c (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:04.468719 15240 tablet_service.cc:1511] Processing CreateTablet for tablet e82f23e062ad47fe80fac622dd633649 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:04.454599 15445 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:04.481985 15439 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.471459 15388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcb1955ebaf442cb75dba3471600141. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.485502 15445 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.488336 15314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5288c8dc0fe4b7aabc37377e0bc0371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.495877 15239 tablet_service.cc:1511] Processing CreateTablet for tablet e5288c8dc0fe4b7aabc37377e0bc0371 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:04.501663 15238 tablet_service.cc:1511] Processing CreateTablet for tablet c0024621f21043e889d114f180f1dccb (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:04.512482 15440 tablet_bootstrap.cc:492] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:04.512890 15312 tablet_service.cc:1511] Processing CreateTablet for tablet ceb4d1b87e1c4966839d620a8aeaaf6a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:04.514848 15381 tablet_service.cc:1511] Processing CreateTablet for tablet e82f23e062ad47fe80fac622dd633649 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:04.512989 15440 ts_tablet_manager.cc:1403] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.329s	user 0.013s	sys 0.006s
I20260709 13:02:04.509598 15240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82f23e062ad47fe80fac622dd633649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.508694 15445 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.535712 15445 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:04.536271 15439 ts_tablet_manager.cc:1434] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.264s	user 0.011s	sys 0.001s
I20260709 13:02:04.536732 15312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceb4d1b87e1c4966839d620a8aeaaf6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.546646 15311 tablet_service.cc:1511] Processing CreateTablet for tablet 907f0d82d81845029df5f0613caae65c (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:04.548144 15311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907f0d82d81845029df5f0613caae65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.556633 15387 tablet_service.cc:1511] Processing CreateTablet for tablet e5288c8dc0fe4b7aabc37377e0bc0371 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:04.531617 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4342f068b244466e9d599b81fd154374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.584234 15383 tablet_service.cc:1511] Processing CreateTablet for tablet c0024621f21043e889d114f180f1dccb (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:04.591439 15383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0024621f21043e889d114f180f1dccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.592969 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82f23e062ad47fe80fac622dd633649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.595069 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1389463201b74b128d916816a1d7c24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.600013 15313 tablet_service.cc:1511] Processing CreateTablet for tablet 529df4c4ec9d4e33b83b594284860b0f (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:04.600014 15306 tablet_service.cc:1511] Processing CreateTablet for tablet 6183201d0cfc47c68ab021f085302aab (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:04.604521 15306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6183201d0cfc47c68ab021f085302aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.605885 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:04.607779 15215 leader_election.cc:343] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.619819 15387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5288c8dc0fe4b7aabc37377e0bc0371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.619983 15389 tablet_service.cc:1511] Processing CreateTablet for tablet 907f0d82d81845029df5f0613caae65c (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:04.621419 15389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907f0d82d81845029df5f0613caae65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.591449 15440 raft_consensus.cc:359] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.622746 15440 raft_consensus.cc:385] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.623087 15440 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.623986 15440 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.625295 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:04.626623 15313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 529df4c4ec9d4e33b83b594284860b0f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:04.627077 15291 leader_election.cc:343] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.639726 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:04.642343 15213 leader_election.cc:343] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.642829 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:04.643986 15444 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.647310 15238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0024621f21043e889d114f180f1dccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.652222 15308 tablet_service.cc:1511] Processing CreateTablet for tablet b0387b757aa040099c98e877245b7bfd (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:04.657379 15233 tablet_service.cc:1511] Processing CreateTablet for tablet ceb4d1b87e1c4966839d620a8aeaaf6a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:04.658628 15440 ts_tablet_manager.cc:1434] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.127s	user 0.011s	sys 0.002s
I20260709 13:02:04.659246 15464 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.659730 15440 tablet_bootstrap.cc:492] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:04.659752 15464 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.660252 15380 tablet_service.cc:1511] Processing CreateTablet for tablet ceb4d1b87e1c4966839d620a8aeaaf6a (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:04.661614 15380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceb4d1b87e1c4966839d620a8aeaaf6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.662789 15464 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:04.657444 15237 tablet_service.cc:1511] Processing CreateTablet for tablet 6183201d0cfc47c68ab021f085302aab (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:04.664464 15237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6183201d0cfc47c68ab021f085302aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.664196 15231 tablet_service.cc:1511] Processing CreateTablet for tablet 529df4c4ec9d4e33b83b594284860b0f (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:04.652316 15235 tablet_service.cc:1511] Processing CreateTablet for tablet 907f0d82d81845029df5f0613caae65c (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:04.665470 15231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 529df4c4ec9d4e33b83b594284860b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.666327 15235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 907f0d82d81845029df5f0613caae65c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.666203 15307 tablet_service.cc:1511] Processing CreateTablet for tablet abb86a150e844b848bc103f128d39a82 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:04.666821 15315 tablet_service.cc:1511] Processing CreateTablet for tablet fd1b68b8eb8145ee8bd4d3629784110f (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:04.672504 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:04.672909 15233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceb4d1b87e1c4966839d620a8aeaaf6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.673991 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:04.675206 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:04.675570 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:04.675863 15399 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
W20260709 13:02:04.676218 15362 leader_election.cc:343] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.676301 15323 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
W20260709 13:02:04.677032 15362 leader_election.cc:343] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.678197 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:04.678261 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:04.681077 15450 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.681509 15450 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.681867 15450 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.678515 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:04.679291 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:04.689208 15464 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.681160 15308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0387b757aa040099c98e877245b7bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.689636 15464 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.690039 15464 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.690625 15439 tablet_bootstrap.cc:492] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:04.691462 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb86a150e844b848bc103f128d39a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.695768 15315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1b68b8eb8145ee8bd4d3629784110f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.705845 15439 tablet_bootstrap.cc:654] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.709849 15441 tablet_bootstrap.cc:492] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:04.710484 15441 ts_tablet_manager.cc:1403] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.510s	user 0.019s	sys 0.011s
I20260709 13:02:04.711439 15311 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6884fe16f4431a8b08af8e659ece9e (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:04.712839 15311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6884fe16f4431a8b08af8e659ece9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.715701 15236 tablet_service.cc:1511] Processing CreateTablet for tablet fd1b68b8eb8145ee8bd4d3629784110f (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:04.716245 15386 tablet_service.cc:1511] Processing CreateTablet for tablet 529df4c4ec9d4e33b83b594284860b0f (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:04.717243 15236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1b68b8eb8145ee8bd4d3629784110f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.717798 15386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 529df4c4ec9d4e33b83b594284860b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.720789 15441 raft_consensus.cc:359] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.721557 15441 raft_consensus.cc:385] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.721843 15441 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.721716 15234 tablet_service.cc:1511] Processing CreateTablet for tablet b0387b757aa040099c98e877245b7bfd (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:04.725570 15381 tablet_service.cc:1511] Processing CreateTablet for tablet 6183201d0cfc47c68ab021f085302aab (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:04.726616 15239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5288c8dc0fe4b7aabc37377e0bc0371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.727253 15382 tablet_service.cc:1511] Processing CreateTablet for tablet b0387b757aa040099c98e877245b7bfd (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:04.728587 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0387b757aa040099c98e877245b7bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.737452 15450 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:04.742889 15365 leader_election.cc:343] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.743441 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:04.748211 15309 tablet_service.cc:1511] Processing CreateTablet for tablet a9161d42f4f04ce8a5234d5b1cfeab22 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:04.749656 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9161d42f4f04ce8a5234d5b1cfeab22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.750442 15234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0387b757aa040099c98e877245b7bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.758155 15445 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.761385 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:04.762195 15441 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.771791 15240 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6884fe16f4431a8b08af8e659ece9e (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:04.772324 15312 tablet_service.cc:1511] Processing CreateTablet for tablet e71ec5b3198446c0a387428e2a4eb753 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:04.774369 15312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e71ec5b3198446c0a387428e2a4eb753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.774731 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6183201d0cfc47c68ab021f085302aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.781823 15384 tablet_service.cc:1511] Processing CreateTablet for tablet a9161d42f4f04ce8a5234d5b1cfeab22 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:04.783404 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9161d42f4f04ce8a5234d5b1cfeab22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.791405 15240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6884fe16f4431a8b08af8e659ece9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.749825 15388 tablet_service.cc:1511] Processing CreateTablet for tablet abb86a150e844b848bc103f128d39a82 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:04.792831 15388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb86a150e844b848bc103f128d39a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.741914 15389 tablet_service.cc:1511] Processing CreateTablet for tablet fd1b68b8eb8145ee8bd4d3629784110f (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:04.795100 15389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd1b68b8eb8145ee8bd4d3629784110f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.766129 15231 tablet_service.cc:1511] Processing CreateTablet for tablet abb86a150e844b848bc103f128d39a82 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:04.797947 15231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb86a150e844b848bc103f128d39a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.799575 15238 tablet_service.cc:1511] Processing CreateTablet for tablet a9161d42f4f04ce8a5234d5b1cfeab22 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:04.800967 15238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9161d42f4f04ce8a5234d5b1cfeab22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.797950 15235 tablet_service.cc:1511] Processing CreateTablet for tablet e71ec5b3198446c0a387428e2a4eb753 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:04.803321 15235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e71ec5b3198446c0a387428e2a4eb753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.808568 15441 ts_tablet_manager.cc:1434] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.002s
I20260709 13:02:04.811862 15464 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:04.824245 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:04.830438 15450 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:04.830651 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:04.817010 15232 tablet_service.cc:1511] Processing CreateTablet for tablet 92362862adca4227bb6dad04afd638cc (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:04.821125 15314 tablet_service.cc:1511] Processing CreateTablet for tablet 92362862adca4227bb6dad04afd638cc (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:02:04.833025 15291 leader_election.cc:343] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.839023 15232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92362862adca4227bb6dad04afd638cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.834502 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:04.840510 15323 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:04.839023 15314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92362862adca4227bb6dad04afd638cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.848672 15444 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.849325 15444 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.858554 15441 tablet_bootstrap.cc:492] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:04.864910 15440 tablet_bootstrap.cc:654] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.861418 15237 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe8125185eb4429a9a0a58b14dd8636 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:04.779452 15385 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6884fe16f4431a8b08af8e659ece9e (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:04.866782 15237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe8125185eb4429a9a0a58b14dd8636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.867975 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6884fe16f4431a8b08af8e659ece9e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:04.842589 15365 leader_election.cc:343] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.870596 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:04.871687 15445 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.884516 15441 tablet_bootstrap.cc:654] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:04.899968 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 68275.3us
I20260709 13:02:04.900277 15309 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe8125185eb4429a9a0a58b14dd8636 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:04.845830 15464 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:04.901093 15365 leader_election.cc:343] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.901705 15309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe8125185eb4429a9a0a58b14dd8636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.910559 15444 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:04.912416 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:04.913151 15323 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:04.914091 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:04.916298 15215 leader_election.cc:343] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.919009 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:04.930358 15444 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.930784 15444 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.931144 15444 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.941459 15444 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.944222 15439 tablet_bootstrap.cc:492] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:04.944777 15439 ts_tablet_manager.cc:1403] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.265s	user 0.019s	sys 0.006s
I20260709 13:02:04.947963 15439 raft_consensus.cc:359] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.948712 15439 raft_consensus.cc:385] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.949028 15439 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.949905 15439 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.954659 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:04.957063 15388 tablet_service.cc:1511] Processing CreateTablet for tablet 2fe8125185eb4429a9a0a58b14dd8636 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:04.958317 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:04.959159 15399 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:04.958519 15388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fe8125185eb4429a9a0a58b14dd8636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.959781 15381 tablet_service.cc:1511] Processing CreateTablet for tablet 92362862adca4227bb6dad04afd638cc (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:04.961158 15381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92362862adca4227bb6dad04afd638cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.961966 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:04.963716 15466 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.964110 15441 tablet_bootstrap.cc:492] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:04.964586 15441 ts_tablet_manager.cc:1403] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.002s
I20260709 13:02:04.965515 15382 tablet_service.cc:1511] Processing CreateTablet for tablet e71ec5b3198446c0a387428e2a4eb753 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:04.966907 15382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e71ec5b3198446c0a387428e2a4eb753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.968259 15307 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f2b48b18a47388a0e1497a84803ff (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:04.969574 15307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f2b48b18a47388a0e1497a84803ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.947389 15236 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f2b48b18a47388a0e1497a84803ff (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:04.971160 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:04.971422 15236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f2b48b18a47388a0e1497a84803ff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:04.971845 15365 leader_election.cc:343] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.977816 15441 raft_consensus.cc:359] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.972951 15444 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:04.978601 15365 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:04.978579 15311 tablet_service.cc:1511] Processing CreateTablet for tablet b29a6f3425a941868726620486fe7013 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:04.978615 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:02:04.980330 15215 leader_election.cc:343] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.980692 15323 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.980167 15464 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.978652 15441 raft_consensus.cc:385] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.984138 15311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29a6f3425a941868726620486fe7013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.985136 15384 tablet_service.cc:1511] Processing CreateTablet for tablet 2d3f2b48b18a47388a0e1497a84803ff (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:04.988091 15439 ts_tablet_manager.cc:1434] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.004s
I20260709 13:02:04.995124 15384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f2b48b18a47388a0e1497a84803ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.986254 15441 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.004276 15441 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:04.996178 15232 tablet_service.cc:1511] Processing CreateTablet for tablet b29a6f3425a941868726620486fe7013 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:05.005930 15232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29a6f3425a941868726620486fe7013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:04.995241 15439 tablet_bootstrap.cc:492] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:04.996178 15385 tablet_service.cc:1511] Processing CreateTablet for tablet b29a6f3425a941868726620486fe7013 (DEFAULT_TABLE table=test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:04.989653 15440 tablet_bootstrap.cc:492] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.011066 15440 ts_tablet_manager.cc:1403] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.352s	user 0.022s	sys 0.025s
I20260709 13:02:05.006807 15441 ts_tablet_manager.cc:1434] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 13:02:04.992945 15323 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:05.014717 15440 raft_consensus.cc:359] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.015735 15440 raft_consensus.cc:385] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.016054 15440 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.016947 15440 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.019240 15440 ts_tablet_manager.cc:1434] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:05.020569 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:05.021886 15470 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.022442 15470 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:05.023252 15470 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.029366 15440 tablet_bootstrap.cc:492] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.030411 15385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29a6f3425a941868726620486fe7013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:05.037346 15440 tablet_bootstrap.cc:654] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.043535 15441 tablet_bootstrap.cc:492] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.059919 15439 tablet_bootstrap.cc:654] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.067338 15441 tablet_bootstrap.cc:654] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.086779 15146 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.094843 15441 tablet_bootstrap.cc:492] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.095412 15441 ts_tablet_manager.cc:1403] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.014s
I20260709 13:02:05.096239 15439 tablet_bootstrap.cc:492] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.096925 15439 ts_tablet_manager.cc:1403] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.014s
I20260709 13:02:05.100714 15439 raft_consensus.cc:359] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.100834 15441 raft_consensus.cc:359] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.101527 15439 raft_consensus.cc:385] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.101910 15441 raft_consensus.cc:385] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.101963 15439 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.102404 15440 tablet_bootstrap.cc:492] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.102573 15441 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.103055 15440 ts_tablet_manager.cc:1403] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.074s	user 0.004s	sys 0.015s
I20260709 13:02:05.103185 15439 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.103801 15441 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.105538 15439 ts_tablet_manager.cc:1434] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:05.106647 15439 tablet_bootstrap.cc:492] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:05.106549 15440 raft_consensus.cc:359] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.107481 15440 raft_consensus.cc:385] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.107901 15440 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.108805 15440 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.114342 15439 tablet_bootstrap.cc:654] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.112293 15441 ts_tablet_manager.cc:1434] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 13:02:05.117627 15441 tablet_bootstrap.cc:492] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.119669 15440 ts_tablet_manager.cc:1434] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:02:05.121079 15440 tablet_bootstrap.cc:492] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.124161 15441 tablet_bootstrap.cc:654] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.131157 15440 tablet_bootstrap.cc:654] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.131604 15439 tablet_bootstrap.cc:492] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.132102 15439 ts_tablet_manager.cc:1403] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.001s
I20260709 13:02:05.135663 15439 raft_consensus.cc:359] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.136693 15439 raft_consensus.cc:385] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.137084 15439 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.138432 15439 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.141369 15439 ts_tablet_manager.cc:1434] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:02:05.142472 15439 tablet_bootstrap.cc:492] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:05.143388 15440 tablet_bootstrap.cc:492] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.143898 15440 ts_tablet_manager.cc:1403] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:02:05.144976 15466 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.145507 15466 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.147217 15440 raft_consensus.cc:359] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.147734 15466 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.147972 15440 raft_consensus.cc:385] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.148324 15440 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.148829 15439 tablet_bootstrap.cc:654] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.148996 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.149194 15440 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.151207 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.151882 15399 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:05.152832 15441 tablet_bootstrap.cc:492] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.153400 15441 ts_tablet_manager.cc:1403] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.005s
W20260709 13:02:05.153791 15291 leader_election.cc:343] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.155741 15440 ts_tablet_manager.cc:1434] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:05.156656 15441 raft_consensus.cc:359] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.157196 15440 tablet_bootstrap.cc:492] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.157585 15441 raft_consensus.cc:385] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.157986 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:05.159240 15466 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.159619 15466 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.159943 15466 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.160301 15439 tablet_bootstrap.cc:492] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.160835 15439 ts_tablet_manager.cc:1403] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:02:05.164726 15464 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.157989 15441 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.165189 15464 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.166345 15441 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.167490 15464 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:05.163936 15439 raft_consensus.cc:359] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.168838 15441 ts_tablet_manager.cc:1434] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:02:05.169040 15439 raft_consensus.cc:385] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.168246 15466 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.169410 15439 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.169387 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.170810 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.170980 15439 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.171434 15466 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.164454 15440 tablet_bootstrap.cc:654] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.173915 15439 ts_tablet_manager.cc:1434] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:02:05.175313 15439 tablet_bootstrap.cc:492] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:05.178342 15441 tablet_bootstrap.cc:492] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
W20260709 13:02:05.173038 15362 leader_election.cc:343] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:05.179441 15365 leader_election.cc:343] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.175541 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:05.181736 15399 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.181794 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:05.182049 15439 tablet_bootstrap.cc:654] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.183280 15464 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.186375 15441 tablet_bootstrap.cc:654] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.186309 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:05.187938 15291 leader_election.cc:343] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.193394 15440 tablet_bootstrap.cc:492] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.193965 15440 ts_tablet_manager.cc:1403] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.003s
I20260709 13:02:05.193837 15399 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:05.195290 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:05.196447 15466 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.196938 15466 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:05.197295 15440 raft_consensus.cc:359] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.198036 15440 raft_consensus.cc:385] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.198369 15440 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.197742 15466 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.199229 15440 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.204294 15439 tablet_bootstrap.cc:492] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.204865 15439 ts_tablet_manager.cc:1403] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.000s
I20260709 13:02:05.205229 15440 ts_tablet_manager.cc:1434] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:05.206403 15440 tablet_bootstrap.cc:492] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.208096 15439 raft_consensus.cc:359] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.208900 15439 raft_consensus.cc:385] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.209227 15439 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.210162 15439 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.212769 15439 ts_tablet_manager.cc:1434] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:02:05.214303 15439 tablet_bootstrap.cc:492] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:05.214416 15440 tablet_bootstrap.cc:654] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.216784 15470 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.217324 15470 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.220803 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.221508 15399 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:05.223320 15439 tablet_bootstrap.cc:654] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.223471 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.224865 15470 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.226073 15440 tablet_bootstrap.cc:492] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.226584 15440 ts_tablet_manager.cc:1403] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:02:05.224809 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:05.227470 15441 tablet_bootstrap.cc:492] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
W20260709 13:02:05.227553 15213 leader_election.cc:343] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.228001 15441 ts_tablet_manager.cc:1403] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.012s
I20260709 13:02:05.229296 15440 raft_consensus.cc:359] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.229975 15440 raft_consensus.cc:385] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.230265 15440 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.231071 15440 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.231592 15441 raft_consensus.cc:359] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.232609 15441 raft_consensus.cc:385] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.232992 15441 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.234579 15470 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.235033 15470 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.235396 15470 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.239566 15440 ts_tablet_manager.cc:1434] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:05.240579 15440 tablet_bootstrap.cc:492] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.233994 15441 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.244148 15441 ts_tablet_manager.cc:1434] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:02:05.246595 15440 tablet_bootstrap.cc:654] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.245601 15441 tablet_bootstrap.cc:492] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.247486 15146 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.259866 15439 tablet_bootstrap.cc:492] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.260425 15439 ts_tablet_manager.cc:1403] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.046s	user 0.030s	sys 0.009s
I20260709 13:02:05.260689 15441 tablet_bootstrap.cc:654] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.263381 15439 raft_consensus.cc:359] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.264369 15439 raft_consensus.cc:385] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.264739 15439 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.265880 15439 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.269107 15439 ts_tablet_manager.cc:1434] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:05.270504 15439 tablet_bootstrap.cc:492] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:05.272235 15444 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.272931 15444 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.275918 15444 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.278306 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.279302 15399 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:05.281406 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:05.282639 15444 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.283010 15444 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.283313 15444 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.283927 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.285513 15464 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:05.285846 15213 leader_election.cc:343] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.285989 15464 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.287659 15439 tablet_bootstrap.cc:654] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.288097 15464 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:05.290774 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.291471 15323 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:05.292589 15362 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:05.293709 15464 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.294077 15464 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.294435 15464 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.302155 15470 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.304538 15444 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.305852 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:05.305888 15441 tablet_bootstrap.cc:492] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.307407 15441 ts_tablet_manager.cc:1403] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.023s
W20260709 13:02:05.307490 15213 leader_election.cc:343] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.310065 15441 raft_consensus.cc:359] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.310881 15441 raft_consensus.cc:385] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.311192 15441 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.311256 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:05.302155 15464 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:05.312924 15213 leader_election.cc:343] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.312554 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:05.313625 15399 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.314985 15470 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.315547 15470 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.316145 15440 tablet_bootstrap.cc:492] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.315975 15470 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.316694 15440 ts_tablet_manager.cc:1403] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.076s	user 0.026s	sys 0.021s
I20260709 13:02:05.318900 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.319550 15323 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:05.319679 15440 raft_consensus.cc:359] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.320504 15440 raft_consensus.cc:385] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.320876 15440 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.320909 15466 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.321828 15440 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.321784 15466 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.324285 15440 ts_tablet_manager.cc:1434] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:05.320106 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:05.325228 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:05.325596 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.325794 15466 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.325847 15323 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.325254 15398 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.312645 15441 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.330982 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.332057 15397 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:05.335757 15441 ts_tablet_manager.cc:1434] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.003s
I20260709 13:02:05.337975 15441 tablet_bootstrap.cc:492] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.333846 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:05.336184 15464 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:05.339322 15450 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.339808 15450 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.340253 15450 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.326279 15250 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:05.320957 15213 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:05.345141 15470 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.346429 15440 tablet_bootstrap.cc:492] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.350419 15439 tablet_bootstrap.cc:492] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.347878 15491 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.354365 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.354661 15491 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.355065 15440 tablet_bootstrap.cc:654] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.355317 15491 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.355819 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:05.348202 15398 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:05.347471 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.357683 15444 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.357893 15397 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:05.354354 15441 tablet_bootstrap.cc:654] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.352957 15399 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:05.358328 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:05.347412 15323 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:05.358762 15439 ts_tablet_manager.cc:1403] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.089s	user 0.023s	sys 0.028s
I20260709 13:02:05.360078 15362 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:05.366147 15491 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.363131 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:05.367682 15250 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:05.368137 15464 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.364154 15450 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.369117 15470 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.365196 15444 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.369197 15439 raft_consensus.cc:359] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.370081 15439 raft_consensus.cc:385] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.370460 15439 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.371208 15439 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.375954 15441 tablet_bootstrap.cc:492] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.376603 15441 ts_tablet_manager.cc:1403] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.006s
I20260709 13:02:05.378254 15450 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.378731 15440 tablet_bootstrap.cc:492] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.379149 15440 ts_tablet_manager.cc:1403] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.000s
I20260709 13:02:05.370175 15464 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:05.380262 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:05.380872 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:05.381119 15399 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.381422 15250 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.381060 15464 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.381791 15440 raft_consensus.cc:359] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.382472 15440 raft_consensus.cc:385] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.382771 15440 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.383525 15440 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.384752 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:05.385537 15491 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.385735 15440 ts_tablet_manager.cc:1434] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:05.385921 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:05.386508 15444 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:05.385557 15323 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:05.395360 15213 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:05.388487 15450 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.396706 15450 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.398775 15399 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:05.390367 15441 raft_consensus.cc:359] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.391448 15440 tablet_bootstrap.cc:492] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.399955 15441 raft_consensus.cc:385] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.400452 15441 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.400542 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.393265 15439 ts_tablet_manager.cc:1434] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:02:05.396245 15491 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.401547 15441 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.403064 15439 tablet_bootstrap.cc:492] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
W20260709 13:02:05.402194 15291 leader_election.cc:343] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.391745 15470 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:05.402979 15450 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.404731 15441 ts_tablet_manager.cc:1434] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:02:05.404543 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.405388 15444 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.408543 15440 tablet_bootstrap.cc:654] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.411108 15441 tablet_bootstrap.cc:492] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.399134 15250 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:05.411890 15397 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:05.416617 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:05.418030 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:05.420585 15439 tablet_bootstrap.cc:654] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.422535 15466 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.433746 15470 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.425247 15450 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.434696 15450 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.435063 15450 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.432587 15145 catalog_manager.cc:5697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.437826 15440 tablet_bootstrap.cc:492] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.443054 15440 ts_tablet_manager.cc:1403] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.007s
I20260709 13:02:05.443938 15466 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:05.443710 15450 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.449249 15440 raft_consensus.cc:359] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.450147 15440 raft_consensus.cc:385] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.450553 15440 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.451345 15440 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.453187 15440 ts_tablet_manager.cc:1434] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:02:05.453621 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:05.454077 15440 tablet_bootstrap.cc:492] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.454200 15399 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.453748 15466 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.455864 15441 tablet_bootstrap.cc:654] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.458782 15450 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.462044 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:05.463565 15291 leader_election.cc:343] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.466079 15439 tablet_bootstrap.cc:492] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.465884 15399 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:05.466674 15439 ts_tablet_manager.cc:1403] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.007s
I20260709 13:02:05.467587 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:05.469193 15450 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.469684 15440 tablet_bootstrap.cc:654] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.469774 15450 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:05.470849 15450 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.471412 15439 raft_consensus.cc:359] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.472095 15439 raft_consensus.cc:385] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.472388 15439 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.473044 15439 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.476655 15439 ts_tablet_manager.cc:1434] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:05.477561 15147 catalog_manager.cc:5697] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.485419 15440 tablet_bootstrap.cc:492] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.485939 15440 ts_tablet_manager.cc:1403] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.005s
I20260709 13:02:05.481496 15439 tablet_bootstrap.cc:492] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:05.490386 15470 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.491183 15470 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.495400 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.497763 15440 raft_consensus.cc:359] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.499154 15470 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.500926 15440 raft_consensus.cc:385] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.501310 15440 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
W20260709 13:02:05.501303 15213 leader_election.cc:343] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.502054 15440 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.503739 15439 tablet_bootstrap.cc:654] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.504256 15440 ts_tablet_manager.cc:1434] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:02:05.500712 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.505539 15399 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:05.506803 15215 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:05.507951 15470 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.508320 15470 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.508658 15470 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.511067 15145 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.514808 15440 tablet_bootstrap.cc:492] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.518424 15399 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.521364 15146 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.529569 15470 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.535656 15444 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.536736 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:02:05.538261 15213 leader_election.cc:343] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.540571 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:05.541391 15398 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.549854 15441 tablet_bootstrap.cc:492] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.550408 15441 ts_tablet_manager.cc:1403] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.139s	user 0.035s	sys 0.026s
I20260709 13:02:05.550310 15470 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.553369 15398 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:05.554409 15441 raft_consensus.cc:359] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.555114 15441 raft_consensus.cc:385] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.555060 15215 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:05.555614 15441 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.556478 15441 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.556017 15147 catalog_manager.cc:5697] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.556859 15470 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.558607 15441 ts_tablet_manager.cc:1434] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:05.534183 15440 tablet_bootstrap.cc:654] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.559521 15441 tablet_bootstrap.cc:492] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.559818 15470 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:05.560838 15470 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.561935 15439 tablet_bootstrap.cc:492] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.564096 15439 ts_tablet_manager.cc:1403] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.013s
I20260709 13:02:05.568015 15441 tablet_bootstrap.cc:654] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.586889 15439 raft_consensus.cc:359] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.587366 15444 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.587877 15439 raft_consensus.cc:385] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.588292 15439 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.591476 15439 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.598453 15439 ts_tablet_manager.cc:1434] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 13:02:05.599586 15439 tablet_bootstrap.cc:492] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:05.600440 15440 tablet_bootstrap.cc:492] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.601161 15440 ts_tablet_manager.cc:1403] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.020s
I20260709 13:02:05.604938 15440 raft_consensus.cc:359] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.605880 15440 raft_consensus.cc:385] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.607363 15439 tablet_bootstrap.cc:654] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.612277 15145 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.606164 15440 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.617599 15440 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.619763 15440 ts_tablet_manager.cc:1434] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:02:05.620699 15440 tablet_bootstrap.cc:492] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.623693 15441 tablet_bootstrap.cc:492] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.624204 15441 ts_tablet_manager.cc:1403] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.007s
I20260709 13:02:05.624955 15466 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.625064 15501 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.625582 15450 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.625883 15501 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.626086 15450 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.628150 15450 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.625593 15466 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.630434 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.630525 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.631194 15249 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:05.632150 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.632953 15398 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:05.633769 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.634577 15399 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:05.635434 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.636055 15397 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:05.637163 15440 tablet_bootstrap.cc:654] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.637666 15290 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:05.638882 15518 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.639014 15441 raft_consensus.cc:359] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.639212 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:05.639777 15441 raft_consensus.cc:385] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.640065 15441 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.640107 15450 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.640544 15450 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.640633 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.640921 15450 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.640811 15441 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.628150 15501 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.643004 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:05.632298 15466 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.644296 15501 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.648264 15441 ts_tablet_manager.cc:1434] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:02:05.648609 15450 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.649641 15441 tablet_bootstrap.cc:492] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.654445 15439 tablet_bootstrap.cc:492] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.654929 15439 ts_tablet_manager.cc:1403] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.010s
I20260709 13:02:05.656545 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:05.657543 15397 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.658355 15501 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.659420 15439 raft_consensus.cc:359] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.659937 15439 raft_consensus.cc:385] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.660176 15439 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.660954 15444 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.660794 15439 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.661384 15444 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.663199 15439 ts_tablet_manager.cc:1434] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:05.663475 15444 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.652262 15450 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.666292 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.667078 15398 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:05.667909 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.668681 15324 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:05.669853 15439 tablet_bootstrap.cc:492] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:05.670019 15441 tablet_bootstrap.cc:654] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.673513 15213 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:05.674407 15440 tablet_bootstrap.cc:492] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.674603 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:05.674888 15440 ts_tablet_manager.cc:1403] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.004s
I20260709 13:02:05.675201 15470 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.675230 15249 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.675657 15501 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.677971 15440 raft_consensus.cc:359] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.678722 15440 raft_consensus.cc:385] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.679000 15440 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.679988 15440 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.683449 15440 ts_tablet_manager.cc:1434] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:05.688261 15249 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:05.690462 15444 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.690315 15397 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:05.691360 15440 tablet_bootstrap.cc:492] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.691071 15444 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.699213 15444 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.700281 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.700536 15470 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.701102 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:05.704174 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.705031 15397 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:05.706377 15215 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:05.707223 15470 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.708863 15518 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.710062 15520 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.714960 15520 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:05.715866 15520 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.721057 15441 tablet_bootstrap.cc:492] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.721195 15470 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.721655 15441 ts_tablet_manager.cc:1403] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.005s
I20260709 13:02:05.724854 15249 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.726511 15439 tablet_bootstrap.cc:654] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.727223 15440 tablet_bootstrap.cc:654] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.734983 15441 raft_consensus.cc:359] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.735807 15441 raft_consensus.cc:385] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.736116 15441 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.736990 15441 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.739620 15441 ts_tablet_manager.cc:1434] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:02:05.739804 15520 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.740517 15441 tablet_bootstrap.cc:492] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.742405 15147 catalog_manager.cc:5697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.744375 15439 tablet_bootstrap.cc:492] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.744869 15439 ts_tablet_manager.cc:1403] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.004s
I20260709 13:02:05.747746 15439 raft_consensus.cc:359] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.748399 15441 tablet_bootstrap.cc:654] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.748435 15439 raft_consensus.cc:385] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.750725 15439 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.751101 15440 tablet_bootstrap.cc:492] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.751578 15440 ts_tablet_manager.cc:1403] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.005s
I20260709 13:02:05.753229 15439 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.754333 15440 raft_consensus.cc:359] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.755025 15440 raft_consensus.cc:385] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.755298 15440 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.756093 15440 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.757215 15439 ts_tablet_manager.cc:1434] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 13:02:05.759181 15439 tablet_bootstrap.cc:492] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:05.765836 15470 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.766397 15470 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.767055 15439 tablet_bootstrap.cc:654] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.768363 15441 tablet_bootstrap.cc:492] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.768841 15441 ts_tablet_manager.cc:1403] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.003s
I20260709 13:02:05.770057 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.770057 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.771593 15441 raft_consensus.cc:359] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.772357 15441 raft_consensus.cc:385] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.772215 15398 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:05.778307 15441 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
W20260709 13:02:05.773548 15213 leader_election.cc:343] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.770112 15470 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.779076 15441 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.779824 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:05.780872 15441 ts_tablet_manager.cc:1434] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:02:05.774988 15440 ts_tablet_manager.cc:1434] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:02:05.780951 15470 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.781415 15470 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.781817 15470 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.784201 15441 tablet_bootstrap.cc:492] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.787253 15440 tablet_bootstrap.cc:492] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.789232 15470 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.791703 15441 tablet_bootstrap.cc:654] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.792421 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:05.793108 15323 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.795961 15440 tablet_bootstrap.cc:654] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.800771 15323 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:05.802124 15213 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:05.803064 15444 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.803574 15444 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:05.804469 15444 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.807533 15440 tablet_bootstrap.cc:492] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.808145 15440 ts_tablet_manager.cc:1403] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 13:02:05.811630 15440 raft_consensus.cc:359] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.812736 15440 raft_consensus.cc:385] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.813444 15470 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.814672 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:05.815271 15398 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.815629 15439 tablet_bootstrap.cc:492] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.816248 15439 ts_tablet_manager.cc:1403] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.009s
I20260709 13:02:05.819834 15439 raft_consensus.cc:359] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.820791 15439 raft_consensus.cc:385] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.821157 15439 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.822081 15439 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.825074 15441 tablet_bootstrap.cc:492] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.825563 15441 ts_tablet_manager.cc:1403] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.015s
I20260709 13:02:05.825760 15439 ts_tablet_manager.cc:1434] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:05.813120 15440 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.826877 15440 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.828274 15441 raft_consensus.cc:359] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.828939 15441 raft_consensus.cc:385] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.829233 15441 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.828786 15146 catalog_manager.cc:5697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:05.829896 15441 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.822072 15398 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:05.833292 15440 ts_tablet_manager.cc:1434] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:02:05.834304 15440 tablet_bootstrap.cc:492] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.837881 15441 ts_tablet_manager.cc:1434] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:02:05.841084 15439 tablet_bootstrap.cc:492] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
W20260709 13:02:05.842324 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:05.843003 15441 tablet_bootstrap.cc:492] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.846393 15464 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.846978 15464 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.849224 15464 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:05.850196 15441 tablet_bootstrap.cc:654] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.851117 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:05.852265 15365 leader_election.cc:343] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.855042 15441 tablet_bootstrap.cc:492] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.855434 15439 tablet_bootstrap.cc:654] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.855540 15441 ts_tablet_manager.cc:1403] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:02:05.858305 15440 tablet_bootstrap.cc:654] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.858140 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.858379 15441 raft_consensus.cc:359] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.859135 15441 raft_consensus.cc:385] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.859445 15441 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
W20260709 13:02:05.859647 15362 leader_election.cc:343] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.860294 15362 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:05.861220 15464 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.861742 15445 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.860256 15441 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.862334 15445 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.863919 15439 tablet_bootstrap.cc:492] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.864414 15439 ts_tablet_manager.cc:1403] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.001s
I20260709 13:02:05.864454 15441 ts_tablet_manager.cc:1434] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:05.865541 15441 tablet_bootstrap.cc:492] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:05.867229 15439 raft_consensus.cc:359] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.867964 15439 raft_consensus.cc:385] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.868237 15439 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.869243 15439 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.871953 15441 tablet_bootstrap.cc:654] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.873214 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.873945 15249 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:05.874907 15445 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:05.876605 15439 ts_tablet_manager.cc:1434] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:02:05.877974 15439 tablet_bootstrap.cc:492] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:05.879027 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:05.880631 15362 leader_election.cc:343] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.881412 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:05.882751 15445 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.883157 15445 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.883490 15445 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.887270 15520 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.887776 15520 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.888912 15464 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.889923 15520 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.893245 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.896492 15440 tablet_bootstrap.cc:492] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:05.896965 15250 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:05.896982 15440 ts_tablet_manager.cc:1403] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.063s	user 0.018s	sys 0.002s
I20260709 13:02:05.898859 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:05.900547 15464 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.905310 15445 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.908455 15440 raft_consensus.cc:359] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.910064 15440 raft_consensus.cc:385] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.910466 15440 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.900314 15520 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.913749 15440 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.914729 15520 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.915539 15520 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.915450 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.916145 15398 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:05.917629 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:05.918509 15250 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.921605 15520 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.924712 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:05.925390 15248 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.926019 15439 tablet_bootstrap.cc:654] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.929024 15501 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.931260 15440 ts_tablet_manager.cc:1434] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:02:05.934376 15501 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.934981 15439 tablet_bootstrap.cc:492] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:05.935436 15439 ts_tablet_manager.cc:1403] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.058s	user 0.003s	sys 0.009s
I20260709 13:02:05.936439 15248 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:05.936058 15520 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.929626 15441 tablet_bootstrap.cc:492] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:05.938941 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:05.951100 15501 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.951679 15501 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:05.952292 15518 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.952536 15501 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.938198 15439 raft_consensus.cc:359] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.941440 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:05.958590 15439 raft_consensus.cc:385] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.958925 15439 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.959012 15399 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.959591 15439 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.960287 15519 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.960559 15518 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.960763 15519 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.961637 15439 ts_tablet_manager.cc:1434] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:02:05.963368 15519 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.964635 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:05.966338 15444 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.941982 15464 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.969749 15464 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.975260 15464 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:05.943749 15440 tablet_bootstrap.cc:492] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:05.990733 15444 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.991566 15444 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:05.995349 15444 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:05.996408 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:05.941445 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:05.998064 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:05.998036 15444 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:05.998062 15213 leader_election.cc:343] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.946593 15250 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:05.999146 15396 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:05.942754 15445 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:05.943424 15441 ts_tablet_manager.cc:1403] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.011s
I20260709 13:02:06.004528 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:06.005865 15470 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.006315 15470 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.006678 15470 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:06.012732 15362 leader_election.cc:343] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.013789 15439 tablet_bootstrap.cc:492] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:06.015309 15440 tablet_bootstrap.cc:654] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.017351 15441 raft_consensus.cc:359] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.019708 15399 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:06.025851 15441 raft_consensus.cc:385] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.027344 15441 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.028210 15441 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.047811 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:06.050324 15441 ts_tablet_manager.cc:1434] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:02:06.053225 15495 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.057778 15441 tablet_bootstrap.cc:492] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:06.057101 15470 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:06.073613 15362 leader_election.cc:343] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.078838 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:06.071717 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 123124us
I20260709 13:02:06.094960 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:06.096995 15146 catalog_manager.cc:5697] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:06.080670 15397 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.108008 15439 tablet_bootstrap.cc:654] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.081013 15470 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.120723 15441 tablet_bootstrap.cc:654] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.134565 15501 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.137348 15501 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.163458 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:06.172505 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:06.172731 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:06.165092 15450 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.174311 15450 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.173240 15395 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:02:06.175506 15291 leader_election.cc:343] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.192276 15441 tablet_bootstrap.cc:492] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:06.184348 15501 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:06.175637 15365 leader_election.cc:343] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.193015 15441 ts_tablet_manager.cc:1403] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.135s	user 0.024s	sys 0.001s
I20260709 13:02:06.176704 15464 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.176443 15450 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.200027 15501 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.176355 15397 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:06.206610 15551 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.204331 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:06.196364 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:06.201108 15501 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.207857 15464 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:06.219475 15555 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:02:06.220085 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:06.221026 15555 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.215613 15445 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.221521 15555 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:06.215449 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:06.222465 15555 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.231480 15519 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:02:06.229084 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53475.7us
I20260709 13:02:06.212030 15551 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.238612 15551 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.227483 15556 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.251446 15556 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.255836 15439 tablet_bootstrap.cc:492] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:06.256218 15439 ts_tablet_manager.cc:1403] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.244s	user 0.029s	sys 0.036s
I20260709 13:02:06.249114 15323 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.263082 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:06.265945 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:06.267771 15440 tablet_bootstrap.cc:492] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:06.268122 15440 ts_tablet_manager.cc:1403] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.325s	user 0.022s	sys 0.004s
I20260709 13:02:06.260771 15290 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:02:06.274367 15213 leader_election.cc:343] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.274506 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:06.274577 15466 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.275283 15322 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:06.273384 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:06.278439 15542 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.264097 15249 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:06.248253 15464 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.281212 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:06.281153 15441 raft_consensus.cc:359] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.281111 15542 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.282437 15248 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
W20260709 13:02:06.287851 15215 leader_election.cc:343] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.288872 15441 raft_consensus.cc:385] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.289789 15501 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.289228 15441 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.289791 15394 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:06.288770 15291 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:06.296692 15441 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.303486 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:06.304252 15248 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:06.304232 15556 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.388801 15441 ts_tablet_manager.cc:1434] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.193s	user 0.003s	sys 0.003s
I20260709 13:02:06.418474 15519 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.428457 15519 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.429083 15441 tablet_bootstrap.cc:492] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:06.431411 15519 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.434114 15520 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.365768 15213 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:06.435225 15556 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:06.435359 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 129445us
I20260709 13:02:06.435659 15556 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.436092 15556 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.427764 15440 raft_consensus.cc:359] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.437242 15440 raft_consensus.cc:385] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.437536 15440 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.437885 15441 tablet_bootstrap.cc:654] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.438300 15440 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:06.320581 15290 leader_election.cc:343] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.439811 15440 ts_tablet_manager.cc:1434] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.171s	user 0.007s	sys 0.000s
I20260709 13:02:06.439757 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:06.316998 15542 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:06.440791 15440 tablet_bootstrap.cc:492] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:06.309168 15501 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.440964 15520 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.441493 15501 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.441869 15501 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.445834 15291 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:06.447716 15555 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.449635 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:06.305598 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:06.306434 15444 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.144s
I20260709 13:02:06.453976 15439 raft_consensus.cc:359] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.454957 15439 raft_consensus.cc:385] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.455310 15439 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.447755 15520 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.457917 15520 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.458988 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:06.459450 15520 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.459530 15394 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:06.460909 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:06.458259 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 134043us
I20260709 13:02:06.463156 15560 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.468441 15560 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.468869 15560 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.467846 15439 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.463577 15551 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:06.464284 15291 leader_election.cc:343] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.465745 15148 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:06.472219 15441 tablet_bootstrap.cc:492] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:06.470849 15555 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.472738 15441 ts_tablet_manager.cc:1403] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 13:02:06.472941 15555 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.477376 15555 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.481477 15439 ts_tablet_manager.cc:1434] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.225s	user 0.019s	sys 0.021s
I20260709 13:02:06.482522 15439 tablet_bootstrap.cc:492] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:06.481019 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:06.479575 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:06.485540 15215 leader_election.cc:343] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.487877 15441 raft_consensus.cc:359] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.488600 15441 raft_consensus.cc:385] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.488878 15441 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.489521 15441 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.493288 15556 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.494328 15555 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.505345 15146 catalog_manager.cc:5697] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:06.528935 15440 tablet_bootstrap.cc:654] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.533589 15441 ts_tablet_manager.cc:1434] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 13:02:06.513761 15501 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.538188 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:06.522861 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:06.538550 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:06.545473 15542 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.545908 15542 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.546218 15542 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:06.551818 15290 leader_election.cc:343] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.552551 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:06.553742 15290 leader_election.cc:343] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.554289 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:06.555025 15519 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.557966 15518 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.559535 15466 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.549980 15560 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.563548 15441 tablet_bootstrap.cc:492] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
W20260709 13:02:06.566145 15213 leader_election.cc:343] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.541765 15520 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.566685 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:06.566954 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:06.568081 15520 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.569027 15501 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.569154 15323 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:06.569504 15555 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.558153 15556 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.571688 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:06.579281 15439 tablet_bootstrap.cc:654] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.572189 15560 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.582355 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:06.583529 15247 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:06.584719 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:06.589573 15249 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:06.585211 15542 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.572463 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:06.592840 15542 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:06.593295 15321 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:06.596520 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:06.597301 15323 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:06.598088 15399 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:02:06.599434 15215 leader_election.cc:343] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.601042 15213 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:06.602134 15555 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.614866 15441 tablet_bootstrap.cc:654] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.606467 15213 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:06.618754 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:06.622040 15323 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:06.625396 15555 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.625660 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:06.634030 15250 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:06.634941 15439 tablet_bootstrap.cc:492] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:06.635938 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:06.636420 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:06.635438 15439 ts_tablet_manager.cc:1403] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.153s	user 0.008s	sys 0.011s
W20260709 13:02:06.638974 15290 leader_election.cc:343] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.639357 15464 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.639473 15290 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:06.640892 15519 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.631196 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:06.647045 15398 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:06.653282 15440 tablet_bootstrap.cc:492] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:06.653982 15440 ts_tablet_manager.cc:1403] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.213s	user 0.010s	sys 0.005s
I20260709 13:02:06.661376 15290 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:06.662637 15520 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.681536 15542 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.685093 15439 raft_consensus.cc:359] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.685838 15439 raft_consensus.cc:385] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.686121 15439 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.674940 15440 raft_consensus.cc:359] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.688342 15440 raft_consensus.cc:385] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.688620 15440 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.688874 15441 tablet_bootstrap.cc:492] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:06.689239 15441 ts_tablet_manager.cc:1403] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.126s	user 0.026s	sys 0.024s
I20260709 13:02:06.689731 15440 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.690711 15439 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.691789 15441 raft_consensus.cc:359] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.692464 15441 raft_consensus.cc:385] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.692732 15441 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.693343 15439 ts_tablet_manager.cc:1434] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.003s
I20260709 13:02:06.693596 15441 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.694393 15439 tablet_bootstrap.cc:492] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:06.695942 15441 ts_tablet_manager.cc:1434] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:06.696857 15441 tablet_bootstrap.cc:492] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:06.701114 15440 ts_tablet_manager.cc:1434] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:02:06.702126 15440 tablet_bootstrap.cc:492] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
W20260709 13:02:06.704191 15362 consensus_peers.cc:597] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:06.706048 15441 tablet_bootstrap.cc:654] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.708833 15440 tablet_bootstrap.cc:654] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.715302 15439 tablet_bootstrap.cc:654] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.732860 15439 tablet_bootstrap.cc:492] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:06.733361 15439 ts_tablet_manager.cc:1403] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.003s
I20260709 13:02:06.733446 15441 tablet_bootstrap.cc:492] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:06.733958 15441 ts_tablet_manager.cc:1403] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:02:06.734822 15440 tablet_bootstrap.cc:492] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:06.735261 15440 ts_tablet_manager.cc:1403] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.013s
I20260709 13:02:06.736146 15439 raft_consensus.cc:359] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.736861 15439 raft_consensus.cc:385] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.736536 15441 raft_consensus.cc:359] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.737119 15439 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.737207 15441 raft_consensus.cc:385] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.737546 15441 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.737872 15439 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.737808 15440 raft_consensus.cc:359] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.738339 15441 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.738956 15440 raft_consensus.cc:385] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.739243 15440 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.739986 15439 ts_tablet_manager.cc:1434] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:06.739872 15440 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.742314 15439 tablet_bootstrap.cc:492] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:06.743322 15441 ts_tablet_manager.cc:1434] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:06.744292 15441 tablet_bootstrap.cc:492] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:06.747609 15440 ts_tablet_manager.cc:1434] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:02:06.748778 15440 tablet_bootstrap.cc:492] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:06.749182 15439 tablet_bootstrap.cc:654] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.750087 15441 tablet_bootstrap.cc:654] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.761353 15441 tablet_bootstrap.cc:492] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:06.761821 15441 ts_tablet_manager.cc:1403] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.006s
I20260709 13:02:06.762955 15552 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.764753 15441 raft_consensus.cc:359] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.765266 15439 tablet_bootstrap.cc:492] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:06.765461 15441 raft_consensus.cc:385] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.765738 15439 ts_tablet_manager.cc:1403] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:02:06.765764 15441 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.766803 15441 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.768579 15439 raft_consensus.cc:359] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.769276 15439 raft_consensus.cc:385] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.769560 15439 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.769876 15441 ts_tablet_manager.cc:1434] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:06.770594 15440 tablet_bootstrap.cc:654] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.776289 15441 tablet_bootstrap.cc:492] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:06.770367 15439 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.780563 15439 ts_tablet_manager.cc:1434] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:02:06.784874 15441 tablet_bootstrap.cc:654] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.785065 15439 tablet_bootstrap.cc:492] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:06.788424 15323 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.791683 15439 tablet_bootstrap.cc:654] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.796875 15440 tablet_bootstrap.cc:492] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:06.797407 15440 ts_tablet_manager.cc:1403] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.004s
I20260709 13:02:06.798369 15551 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.799017 15551 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.800251 15440 raft_consensus.cc:359] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.800945 15440 raft_consensus.cc:385] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.801198 15440 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.801883 15440 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.804361 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:06.804874 15440 ts_tablet_manager.cc:1434] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:06.805787 15440 tablet_bootstrap.cc:492] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:06.806542 15501 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.807071 15501 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:06.809952 15213 leader_election.cc:343] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.811172 15501 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.811591 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:06.812790 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:06.813479 15394 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
W20260709 13:02:06.814112 15215 leader_election.cc:343] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.814816 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:06.815197 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:06.815752 15560 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.815804 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:06.818773 15291 leader_election.cc:343] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.819993 15440 tablet_bootstrap.cc:654] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.801884 15551 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.822597 15501 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.823179 15501 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.823637 15501 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.826666 15466 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.826865 15551 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:06.827327 15466 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.830683 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:06.831403 15250 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:06.832495 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:06.833288 15464 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.833868 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:06.833806 15464 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:06.834514 15290 leader_election.cc:343] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.834820 15520 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.835258 15520 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.835588 15520 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.836081 15464 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:06.837510 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:06.837749 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:06.838402 15324 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:06.830727 15466 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:06.839509 15365 leader_election.cc:343] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.840236 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:06.841681 15464 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.842128 15464 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.844348 15520 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.848608 15520 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.849548 15560 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.850136 15560 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.852743 15560 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.853137 15501 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.842594 15464 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.858176 15441 tablet_bootstrap.cc:492] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:06.858726 15441 ts_tablet_manager.cc:1403] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.026s
I20260709 13:02:06.861505 15441 raft_consensus.cc:359] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.862273 15441 raft_consensus.cc:385] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.862568 15441 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.863374 15441 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.864419 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:06.855577 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:06.865736 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:06.866078 15213 leader_election.cc:343] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.866483 15250 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.865780 15441 ts_tablet_manager.cc:1434] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:02:06.867491 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:06.867717 15441 tablet_bootstrap.cc:492] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
W20260709 13:02:06.870915 15290 leader_election.cc:343] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.866681 15398 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:06.882614 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:06.884904 15555 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.885481 15555 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:06.862015 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:06.885929 15555 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.888907 15445 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.890105 15445 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.891121 15501 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.892127 15250 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:06.893435 15441 tablet_bootstrap.cc:654] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.893944 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:06.894208 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:06.894676 15325 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:06.894807 15398 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.895188 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:06.896040 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:06.892071 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:06.896979 15542 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:06.897444 15542 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.897826 15542 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:06.898098 15291 leader_election.cc:343] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.898710 15445 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:06.899080 15501 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.899955 15501 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:06.900842 15501 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.901193 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:06.902441 15250 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:06.904637 15439 tablet_bootstrap.cc:492] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:06.905721 15440 tablet_bootstrap.cc:492] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:06.906104 15439 ts_tablet_manager.cc:1403] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.121s	user 0.048s	sys 0.019s
I20260709 13:02:06.909029 15439 raft_consensus.cc:359] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.906217 15440 ts_tablet_manager.cc:1403] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.101s	user 0.016s	sys 0.025s
I20260709 13:02:06.910012 15439 raft_consensus.cc:385] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.910446 15439 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.911330 15439 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.912020 15441 tablet_bootstrap.cc:492] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:06.912521 15441 ts_tablet_manager.cc:1403] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.045s	user 0.003s	sys 0.011s
I20260709 13:02:06.912850 15440 raft_consensus.cc:359] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.913517 15440 raft_consensus.cc:385] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.913790 15440 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.915305 15440 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.916633 15441 raft_consensus.cc:359] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.917322 15441 raft_consensus.cc:385] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.917593 15441 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.918218 15441 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.909198 15464 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.905339 15398 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:06.919732 15441 ts_tablet_manager.cc:1434] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:06.919726 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:06.920737 15441 tablet_bootstrap.cc:492] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:06.921284 15520 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.921792 15520 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:06.923225 15439 ts_tablet_manager.cc:1434] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:02:06.922837 15520 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.926801 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:06.928330 15365 leader_election.cc:343] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.929071 15542 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.933525 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:06.934206 15248 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.936087 15441 tablet_bootstrap.cc:654] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.937103 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:06.937739 15325 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:06.938450 15464 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:06.939160 15440 ts_tablet_manager.cc:1434] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.004s
I20260709 13:02:06.940464 15440 tablet_bootstrap.cc:492] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:06.943274 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:06.944025 15324 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.947388 15439 tablet_bootstrap.cc:492] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:06.948442 15440 tablet_bootstrap.cc:654] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.943379 15248 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:06.953609 15441 tablet_bootstrap.cc:492] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:06.954300 15441 ts_tablet_manager.cc:1403] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.003s
I20260709 13:02:06.955580 15365 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:06.956743 15464 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:06.957273 15464 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:06.933660 15555 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.957705 15441 raft_consensus.cc:359] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.958284 15464 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.961944 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:06.958485 15441 raft_consensus.cc:385] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.965061 15441 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
W20260709 13:02:06.965966 15213 leader_election.cc:343] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.966526 15441 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.960219 15325 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:06.962121 15324 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:06.962175 15542 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:06.968863 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:06.970546 15439 tablet_bootstrap.cc:654] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.971088 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:06.971804 15542 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.972023 15398 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.972530 15542 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:06.973428 15542 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.979641 15555 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:06.981212 15441 ts_tablet_manager.cc:1434] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:02:06.984195 15441 tablet_bootstrap.cc:492] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:06.985226 15440 tablet_bootstrap.cc:492] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:06.985711 15440 ts_tablet_manager.cc:1403] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.007s
I20260709 13:02:06.979558 15398 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:06.988245 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:06.989115 15440 raft_consensus.cc:359] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:06.989544 15560 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.989904 15440 raft_consensus.cc:385] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.990130 15560 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:06.990213 15441 tablet_bootstrap.cc:654] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.999119 15145 catalog_manager.cc:5697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:06.990264 15440 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.003744 15440 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.004789 15441 tablet_bootstrap.cc:492] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:07.005239 15441 ts_tablet_manager.cc:1403] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 13:02:06.991070 15560 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.006304 15440 ts_tablet_manager.cc:1434] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 13:02:07.007251 15440 tablet_bootstrap.cc:492] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:07.007987 15441 raft_consensus.cc:359] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.008661 15441 raft_consensus.cc:385] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.008912 15441 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.009744 15441 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.012296 15441 ts_tablet_manager.cc:1434] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:07.013187 15464 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.013330 15441 tablet_bootstrap.cc:492] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:07.013732 15464 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.014729 15440 tablet_bootstrap.cc:654] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.015928 15464 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:07.018972 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.019738 15441 tablet_bootstrap.cc:654] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:07.020948 15365 leader_election.cc:343] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.011969 15144 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 2, leader changed from <none> to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.022773 15144 catalog_manager.cc:5697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.026427 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.027132 15325 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:07.028333 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:07.029503 15464 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.029860 15464 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.030222 15464 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.034485 15501 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.035152 15501 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.039937 15501 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.040143 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:07.041723 15290 leader_election.cc:343] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.048337 15146 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.038862 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.051198 15250 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:07.052960 15291 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:07.054672 15501 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.055231 15501 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.055683 15501 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.038204 15145 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.063943 15464 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.070564 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:07.071925 15365 leader_election.cc:343] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.074261 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:07.074860 15325 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.078333 15560 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.078892 15560 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.081054 15560 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.082583 15325 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:07.083503 15464 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:07.085589 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:07.086104 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.086750 15464 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.087872 15464 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:07.088238 15466 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.088692 15466 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.088721 15464 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.091639 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:07.095191 15213 leader_election.cc:343] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:07.096508 15215 leader_election.cc:343] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.097163 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:07.099954 15555 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.104777 15466 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.107662 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.108598 15439 tablet_bootstrap.cc:492] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:07.109084 15439 ts_tablet_manager.cc:1403] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.162s	user 0.020s	sys 0.020s
W20260709 13:02:07.110250 15291 leader_election.cc:343] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.111980 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:07.112617 15394 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:07.112537 15439 raft_consensus.cc:359] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.113315 15439 raft_consensus.cc:385] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.113690 15439 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.114362 15439 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.115051 15440 tablet_bootstrap.cc:492] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:07.116050 15325 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.118177 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:07.119426 15520 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.119814 15520 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.120124 15520 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.121503 15542 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.121840 15440 ts_tablet_manager.cc:1403] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.003s
I20260709 13:02:07.121951 15542 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.124586 15440 raft_consensus.cc:359] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.125262 15440 raft_consensus.cc:385] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.125525 15440 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.125597 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.126398 15324 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:07.127831 15542 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:07.128049 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.128893 15250 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:07.130491 15439 ts_tablet_manager.cc:1434] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:02:07.130329 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:07.131466 15439 tablet_bootstrap.cc:492] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:07.131771 15542 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.135262 15501 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.139308 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:07.140153 15250 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.144140 15439 tablet_bootstrap.cc:654] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.151285 15440 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.154881 15146 catalog_manager.cc:5697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.164819 15440 ts_tablet_manager.cc:1434] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.002s
I20260709 13:02:07.165848 15440 tablet_bootstrap.cc:492] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:07.163060 15542 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.163763 15520 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.171783 15466 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.172312 15466 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.173111 15250 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:07.174365 15291 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:07.181372 15501 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.187042 15501 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.187608 15501 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:07.188503 15501 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.190982 15464 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.191499 15464 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.185276 15466 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.193578 15464 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:07.196913 15441 tablet_bootstrap.cc:492] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:07.197420 15441 ts_tablet_manager.cc:1403] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.184s	user 0.050s	sys 0.081s
I20260709 13:02:07.196856 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.204109 15248 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:07.204598 15520 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.212976 15441 raft_consensus.cc:359] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.211931 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:07.214133 15441 raft_consensus.cc:385] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.215188 15441 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.215993 15439 tablet_bootstrap.cc:492] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:07.216648 15439 ts_tablet_manager.cc:1403] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.010s
I20260709 13:02:07.217628 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:07.217895 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:07.218284 15398 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.218425 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:07.220059 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.215878 15441 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.220333 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.220719 15250 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:07.222131 15441 ts_tablet_manager.cc:1434] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:02:07.223066 15441 tablet_bootstrap.cc:492] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
W20260709 13:02:07.224165 15291 leader_election.cc:343] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.224092 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:07.219447 15439 raft_consensus.cc:359] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.224964 15291 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:07.225229 15439 raft_consensus.cc:385] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.225509 15439 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.225521 15464 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.226317 15439 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.228592 15439 ts_tablet_manager.cc:1434] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:02:07.229571 15439 tablet_bootstrap.cc:492] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:07.230792 15441 tablet_bootstrap.cc:654] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.236627 15439 tablet_bootstrap.cc:654] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.228726 15606 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.237416 15606 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.237767 15606 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.241771 15464 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.243101 15441 tablet_bootstrap.cc:492] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:07.243754 15441 ts_tablet_manager.cc:1403] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.008s
W20260709 13:02:07.244544 15290 leader_election.cc:343] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:07.246081 15290 leader_election.cc:343] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.246694 15440 tablet_bootstrap.cc:654] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.247529 15441 raft_consensus.cc:359] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.248476 15441 raft_consensus.cc:385] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.248838 15441 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.250370 15441 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.252137 15398 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:07.253340 15441 ts_tablet_manager.cc:1434] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:07.253436 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:07.254616 15607 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.254859 15441 tablet_bootstrap.cc:492] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:07.255079 15607 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:07.255930 15607 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.266940 15501 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.268039 15501 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.268613 15146 catalog_manager.cc:5697] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.270624 15501 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.271080 15606 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.272161 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:07.273372 15560 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.274219 15560 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.274806 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.275449 15250 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:07.276208 15441 tablet_bootstrap.cc:654] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.276412 15560 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.277067 15606 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.279132 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.279660 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:07.280018 15325 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:07.280687 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:07.281414 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:07.281656 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:07.282863 15560 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.283931 15250 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:07.282968 15290 leader_election.cc:343] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.285378 15439 tablet_bootstrap.cc:492] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:07.286033 15439 ts_tablet_manager.cc:1403] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.016s
I20260709 13:02:07.285362 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:07.292735 15440 tablet_bootstrap.cc:492] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:07.293246 15440 ts_tablet_manager.cc:1403] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.005s
I20260709 13:02:07.288272 15606 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.295269 15606 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.295653 15606 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.297096 15440 raft_consensus.cc:359] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.297863 15440 raft_consensus.cc:385] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.298151 15440 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
W20260709 13:02:07.298098 15290 leader_election.cc:343] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.299156 15440 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.300012 15439 raft_consensus.cc:359] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.300817 15439 raft_consensus.cc:385] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.301132 15439 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.301834 15439 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.302282 15440 ts_tablet_manager.cc:1434] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:02:07.303933 15439 ts_tablet_manager.cc:1434] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 13:02:07.305148 15439 tablet_bootstrap.cc:492] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:07.304970 15146 catalog_manager.cc:5697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.310516 15464 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.311072 15464 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.312044 15439 tablet_bootstrap.cc:654] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.312343 15441 tablet_bootstrap.cc:492] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:07.312803 15441 ts_tablet_manager.cc:1403] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.007s
I20260709 13:02:07.313129 15464 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:07.316581 15501 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.316694 15441 raft_consensus.cc:359] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.317739 15441 raft_consensus.cc:385] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.318152 15441 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.319252 15441 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.322499 15250 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:07.323740 15441 ts_tablet_manager.cc:1434] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:02:07.323523 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.323963 15291 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:07.324867 15441 tablet_bootstrap.cc:492] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:07.325519 15501 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.326367 15501 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:07.328125 15501 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.332284 15441 tablet_bootstrap.cc:654] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.332160 15607 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.325433 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.335182 15325 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:07.336853 15362 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:07.324743 15249 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:07.337787 15464 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.339147 15464 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.339507 15464 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.351460 15464 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.358042 15466 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.361385 15440 tablet_bootstrap.cc:492] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
W20260709 13:02:07.363525 15291 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:07.397650 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:07.398438 15325 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.395716 15464 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:07.368664 15560 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.405925 15440 tablet_bootstrap.cc:654] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.411062 15325 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:07.412138 15439 tablet_bootstrap.cc:492] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:07.412616 15439 ts_tablet_manager.cc:1403] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.108s	user 0.039s	sys 0.054s
I20260709 13:02:07.412449 15362 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:07.413442 15464 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.414182 15464 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:07.406605 15144 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.415156 15464 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.416366 15439 raft_consensus.cc:359] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.417080 15439 raft_consensus.cc:385] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.407249 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:07.418135 15439 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.418408 15250 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.418936 15439 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.421082 15439 ts_tablet_manager.cc:1434] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:02:07.422011 15439 tablet_bootstrap.cc:492] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:07.424747 15606 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.428426 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:07.429253 15439 tablet_bootstrap.cc:654] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:07.430342 15290 leader_election.cc:343] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.433297 15325 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:07.435245 15464 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.433151 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:07.438925 15249 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.440272 15250 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:07.441380 15439 tablet_bootstrap.cc:492] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:07.441851 15439 ts_tablet_manager.cc:1403] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:02:07.443054 15606 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.444974 15441 tablet_bootstrap.cc:492] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:07.444792 15439 raft_consensus.cc:359] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.445433 15441 ts_tablet_manager.cc:1403] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.026s
I20260709 13:02:07.445492 15439 raft_consensus.cc:385] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.445948 15439 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.446868 15439 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.448376 15441 raft_consensus.cc:359] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.449076 15441 raft_consensus.cc:385] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.449193 15439 ts_tablet_manager.cc:1434] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:07.449374 15441 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.450196 15439 tablet_bootstrap.cc:492] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:07.450177 15441 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.451589 15249 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:07.452701 15441 ts_tablet_manager.cc:1434] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:02:07.453362 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:07.453687 15441 tablet_bootstrap.cc:492] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:07.454162 15606 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.454675 15606 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:07.455557 15606 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.458316 15439 tablet_bootstrap.cc:654] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.469501 15439 tablet_bootstrap.cc:492] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:07.469985 15439 ts_tablet_manager.cc:1403] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:02:07.472886 15439 raft_consensus.cc:359] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.473656 15439 raft_consensus.cc:385] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.473928 15439 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.474388 15146 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.474915 15439 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.477813 15439 ts_tablet_manager.cc:1434] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:07.479049 15439 tablet_bootstrap.cc:492] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:07.480580 15440 tablet_bootstrap.cc:492] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:07.481060 15440 ts_tablet_manager.cc:1403] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.120s	user 0.004s	sys 0.011s
I20260709 13:02:07.483091 15441 tablet_bootstrap.cc:654] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.493559 15439 tablet_bootstrap.cc:654] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.495214 15145 catalog_manager.cc:5697] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.498553 15249 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.499751 15441 tablet_bootstrap.cc:492] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:07.500496 15441 ts_tablet_manager.cc:1403] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.008s
I20260709 13:02:07.504104 15441 raft_consensus.cc:359] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.504439 15552 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.504806 15441 raft_consensus.cc:385] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.505103 15441 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.505246 15439 tablet_bootstrap.cc:492] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:07.504956 15552 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.505692 15439 ts_tablet_manager.cc:1403] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.003s
I20260709 13:02:07.505949 15441 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.507380 15552 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.508433 15441 ts_tablet_manager.cc:1434] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:07.508898 15439 raft_consensus.cc:359] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.509394 15441 tablet_bootstrap.cc:492] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:07.509284 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:07.509542 15439 raft_consensus.cc:385] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.509982 15439 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.509968 15394 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:07.511523 15215 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:07.511584 15439 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.512676 15555 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.513036 15555 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.513394 15555 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.514019 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.514788 15324 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:07.516615 15464 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.520093 15441 tablet_bootstrap.cc:654] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.520870 15555 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.523283 15248 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:07.524957 15439 ts_tablet_manager.cc:1434] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:02:07.525347 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:07.525895 15324 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.526209 15439 tablet_bootstrap.cc:492] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:07.530349 15464 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.536482 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:07.537357 15394 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.537645 15324 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:07.540688 15542 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.487118 15440 raft_consensus.cc:359] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.542114 15440 raft_consensus.cc:385] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.542466 15440 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.543120 15440 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.547786 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:07.548221 15394 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:07.549435 15440 ts_tablet_manager.cc:1434] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 13:02:07.549981 15555 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.550421 15560 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.550980 15560 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:07.552121 15560 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.560930 15439 tablet_bootstrap.cc:654] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.563613 15501 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.564203 15501 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.567173 15555 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.573635 15501 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.583164 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.583367 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:07.585124 15323 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:07.587093 15290 leader_election.cc:343] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:07.594262 15291 leader_election.cc:343] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.594970 15291 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:07.601477 15606 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.607556 15555 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.643991 15439 tablet_bootstrap.cc:492] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:07.644654 15439 ts_tablet_manager.cc:1403] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.119s	user 0.008s	sys 0.006s
I20260709 13:02:07.651845 15439 raft_consensus.cc:359] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.652661 15439 raft_consensus.cc:385] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.653067 15439 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.658654 15439 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.662750 15439 ts_tablet_manager.cc:1434] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 13:02:07.663949 15501 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.550463 15440 tablet_bootstrap.cc:492] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:07.672593 15439 tablet_bootstrap.cc:492] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:07.678421 15501 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.683807 15440 tablet_bootstrap.cc:654] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.687820 15439 tablet_bootstrap.cc:654] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.688864 15441 tablet_bootstrap.cc:492] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:07.689544 15441 ts_tablet_manager.cc:1403] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.180s	user 0.065s	sys 0.088s
I20260709 13:02:07.693687 15441 raft_consensus.cc:359] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.694622 15441 raft_consensus.cc:385] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.694923 15441 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.695631 15441 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.697736 15441 ts_tablet_manager.cc:1434] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:02:07.698386 15439 tablet_bootstrap.cc:492] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:07.698673 15441 tablet_bootstrap.cc:492] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:07.698850 15439 ts_tablet_manager.cc:1403] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:02:07.706172 15441 tablet_bootstrap.cc:654] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.705982 15439 raft_consensus.cc:359] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.706696 15439 raft_consensus.cc:385] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.707010 15439 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.707104 15552 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.707677 15552 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.710857 15439 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:07.719000 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 157572us
I20260709 13:02:07.731880 15439 ts_tablet_manager.cc:1434] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:02:07.752605 15439 tablet_bootstrap.cc:492] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:07.714896 15552 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.759240 15552 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.771150 15440 tablet_bootstrap.cc:492] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:07.771611 15440 ts_tablet_manager.cc:1403] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.221s	user 0.011s	sys 0.025s
I20260709 13:02:07.769718 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:07.764614 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.778625 15441 tablet_bootstrap.cc:492] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:07.779104 15441 ts_tablet_manager.cc:1403] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.009s
I20260709 13:02:07.783465 15441 raft_consensus.cc:359] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:07.784523 15215 leader_election.cc:343] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.777669 15323 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:07.786036 15441 raft_consensus.cc:385] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.790390 15637 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.795287 15637 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.774708 15644 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.794014 15441 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.774394 15552 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.834457 15441 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.835258 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:07.835994 15441 ts_tablet_manager.cc:1434] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.007s
I20260709 13:02:07.848290 15560 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.834256 15644 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.853924 15560 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.853267 15441 tablet_bootstrap.cc:492] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:07.847970 15394 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.850162 15551 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.856191 15651 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.850294 15552 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.852021 15637 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:07.897385 15440 raft_consensus.cc:359] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.899693 15440 raft_consensus.cc:385] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.900331 15440 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.901584 15440 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.852124 15520 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 13:02:07.883113 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:07.887894 15551 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.906029 15249 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.916018 15146 catalog_manager.cc:5697] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.920890 15440 ts_tablet_manager.cc:1434] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.149s	user 0.007s	sys 0.002s
I20260709 13:02:07.921730 15440 tablet_bootstrap.cc:492] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:07.899711 15644 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:07.898078 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 63837.9us
W20260709 13:02:07.931394 15215 leader_election.cc:343] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.932945 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:07.933831 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.910936 15551 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.895692 15651 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.943060 15651 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.943562 15250 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.928913 15560 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:07.955561 15439 tablet_bootstrap.cc:654] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.960798 15501 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.961360 15501 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:07.964764 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.965462 15324 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:07.966586 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.969272 15644 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.971692 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:07.982458 15639 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:02:07.983824 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.986735 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:07.990797 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:07.980645 15555 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.994711 15555 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.001498 15466 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.003151 15213 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:08.005039 15655 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.005456 15655 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.005789 15655 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.017102 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:08.018816 15213 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:08.020087 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:08.021430 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:02:08.021729 15215 leader_election.cc:343] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.023945 15399 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.024163 15501 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.026360 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:08.011765 15555 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.027184 15644 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.028229 15644 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.031839 15607 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.020097 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:08.038185 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:08.040194 15551 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.030033 15655 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.048022 15441 tablet_bootstrap.cc:654] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.048411 15439 tablet_bootstrap.cc:492] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:08.049131 15439 ts_tablet_manager.cc:1403] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.297s	user 0.014s	sys 0.009s
I20260709 13:02:08.043974 15560 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.044234 15644 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.060638 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:08.065737 15653 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.051236 15655 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.071422 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:08.069240 15551 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.074700 15551 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.074860 15439 raft_consensus.cc:359] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.075492 15439 raft_consensus.cc:385] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.075783 15439 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.076651 15439 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:08.075747 15215 leader_election.cc:343] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.078831 15439 ts_tablet_manager.cc:1434] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:02:08.079988 15439 tablet_bootstrap.cc:492] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:08.069401 15639 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:02:08.086581 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:08.067317 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:08.088032 15440 tablet_bootstrap.cc:654] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.088719 15325 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:08.096210 15290 consensus_peers.cc:597] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:08.096613 15215 leader_election.cc:343] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.098501 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:08.105507 15617 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:02:08.104671 15322 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:08.109076 15213 leader_election.cc:343] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.109581 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:08.129281 15520 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.131012 15325 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:08.132839 15520 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.133066 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:08.133631 15520 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.134943 15322 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:08.144207 15520 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.144443 15551 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:08.153892 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44886.4us
I20260709 13:02:08.154150 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:08.156548 15213 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:08.156880 15653 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:08.159176 15655 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.159792 15655 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:08.158926 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:08.161201 15653 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.160887 15655 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.161731 15653 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:08.162657 15653 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:08.168286 15291 leader_election.cc:343] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.205497 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:08.222913 15441 tablet_bootstrap.cc:492] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:08.223656 15441 ts_tablet_manager.cc:1403] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.371s	user 0.032s	sys 0.025s
W20260709 13:02:08.242530 15290 leader_election.cc:343] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.243059 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:08.243842 15607 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.248611 15555 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.249117 15555 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.208407 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:08.265647 15291 leader_election.cc:343] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:08.273600 15662 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:02:08.279561 15439 tablet_bootstrap.cc:654] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:08.289167 15290 leader_election.cc:343] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.303025 15441 raft_consensus.cc:359] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.303798 15441 raft_consensus.cc:385] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.304091 15441 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.304729 15441 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.315764 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:08.321807 15441 ts_tablet_manager.cc:1434] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.098s	user 0.005s	sys 0.003s
I20260709 13:02:08.322939 15441 tablet_bootstrap.cc:492] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:08.324669 15638 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.326282 15638 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:08.331431 15213 leader_election.cc:343] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.324663 15654 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.333156 15654 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.317802 15555 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.337692 15654 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.358961 15644 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.359716 15644 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.374620 15644 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:08.374856 15441 tablet_bootstrap.cc:654] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.393021 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:08.393959 15396 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:08.395025 15440 tablet_bootstrap.cc:492] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:08.398125 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:08.399492 15607 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.401973 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:08.402859 15248 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:08.404902 15365 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:08.406378 15637 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.406736 15637 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.407060 15637 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.407356 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:08.409161 15552 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:08.409703 15552 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.410136 15552 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:08.417412 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:08.448274 15637 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.451066 15440 ts_tablet_manager.cc:1403] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.529s	user 0.033s	sys 0.022s
I20260709 13:02:08.451660 15399 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:08.456727 15638 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:08.456630 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:08.457469 15325 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:08.459491 15439 tablet_bootstrap.cc:492] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:08.460000 15439 ts_tablet_manager.cc:1403] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.380s	user 0.017s	sys 0.014s
W20260709 13:02:08.451849 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 171297us
I20260709 13:02:08.464041 15552 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.466739 15552 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.467005 15637 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:08.469246 15555 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.468580 15440 raft_consensus.cc:359] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.469727 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:08.470014 15440 raft_consensus.cc:385] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.470413 15325 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:08.470438 15440 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.471395 15440 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.473045 15440 ts_tablet_manager.cc:1434] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.004s
I20260709 13:02:08.474414 15215 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:08.474833 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:08.475268 15655 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.475551 15399 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:08.482193 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:08.476670 15440 tablet_bootstrap.cc:492] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:08.483263 15655 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.469726 15555 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.487202 15555 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.487149 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:08.487748 15247 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:08.487970 15323 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:08.484040 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:08.489486 15213 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:08.489827 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:08.490633 15397 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:08.492857 15145 catalog_manager.cc:5697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.494038 15145 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.495196 15654 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:08.495633 15654 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.496001 15654 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:08.498718 15440 tablet_bootstrap.cc:654] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.501443 15441 tablet_bootstrap.cc:492] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:08.501955 15441 ts_tablet_manager.cc:1403] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.005s
I20260709 13:02:08.502460 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:08.503245 15638 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:08.503724 15638 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.504173 15638 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:08.504648 15441 raft_consensus.cc:359] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.505375 15441 raft_consensus.cc:385] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.505656 15441 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.506353 15441 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.509801 15399 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:08.511430 15440 tablet_bootstrap.cc:492] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:08.514566 15440 ts_tablet_manager.cc:1403] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.004s
I20260709 13:02:08.517442 15441 ts_tablet_manager.cc:1434] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:02:08.518486 15441 tablet_bootstrap.cc:492] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:08.518493 15440 raft_consensus.cc:359] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.519280 15440 raft_consensus.cc:385] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.519569 15440 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.520321 15440 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.520648 15654 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.522761 15440 ts_tablet_manager.cc:1434] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:08.523730 15440 tablet_bootstrap.cc:492] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:08.523893 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:08.525278 15638 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.526979 15397 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:08.528132 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:08.538652 15440 tablet_bootstrap.cc:654] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.538293 15439 raft_consensus.cc:359] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.535554 15552 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:08.541165 15638 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:08.541302 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:08.500535 15325 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:08.542944 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:08.547046 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:08.547837 15439 raft_consensus.cc:385] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.556929 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:08.557341 15439 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.549786 15247 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:08.548936 15323 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:08.558118 15439 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.560240 15439 ts_tablet_manager.cc:1434] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.100s	user 0.005s	sys 0.002s
I20260709 13:02:08.561169 15439 tablet_bootstrap.cc:492] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:08.554642 15552 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:08.562556 15552 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.557143 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:08.549337 15654 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.551223 15245 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:08.570487 15365 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:08.572408 15638 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.573248 15441 tablet_bootstrap.cc:654] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.573117 15638 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:08.575276 15638 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.592711 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:08.589475 15323 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:08.601068 15213 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:08.613790 15440 tablet_bootstrap.cc:492] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:08.614399 15440 ts_tablet_manager.cc:1403] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.091s	user 0.018s	sys 0.021s
I20260709 13:02:08.614413 15654 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:08.614986 15654 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:08.615869 15654 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:08.617802 15362 leader_election.cc:343] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.618554 15440 raft_consensus.cc:359] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.619287 15440 raft_consensus.cc:385] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.619582 15440 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
W20260709 13:02:08.619714 15362 leader_election.cc:343] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.621096 15439 tablet_bootstrap.cc:654] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.620546 15440 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.624542 15607 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.627501 15440 ts_tablet_manager.cc:1434] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:02:08.628844 15440 tablet_bootstrap.cc:492] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:08.626381 15607 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.623724 15362 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:08.643509 15441 tablet_bootstrap.cc:492] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:08.644227 15441 ts_tablet_manager.cc:1403] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.126s	user 0.017s	sys 0.002s
I20260709 13:02:08.644341 15607 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.645365 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:08.646364 15639 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:08.646984 15291 leader_election.cc:343] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.647670 15639 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.648133 15639 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.657742 15637 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.658547 15637 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.658943 15639 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:08.660789 15637 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:08.662973 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:08.663672 15245 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:08.664722 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:08.668690 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:08.670403 15365 leader_election.cc:343] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.673283 15441 raft_consensus.cc:359] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.674288 15441 raft_consensus.cc:385] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.674634 15441 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.677573 15441 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.672412 15637 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.687454 15637 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.687841 15637 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.697387 15441 ts_tablet_manager.cc:1434] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:02:08.698648 15441 tablet_bootstrap.cc:492] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:08.692263 15552 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:02:08.713577 15440 tablet_bootstrap.cc:654] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:08.712780 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 63497.5us
W20260709 13:02:08.726063 15215 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.723894 15146 catalog_manager.cc:5697] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:08.736171 15145 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 2, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 2 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.738104 15145 catalog_manager.cc:5697] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 2, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 2 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:08.747747 15439 tablet_bootstrap.cc:492] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:08.751507 15654 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:08.755736 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:08.757416 15439 ts_tablet_manager.cc:1403] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.196s	user 0.040s	sys 0.036s
I20260709 13:02:08.761207 15439 raft_consensus.cc:359] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.762250 15439 raft_consensus.cc:385] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.762705 15439 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.763656 15439 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.714824 15637 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.766674 15439 ts_tablet_manager.cc:1434] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:02:08.775995 15439 tablet_bootstrap.cc:492] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:08.791378 15441 tablet_bootstrap.cc:654] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.791839 15440 tablet_bootstrap.cc:492] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:08.797791 15440 ts_tablet_manager.cc:1403] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.169s	user 0.017s	sys 0.012s
I20260709 13:02:08.797487 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:08.801405 15322 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:08.804946 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:08.805595 15250 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.807526 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:08.808291 15691 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.801827 15637 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:08.807600 15397 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.808801 15691 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:08.807792 15290 leader_election.cc:343] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.823486 15439 tablet_bootstrap.cc:654] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.816039 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:08.830526 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:08.831360 15520 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.831480 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:08.833308 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:08.844295 15654 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:08.839318 15520 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.847846 15520 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.848364 15520 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.853030 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:08.854430 15639 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:08.854808 15639 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:08.855136 15639 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:08.855623 15362 leader_election.cc:343] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.860528 15250 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:08.862062 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:08.870447 15607 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.871197 15607 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.875698 15607 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.876989 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:08.880323 15291 leader_election.cc:343] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.842325 15691 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.888680 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:08.893594 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:08.895079 15362 leader_election.cc:343] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.900466 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:08.902392 15440 raft_consensus.cc:359] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.904367 15439 tablet_bootstrap.cc:492] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:08.906056 15440 raft_consensus.cc:385] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:08.904836 15290 leader_election.cc:343] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.890688 15637 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.902164 15520 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.906191 15439 ts_tablet_manager.cc:1403] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.130s	user 0.044s	sys 0.031s
I20260709 13:02:08.906584 15441 tablet_bootstrap.cc:492] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:08.906464 15440 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.907742 15441 ts_tablet_manager.cc:1403] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.209s	user 0.035s	sys 0.009s
I20260709 13:02:08.908228 15440 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.909904 15439 raft_consensus.cc:359] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.910605 15439 raft_consensus.cc:385] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.910926 15439 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.906636 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:08.911891 15439 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.910300 15441 raft_consensus.cc:359] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:08.912226 15290 leader_election.cc:343] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:08.912830 15441 raft_consensus.cc:385] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.913239 15441 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.913630 15607 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:08.914094 15441 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.914573 15639 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.916513 15441 ts_tablet_manager.cc:1434] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:08.916647 15639 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:08.918689 15439 ts_tablet_manager.cc:1434] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:08.918576 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:08.919376 15250 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.919528 15637 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:08.920480 15637 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.923424 15520 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:08.910755 15440 ts_tablet_manager.cc:1434] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 13:02:08.924734 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:08.925148 15439 tablet_bootstrap.cc:492] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:08.925420 15247 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.925694 15440 tablet_bootstrap.cc:492] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:08.929049 15441 tablet_bootstrap.cc:492] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:08.936887 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:08.937806 15397 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.941462 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:08.944190 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:08.945434 15323 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:08.945727 15250 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:08.949014 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:08.952243 15441 tablet_bootstrap.cc:654] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.952875 15323 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:08.951648 15639 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.955440 15639 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:08.956748 15639 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.959048 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:08.959961 15607 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:08.960425 15607 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:08.961244 15607 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.964982 15397 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:08.972487 15440 tablet_bootstrap.cc:654] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.978657 15439 tablet_bootstrap.cc:654] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:08.980544 15145 catalog_manager.cc:5697] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:08.987502 15362 consensus_peers.cc:597] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:08.990440 15441 tablet_bootstrap.cc:492] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:08.991451 15441 ts_tablet_manager.cc:1403] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.004s
I20260709 13:02:08.995332 15441 raft_consensus.cc:359] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:08.996107 15441 raft_consensus.cc:385] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:08.996457 15441 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.997406 15441 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.000412 15439 tablet_bootstrap.cc:492] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:09.000901 15439 ts_tablet_manager.cc:1403] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.000s
I20260709 13:02:09.000787 15147 catalog_manager.cc:5697] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:09.003196 15441 ts_tablet_manager.cc:1434] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:09.003391 15439 raft_consensus.cc:359] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.004038 15439 raft_consensus.cc:385] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.004218 15441 tablet_bootstrap.cc:492] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:09.004307 15439 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:08.997949 15145 catalog_manager.cc:5697] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.005035 15439 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.011945 15441 tablet_bootstrap.cc:654] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.018781 15323 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:09.021214 15440 tablet_bootstrap.cc:492] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:09.021153 15654 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.021914 15440 ts_tablet_manager.cc:1403] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.002s
I20260709 13:02:09.025879 15440 raft_consensus.cc:359] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.030197 15440 raft_consensus.cc:385] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.030658 15440 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.031597 15440 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.044072 15397 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:09.047549 15653 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.059465 15440 ts_tablet_manager.cc:1434] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 13:02:09.060571 15607 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.061321 15439 ts_tablet_manager.cc:1434] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:02:09.061115 15607 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.063192 15607 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.060773 15440 tablet_bootstrap.cc:492] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:09.065192 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:09.066368 15247 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:09.069041 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.071317 15439 tablet_bootstrap.cc:492] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:09.071317 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:09.076756 15617 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.083202 15552 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.083781 15552 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.086019 15440 tablet_bootstrap.cc:654] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.086182 15552 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.091780 15322 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:09.097759 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.119299 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:09.128839 15215 leader_election.cc:343] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:09.131768 15213 leader_election.cc:343] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.132493 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:09.133493 15654 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.137542 15654 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.138221 15520 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.140657 15637 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.148232 15397 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:09.154806 15617 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.160997 15637 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.161044 15520 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.175299 15552 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.178748 15439 tablet_bootstrap.cc:654] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.178731 15637 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:09.180914 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:09.181118 15520 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.181944 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:09.182750 15245 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:09.191983 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.193782 15637 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.194900 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:09.196563 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:09.197916 15637 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.199473 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:09.201411 15617 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.204876 15441 tablet_bootstrap.cc:492] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:09.205322 15441 ts_tablet_manager.cc:1403] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.201s	user 0.065s	sys 0.070s
I20260709 13:02:09.208828 15441 raft_consensus.cc:359] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.209875 15441 raft_consensus.cc:385] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.210215 15441 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
W20260709 13:02:09.209977 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:09.211000 15441 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.214164 15441 ts_tablet_manager.cc:1434] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:02:09.215242 15441 tablet_bootstrap.cc:492] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:09.224908 15439 tablet_bootstrap.cc:492] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:09.225435 15439 ts_tablet_manager.cc:1403] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.154s	user 0.010s	sys 0.004s
I20260709 13:02:09.227248 15617 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.228323 15439 raft_consensus.cc:359] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.229085 15439 raft_consensus.cc:385] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.229344 15439 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.233850 15441 tablet_bootstrap.cc:654] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.235292 15439 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.238701 15439 ts_tablet_manager.cc:1434] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:02:09.240155 15439 tablet_bootstrap.cc:492] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:09.240821 15440 tablet_bootstrap.cc:492] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:09.241302 15440 ts_tablet_manager.cc:1403] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.181s	user 0.011s	sys 0.004s
I20260709 13:02:09.244067 15440 raft_consensus.cc:359] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.244794 15440 raft_consensus.cc:385] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.245126 15440 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.251237 15440 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.254433 15439 tablet_bootstrap.cc:654] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.256347 15655 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.253590 15440 ts_tablet_manager.cc:1434] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:02:09.256866 15655 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.257893 15440 tablet_bootstrap.cc:492] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:09.258960 15655 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.261113 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.261824 15399 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:09.264178 15440 tablet_bootstrap.cc:654] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.267020 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:09.267694 15323 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:09.268901 15213 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:09.270084 15655 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.270496 15655 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.270815 15655 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.294210 15439 tablet_bootstrap.cc:492] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:09.295123 15439 ts_tablet_manager.cc:1403] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.055s	user 0.004s	sys 0.008s
I20260709 13:02:09.296018 15441 tablet_bootstrap.cc:492] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:09.296516 15441 ts_tablet_manager.cc:1403] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.036s
I20260709 13:02:09.278789 15655 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.299099 15441 raft_consensus.cc:359] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.299778 15441 raft_consensus.cc:385] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.300065 15441 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.297724 15439 raft_consensus.cc:359] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.300657 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:09.301092 15439 raft_consensus.cc:385] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.300750 15441 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.301281 15322 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.301411 15439 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.302975 15441 ts_tablet_manager.cc:1434] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:09.303357 15655 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.303934 15441 tablet_bootstrap.cc:492] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:09.306128 15439 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.307716 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:09.308319 15397 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.308776 15439 ts_tablet_manager.cc:1434] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:02:09.309737 15439 tablet_bootstrap.cc:492] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:09.310003 15441 tablet_bootstrap.cc:654] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.311177 15638 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.324565 15322 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:09.325950 15213 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:09.337271 15397 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
W20260709 13:02:09.384173 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58034.9us
I20260709 13:02:09.389037 15617 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.390543 15617 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.401724 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:09.406196 15555 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.410285 15555 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:02:09.420001 15291 leader_election.cc:343] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.420610 15555 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.427196 15440 tablet_bootstrap.cc:492] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:09.428315 15440 ts_tablet_manager.cc:1403] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.171s	user 0.008s	sys 0.014s
I20260709 13:02:09.432301 15439 tablet_bootstrap.cc:654] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.439884 15441 tablet_bootstrap.cc:492] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:09.440893 15441 ts_tablet_manager.cc:1403] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.137s	user 0.017s	sys 0.017s
I20260709 13:02:09.450562 15690 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.451427 15690 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.448164 15617 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.463557 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:09.464558 15441 raft_consensus.cc:359] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.465421 15441 raft_consensus.cc:385] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.465003 15690 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:09.465687 15291 leader_election.cc:343] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.466171 15440 raft_consensus.cc:359] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.466979 15440 raft_consensus.cc:385] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.467284 15440 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.467371 15399 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.468152 15440 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.465739 15441 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.476666 15439 tablet_bootstrap.cc:492] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:09.489733 15441 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.486019 15654 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.494648 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.494498 15654 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.500181 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.503608 15637 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.504108 15439 ts_tablet_manager.cc:1403] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.195s	user 0.009s	sys 0.012s
W20260709 13:02:09.505895 15215 leader_election.cc:343] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.515164 15441 ts_tablet_manager.cc:1434] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.006s
I20260709 13:02:09.501144 15654 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.530166 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.525837 15440 ts_tablet_manager.cc:1434] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.005s
I20260709 13:02:09.536262 15441 tablet_bootstrap.cc:492] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
W20260709 13:02:09.536743 15290 leader_election.cc:343] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.537500 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:09.542892 15440 tablet_bootstrap.cc:492] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:09.544430 15439 raft_consensus.cc:359] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.545643 15439 raft_consensus.cc:385] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.545904 15439 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.548568 15637 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.546402 15439 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.551091 15520 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:09.557796 15691 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.559906 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:09.579730 15290 leader_election.cc:343] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.580186 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:09.584964 15690 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.583607 15520 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.596303 15552 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.596886 15552 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.578594 15325 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:09.599306 15552 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.600785 15441 tablet_bootstrap.cc:654] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.602414 15439 ts_tablet_manager.cc:1434] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.000s
I20260709 13:02:09.610720 15439 tablet_bootstrap.cc:492] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:09.601643 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.623725 15637 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.625855 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:09.627400 15654 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.627838 15654 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.628252 15654 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.634145 15440 tablet_bootstrap.cc:654] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.637526 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:09.639863 15323 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
W20260709 13:02:09.654841 15215 leader_election.cc:343] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.671309 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:09.672260 15552 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.672778 15552 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.673228 15552 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.673298 15637 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.673907 15637 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.676260 15637 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:09.676427 15439 tablet_bootstrap.cc:654] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.680912 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:09.697126 15654 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.710736 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:09.713125 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:09.714080 15322 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.677146 15398 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.718442 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:09.726075 15441 tablet_bootstrap.cc:492] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:09.726585 15441 ts_tablet_manager.cc:1403] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.191s	user 0.009s	sys 0.010s
I20260709 13:02:09.732985 15322 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:09.734426 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:09.736987 15555 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.737522 15555 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:09.738466 15555 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.736151 15147 catalog_manager.cc:5697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.750648 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:09.752422 15215 leader_election.cc:343] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.750478 15654 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.763319 15439 tablet_bootstrap.cc:492] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:09.763902 15439 ts_tablet_manager.cc:1403] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.154s	user 0.014s	sys 0.007s
I20260709 13:02:09.765686 15552 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.769480 15637 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:09.769815 15552 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.769802 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:09.770542 15325 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.769212 15439 raft_consensus.cc:359] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.775089 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:09.776702 15215 leader_election.cc:343] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:09.772780 15439 raft_consensus.cc:385] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.777076 15441 raft_consensus.cc:359] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.777626 15440 tablet_bootstrap.cc:492] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:09.777854 15441 raft_consensus.cc:385] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.778128 15440 ts_tablet_manager.cc:1403] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.245s	user 0.014s	sys 0.022s
I20260709 13:02:09.779832 15441 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.783689 15440 raft_consensus.cc:359] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.784732 15440 raft_consensus.cc:385] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.785183 15440 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.784757 15325 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:09.787220 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:09.788568 15552 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.789860 15552 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:09.786618 15440 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.789717 15441 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.777424 15439 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.790969 15552 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.793116 15441 ts_tablet_manager.cc:1434] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:02:09.797202 15441 tablet_bootstrap.cc:492] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:09.800012 15440 ts_tablet_manager.cc:1434] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:02:09.801440 15440 tablet_bootstrap.cc:492] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:09.802145 15441 tablet_bootstrap.cc:654] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.806723 15441 tablet_bootstrap.cc:492] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:09.807185 15441 ts_tablet_manager.cc:1403] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:02:09.806903 15439 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.810019 15440 tablet_bootstrap.cc:654] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.810537 15439 ts_tablet_manager.cc:1434] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.002s
I20260709 13:02:09.810472 15441 raft_consensus.cc:359] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.811295 15441 raft_consensus.cc:385] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.811655 15441 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.812122 15439 tablet_bootstrap.cc:492] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:09.812529 15441 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.816983 15440 tablet_bootstrap.cc:492] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:09.817462 15440 ts_tablet_manager.cc:1403] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.001s
I20260709 13:02:09.820827 15440 raft_consensus.cc:359] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.821346 15439 tablet_bootstrap.cc:654] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.821516 15440 raft_consensus.cc:385] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.822001 15440 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.823029 15440 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.824641 15440 ts_tablet_manager.cc:1434] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:09.825057 15441 ts_tablet_manager.cc:1434] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:02:09.825634 15440 tablet_bootstrap.cc:492] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:09.826328 15441 tablet_bootstrap.cc:492] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:09.828390 15439 tablet_bootstrap.cc:492] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:09.828891 15439 ts_tablet_manager.cc:1403] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.001s
I20260709 13:02:09.832887 15441 tablet_bootstrap.cc:654] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.832836 15439 raft_consensus.cc:359] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.833599 15439 raft_consensus.cc:385] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.833873 15439 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.834555 15439 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.835811 15440 tablet_bootstrap.cc:654] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.836968 15439 ts_tablet_manager.cc:1434] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:09.838198 15439 tablet_bootstrap.cc:492] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:09.846729 15439 tablet_bootstrap.cc:654] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.849967 15441 tablet_bootstrap.cc:492] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:09.850513 15441 ts_tablet_manager.cc:1403] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260709 13:02:09.853338 15441 raft_consensus.cc:359] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.854012 15441 raft_consensus.cc:385] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.854310 15441 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.855711 15441 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.857800 15441 ts_tablet_manager.cc:1434] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:09.858870 15441 tablet_bootstrap.cc:492] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:09.865566 15441 tablet_bootstrap.cc:654] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.866467 15440 tablet_bootstrap.cc:492] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:09.866948 15440 ts_tablet_manager.cc:1403] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.008s
I20260709 13:02:09.869576 15440 raft_consensus.cc:359] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.870306 15440 raft_consensus.cc:385] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.870579 15440 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.873495 15440 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.875952 15440 ts_tablet_manager.cc:1434] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:09.882480 15441 tablet_bootstrap.cc:492] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:09.884021 15654 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.884244 15441 ts_tablet_manager.cc:1403] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.003s
I20260709 13:02:09.884539 15654 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.882480 15439 tablet_bootstrap.cc:492] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:09.886173 15439 ts_tablet_manager.cc:1403] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.011s
I20260709 13:02:09.886710 15654 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.887547 15441 raft_consensus.cc:359] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.889003 15441 raft_consensus.cc:385] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.889376 15441 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.889014 15439 raft_consensus.cc:359] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.889897 15439 raft_consensus.cc:385] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:09.890215 15439 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:09.890498 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.891130 15396 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:09.891021 15439 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.890959 15441 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.892479 15215 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:09.893071 15441 ts_tablet_manager.cc:1434] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:02:09.893679 15555 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.894096 15555 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.894276 15441 tablet_bootstrap.cc:492] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:09.894506 15555 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.896736 15439 ts_tablet_manager.cc:1434] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:09.889202 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:09.901466 15441 tablet_bootstrap.cc:654] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.901479 15325 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:09.902757 15439 tablet_bootstrap.cc:492] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:09.905894 15440 tablet_bootstrap.cc:492] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:09.909963 15439 tablet_bootstrap.cc:654] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.910267 15555 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.913985 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:09.914625 15396 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.922335 15552 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.923128 15552 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.927428 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.927845 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:09.928196 15398 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:09.928434 15321 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:09.929551 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:09.931133 15653 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.931532 15653 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.931903 15653 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.932283 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:09.934983 15607 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.925982 15552 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.935711 15607 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.937340 15555 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.941543 15552 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.961899 15147 catalog_manager.cc:5697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.947916 15396 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:09.951308 15653 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.983760 15215 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:09.950846 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:09.984699 15653 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.961288 15325 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.985798 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:09.948779 15607 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:09.943085 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:09.985935 15147 catalog_manager.cc:5697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:09.986747 15245 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:09.988051 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:09.988628 15323 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.986490 15398 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.990610 15291 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:09.984742 15748 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:09.991708 15617 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:09.991938 15748 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:09.992093 15617 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.992475 15617 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:09.993136 15748 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:09.968096 15440 tablet_bootstrap.cc:654] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:09.998495 15398 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:10.000296 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:09.971813 15441 tablet_bootstrap.cc:492] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:09.972695 15439 tablet_bootstrap.cc:492] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:10.001513 15552 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.002105 15439 ts_tablet_manager.cc:1403] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.104s	user 0.023s	sys 0.046s
I20260709 13:02:09.979955 15654 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:10.002064 15552 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:10.004467 15552 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.005179 15323 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:10.005458 15439 raft_consensus.cc:359] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.006130 15439 raft_consensus.cc:385] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.006421 15439 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.007081 15439 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.002084 15441 ts_tablet_manager.cc:1403] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.013s
I20260709 13:02:10.009879 15439 ts_tablet_manager.cc:1434] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:10.010967 15439 tablet_bootstrap.cc:492] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:10.011401 15617 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.019495 15617 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.017639 15439 tablet_bootstrap.cc:654] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:10.017421 15290 leader_election.cc:343] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.016324 15440 tablet_bootstrap.cc:492] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:10.020627 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:10.039736 15440 ts_tablet_manager.cc:1403] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.142s	user 0.008s	sys 0.005s
I20260709 13:02:10.023154 15441 raft_consensus.cc:359] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.039696 15250 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.042785 15440 raft_consensus.cc:359] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.043522 15440 raft_consensus.cc:385] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.047760 15440 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.048450 15440 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.050743 15440 ts_tablet_manager.cc:1434] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:10.051265 15250 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:10.035506 15325 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:10.052259 15440 tablet_bootstrap.cc:492] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:10.052641 15291 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:10.046597 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:10.053546 15617 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.053974 15398 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.054090 15617 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:10.047413 15441 raft_consensus.cc:385] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.054679 15441 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.055019 15617 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.055711 15439 tablet_bootstrap.cc:492] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:10.056172 15439 ts_tablet_manager.cc:1403] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.003s
I20260709 13:02:10.056581 15441 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.058873 15439 raft_consensus.cc:359] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.062096 15439 raft_consensus.cc:385] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.062445 15439 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.062687 15441 ts_tablet_manager.cc:1434] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:02:10.063185 15398 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:10.063753 15441 tablet_bootstrap.cc:492] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:10.063534 15439 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.069622 15748 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.070348 15748 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.069751 15439 ts_tablet_manager.cc:1434] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:02:10.073675 15439 tablet_bootstrap.cc:492] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:10.076141 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:10.076984 15325 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:10.078282 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:10.077979 15146 catalog_manager.cc:5697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.079279 15552 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.079747 15439 tablet_bootstrap.cc:654] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.079964 15441 tablet_bootstrap.cc:654] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.080349 15748 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.079677 15146 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.079813 15520 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.086576 15520 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.079694 15552 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.092767 15552 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.093019 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:10.094416 15520 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:10.094636 15290 leader_election.cc:343] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.085881 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:10.095521 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:10.094364 15441 tablet_bootstrap.cc:492] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:10.096200 15250 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:10.096421 15441 ts_tablet_manager.cc:1403] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.010s
W20260709 13:02:10.097784 15215 leader_election.cc:343] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.098126 15439 tablet_bootstrap.cc:492] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:10.098608 15439 ts_tablet_manager.cc:1403] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 13:02:10.098661 15617 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.099184 15617 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.099288 15441 raft_consensus.cc:359] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.099993 15441 raft_consensus.cc:385] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.100268 15441 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.100924 15441 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.101377 15617 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.101315 15439 raft_consensus.cc:359] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.102056 15439 raft_consensus.cc:385] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.102357 15439 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.103370 15441 ts_tablet_manager.cc:1434] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:10.103080 15439 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.104434 15441 tablet_bootstrap.cc:492] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:10.105338 15439 ts_tablet_manager.cc:1434] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:10.106109 15552 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.111356 15440 tablet_bootstrap.cc:654] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.107510 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:10.108466 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:10.108647 15291 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:10.113773 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:10.114404 15325 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.114732 15607 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:10.114272 15290 leader_election.cc:343] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.115113 15607 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.106860 15439 tablet_bootstrap.cc:492] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:10.115509 15607 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:10.122326 15291 leader_election.cc:343] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.122627 15439 tablet_bootstrap.cc:654] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.124435 15325 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:10.121227 15147 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.126312 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:10.124569 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:10.127589 15748 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.127669 15520 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.128351 15748 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:10.129452 15748 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.139386 15607 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.111356 15441 tablet_bootstrap.cc:654] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.157135 15753 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.157711 15753 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.158746 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:10.160554 15215 leader_election.cc:343] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.161185 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:10.162418 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:10.163012 15245 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.165868 15552 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:10.163030 15215 leader_election.cc:343] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.166458 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:10.170153 15213 leader_election.cc:343] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.170678 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:10.171485 15753 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.172264 15753 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.173028 15245 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:10.175410 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:10.175935 15291 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:10.177093 15607 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.177644 15520 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.179045 15520 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:10.182348 15520 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.185210 15439 tablet_bootstrap.cc:492] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:10.185761 15439 ts_tablet_manager.cc:1403] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.008s
I20260709 13:02:10.188241 15440 tablet_bootstrap.cc:492] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:10.188731 15440 ts_tablet_manager.cc:1403] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.137s	user 0.033s	sys 0.034s
I20260709 13:02:10.188668 15439 raft_consensus.cc:359] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.189462 15441 tablet_bootstrap.cc:492] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
W20260709 13:02:10.189409 15215 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:10.189448 15439 raft_consensus.cc:385] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.190562 15441 ts_tablet_manager.cc:1403] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.003s
I20260709 13:02:10.190864 15439 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
W20260709 13:02:10.205087 15290 leader_election.cc:343] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.205047 15439 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.207012 15439 ts_tablet_manager.cc:1434] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.021s	user 0.011s	sys 0.010s
I20260709 13:02:10.205988 15440 raft_consensus.cc:359] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.208026 15440 raft_consensus.cc:385] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.208376 15440 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.209304 15440 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.217379 15439 tablet_bootstrap.cc:492] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:10.218932 15440 ts_tablet_manager.cc:1434] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:02:10.226614 15440 tablet_bootstrap.cc:492] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:10.227895 15439 tablet_bootstrap.cc:654] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.232913 15440 tablet_bootstrap.cc:654] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.236259 15552 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.236775 15552 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.238904 15441 raft_consensus.cc:359] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.239634 15441 raft_consensus.cc:385] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.239862 15146 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.239926 15441 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.247591 15441 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.260018 15552 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.255095 15748 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.263417 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:10.268707 15325 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:10.268850 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:10.269492 15398 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:10.271708 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:10.273990 15441 ts_tablet_manager.cc:1434] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.003s
I20260709 13:02:10.274406 15753 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.274426 15617 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.267154 15748 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.279521 15617 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.281601 15617 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.282795 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:10.283826 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:10.284466 15245 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:10.284471 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:10.285573 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:10.285678 15323 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
W20260709 13:02:10.286475 15290 leader_election.cc:343] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.278992 15753 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.287633 15753 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.297478 15748 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.298332 15439 tablet_bootstrap.cc:492] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:10.298848 15439 ts_tablet_manager.cc:1403] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.023s
I20260709 13:02:10.299685 15691 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.300194 15691 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.302172 15440 tablet_bootstrap.cc:492] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:10.303002 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:10.306332 15291 leader_election.cc:343] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.307144 15441 tablet_bootstrap.cc:492] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:10.302685 15440 ts_tablet_manager.cc:1403] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.076s	user 0.007s	sys 0.018s
I20260709 13:02:10.310801 15440 raft_consensus.cc:359] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.311535 15440 raft_consensus.cc:385] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.311820 15440 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.312525 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:10.313588 15753 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.314944 15439 raft_consensus.cc:359] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.315629 15439 raft_consensus.cc:385] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.315726 15753 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.317292 15439 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.318102 15439 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.318950 15441 tablet_bootstrap.cc:654] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.320338 15439 ts_tablet_manager.cc:1434] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:02:10.321146 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:10.317363 15691 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.322120 15748 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.322276 15439 tablet_bootstrap.cc:492] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:10.322538 15748 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.322947 15748 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.327172 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:10.327858 15325 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.331180 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:10.332557 15290 leader_election.cc:343] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.334807 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:10.336179 15520 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.286545 15617 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.337503 15617 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.337917 15617 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.337606 15147 catalog_manager.cc:5697] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:10.336468 15215 leader_election.cc:343] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.340682 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:10.341287 15397 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:10.342890 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:10.344722 15655 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:10.345394 15215 consensus_peers.cc:597] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:10.320870 15440 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.333576 15439 tablet_bootstrap.cc:654] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.355728 15439 tablet_bootstrap.cc:492] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:10.356003 15325 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:10.356329 15439 ts_tablet_manager.cc:1403] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.003s
I20260709 13:02:10.357355 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:10.358836 15655 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.359352 15655 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:10.360154 15655 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.364504 15397 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:10.368472 15617 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.369331 15440 ts_tablet_manager.cc:1434] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260709 13:02:10.372340 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:10.372990 15245 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.373301 15144 catalog_manager.cc:5697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.374055 15753 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:10.365732 15439 raft_consensus.cc:359] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.374749 15439 raft_consensus.cc:385] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.375065 15439 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.375779 15439 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.379638 15439 ts_tablet_manager.cc:1434] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:02:10.379885 15245 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:10.380892 15439 tablet_bootstrap.cc:492] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:10.383026 15748 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.386585 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:10.373332 15440 tablet_bootstrap.cc:492] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Bootstrap starting.
W20260709 13:02:10.399147 15290 leader_election.cc:343] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.387810 15617 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.402915 15748 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.404312 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:10.405884 15441 tablet_bootstrap.cc:492] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:10.406157 15439 tablet_bootstrap.cc:654] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.406613 15441 ts_tablet_manager.cc:1403] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.000s
W20260709 13:02:10.406895 15215 leader_election.cc:343] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.407052 15440 tablet_bootstrap.cc:654] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.409842 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:10.409741 15441 raft_consensus.cc:359] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.412901 15441 raft_consensus.cc:385] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.413302 15441 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.410759 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:10.414259 15323 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.416309 15520 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.416883 15520 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:10.421329 15323 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:10.422040 15441 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.417685 15520 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.426821 15441 ts_tablet_manager.cc:1434] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:02:10.427938 15441 tablet_bootstrap.cc:492] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:10.431314 15440 tablet_bootstrap.cc:492] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:10.431890 15440 ts_tablet_manager.cc:1403] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.000s
I20260709 13:02:10.435004 15440 raft_consensus.cc:359] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.435644 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:10.435982 15440 raft_consensus.cc:385] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.436394 15440 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.436887 15654 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:10.437919 15440 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.439260 15654 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:10.440176 15440 ts_tablet_manager.cc:1434] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:10.440186 15654 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.441174 15440 tablet_bootstrap.cc:492] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:10.444159 15638 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.444706 15638 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.446230 15441 tablet_bootstrap.cc:654] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.446880 15638 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:10.447330 15440 tablet_bootstrap.cc:654] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.449527 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:10.453169 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:10.454773 15439 tablet_bootstrap.cc:492] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:10.455283 15439 ts_tablet_manager.cc:1403] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.012s
I20260709 13:02:10.455622 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:10.457013 15644 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:10.460757 15439 raft_consensus.cc:359] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.461509 15439 raft_consensus.cc:385] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.461787 15439 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.462491 15439 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.464520 15439 ts_tablet_manager.cc:1434] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.003s
I20260709 13:02:10.465464 15439 tablet_bootstrap.cc:492] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:10.470590 15441 tablet_bootstrap.cc:492] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:10.470736 15440 tablet_bootstrap.cc:492] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:10.471526 15441 ts_tablet_manager.cc:1403] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.000s
I20260709 13:02:10.471675 15440 ts_tablet_manager.cc:1403] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.000s
I20260709 13:02:10.472810 15439 tablet_bootstrap.cc:654] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.478121 15607 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.482604 15753 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:10.484568 15440 raft_consensus.cc:359] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.485329 15440 raft_consensus.cc:385] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.485642 15440 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.486352 15440 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.487082 15441 raft_consensus.cc:359] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.488216 15441 raft_consensus.cc:385] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.488569 15441 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.489301 15441 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.484484 15147 catalog_manager.cc:5697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.493352 15440 ts_tablet_manager.cc:1434] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:02:10.494504 15440 tablet_bootstrap.cc:492] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:10.499101 15654 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.500617 15440 tablet_bootstrap.cc:654] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.504643 15441 ts_tablet_manager.cc:1434] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:02:10.521757 15691 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:10.523823 15215 consensus_peers.cc:597] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:10.536046 15441 tablet_bootstrap.cc:492] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:10.538215 15520 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.539028 15520 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.544162 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:10.545085 15250 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:10.546027 15520 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.551546 15291 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:10.553848 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:10.555085 15290 leader_election.cc:343] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.555310 15439 tablet_bootstrap.cc:492] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:10.536156 15144 catalog_manager.cc:5697] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.555833 15439 ts_tablet_manager.cc:1403] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.002s
I20260709 13:02:10.553660 15607 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.563131 15607 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.563687 15607 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.571478 15440 tablet_bootstrap.cc:492] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:10.571973 15440 ts_tablet_manager.cc:1403] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.041s
I20260709 13:02:10.576539 15440 raft_consensus.cc:359] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.577389 15440 raft_consensus.cc:385] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.577723 15440 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.578420 15654 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.578464 15440 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.572284 15439 raft_consensus.cc:359] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.581036 15440 ts_tablet_manager.cc:1434] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:10.581164 15439 raft_consensus.cc:385] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.581566 15439 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.582396 15440 tablet_bootstrap.cc:492] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:10.582294 15439 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.583124 15441 tablet_bootstrap.cc:654] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.614849 15655 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:10.622846 15439 ts_tablet_manager.cc:1434] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.000s
I20260709 13:02:10.628430 15753 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:02:10.650206 15440 tablet_bootstrap.cc:654] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.652331 15439 tablet_bootstrap.cc:492] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:10.660665 15520 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:10.675804 15644 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.677517 15644 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.681895 15644 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:10.685889 15439 tablet_bootstrap.cc:654] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:10.674808 15638 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.696781 15639 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.704101 15653 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.702992 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:10.705237 15520 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.703570 15552 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.705706 15520 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.704231 15639 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.716735 15520 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.698329 15638 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.704684 15653 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.728005 15639 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:10.729038 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:10.730749 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:10.731053 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:10.731488 15321 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:10.713548 15552 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.734170 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:10.735653 15552 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.736156 15638 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:10.712033 15245 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:10.737721 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:10.738627 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:10.742774 15290 leader_election.cc:343] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.742018 15365 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:10.744347 15644 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.744735 15644 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.745082 15644 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.747998 15394 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:10.751711 15441 tablet_bootstrap.cc:492] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:10.752425 15441 ts_tablet_manager.cc:1403] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.217s	user 0.029s	sys 0.027s
I20260709 13:02:10.754972 15607 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.758249 15323 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:10.764595 15654 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.765311 15654 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.778927 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:10.781100 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:10.782760 15748 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:10.783190 15748 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.783521 15748 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:10.791285 15213 leader_election.cc:343] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:10.751899 15291 leader_election.cc:343] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:10.798941 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:10.800752 15607 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.805920 15748 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.755272 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:10.823701 15520 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.825456 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 73603.4us
I20260709 13:02:10.824195 15520 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.827911 15520 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.821812 15653 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.829030 15441 raft_consensus.cc:359] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.822364 15639 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.831861 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:10.832118 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:10.835072 15639 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.829772 15441 raft_consensus.cc:385] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:10.841812 15441 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.828939 15607 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:10.883638 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54656us
I20260709 13:02:10.870641 15748 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.841498 15654 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:10.870847 15644 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.899119 15398 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:02:10.986219 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 154706us
W20260709 13:02:10.945655 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56363.4us
I20260709 13:02:10.992882 15441 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:10.906502 15644 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:10.996572 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:10.997123 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:10.996645 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:10.998179 15247 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.002686 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:11.003263 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:11.013823 15440 tablet_bootstrap.cc:492] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:11.013909 15441 ts_tablet_manager.cc:1434] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.261s	user 0.040s	sys 0.010s
I20260709 13:02:11.015396 15440 ts_tablet_manager.cc:1403] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.433s	user 0.071s	sys 0.094s
I20260709 13:02:11.015638 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:10.995685 15639 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:11.019538 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:11.026150 15439 tablet_bootstrap.cc:492] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:11.026849 15439 ts_tablet_manager.cc:1403] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.381s	user 0.018s	sys 0.002s
I20260709 13:02:11.027642 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:11.031859 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:11.033507 15638 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.033741 15247 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:11.033898 15439 raft_consensus.cc:359] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.034651 15439 raft_consensus.cc:385] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.034957 15439 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.036448 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:11.038349 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:11.039143 15323 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:11.035593 15439 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:11.041895 15290 leader_election.cc:343] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:11.042625 15215 leader_election.cc:343] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:11.043977 15213 leader_election.cc:343] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.042977 15215 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:02:11.049201 15290 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:11.056241 15653 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.058485 15397 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.065276 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:11.065930 15322 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.059947 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:11.067912 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:11.074275 15792 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.075256 15441 tablet_bootstrap.cc:492] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:11.089833 15440 raft_consensus.cc:359] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.090551 15440 raft_consensus.cc:385] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.090813 15440 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.091435 15440 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.100497 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:11.101161 15323 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:02:11.087277 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 44656.8us
I20260709 13:02:11.108472 15440 ts_tablet_manager.cc:1434] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.093s	user 0.008s	sys 0.000s
W20260709 13:02:11.115383 15215 leader_election.cc:343] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.120187 15440 tablet_bootstrap.cc:492] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Bootstrap starting.
W20260709 13:02:11.120703 15291 leader_election.cc:343] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.123056 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:11.121143 15555 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:11.124725 15439 ts_tablet_manager.cc:1434] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.098s	user 0.010s	sys 0.008s
W20260709 13:02:11.125545 15215 leader_election.cc:343] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.125823 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:11.127691 15215 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:11.132867 15690 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.134115 15644 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.136734 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:11.136947 15748 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.135396 15607 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:11.138103 15638 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.140543 15291 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:11.141321 15607 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.142347 15607 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:11.143229 15607 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.145433 15638 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.147374 15441 tablet_bootstrap.cc:654] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.150007 15439 tablet_bootstrap.cc:492] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:11.133316 15322 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:11.175359 15440 tablet_bootstrap.cc:654] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.176998 15607 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.176990 15800 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:11.184718 15441 tablet_bootstrap.cc:492] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:11.186012 15441 ts_tablet_manager.cc:1403] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.002s
W20260709 13:02:11.178766 15215 leader_election.cc:343] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.184644 15798 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:11.191345 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:11.192842 15748 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.195794 15439 tablet_bootstrap.cc:654] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.196961 15397 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.197610 15748 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:11.200645 15441 raft_consensus.cc:359] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.201376 15441 raft_consensus.cc:385] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.201637 15441 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.202505 15441 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.203907 15748 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.204684 15441 ts_tablet_manager.cc:1434] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:02:11.205677 15441 tablet_bootstrap.cc:492] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:11.200649 15144 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.221498 15441 tablet_bootstrap.cc:654] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.228714 15798 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:11.236447 15607 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.237105 15607 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.240265 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:11.240622 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:11.241004 15245 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
W20260709 13:02:11.242161 15290 leader_election.cc:343] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.240296 15607 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.242858 15291 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:11.243669 15796 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.244076 15796 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.244479 15796 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.258033 15796 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.260299 15796 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.260857 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:11.261574 15245 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.262085 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:11.262943 15439 tablet_bootstrap.cc:492] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:11.263424 15439 ts_tablet_manager.cc:1403] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.114s	user 0.009s	sys 0.012s
W20260709 13:02:11.263737 15290 leader_election.cc:343] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.269040 15245 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:11.275914 15441 tablet_bootstrap.cc:492] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:11.277154 15291 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:11.277884 15441 ts_tablet_manager.cc:1403] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.005s
I20260709 13:02:11.266129 15439 raft_consensus.cc:359] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.278548 15690 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.278950 15439 raft_consensus.cc:385] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.279136 15690 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:11.280107 15690 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.281641 15440 tablet_bootstrap.cc:492] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:11.282105 15440 ts_tablet_manager.cc:1403] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.168s	user 0.019s	sys 0.008s
I20260709 13:02:11.284895 15440 raft_consensus.cc:359] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.285562 15440 raft_consensus.cc:385] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.285835 15440 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.279250 15439 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.286669 15439 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.289232 15441 raft_consensus.cc:359] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.289938 15441 raft_consensus.cc:385] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.290210 15441 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.293319 15439 ts_tablet_manager.cc:1434] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:02:11.296056 15440 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.296615 15441 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.297716 15439 tablet_bootstrap.cc:492] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:11.298390 15440 ts_tablet_manager.cc:1434] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:02:11.299373 15440 tablet_bootstrap.cc:492] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:11.301170 15441 ts_tablet_manager.cc:1434] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:02:11.302201 15441 tablet_bootstrap.cc:492] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:11.305968 15440 tablet_bootstrap.cc:654] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.312857 15146 catalog_manager.cc:5697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.316627 15441 tablet_bootstrap.cc:654] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.317379 15440 tablet_bootstrap.cc:492] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:11.317903 15440 ts_tablet_manager.cc:1403] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:02:11.320592 15440 raft_consensus.cc:359] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.321137 15439 tablet_bootstrap.cc:654] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.321308 15440 raft_consensus.cc:385] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.321576 15440 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.322405 15440 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.324165 15440 ts_tablet_manager.cc:1434] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:02:11.325443 15440 tablet_bootstrap.cc:492] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:11.338145 15441 tablet_bootstrap.cc:492] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:11.338708 15441 ts_tablet_manager.cc:1403] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.005s
I20260709 13:02:11.342303 15439 tablet_bootstrap.cc:492] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:11.342777 15440 tablet_bootstrap.cc:654] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.342795 15439 ts_tablet_manager.cc:1403] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.002s
I20260709 13:02:11.345911 15439 raft_consensus.cc:359] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.346617 15439 raft_consensus.cc:385] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.346886 15439 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.347536 15441 raft_consensus.cc:359] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.348212 15441 raft_consensus.cc:385] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.348470 15441 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.347500 15439 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.350621 15439 ts_tablet_manager.cc:1434] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:11.352087 15439 tablet_bootstrap.cc:492] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:11.355504 15441 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.359318 15441 ts_tablet_manager.cc:1434] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 13:02:11.360442 15441 tablet_bootstrap.cc:492] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:11.361822 15440 tablet_bootstrap.cc:492] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:11.364933 15440 ts_tablet_manager.cc:1403] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.005s
I20260709 13:02:11.366376 15439 tablet_bootstrap.cc:654] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.368448 15440 raft_consensus.cc:359] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.369174 15440 raft_consensus.cc:385] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.369534 15440 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.371397 15398 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.373229 15440 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.375384 15440 ts_tablet_manager.cc:1434] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:02:11.376295 15440 tablet_bootstrap.cc:492] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:11.385707 15441 tablet_bootstrap.cc:654] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.382140 15440 tablet_bootstrap.cc:654] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.401837 15439 tablet_bootstrap.cc:492] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:11.402348 15439 ts_tablet_manager.cc:1403] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 13:02:11.405313 15439 raft_consensus.cc:359] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.406203 15439 raft_consensus.cc:385] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.406605 15439 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.407486 15439 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.414590 15439 ts_tablet_manager.cc:1434] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 13:02:11.414959 15440 tablet_bootstrap.cc:492] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:11.415453 15440 ts_tablet_manager.cc:1403] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.007s
I20260709 13:02:11.415635 15439 tablet_bootstrap.cc:492] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:11.417392 15441 tablet_bootstrap.cc:492] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:11.417904 15441 ts_tablet_manager.cc:1403] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.001s
I20260709 13:02:11.417965 15440 raft_consensus.cc:359] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.418937 15440 raft_consensus.cc:385] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.419284 15440 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.419898 15440 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.422181 15440 ts_tablet_manager.cc:1434] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:11.423786 15441 raft_consensus.cc:359] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.427594 15440 tablet_bootstrap.cc:492] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:11.427722 15441 raft_consensus.cc:385] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.428202 15441 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.429003 15441 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.430744 15439 tablet_bootstrap.cc:654] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.431370 15441 ts_tablet_manager.cc:1434] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:02:11.432411 15441 tablet_bootstrap.cc:492] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:11.423969 15398 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.435163 15690 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.435680 15690 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.438766 15441 tablet_bootstrap.cc:654] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.439445 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:11.441030 15290 leader_election.cc:343] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.434041 15440 tablet_bootstrap.cc:654] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:11.441768 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:11.445417 15439 tablet_bootstrap.cc:492] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:11.446023 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:11.446349 15439 ts_tablet_manager.cc:1403] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.001s
I20260709 13:02:11.446768 15247 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:11.448143 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:11.449036 15796 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.449415 15796 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.449820 15796 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.449451 15439 raft_consensus.cc:359] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.450213 15439 raft_consensus.cc:385] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.450497 15439 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.451123 15439 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.452145 15607 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.452641 15607 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.437983 15690 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.457055 15607 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.457643 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:11.457777 15796 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.458666 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:11.459403 15291 leader_election.cc:343] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:11.460033 15290 leader_election.cc:343] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.460049 15796 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.460592 15290 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:11.461319 15796 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.461261 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:11.461215 15144 catalog_manager.cc:5697] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.462118 15247 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.462527 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:11.463900 15290 leader_election.cc:343] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.468735 15247 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:11.470146 15441 tablet_bootstrap.cc:492] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:11.470218 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:11.470733 15441 ts_tablet_manager.cc:1403] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.003s
I20260709 13:02:11.471362 15440 tablet_bootstrap.cc:492] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:11.471282 15796 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.471926 15796 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:11.472759 15796 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.474025 15441 raft_consensus.cc:359] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.474923 15441 raft_consensus.cc:385] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.475427 15441 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.476317 15440 ts_tablet_manager.cc:1403] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.000s
I20260709 13:02:11.476627 15798 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.477100 15798 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.479297 15798 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.479214 15440 raft_consensus.cc:359] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.480015 15440 raft_consensus.cc:385] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.480306 15440 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.481132 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:11.483362 15215 leader_election.cc:343] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.483178 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:11.476046 15441 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.485026 15441 ts_tablet_manager.cc:1434] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:02:11.485225 15323 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:11.485991 15441 tablet_bootstrap.cc:492] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:11.453325 15439 ts_tablet_manager.cc:1434] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:11.489904 15213 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:11.491554 15798 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.480969 15440 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.492072 15798 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.492590 15798 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.493796 15440 ts_tablet_manager.cc:1434] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:02:11.487785 15439 tablet_bootstrap.cc:492] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:11.500159 15440 tablet_bootstrap.cc:492] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:11.505733 15441 tablet_bootstrap.cc:654] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.530313 15440 tablet_bootstrap.cc:654] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.532111 15798 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.536962 15441 tablet_bootstrap.cc:492] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:11.537473 15441 ts_tablet_manager.cc:1403] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.010s
I20260709 13:02:11.539801 15798 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.540422 15439 tablet_bootstrap.cc:654] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.542110 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:11.542583 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:11.542737 15323 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:11.543973 15215 leader_election.cc:343] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.543833 15145 catalog_manager.cc:5697] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.545938 15441 raft_consensus.cc:359] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.546785 15441 raft_consensus.cc:385] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.547056 15441 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.548194 15441 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.550535 15441 ts_tablet_manager.cc:1434] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:02:11.550710 15748 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.551581 15441 tablet_bootstrap.cc:492] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:11.551191 15748 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.554354 15792 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.554845 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:11.554924 15792 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.555783 15796 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:11.556306 15215 leader_election.cc:343] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.556828 15748 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.558060 15441 tablet_bootstrap.cc:654] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:11.558909 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:11.559590 15322 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:11.563673 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:11.564320 15250 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:11.566080 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:11.566112 15792 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:11.568423 15644 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.568583 15323 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:11.569077 15644 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.569631 15644 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.582828 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:11.583564 15320 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:11.598205 15213 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:11.599706 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:11.600500 15555 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:11.600955 15799 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:11.601257 15555 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:11.601545 15799 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.602074 15799 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.602408 15555 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.609270 15654 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.610140 15654 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.613718 15654 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.659577 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:11.662361 15215 leader_election.cc:343] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.702349 15398 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.704231 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:11.730513 15439 tablet_bootstrap.cc:492] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:11.731037 15439 ts_tablet_manager.cc:1403] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.244s	user 0.008s	sys 0.004s
I20260709 13:02:11.733646 15798 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:11.779937 15213 leader_election.cc:343] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:11.780342 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:11.786408 15439 raft_consensus.cc:359] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.787150 15439 raft_consensus.cc:385] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.787452 15439 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.788157 15439 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.793859 15440 tablet_bootstrap.cc:492] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:11.794859 15440 ts_tablet_manager.cc:1403] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.300s	user 0.013s	sys 0.002s
I20260709 13:02:11.796013 15799 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.779472 15655 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.793182 15798 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:11.783129 15654 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:02:11.735733 15644 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.813721 15441 tablet_bootstrap.cc:492] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:11.824479 15441 ts_tablet_manager.cc:1403] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.273s	user 0.069s	sys 0.051s
I20260709 13:02:11.803962 15655 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.827906 15638 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.830400 15792 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.845577 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 63016.1us
W20260709 13:02:11.845719 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65804.9us
I20260709 13:02:11.833781 15799 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.851011 15439 ts_tablet_manager.cc:1434] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.120s	user 0.028s	sys 0.018s
I20260709 13:02:11.874715 15439 tablet_bootstrap.cc:492] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:11.848923 15638 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.851177 15792 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:11.899276 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49136us
I20260709 13:02:11.908582 15644 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:11.907490 15441 raft_consensus.cc:359] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.910772 15441 raft_consensus.cc:385] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.911154 15441 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.912110 15440 raft_consensus.cc:359] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.913116 15440 raft_consensus.cc:385] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:11.911980 15441 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.914995 15441 ts_tablet_manager.cc:1434] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.001s
I20260709 13:02:11.916339 15441 tablet_bootstrap.cc:492] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:11.916396 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:11.917128 15323 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:11.913491 15440 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.934079 15323 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:11.946451 15440 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:11.911695 15644 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.955467 15441 tablet_bootstrap.cc:654] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.039314 15638 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:12.040963 15655 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:11.969208 15644 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.025101 15839 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.056202 15440 ts_tablet_manager.cc:1434] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.261s	user 0.013s	sys 0.010s
I20260709 13:02:12.065181 15145 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:12.066177 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:12.075935 15690 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:12.024499 15842 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.088536 15644 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:12.089731 15792 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:12.090521 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:12.102087 15440 tablet_bootstrap.cc:492] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:12.095433 15842 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.104825 15842 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:12.055546 15839 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.108103 15839 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:12.113224 15439 tablet_bootstrap.cc:654] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:12.116590 15837 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.265s	user 0.003s	sys 0.000s
I20260709 13:02:12.116415 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:12.117360 15322 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.091277 15391 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
W20260709 13:02:12.085963 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 133166us
W20260709 13:02:12.190061 15215 leader_election.cc:343] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.195446 15215 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:12.224210 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:12.225121 15323 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:12.230809 15843 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.231464 15843 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.231819 15843 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.239243 15843 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.242180 15843 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:12.243759 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 275445us
I20260709 13:02:12.230754 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:12.246354 15290 consensus_peers.cc:597] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.248484 15441 tablet_bootstrap.cc:492] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:12.249157 15441 ts_tablet_manager.cc:1403] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.333s	user 0.021s	sys 0.015s
I20260709 13:02:12.249473 15249 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:12.265585 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:12.266829 15248 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:12.268851 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:12.269958 15440 tablet_bootstrap.cc:654] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.270607 15323 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:12.248173 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:12.293398 15439 tablet_bootstrap.cc:492] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:12.294050 15439 ts_tablet_manager.cc:1403] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.423s	user 0.011s	sys 0.030s
I20260709 13:02:12.298705 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:12.288295 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:12.290112 15320 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
W20260709 13:02:12.302922 15351 tablet.cc:2406] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:12.316111 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:12.312085 15249 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.318080 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:12.478075 15398 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:12.470395 15323 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 0.
I20260709 13:02:12.397816 15322 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:12.315397 15441 raft_consensus.cc:359] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.483743 15213 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:12.484489 15441 raft_consensus.cc:385] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.484887 15441 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.485466 15441 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.486943 15441 ts_tablet_manager.cc:1434] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.237s	user 0.019s	sys 0.016s
I20260709 13:02:12.488656 15439 raft_consensus.cc:359] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.489408 15439 raft_consensus.cc:385] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.489673 15439 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.491576 15798 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.492690 15798 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.493010 15798 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.483247 15690 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.496348 15690 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.498484 15690 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:12.490365 15800 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:02:12.500375 15798 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.508451 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:12.510082 15318 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.491490 15439 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.519750 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:12.523247 15843 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:12.343566 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:12.523793 15843 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:12.524667 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:12.530071 15852 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.530712 15852 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.531153 15852 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.539659 15852 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.541544 15852 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:12.546983 15439 ts_tablet_manager.cc:1434] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.253s	user 0.014s	sys 0.000s
W20260709 13:02:12.551214 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 214026us
I20260709 13:02:12.553237 15362 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:12.527330 15249 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:12.564662 15638 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:12.564800 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:12.565478 15638 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:12.565584 15249 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.508298 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:12.576225 15242 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:12.571031 15852 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:02:12.578037 15858 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.578521 15858 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.578881 15858 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.582784 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:12.584295 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:12.585047 15325 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.585306 15439 tablet_bootstrap.cc:492] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:12.592307 15866 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.592947 15866 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.593379 15866 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.581445 15798 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:12.602494 15848 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.603106 15440 tablet_bootstrap.cc:492] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:12.603025 15848 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.603562 15440 ts_tablet_manager.cc:1403] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.502s	user 0.024s	sys 0.016s
I20260709 13:02:12.605885 15439 tablet_bootstrap.cc:654] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.606220 15848 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:12.606860 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:12.566684 15638 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:12.608217 15291 leader_election.cc:343] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.609274 15843 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.622447 15325 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:12.619017 15440 raft_consensus.cc:359] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.625353 15440 raft_consensus.cc:385] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.625741 15440 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.628672 15440 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.646204 15440 ts_tablet_manager.cc:1434] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.042s	user 0.012s	sys 0.009s
I20260709 13:02:12.653723 15249 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:12.654451 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:12.654976 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:12.659056 15440 tablet_bootstrap.cc:492] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:12.627791 15362 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:12.649753 15318 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:12.677050 15441 tablet_bootstrap.cc:492] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:12.677659 15439 tablet_bootstrap.cc:492] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:12.678119 15439 ts_tablet_manager.cc:1403] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.001s
I20260709 13:02:12.663187 15860 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.681901 15439 raft_consensus.cc:359] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.684712 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:12.685438 15858 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.695204 15439 raft_consensus.cc:385] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.695807 15439 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.697072 15439 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:12.701668 15290 consensus_peers.cc:597] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.698866 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:12.688894 15860 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:12.720575 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:12.727214 15439 ts_tablet_manager.cc:1434] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:02:12.729990 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:12.733314 15440 tablet_bootstrap.cc:654] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.734757 15855 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:12.737561 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:12.739095 15858 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:12.739360 15842 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:12.739879 15842 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:12.716229 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:12.740695 15244 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:02:12.737622 15880 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:02:12.740717 15842 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.705647 15848 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:02:12.745774 15213 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:12.746791 15866 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.727065 15860 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.749632 15654 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:12.757372 15690 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.758102 15690 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.760804 15690 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:12.763943 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:12.764787 15399 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:12.765602 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:12.766386 15398 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.768930 15654 raft_consensus.cc:697] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:12.781558 15398 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:12.766019 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:12.770010 15654 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:12.799397 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 86086.3us
W20260709 13:02:12.800542 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66325.8us
I20260709 13:02:12.801828 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:12.804809 15858 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:12.794377 15391 raft_consensus.cc:2376] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1. Re-sending same reply.
I20260709 13:02:12.814726 15866 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:12.844414 15441 tablet_bootstrap.cc:654] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:12.846998 15855 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:12.854544 15440 tablet_bootstrap.cc:492] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:12.855050 15440 ts_tablet_manager.cc:1403] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.206s	user 0.008s	sys 0.012s
I20260709 13:02:12.849018 15855 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.858204 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:12.859642 15215 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:12.838488 15841 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.864893 15439 tablet_bootstrap.cc:492] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:12.861830 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:12.872943 15244 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:12.862493 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:12.872614 15841 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.875721 15248 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.876928 15860 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.880196 15440 raft_consensus.cc:359] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.877261 15841 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:12.885758 15396 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:12.889075 15440 raft_consensus.cc:385] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:12.890780 15440 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.891947 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:12.916697 15860 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:12.917984 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 116829us
I20260709 13:02:12.918442 15441 tablet_bootstrap.cc:492] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:12.918913 15441 ts_tablet_manager.cc:1403] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.245s	user 0.028s	sys 0.001s
I20260709 13:02:12.919592 15440 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.919070 15248 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
W20260709 13:02:12.921772 15290 leader_election.cc:343] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:12.927176 15290 leader_election.cc:343] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:12.927628 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:12.928402 15607 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:12.927520 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:12.933450 15607 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:12.933581 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:12.934038 15607 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.934410 15607 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:12.934864 15866 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:12.935356 15866 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:12.936182 15866 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.938586 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:12.939474 15248 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:12.969199 15607 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:12.982870 15440 ts_tablet_manager.cc:1434] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.128s	user 0.004s	sys 0.005s
I20260709 13:02:12.983932 15607 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:12.988724 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:13.002215 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:13.002584 15244 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.007021 15441 raft_consensus.cc:359] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.007717 15441 raft_consensus.cc:385] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.007989 15441 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.008599 15441 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.010795 15441 ts_tablet_manager.cc:1434] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.090s	user 0.003s	sys 0.003s
I20260709 13:02:13.010867 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:13.013059 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:02:13.014410 15290 leader_election.cc:343] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.016898 15397 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.016680 15147 catalog_manager.cc:5697] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.022887 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:13.023964 15290 leader_election.cc:343] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.024986 15440 tablet_bootstrap.cc:492] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:13.027585 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:13.029469 15362 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:13.025096 15441 tablet_bootstrap.cc:492] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Bootstrap starting.
I20260709 13:02:13.031247 15439 tablet_bootstrap.cc:654] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.034192 15851 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:13.055836 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:13.060022 15394 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.053818 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:13.071242 15319 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:02:13.079389 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 55452.9us
W20260709 13:02:13.086285 15290 leader_election.cc:343] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:13.100495 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 71112.2us
I20260709 13:02:13.130336 15885 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:13.138609 15440 tablet_bootstrap.cc:654] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.143989 15244 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:13.146384 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:13.148736 15441 tablet_bootstrap.cc:654] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.149603 15607 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:13.150113 15607 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:13.131076 15862 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:02:13.153012 15362 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:13.155833 15638 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:13.158134 15607 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.172537 15439 tablet_bootstrap.cc:492] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:13.173004 15439 ts_tablet_manager.cc:1403] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.334s	user 0.018s	sys 0.016s
I20260709 13:02:13.177901 15860 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:13.200244 15858 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:02:13.212917 15753 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:02:13.180111 15439 raft_consensus.cc:359] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.228956 15439 raft_consensus.cc:385] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.229243 15439 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.246917 15843 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:13.256798 15439 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.261549 15439 ts_tablet_manager.cc:1434] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:02:13.271016 15439 tablet_bootstrap.cc:492] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b: Bootstrap starting.
I20260709 13:02:13.270861 15862 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:13.297606 15862 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:13.301643 15866 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:13.310246 15440 tablet_bootstrap.cc:492] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:13.351289 15607 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.351903 15607 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.387180 15855 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:13.395849 15441 tablet_bootstrap.cc:492] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: No bootstrap required, opened a new log
I20260709 13:02:13.396343 15441 ts_tablet_manager.cc:1403] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent bootstrapping tablet: real 0.371s	user 0.016s	sys 0.019s
I20260709 13:02:13.397303 15440 ts_tablet_manager.cc:1403] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.373s	user 0.029s	sys 0.031s
I20260709 13:02:13.402175 15441 raft_consensus.cc:359] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.402977 15441 raft_consensus.cc:385] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.403263 15441 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.403873 15441 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.406028 15441 ts_tablet_manager.cc:1434] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:02:13.422993 15607 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:13.422840 15753 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.443094 15753 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.450383 15753 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:13.451071 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:13.452883 15290 leader_election.cc:343] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.453065 15440 raft_consensus.cc:359] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.453807 15440 raft_consensus.cc:385] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.454093 15440 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.458493 15440 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.468853 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:13.469663 15318 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:13.475766 15440 ts_tablet_manager.cc:1434] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.004s
I20260709 13:02:13.481294 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:13.482366 15247 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:13.470388 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:13.499104 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:13.506034 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:02:13.507669 15215 leader_election.cc:343] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.515054 15796 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:13.515563 15796 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.515936 15796 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.515120 15859 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:13.519367 15859 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.519729 15859 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.530988 15753 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:02:13.542846 15851 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.550450 15851 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.556559 15439 tablet_bootstrap.cc:654] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:13.611212 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 77080.7us
I20260709 13:02:13.617107 15440 tablet_bootstrap.cc:492] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:13.634420 15851 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:13.637638 15859 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:13.642561 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 115877us
I20260709 13:02:13.648463 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:13.649936 15215 leader_election.cc:343] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:13.657285 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:13.658190 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:13.662740 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:13.662748 15859 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:13.868350 15796 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.869901 15316 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:02:13.870471 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 94924us
W20260709 13:02:13.877867 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 162045us
I20260709 13:02:13.884259 15440 tablet_bootstrap.cc:700] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16: Time spent opening tablet: real 0.177s	user 0.006s	sys 0.003s
I20260709 13:02:13.884977 15440 tablet_bootstrap.cc:654] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:13.902840 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 237688us
I20260709 13:02:13.903772 15796 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:13.910488 15439 tablet_bootstrap.cc:492] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b: No bootstrap required, opened a new log
I20260709 13:02:13.911062 15439 ts_tablet_manager.cc:1403] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b: Time spent bootstrapping tablet: real 0.640s	user 0.036s	sys 0.047s
I20260709 13:02:13.933048 15393 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.943679 15914 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.954387 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 287089us
I20260709 13:02:13.963326 15439 raft_consensus.cc:359] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.964083 15439 raft_consensus.cc:385] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.964368 15439 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Initialized, Role: FOLLOWER
W20260709 13:02:13.976572 15290 consensus_peers.cc:597] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:13.985616 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:13.990068 15439 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.996876 15861 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:13.955142 15914 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:13.974021 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:14.036975 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59699.5us
I20260709 13:02:14.043795 15439 ts_tablet_manager.cc:1434] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b: Time spent starting tablet: real 0.132s	user 0.006s	sys 0.002s
I20260709 13:02:14.049228 15932 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.055370 15855 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.060796 15145 catalog_manager.cc:5697] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.062311 15914 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:14.078476 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:14.079883 15362 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:14.074371 15243 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:14.083554 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:14.092931 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:14.099006 15145 catalog_manager.cc:5697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.096097 15932 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.122430 15316 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 0.
I20260709 13:02:14.131835 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:14.136018 15290 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:14.141604 15215 leader_election.cc:343] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.145107 15866 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:14.147717 15440 tablet_bootstrap.cc:492] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:14.148237 15440 ts_tablet_manager.cc:1403] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.531s	user 0.027s	sys 0.008s
I20260709 13:02:14.183789 15440 raft_consensus.cc:359] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.184577 15440 raft_consensus.cc:385] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.184859 15440 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.185487 15440 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.189739 15932 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:14.189917 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:14.194778 15846 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.195364 15846 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.195827 15846 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.199679 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:14.202091 15440 ts_tablet_manager.cc:1434] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:02:14.202867 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:14.163723 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53184.4us
I20260709 13:02:14.301252 15846 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.322141 15244 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:14.325002 15846 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:14.335564 15440 tablet_bootstrap.cc:492] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:14.342281 15930 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.345517 15440 tablet_bootstrap.cc:654] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:14.375643 15290 leader_election.cc:343] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.376183 15290 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:14.377043 15849 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.382133 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:14.386585 15215 leader_election.cc:343] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.387329 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:14.388103 15321 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.399017 15321 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
W20260709 13:02:14.402782 15290 leader_election.cc:343] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.403344 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:14.404024 15866 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.410166 15144 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.419051 15145 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49174 (request call id 97) took 1526 ms. Trace:
I20260709 13:02:14.427088 15440 tablet_bootstrap.cc:492] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:14.427639 15440 ts_tablet_manager.cc:1403] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.092s	user 0.007s	sys 0.005s
I20260709 13:02:14.430464 15440 raft_consensus.cc:359] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.431246 15440 raft_consensus.cc:385] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.419566 15145 rpcz_store.cc:276] 0709 13:02:12.892310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.923512 (+ 31202us) service_pool.cc:224] Handling call
0709 13:02:14.418935 (+1495423us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:14.343730 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:14.344295 (+   565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:14.344325 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:02:14.344341 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:14.344725 (+   384us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:14.344803 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:14.344830 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:14.345134 (+   304us) tablet.cc:701] Row locks acquired
0709 13:02:14.345153 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:02:14.345302 (+   149us) write_op.cc:270] Start()
0709 13:02:14.345408 (+   106us) write_op.cc:276] Timestamp: P: 1783602134345249 usec, L: 0
0709 13:02:14.345431 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:14.346069 (+   638us) log.cc:844] Serialized 934 byte log entry
0709 13:02:14.385222 (+ 39153us) op_driver.cc:464] REPLICATION: finished
0709 13:02:14.399247 (+ 14025us) write_op.cc:301] APPLY: starting
0709 13:02:14.399303 (+    56us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:14.399384 (+    81us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:14.399544 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:14.399840 (+   296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:14.399990 (+   150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:02:14.400044 (+    54us) write_op.cc:312] APPLY: finished
0709 13:02:14.400196 (+   152us) log.cc:844] Serialized 28 byte log entry
0709 13:02:14.400317 (+   121us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:14.400374 (+    57us) write_op.cc:454] Released schema lock
0709 13:02:14.400398 (+    24us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":3884,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":13841,"apply.run_cpu_time_us":1397,"apply.run_wall_time_us":1397,"num_ops":2,"prepare.queue_time_us":238677,"prepare.run_cpu_time_us":2662,"prepare.run_wall_time_us":10671,"replication_time_us":39666,"thread_start_us":208331,"threads_started":2}]]}
I20260709 13:02:14.435390 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:14.436456 15921 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.437170 15921 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:14.438014 15921 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.431736 15440 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.447800 15440 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.450016 15440 ts_tablet_manager.cc:1434] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:02:14.451191 15440 tablet_bootstrap.cc:492] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:14.457300 15440 tablet_bootstrap.cc:654] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.459875 15144 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 96) took 1336 ms. Trace:
I20260709 13:02:14.463730 15395 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.477197 15147 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:02:14.460268 15144 rpcz_store.cc:276] 0709 13:02:13.130219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.130355 (+   136us) service_pool.cc:224] Handling call
0709 13:02:13.204555 (+ 74200us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b64090 00007f3669c02f3a 00007f366f9b91cc 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc 00007f366df77392 00007f3667f3548c 00007f3667f348c6
0709 13:02:14.459813 (+1255258us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:14.423085 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:14.423608 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:14.423643 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:02:14.423659 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:14.424003 (+   344us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:14.424054 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:14.424090 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:14.424283 (+   193us) tablet.cc:701] Row locks acquired
0709 13:02:14.424303 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:02:14.424478 (+   175us) write_op.cc:270] Start()
0709 13:02:14.424608 (+   130us) write_op.cc:276] Timestamp: P: 1783602134424411 usec, L: 0
0709 13:02:14.424631 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:14.425250 (+   619us) log.cc:844] Serialized 543 byte log entry
0709 13:02:14.430375 (+  5125us) op_driver.cc:464] REPLICATION: finished
0709 13:02:14.434937 (+  4562us) write_op.cc:301] APPLY: starting
0709 13:02:14.435036 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:14.435939 (+   903us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:14.454385 (+ 18446us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:14.454572 (+   187us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:14.454709 (+   137us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:14.454757 (+    48us) write_op.cc:312] APPLY: finished
0709 13:02:14.454958 (+   201us) log.cc:844] Serialized 22 byte log entry
0709 13:02:14.455712 (+   754us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:14.455793 (+    81us) write_op.cc:454] Released schema lock
0709 13:02:14.455828 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:14.456126 (+   298us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:14.456150 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4955,"reported_tablets":6,"spinlock_wait_cycles":114204032,"child_traces":[["op",{"apply.queue_time_us":4302,"apply.run_cpu_time_us":1543,"apply.run_wall_time_us":21166,"num_ops":1,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":2433,"prepare.run_wall_time_us":2432,"replication_time_us":5629}]]}
I20260709 13:02:14.497114 15440 tablet_bootstrap.cc:492] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:14.497651 15440 ts_tablet_manager.cc:1403] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.018s
I20260709 13:02:14.500538 15440 raft_consensus.cc:359] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.501251 15440 raft_consensus.cc:385] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.501541 15440 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.502197 15440 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.507365 15440 ts_tablet_manager.cc:1434] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:02:14.508319 15440 tablet_bootstrap.cc:492] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:14.516178 15849 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.517169 15440 tablet_bootstrap.cc:654] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.516703 15849 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.519797 15849 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:14.530036 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:14.526202 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:14.536990 15242 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 0.
I20260709 13:02:14.543825 15291 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:14.544840 15849 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:14.545250 15849 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.550314 15849 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:14.563158 15290 leader_election.cc:343] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.548852 15147 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:02:14.580302 15147 catalog_manager.cc:5697] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:02:14.582173 15849 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.582463 15147 catalog_manager.cc:5697] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.598256 15440 tablet_bootstrap.cc:492] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:14.598776 15440 ts_tablet_manager.cc:1403] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.091s	user 0.023s	sys 0.020s
I20260709 13:02:14.603266 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:14.604792 15290 leader_election.cc:343] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:14.605335 15849 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:14.605026 15440 raft_consensus.cc:359] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.606410 15440 raft_consensus.cc:385] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.606714 15440 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.606980 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:14.607604 15242 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.607453 15440 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.610596 15440 ts_tablet_manager.cc:1434] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:02:14.611593 15440 tablet_bootstrap.cc:492] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:14.618633 15440 tablet_bootstrap.cc:654] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.629766 15440 tablet_bootstrap.cc:492] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:14.630256 15440 ts_tablet_manager.cc:1403] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 13:02:14.631006 15242 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:14.632858 15440 raft_consensus.cc:359] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.633584 15440 raft_consensus.cc:385] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.633850 15440 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.634696 15291 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:14.634526 15440 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.635514 15923 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:14.636210 15923 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:14.636221 15440 ts_tablet_manager.cc:1434] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:14.639065 15440 tablet_bootstrap.cc:492] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Bootstrap starting.
I20260709 13:02:14.637101 15923 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.644961 15440 tablet_bootstrap.cc:654] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:14.646625 15395 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.656128 15440 tablet_bootstrap.cc:492] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: No bootstrap required, opened a new log
I20260709 13:02:14.656662 15440 ts_tablet_manager.cc:1403] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:02:14.659384 15440 raft_consensus.cc:359] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.659817 15858 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.660089 15440 raft_consensus.cc:385] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:14.660378 15440 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Initialized, Role: FOLLOWER
I20260709 13:02:14.660285 15858 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.661058 15440 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.663295 15440 ts_tablet_manager.cc:1434] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:14.663230 15858 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:14.663718 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:14.664587 15245 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:14.667533 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:14.668349 15321 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:14.670930 15362 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:14.672003 15858 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.683538 15858 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.694345 15145 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:14.708118 15395 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.840525 15858 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.841082 15858 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.843302 15858 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:14.843866 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:14.844220 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:14.845031 15321 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:14.845791 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:14.846421 15858 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.852037 15858 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:14.924974 15858 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.925473 15858 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:14.929224 15858 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:14.930162 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:14.932160 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:14.932853 15245 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 1: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:14.933650 15365 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:14.934291 15930 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:14.939399 15930 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.041144 15849 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:15.055912 15921 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:15.073307 15920 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:15.073836 15849 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:15.142843 15196 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:15.911696 15796 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.912300 15796 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:15.914513 15796 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:15.915264 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:15.915591 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:15.915988 15242 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:15.916217 15397 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:15.917346 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:15.918931 15796 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:15.919308 15796 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.919646 15796 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:15.925275 15796 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:15.927361 15796 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:15.928166 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:15.928817 15242 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:15.929282 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:15.929857 15398 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:15.934909 15398 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:15.935567 15242 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:15.935822 15290 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:15.936818 15796 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:15.937214 15796 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:15.937924 15796 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:15.947947 15147 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 0 to 2, leader changed from <none> to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 2 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.322408 15398 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:16.323549 15923 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.333534 15244 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:16.338814 15974 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:17.930414 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:17.956187 15988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:17.956175 15987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:17.956216 15990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:17.958488 14139 server_base.cc:1061] running on GCE node
I20260709 13:02:17.960882 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:17.961201 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:17.961473 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602137961451 us; error 0 us; skew 500 ppm
I20260709 13:02:17.962080 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:17.964922 14139 webserver.cc:533] Webserver started at http://127.13.206.196:35867/ using document root <none> and password file <none>
I20260709 13:02:17.965484 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:17.965705 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:17.966028 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:17.967303 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-3-root/instance:
uuid: "edcf4a6bae7e4781bce325a586109ca5"
format_stamp: "Formatted at 2026-07-09 13:02:17 on dist-test-slave-ml7r"
I20260709 13:02:17.973711 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.006s
I20260709 13:02:17.977272 15995 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:17.978087 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:17.978477 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-3-root
uuid: "edcf4a6bae7e4781bce325a586109ca5"
format_stamp: "Formatted at 2026-07-09 13:02:17 on dist-test-slave-ml7r"
I20260709 13:02:17.978775 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:17.992844 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:17.994208 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:17.995905 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:18.001201 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:18.001564 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:02:18.001938 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:18.002194 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:18.068903 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.196:38543
I20260709 13:02:18.068991 16057 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.196:38543 every 8 connection(s)
I20260709 13:02:18.075423 14139 auto_leader_rebalancer-test.cc:384] add a tserver: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:18.099275 16058 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45539
I20260709 13:02:18.099798 16058 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:18.100683 16058 heartbeater.cc:507] Master 127.13.206.254:45539 requested a full tablet report, sending...
I20260709 13:02:18.102732 15145 ts_manager.cc:194] Registered new tserver with Master: edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:18.104488 15145 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54066
I20260709 13:02:18.333472 15245 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:18.342860 15323 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.344399 15982 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:18.357280 15398 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:18.363271 15316 raft_consensus.cc:2955] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.363271 15982 raft_consensus.cc:2955] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:02:18.372464 15214 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b3be1966cf543b3b9832118d5f11aa2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.380908 15920 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.385847 15242 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:18.395393 15398 raft_consensus.cc:2955] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.397392 15147 catalog_manager.cc:5697] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 2 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.411420 15316 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:18.411880 15397 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:18.413157 16068 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.414739 15920 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:18.415758 15214 consensus_peers.cc:597] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 76857f06f24d4d9183e84f52d83bf070. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.437686 16068 raft_consensus.cc:2955] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.443733 15398 raft_consensus.cc:2955] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.446107 15316 raft_consensus.cc:2955] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.468950 15145 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.484905 15316 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:18.493100 15242 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:18.493566 15398 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:18.495015 15981 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:18.496023 15985 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:18.514029 15289 consensus_peers.cc:597] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b29a6f3425a941868726620486fe7013. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.518707 15980 raft_consensus.cc:2955] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.528612 15242 raft_consensus.cc:2955] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.532279 15397 raft_consensus.cc:2955] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.534672 15245 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:18.537883 15147 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:18.547840 15397 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:18.550109 16069 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:18.553803 15214 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 521a10ac7e184bf1978bbe6947d0ca8d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:18.555025 15316 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:18.557657 15982 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:18.587212 16069 raft_consensus.cc:2955] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.589095 15321 raft_consensus.cc:2955] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.592111 15397 raft_consensus.cc:2955] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.612455 15145 catalog_manager.cc:5697] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:18.769399 16086 ts_tablet_manager.cc:933] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:18.771636 16086 tablet_copy_client.cc:323] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:18.785555 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet 6b3be1966cf543b3b9832118d5f11aa2 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:18.786172 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet 6b3be1966cf543b3b9832118d5f11aa2 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-6b3be1966cf543b3b9832118d5f11aa2
I20260709 13:02:18.794663 15260 tablet_copy_source_session.cc:215] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:18.798556 16086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b3be1966cf543b3b9832118d5f11aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:18.811412 16086 tablet_copy_client.cc:806] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:18.812052 16086 tablet_copy_client.cc:670] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:18.816227 16086 tablet_copy_client.cc:538] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:18.826462 16086 tablet_bootstrap.cc:492] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:18.861893 16086 tablet_bootstrap.cc:492] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:18.863385 16086 tablet_bootstrap.cc:492] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:18.864076 16086 ts_tablet_manager.cc:1403] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.001s
I20260709 13:02:18.866945 16086 raft_consensus.cc:359] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:18.867817 16086 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:18.868489 16086 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:18.871112 16058 heartbeater.cc:499] Master 127.13.206.254:45539 was elected leader, sending a full tablet report...
I20260709 13:02:18.873251 16086 ts_tablet_manager.cc:1434] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:18.877087 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-6b3be1966cf543b3b9832118d5f11aa2 received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:18.877562 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-6b3be1966cf543b3b9832118d5f11aa2 on tablet 6b3be1966cf543b3b9832118d5f11aa2 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:18.916956 16086 ts_tablet_manager.cc:933] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:18.918776 16086 tablet_copy_client.cc:323] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:18.929688 15335 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet b29a6f3425a941868726620486fe7013 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:18.930337 15335 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet b29a6f3425a941868726620486fe7013 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-b29a6f3425a941868726620486fe7013
I20260709 13:02:18.935834 15335 tablet_copy_source_session.cc:215] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:18.939050 16086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29a6f3425a941868726620486fe7013. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:18.955384 16086 tablet_copy_client.cc:806] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:18.955992 16086 tablet_copy_client.cc:670] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:18.964891 16086 tablet_copy_client.cc:538] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:18.975629 16086 tablet_bootstrap.cc:492] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:18.988462 16092 ts_tablet_manager.cc:933] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:18.990482 16092 tablet_copy_client.cc:323] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:18.993223 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet 76857f06f24d4d9183e84f52d83bf070 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:18.993808 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet 76857f06f24d4d9183e84f52d83bf070 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-76857f06f24d4d9183e84f52d83bf070
I20260709 13:02:19.003715 15260 tablet_copy_source_session.cc:215] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:19.006969 16092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76857f06f24d4d9183e84f52d83bf070. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:19.016134 16086 tablet_bootstrap.cc:492] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:19.017179 16086 tablet_bootstrap.cc:492] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:19.017864 16086 ts_tablet_manager.cc:1403] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.013s
I20260709 13:02:19.020728 16086 raft_consensus.cc:359] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:19.021559 16086 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:19.022195 16086 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:19.030613 16086 ts_tablet_manager.cc:1434] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.006s
I20260709 13:02:19.038125 15335 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-b29a6f3425a941868726620486fe7013 received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:19.038661 15335 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-b29a6f3425a941868726620486fe7013 on tablet b29a6f3425a941868726620486fe7013 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:19.051443 16092 tablet_copy_client.cc:806] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:19.052103 16092 tablet_copy_client.cc:670] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:19.055550 16092 tablet_copy_client.cc:538] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:19.064560 16092 tablet_bootstrap.cc:492] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:19.069052 16086 ts_tablet_manager.cc:933] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:19.083129 16086 tablet_copy_client.cc:323] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:19.086476 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet 521a10ac7e184bf1978bbe6947d0ca8d from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:19.087047 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet 521a10ac7e184bf1978bbe6947d0ca8d from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-521a10ac7e184bf1978bbe6947d0ca8d
I20260709 13:02:19.090922 16092 tablet_bootstrap.cc:492] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:19.091812 16092 tablet_bootstrap.cc:492] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:19.092384 16092 ts_tablet_manager.cc:1403] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.028s	user 0.023s	sys 0.004s
I20260709 13:02:19.094410 15260 tablet_copy_source_session.cc:215] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:19.095167 16092 raft_consensus.cc:359] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:19.096043 16092 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:19.096716 16092 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:19.097651 16086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521a10ac7e184bf1978bbe6947d0ca8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:19.107435 16092 ts_tablet_manager.cc:1434] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:02:19.115458 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-76857f06f24d4d9183e84f52d83bf070 received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:19.115940 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-76857f06f24d4d9183e84f52d83bf070 on tablet 76857f06f24d4d9183e84f52d83bf070 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:19.124141 16086 tablet_copy_client.cc:806] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:19.124770 16086 tablet_copy_client.cc:670] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:19.130338 16086 tablet_copy_client.cc:538] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:19.136222 16086 tablet_bootstrap.cc:492] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:19.164120 16086 tablet_bootstrap.cc:492] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:19.165022 16086 tablet_bootstrap.cc:492] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:19.165904 16086 ts_tablet_manager.cc:1403] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.009s
I20260709 13:02:19.172946 16086 raft_consensus.cc:359] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:19.173692 16086 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:19.174396 16086 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:19.177275 16086 ts_tablet_manager.cc:1434] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:02:19.180708 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-521a10ac7e184bf1978bbe6947d0ca8d received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:19.181160 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-521a10ac7e184bf1978bbe6947d0ca8d on tablet 521a10ac7e184bf1978bbe6947d0ca8d with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:19.217705 16033 raft_consensus.cc:1217] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:02:19.374069 16033 raft_consensus.cc:1217] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:19.553459 16033 raft_consensus.cc:1217] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:19.590843 16033 raft_consensus.cc:1217] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:19.670113 16068 raft_consensus.cc:1064] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:19.674198 16068 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:19.685148 16033 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:19.685333 15395 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:19.691176 15319 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:19.694449 16099 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:19.697664 16069 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:19.699012 15920 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:19.824013 15396 raft_consensus.cc:2955] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:19.817143 15982 raft_consensus.cc:2955] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:19.849625 16033 raft_consensus.cc:2955] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:19.862310 15144 catalog_manager.cc:5697] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:19.871306 15316 raft_consensus.cc:2955] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:19.909843 16068 raft_consensus.cc:1064] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:19.912776 16068 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:19.920480 15245 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:19.928803 16033 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:02:19.931207 15920 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:19.935472 16032 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:19.939935 15323 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:19.942101 15920 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:19.943866 16101 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:19.948194 15920 raft_consensus.cc:2955] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:19.954912 15398 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:02:19.958288 15982 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:19.963748 15398 raft_consensus.cc:2955] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:19.954788 16033 raft_consensus.cc:2955] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:19.975106 15395 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:19.978192 16068 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:19.991514 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b3be1966cf543b3b9832118d5f11aa2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:19.996306 16068 raft_consensus.cc:2955] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.001748 16031 raft_consensus.cc:2955] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:19.999792 15146 catalog_manager.cc:5697] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New cstate: current_term: 2 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.024281 15395 raft_consensus.cc:2955] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.037760 15314 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b3be1966cf543b3b9832118d5f11aa2 with delete_type TABLET_DATA_TOMBSTONED (TS 45ddec37d9e741a598bf32f6c9d7e0ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39704
I20260709 13:02:20.043211 15147 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.064546 16115 tablet_replica.cc:333] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:02:20.066354 15316 raft_consensus.cc:2955] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.067345 16115 raft_consensus.cc:2243] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.078660 16115 raft_consensus.cc:2272] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.092473 16115 ts_tablet_manager.cc:1916] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:20.099774 15242 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:20.111421 16031 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:20.111840 16115 ts_tablet_manager.cc:1929] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:02:20.112454 16115 log.cc:1199] T 6b3be1966cf543b3b9832118d5f11aa2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/wals/6b3be1966cf543b3b9832118d5f11aa2
I20260709 13:02:20.113054 15982 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:20.114818 15132 catalog_manager.cc:5028] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): tablet 6b3be1966cf543b3b9832118d5f11aa2 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:20.118366 15316 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:20.119832 15920 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:20.121007 16099 raft_consensus.cc:2955] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.124187 15316 raft_consensus.cc:2955] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.131330 16031 raft_consensus.cc:2955] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.140008 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 76857f06f24d4d9183e84f52d83bf070 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:20.145630 15147 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.157184 15385 tablet_service.cc:1558] Processing DeleteTablet for tablet 76857f06f24d4d9183e84f52d83bf070 with delete_type TABLET_DATA_TOMBSTONED (TS ee9654803379434388de45d4693e6b16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39706
I20260709 13:02:20.159178 16116 tablet_replica.cc:333] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:02:20.160367 16116 raft_consensus.cc:2243] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.161062 16116 raft_consensus.cc:2272] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.168906 15981 raft_consensus.cc:1064] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:20.169509 16116 ts_tablet_manager.cc:1916] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:20.171612 15981 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:20.194015 15982 raft_consensus.cc:1064] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:20.194918 16031 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:20.196516 15982 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:20.197392 15985 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:20.198113 16116 ts_tablet_manager.cc:1929] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:20.198611 16116 log.cc:1199] T 76857f06f24d4d9183e84f52d83bf070 P ee9654803379434388de45d4693e6b16: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/wals/76857f06f24d4d9183e84f52d83bf070
I20260709 13:02:20.200702 15134 catalog_manager.cc:5028] TS ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): tablet 76857f06f24d4d9183e84f52d83bf070 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:20.209939 15394 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:20.210680 15242 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:20.212459 16032 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:20.213158 15981 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:20.213434 15394 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:20.214944 15920 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:20.215190 15980 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:20.224162 15982 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:20.225350 15316 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:20.228380 15982 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:20.247301 15980 raft_consensus.cc:2955] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.253269 15395 raft_consensus.cc:2955] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.254740 15982 raft_consensus.cc:2955] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.259290 15323 raft_consensus.cc:2955] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.260013 16032 raft_consensus.cc:2955] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.268539 15242 raft_consensus.cc:2955] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.270887 15395 raft_consensus.cc:2955] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.277088 15145 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.324667 15147 catalog_manager.cc:5697] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.364534 16032 raft_consensus.cc:2955] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:02:20.394536 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 63317us
I20260709 13:02:20.406740 15245 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:20.409009 15316 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:20.413900 16032 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:20.414763 15393 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:20.415784 16099 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:20.420334 16069 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:20.436527 15982 raft_consensus.cc:2955] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.440959 16032 raft_consensus.cc:2955] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.470541 15395 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:20.471500 16031 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:20.479938 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 521a10ac7e184bf1978bbe6947d0ca8d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:20.484498 16126 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:20.492168 15145 catalog_manager.cc:5697] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:20.494768 15393 raft_consensus.cc:2955] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.513477 15981 raft_consensus.cc:2955] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.514704 15394 raft_consensus.cc:2955] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.518136 15314 tablet_service.cc:1558] Processing DeleteTablet for tablet 521a10ac7e184bf1978bbe6947d0ca8d with delete_type TABLET_DATA_TOMBSTONED (TS 45ddec37d9e741a598bf32f6c9d7e0ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39704
I20260709 13:02:20.519229 16115 tablet_replica.cc:333] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:02:20.519438 16126 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:20.520267 16115 raft_consensus.cc:2243] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.521217 16115 raft_consensus.cc:2272] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.525739 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b29a6f3425a941868726620486fe7013 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:20.534250 16115 ts_tablet_manager.cc:1916] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:20.543072 16032 raft_consensus.cc:2955] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:20.545497 15145 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.574352 15236 tablet_service.cc:1558] Processing DeleteTablet for tablet b29a6f3425a941868726620486fe7013 with delete_type TABLET_DATA_TOMBSTONED (TS 89940175e5444593aab6b3a025624b5b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59986
I20260709 13:02:20.582376 16115 ts_tablet_manager.cc:1929] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:20.583195 16115 log.cc:1199] T 521a10ac7e184bf1978bbe6947d0ca8d P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/wals/521a10ac7e184bf1978bbe6947d0ca8d
I20260709 13:02:20.583791 16127 tablet_replica.cc:333] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:02:20.584627 15132 catalog_manager.cc:5028] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): tablet 521a10ac7e184bf1978bbe6947d0ca8d (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:20.584928 16127 raft_consensus.cc:2243] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:20.585637 16127 raft_consensus.cc:2272] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:20.588255 16127 ts_tablet_manager.cc:1916] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:20.600570 16127 ts_tablet_manager.cc:1929] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:20.600914 16127 log.cc:1199] T b29a6f3425a941868726620486fe7013 P 89940175e5444593aab6b3a025624b5b: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/wals/b29a6f3425a941868726620486fe7013
I20260709 13:02:20.602383 15135 catalog_manager.cc:5028] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): tablet b29a6f3425a941868726620486fe7013 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:21.640494 15316 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:21.646517 15393 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:21.646793 15245 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:02:21.648195 15289 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d3f2b48b18a47388a0e1497a84803ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:21.648237 15985 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.649139 15981 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.658933 15393 raft_consensus.cc:2955] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.657433 15981 raft_consensus.cc:2955] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.659591 15244 raft_consensus.cc:2955] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.675356 15147 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 2 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.700042 15393 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:21.722043 15316 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:21.723927 15858 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:21.724016 15244 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:21.726521 16129 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.759761 16129 raft_consensus.cc:2955] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.770095 15323 raft_consensus.cc:2955] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:02:21.774425 15363 consensus_peers.cc:597] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5db51018c5b04518b8cb7f3e5f2ca694. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:21.782270 15245 raft_consensus.cc:2955] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.789920 15244 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:21.807204 15393 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:21.808187 15316 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:21.808761 16069 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.808292 15145 catalog_manager.cc:5697] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.809593 15982 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:21.812543 15214 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6d786e7c4904b39b63a5862d5a7e6f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:21.828956 16101 raft_consensus.cc:2955] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.835606 15394 raft_consensus.cc:2955] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.843811 15323 raft_consensus.cc:2955] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.866866 15147 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 2 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.872014 15323 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:21.890480 15395 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:21.890985 15289 consensus_peers.cc:597] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5704803490ae4e7bb7f8229734bd20df. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:21.891997 15244 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:21.893589 15981 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.895151 16126 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:21.913189 15981 raft_consensus.cc:2955] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.915215 15393 raft_consensus.cc:2955] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.915798 15245 raft_consensus.cc:2955] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:21.934376 15147 catalog_manager.cc:5697] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.225349 16152 ts_tablet_manager.cc:933] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:22.239562 16154 ts_tablet_manager.cc:933] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:22.239799 16152 tablet_copy_client.cc:323] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:22.242102 16154 tablet_copy_client.cc:323] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:22.242076 15335 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet 2d3f2b48b18a47388a0e1497a84803ff from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:22.242893 15335 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet 2d3f2b48b18a47388a0e1497a84803ff from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-2d3f2b48b18a47388a0e1497a84803ff
I20260709 13:02:22.244279 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet a6d786e7c4904b39b63a5862d5a7e6f4 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:22.244808 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet a6d786e7c4904b39b63a5862d5a7e6f4 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-a6d786e7c4904b39b63a5862d5a7e6f4
I20260709 13:02:22.252429 15335 tablet_copy_source_session.cc:215] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:22.252939 15260 tablet_copy_source_session.cc:215] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:22.255722 16156 ts_tablet_manager.cc:933] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:22.257540 16154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6d786e7c4904b39b63a5862d5a7e6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.259882 16152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d3f2b48b18a47388a0e1497a84803ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.279124 16154 tablet_copy_client.cc:806] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:22.279848 16154 tablet_copy_client.cc:670] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:22.284687 16154 tablet_copy_client.cc:538] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:22.301375 16152 tablet_copy_client.cc:806] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:22.302114 16152 tablet_copy_client.cc:670] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:22.306327 16156 tablet_copy_client.cc:323] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.195:44417
I20260709 13:02:22.310213 16152 tablet_copy_client.cc:538] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:22.326905 16158 ts_tablet_manager.cc:933] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:22.337392 16154 tablet_bootstrap.cc:492] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:22.337836 16158 tablet_copy_client.cc:323] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:22.337416 16152 tablet_bootstrap.cc:492] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:22.339902 15335 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet 5704803490ae4e7bb7f8229734bd20df from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:22.340449 15335 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet 5704803490ae4e7bb7f8229734bd20df from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-5704803490ae4e7bb7f8229734bd20df
I20260709 13:02:22.342931 15409 tablet_copy_service.cc:140] P ee9654803379434388de45d4693e6b16: Received BeginTabletCopySession request for tablet 5db51018c5b04518b8cb7f3e5f2ca694 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:51818)
I20260709 13:02:22.343541 15409 tablet_copy_service.cc:161] P ee9654803379434388de45d4693e6b16: Beginning new tablet copy session on tablet 5db51018c5b04518b8cb7f3e5f2ca694 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:51818: session id = edcf4a6bae7e4781bce325a586109ca5-5db51018c5b04518b8cb7f3e5f2ca694
I20260709 13:02:22.353427 15409 tablet_copy_source_session.cc:215] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:22.353499 15335 tablet_copy_source_session.cc:215] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:22.357272 16158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5704803490ae4e7bb7f8229734bd20df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.365756 16156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db51018c5b04518b8cb7f3e5f2ca694. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:22.386737 16156 tablet_copy_client.cc:806] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:22.387416 16156 tablet_copy_client.cc:670] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:22.391914 16156 tablet_copy_client.cc:538] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:22.393970 16154 tablet_bootstrap.cc:492] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:22.397461 16154 tablet_bootstrap.cc:492] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:22.399679 16154 ts_tablet_manager.cc:1403] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.008s
I20260709 13:02:22.403231 16156 tablet_bootstrap.cc:492] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:22.403472 16158 tablet_copy_client.cc:806] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:22.404896 16158 tablet_copy_client.cc:670] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:22.409394 16158 tablet_copy_client.cc:538] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:22.418399 16154 raft_consensus.cc:359] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:22.419745 16154 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:22.423115 16154 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:22.438949 16152 tablet_bootstrap.cc:492] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:22.440775 16154 ts_tablet_manager.cc:1434] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.008s
I20260709 13:02:22.432833 16158 tablet_bootstrap.cc:492] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:22.445245 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-a6d786e7c4904b39b63a5862d5a7e6f4 received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:22.445737 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-a6d786e7c4904b39b63a5862d5a7e6f4 on tablet a6d786e7c4904b39b63a5862d5a7e6f4 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:22.447196 16156 tablet_bootstrap.cc:492] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:22.448120 16156 tablet_bootstrap.cc:492] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:22.448904 16156 ts_tablet_manager.cc:1403] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.046s	user 0.025s	sys 0.005s
I20260709 13:02:22.450219 16152 tablet_bootstrap.cc:492] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:22.451094 16152 ts_tablet_manager.cc:1403] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.116s	user 0.025s	sys 0.003s
I20260709 13:02:22.452122 16156 raft_consensus.cc:359] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:22.454466 16156 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:22.462477 16156 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:22.465824 16156 ts_tablet_manager.cc:1434] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:02:22.468737 16152 raft_consensus.cc:359] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:22.469269 15409 tablet_copy_service.cc:342] P ee9654803379434388de45d4693e6b16: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-5db51018c5b04518b8cb7f3e5f2ca694 received from {username='slave'} at 127.0.0.1:51818
I20260709 13:02:22.469789 15409 tablet_copy_service.cc:434] P ee9654803379434388de45d4693e6b16: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-5db51018c5b04518b8cb7f3e5f2ca694 on tablet 5db51018c5b04518b8cb7f3e5f2ca694 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:22.469687 16152 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:22.470616 16152 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:22.473248 16152 ts_tablet_manager.cc:1434] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:02:22.475185 15335 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-2d3f2b48b18a47388a0e1497a84803ff received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:22.475675 15335 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-2d3f2b48b18a47388a0e1497a84803ff on tablet 2d3f2b48b18a47388a0e1497a84803ff with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:22.497609 16158 tablet_bootstrap.cc:492] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:22.498716 16158 tablet_bootstrap.cc:492] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:22.499503 16158 ts_tablet_manager.cc:1403] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.067s	user 0.026s	sys 0.006s
I20260709 13:02:22.502532 16158 raft_consensus.cc:359] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:22.503485 16158 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:22.504256 16158 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:22.506299 16158 ts_tablet_manager.cc:1434] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:22.508229 15335 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-5704803490ae4e7bb7f8229734bd20df received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:22.508678 15335 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-5704803490ae4e7bb7f8229734bd20df on tablet 5704803490ae4e7bb7f8229734bd20df with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:22.608312 16032 raft_consensus.cc:1217] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:02:22.653787 16032 raft_consensus.cc:1217] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:02:22.662343 16032 raft_consensus.cc:1217] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:22.903041 16032 raft_consensus.cc:1217] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:23.038391 16166 raft_consensus.cc:1064] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:23.041142 16166 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:23.049805 16032 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:23.051679 15395 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:23.052954 15316 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:23.053136 15982 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.054832 15982 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.058624 15982 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.075573 16101 raft_consensus.cc:2955] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.078024 16031 raft_consensus.cc:2955] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.100020 15393 raft_consensus.cc:2955] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.104326 15145 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.107678 15316 raft_consensus.cc:2955] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.167889 15242 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:23.176088 16031 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:02:23.176926 15395 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:02:23.177381 16101 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:23.178390 16171 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:23.185289 16166 raft_consensus.cc:2955] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.189788 15395 raft_consensus.cc:2955] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.196749 16031 raft_consensus.cc:2955] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.199191 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6d786e7c4904b39b63a5862d5a7e6f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:23.208469 15146 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New cstate: current_term: 2 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.220352 15314 tablet_service.cc:1558] Processing DeleteTablet for tablet a6d786e7c4904b39b63a5862d5a7e6f4 with delete_type TABLET_DATA_TOMBSTONED (TS 45ddec37d9e741a598bf32f6c9d7e0ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39704
I20260709 13:02:23.222165 16179 tablet_replica.cc:333] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:02:23.223327 16179 raft_consensus.cc:2243] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.224385 16179 raft_consensus.cc:2272] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.228168 16179 ts_tablet_manager.cc:1916] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:23.232251 15985 raft_consensus.cc:1064] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:23.235350 15985 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:23.246325 16179 ts_tablet_manager.cc:1929] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:02:23.246918 16179 log.cc:1199] T a6d786e7c4904b39b63a5862d5a7e6f4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/wals/a6d786e7c4904b39b63a5862d5a7e6f4
I20260709 13:02:23.248665 15132 catalog_manager.cc:5028] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): tablet a6d786e7c4904b39b63a5862d5a7e6f4 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:23.255334 16031 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:23.256481 15395 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:23.256958 15242 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:23.256855 16126 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:23.260687 15981 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.262856 15981 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.267590 16145 raft_consensus.cc:1064] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:23.270215 16145 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:23.280023 16126 raft_consensus.cc:2955] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.284217 15395 raft_consensus.cc:2955] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.286970 16031 raft_consensus.cc:2955] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.310101 15146 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.313776 15316 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:23.314944 16032 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:23.315928 16168 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.319068 15245 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:23.318845 16168 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:23.323731 16145 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.329533 15242 raft_consensus.cc:2955] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.360351 15985 raft_consensus.cc:1064] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:23.360488 15323 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:23.362769 15985 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:23.394670 16032 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:02:23.394958 15242 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:02:23.398048 16126 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:23.399294 16031 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:23.401490 15981 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.403420 15981 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:23.406021 15244 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:23.412212 15397 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:23.417563 15981 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:23.420152 15981 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:23.421571 16126 raft_consensus.cc:2955] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.430101 16031 raft_consensus.cc:2955] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.455168 16145 raft_consensus.cc:2955] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.457862 15245 raft_consensus.cc:2955] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:02:23.469215 16191 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:02:23.475050 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 43651.4us
I20260709 13:02:23.477594 15242 raft_consensus.cc:2955] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.488840 15146 catalog_manager.cc:5697] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.500716 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d3f2b48b18a47388a0e1497a84803ff with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:23.501672 15144 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New cstate: current_term: 2 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.501207 16032 raft_consensus.cc:2955] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.516703 16193 raft_consensus.cc:2955] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.530861 15385 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d3f2b48b18a47388a0e1497a84803ff with delete_type TABLET_DATA_TOMBSTONED (TS ee9654803379434388de45d4693e6b16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39706
I20260709 13:02:23.530578 15244 raft_consensus.cc:2955] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.545732 16032 raft_consensus.cc:2955] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.555958 15144 catalog_manager.cc:5697] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.573343 15319 raft_consensus.cc:2955] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.589459 16197 tablet_replica.cc:333] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:02:23.590695 16197 raft_consensus.cc:2243] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.602262 16197 raft_consensus.cc:2272] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.603788 15395 raft_consensus.cc:2955] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.610934 15397 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:23.622977 16032 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:23.624410 16197 ts_tablet_manager.cc:1916] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:23.625339 16195 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:23.625959 15323 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:23.628813 16168 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:23.634760 15323 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:23.637427 16168 raft_consensus.cc:2955] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.642884 16031 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:23.644902 16192 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:23.647302 15319 raft_consensus.cc:2955] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.649919 15397 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:23.655771 15134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5db51018c5b04518b8cb7f3e5f2ca694 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:23.656181 16031 raft_consensus.cc:2955] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.667698 16192 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:23.671540 15146 catalog_manager.cc:5697] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.680809 16192 raft_consensus.cc:2955] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.691526 15236 tablet_service.cc:1558] Processing DeleteTablet for tablet 5db51018c5b04518b8cb7f3e5f2ca694 with delete_type TABLET_DATA_TOMBSTONED (TS 89940175e5444593aab6b3a025624b5b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59986
I20260709 13:02:23.692816 16197 ts_tablet_manager.cc:1929] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:02:23.693372 16197 log.cc:1199] T 2d3f2b48b18a47388a0e1497a84803ff P ee9654803379434388de45d4693e6b16: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/wals/2d3f2b48b18a47388a0e1497a84803ff
I20260709 13:02:23.697149 16031 raft_consensus.cc:2955] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.699776 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5704803490ae4e7bb7f8229734bd20df with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:23.694943 15134 catalog_manager.cc:5028] TS ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): tablet 2d3f2b48b18a47388a0e1497a84803ff (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:23.712127 15393 raft_consensus.cc:2955] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.721714 16198 tablet_replica.cc:333] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:02:23.723264 16198 raft_consensus.cc:2243] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.723107 15146 catalog_manager.cc:5697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:23.724076 16198 raft_consensus.cc:2272] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.727643 16198 ts_tablet_manager.cc:1916] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:23.745168 15236 tablet_service.cc:1558] Processing DeleteTablet for tablet 5704803490ae4e7bb7f8229734bd20df with delete_type TABLET_DATA_TOMBSTONED (TS 89940175e5444593aab6b3a025624b5b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59986
I20260709 13:02:23.745463 16198 ts_tablet_manager.cc:1929] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:23.745956 16198 log.cc:1199] T 5db51018c5b04518b8cb7f3e5f2ca694 P 89940175e5444593aab6b3a025624b5b: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/wals/5db51018c5b04518b8cb7f3e5f2ca694
I20260709 13:02:23.747885 16198 tablet_replica.cc:333] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:02:23.748162 15135 catalog_manager.cc:5028] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): tablet 5db51018c5b04518b8cb7f3e5f2ca694 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:23.749514 16198 raft_consensus.cc:2243] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:23.750352 16198 raft_consensus.cc:2272] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:23.753865 16198 ts_tablet_manager.cc:1916] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:23.770063 16198 ts_tablet_manager.cc:1929] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:23.770597 16198 log.cc:1199] T 5704803490ae4e7bb7f8229734bd20df P 89940175e5444593aab6b3a025624b5b: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/wals/5704803490ae4e7bb7f8229734bd20df
I20260709 13:02:23.772053 15135 catalog_manager.cc:5028] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): tablet 5704803490ae4e7bb7f8229734bd20df (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:24.834268 15245 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
W20260709 13:02:24.842397 15214 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 87a9a9eccfa9436c993e85bfe0343332. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:24.842831 15397 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:24.843677 15319 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:24.844287 16199 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.845455 16166 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.857342 16166 raft_consensus.cc:2955] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.859221 15393 raft_consensus.cc:2955] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.861923 15319 raft_consensus.cc:2955] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.876338 15144 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.879498 15319 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
W20260709 13:02:24.898571 15289 consensus_peers.cc:597] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4342f068b244466e9d599b81fd154374. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:24.899633 15393 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:24.901269 16193 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.901638 15245 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:24.903393 16193 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.913596 16181 raft_consensus.cc:2955] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.919118 15393 raft_consensus.cc:2955] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.923599 15242 raft_consensus.cc:2955] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.938498 15244 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:24.943727 15147 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.954875 15397 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:24.956147 16128 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.956657 15319 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:24.956928 15214 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13d6106766cf4009837f848b4f8cbb1f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:24.957860 16128 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.968811 16166 raft_consensus.cc:2955] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.972994 15397 raft_consensus.cc:2955] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.985257 15323 raft_consensus.cc:2955] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:24.993101 15319 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:24.995842 15144 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:25.002175 15289 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e71ec5b3198446c0a387428e2a4eb753. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:25.016757 15397 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:25.016961 15244 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:25.018350 16200 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.019260 16193 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.028213 16193 raft_consensus.cc:2955] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:25.039808 15244 raft_consensus.cc:2955] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:25.040405 15395 raft_consensus.cc:2955] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:25.055925 15146 catalog_manager.cc:5697] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.424934 16220 ts_tablet_manager.cc:933] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:25.461292 16220 tablet_copy_client.cc:323] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:25.463999 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet 87a9a9eccfa9436c993e85bfe0343332 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:25.464668 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet 87a9a9eccfa9436c993e85bfe0343332 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-87a9a9eccfa9436c993e85bfe0343332
I20260709 13:02:25.468601 16222 ts_tablet_manager.cc:933] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:25.469139 16223 ts_tablet_manager.cc:933] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:25.473884 16222 tablet_copy_client.cc:323] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:25.476002 15335 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet e71ec5b3198446c0a387428e2a4eb753 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:25.476589 15335 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet e71ec5b3198446c0a387428e2a4eb753 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-e71ec5b3198446c0a387428e2a4eb753
I20260709 13:02:25.477113 16223 tablet_copy_client.cc:323] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:25.477716 15260 tablet_copy_source_session.cc:215] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:25.483522 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet 4342f068b244466e9d599b81fd154374 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:25.484210 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet 4342f068b244466e9d599b81fd154374 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-4342f068b244466e9d599b81fd154374
I20260709 13:02:25.483502 16220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a9a9eccfa9436c993e85bfe0343332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:25.488528 15335 tablet_copy_source_session.cc:215] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:25.492105 16222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e71ec5b3198446c0a387428e2a4eb753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:25.492931 15334 tablet_copy_source_session.cc:215] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:25.497339 16223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4342f068b244466e9d599b81fd154374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:25.513059 16222 tablet_copy_client.cc:806] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:25.514114 16222 tablet_copy_client.cc:670] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:25.516211 16226 ts_tablet_manager.cc:933] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:25.520609 16222 tablet_copy_client.cc:538] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:25.533581 16223 tablet_copy_client.cc:806] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:25.534565 16223 tablet_copy_client.cc:670] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:25.537954 16222 tablet_bootstrap.cc:492] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:25.540817 16223 tablet_copy_client.cc:538] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:25.555505 16220 tablet_copy_client.cc:806] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:25.556385 16220 tablet_copy_client.cc:670] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:25.564790 16220 tablet_copy_client.cc:538] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:25.581315 16226 tablet_copy_client.cc:323] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:25.584081 16223 tablet_bootstrap.cc:492] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:25.587286 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet 13d6106766cf4009837f848b4f8cbb1f from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:25.587893 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet 13d6106766cf4009837f848b4f8cbb1f from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-13d6106766cf4009837f848b4f8cbb1f
I20260709 13:02:25.602695 15260 tablet_copy_source_session.cc:215] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:25.608743 16226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d6106766cf4009837f848b4f8cbb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:25.623754 16220 tablet_bootstrap.cc:492] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:25.625969 16222 tablet_bootstrap.cc:492] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:25.627967 16222 tablet_bootstrap.cc:492] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:25.628743 16222 ts_tablet_manager.cc:1403] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.092s	user 0.020s	sys 0.012s
I20260709 13:02:25.631832 16222 raft_consensus.cc:359] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:25.638399 16222 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:25.639236 16222 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:25.643989 16223 tablet_bootstrap.cc:492] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:25.644389 16226 tablet_copy_client.cc:806] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:25.644955 16223 tablet_bootstrap.cc:492] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:25.645042 16226 tablet_copy_client.cc:670] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:25.645747 16223 ts_tablet_manager.cc:1403] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.008s
I20260709 13:02:25.649765 16226 tablet_copy_client.cc:538] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:25.651105 16223 raft_consensus.cc:359] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:25.652045 16223 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:25.652712 16223 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:25.667788 16226 tablet_bootstrap.cc:492] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:25.672298 16223 ts_tablet_manager.cc:1434] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.015s
I20260709 13:02:25.675508 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-4342f068b244466e9d599b81fd154374 received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:25.676021 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-4342f068b244466e9d599b81fd154374 on tablet 4342f068b244466e9d599b81fd154374 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:25.687152 16222 ts_tablet_manager.cc:1434] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.012s
I20260709 13:02:25.698849 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-e71ec5b3198446c0a387428e2a4eb753 received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:25.699316 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-e71ec5b3198446c0a387428e2a4eb753 on tablet e71ec5b3198446c0a387428e2a4eb753 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:25.702592 16220 tablet_bootstrap.cc:492] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:25.703558 16220 tablet_bootstrap.cc:492] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:25.704262 16220 ts_tablet_manager.cc:1403] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.005s
I20260709 13:02:25.706532 16226 tablet_bootstrap.cc:492] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:25.707579 16226 tablet_bootstrap.cc:492] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:25.707703 16220 raft_consensus.cc:359] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:25.708613 16220 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:25.709442 16226 ts_tablet_manager.cc:1403] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.005s
I20260709 13:02:25.709290 16220 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:25.712563 16220 ts_tablet_manager.cc:1434] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:25.714495 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-87a9a9eccfa9436c993e85bfe0343332 received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:25.713975 16226 raft_consensus.cc:359] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:25.714962 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-87a9a9eccfa9436c993e85bfe0343332 on tablet 87a9a9eccfa9436c993e85bfe0343332 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:25.715024 16226 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:25.715806 16226 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:25.718354 16226 ts_tablet_manager.cc:1434] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:02:25.720423 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-13d6106766cf4009837f848b4f8cbb1f received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:25.720821 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-13d6106766cf4009837f848b4f8cbb1f on tablet 13d6106766cf4009837f848b4f8cbb1f with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:25.867494 16032 raft_consensus.cc:1217] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:26.012738 16032 raft_consensus.cc:1217] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:26.046115 16032 raft_consensus.cc:1217] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:26.115115 16032 raft_consensus.cc:1217] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:26.280496 16200 raft_consensus.cc:1064] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:26.283172 16200 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:26.289799 16032 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:26.290115 15395 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:26.291401 15244 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:26.291675 16193 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:26.292598 16200 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:26.294045 16219 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:26.312683 16219 raft_consensus.cc:2955] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:26.314491 15395 raft_consensus.cc:2955] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:02:26.463059 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 121976us
I20260709 13:02:26.507436 15144 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:02:26.550396 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 50104.5us
I20260709 13:02:26.555802 16166 raft_consensus.cc:1064] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:26.562974 16032 raft_consensus.cc:2955] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:26.565770 16166 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:26.620850 16240 raft_consensus.cc:1064] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:26.623495 16240 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:26.655603 16031 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:26.658284 16245 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:26.658528 15395 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:26.666013 16244 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:26.695658 15242 raft_consensus.cc:2955] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:26.698012 15319 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:26.833675 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49733.8us
W20260709 13:02:26.868353 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 127615us
W20260709 13:02:26.892097 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 72779.7us
I20260709 13:02:26.946918 16262 raft_consensus.cc:1064] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
W20260709 13:02:26.981769 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 61170us
I20260709 13:02:26.992852 16262 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:27.047248 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 148813us
I20260709 13:02:27.115087 15319 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:02:27.123999 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:27.125787 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 77409.8us
I20260709 13:02:27.135398 16033 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:27.138387 16166 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:27.153563 15247 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:27.162386 16033 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:27.164520 15395 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:27.167781 15397 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:27.169059 16032 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:27.182228 16243 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:27.192075 16274 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:27.197072 16265 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:27.203459 15393 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:27.220927 16274 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:27.223974 16274 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:27.227025 16199 raft_consensus.cc:2955] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.233601 16240 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:27.238936 15316 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:27.260066 16272 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:27.265520 16274 raft_consensus.cc:2955] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.284495 16031 raft_consensus.cc:2955] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.289784 15147 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.301959 16033 raft_consensus.cc:2955] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.303139 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4342f068b244466e9d599b81fd154374 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:27.321316 15144 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.348834 16276 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:27.360266 15319 raft_consensus.cc:2955] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.373605 15236 tablet_service.cc:1558] Processing DeleteTablet for tablet 4342f068b244466e9d599b81fd154374 with delete_type TABLET_DATA_TOMBSTONED (TS 89940175e5444593aab6b3a025624b5b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59986
I20260709 13:02:27.373940 16199 raft_consensus.cc:2955] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.377779 16290 tablet_replica.cc:333] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:02:27.379040 16290 raft_consensus.cc:2243] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:27.379855 16290 raft_consensus.cc:2272] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:27.379969 15319 raft_consensus.cc:2955] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.383649 16290 ts_tablet_manager.cc:1916] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:27.392032 16271 raft_consensus.cc:2955] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.393273 16033 raft_consensus.cc:2955] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.399391 15396 raft_consensus.cc:2955] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.402209 16031 raft_consensus.cc:2955] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.420210 16290 ts_tablet_manager.cc:1929] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:27.420811 16290 log.cc:1199] T 4342f068b244466e9d599b81fd154374 P 89940175e5444593aab6b3a025624b5b: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/wals/4342f068b244466e9d599b81fd154374
I20260709 13:02:27.422665 15135 catalog_manager.cc:5028] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): tablet 4342f068b244466e9d599b81fd154374 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:27.439989 15245 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:27.451925 15393 raft_consensus.cc:2955] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.473606 16031 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:27.467397 15146 catalog_manager.cc:5697] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.475548 15396 raft_consensus.cc:2955] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.482259 15320 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:27.489151 16245 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:27.492730 16199 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:27.500658 15245 raft_consensus.cc:2955] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.505261 15148 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.512491 16242 raft_consensus.cc:2955] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.516789 15320 raft_consensus.cc:2955] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.545446 15319 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:27.512403 15394 raft_consensus.cc:2955] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.554804 15245 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:27.555783 16033 raft_consensus.cc:2955] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.556824 16271 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:27.563133 15148 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.564147 16265 raft_consensus.cc:2955] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.566957 16031 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:27.578418 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 87a9a9eccfa9436c993e85bfe0343332 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:27.582027 15249 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:27.590533 15385 tablet_service.cc:1558] Processing DeleteTablet for tablet 87a9a9eccfa9436c993e85bfe0343332 with delete_type TABLET_DATA_TOMBSTONED (TS ee9654803379434388de45d4693e6b16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39706
I20260709 13:02:27.592352 16274 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:27.597739 15245 raft_consensus.cc:2955] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.603688 16031 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:27.609424 16242 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:27.617352 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e71ec5b3198446c0a387428e2a4eb753 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:27.618027 16199 raft_consensus.cc:2955] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.626008 16032 raft_consensus.cc:2955] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.601145 16033 raft_consensus.cc:2955] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.656318 16292 tablet_replica.cc:333] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:02:27.643415 15148 catalog_manager.cc:5697] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.658053 15396 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:27.658362 16292 raft_consensus.cc:2243] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:27.659585 16292 raft_consensus.cc:2272] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:27.664763 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13d6106766cf4009837f848b4f8cbb1f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:27.668694 16272 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:27.675463 16292 ts_tablet_manager.cc:1916] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:27.675361 15394 raft_consensus.cc:2955] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:27.681134 15147 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.710529 15385 tablet_service.cc:1558] Processing DeleteTablet for tablet e71ec5b3198446c0a387428e2a4eb753 with delete_type TABLET_DATA_TOMBSTONED (TS ee9654803379434388de45d4693e6b16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39706
I20260709 13:02:27.733392 16292 ts_tablet_manager.cc:1929] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:27.733894 16292 log.cc:1199] T 87a9a9eccfa9436c993e85bfe0343332 P ee9654803379434388de45d4693e6b16: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/wals/87a9a9eccfa9436c993e85bfe0343332
I20260709 13:02:27.735634 16292 tablet_replica.cc:333] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:02:27.744623 15134 catalog_manager.cc:5028] TS ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): tablet 87a9a9eccfa9436c993e85bfe0343332 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:27.761983 16292 raft_consensus.cc:2243] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:27.762921 16292 raft_consensus.cc:2272] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:27.765579 15346 debug-util.cc:398] Leaking SignalData structure 0x7b080009c8e0 after lost signal to thread 14142
W20260709 13:02:27.766803 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08000995a0 after lost signal to thread 15182
W20260709 13:02:27.768049 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa4a0 after lost signal to thread 15274
I20260709 13:02:27.768383 15314 tablet_service.cc:1558] Processing DeleteTablet for tablet 13d6106766cf4009837f848b4f8cbb1f with delete_type TABLET_DATA_TOMBSTONED (TS 45ddec37d9e741a598bf32f6c9d7e0ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39704
W20260709 13:02:27.769213 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb380 after lost signal to thread 15349
W20260709 13:02:27.774416 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08002ccc00 after lost signal to thread 15423
W20260709 13:02:27.775547 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef600 after lost signal to thread 16057
I20260709 13:02:27.778252 16292 ts_tablet_manager.cc:1916] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:27.807430 16293 tablet_replica.cc:333] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:02:27.812211 16293 raft_consensus.cc:2243] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:27.812965 16293 raft_consensus.cc:2272] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:27.826371 16292 ts_tablet_manager.cc:1929] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:27.826871 16292 log.cc:1199] T e71ec5b3198446c0a387428e2a4eb753 P ee9654803379434388de45d4693e6b16: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/wals/e71ec5b3198446c0a387428e2a4eb753
I20260709 13:02:27.828681 15134 catalog_manager.cc:5028] TS ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): tablet e71ec5b3198446c0a387428e2a4eb753 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:27.830346 16293 ts_tablet_manager.cc:1916] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:27.850751 16293 ts_tablet_manager.cc:1929] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:27.851315 16293 log.cc:1199] T 13d6106766cf4009837f848b4f8cbb1f P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/wals/13d6106766cf4009837f848b4f8cbb1f
I20260709 13:02:27.853191 15132 catalog_manager.cc:5028] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): tablet 13d6106766cf4009837f848b4f8cbb1f (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:28.883718 15393 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
W20260709 13:02:28.892400 15363 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0fa77b7aa76c4cce87f6d985fe8e1d3a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.893958 15244 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:28.893958 15320 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:28.899048 16270 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.901535 16269 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.919345 16269 raft_consensus.cc:2955] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:28.920564 15320 raft_consensus.cc:2955] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:28.944247 15146 catalog_manager.cc:5697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:28.947600 15320 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:28.951339 15244 raft_consensus.cc:2955] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:02:28.974408 15289 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68e68ea4eb05497288804ad7aefb241e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.980742 15394 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:28.982697 16265 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.983650 15244 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:28.986320 16274 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.014459 16274 raft_consensus.cc:2955] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:29.020923 15393 raft_consensus.cc:2955] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:29.046448 15320 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:29.056977 15144 catalog_manager.cc:5697] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:29.074990 15289 consensus_peers.cc:597] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6183201d0cfc47c68ab021f085302aab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:29.078895 15393 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:29.079399 15244 raft_consensus.cc:2955] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:29.084022 15249 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:29.086467 16267 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.088430 16267 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:29.112140 16274 raft_consensus.cc:2955] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:29.120128 15394 raft_consensus.cc:2955] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:29.134137 15244 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:29.133744 15249 raft_consensus.cc:2955] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:29.300673 15320 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:29.306367 15144 catalog_manager.cc:5697] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:29.340355 15393 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:29.348008 16312 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:29.359576 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 57392.8us
I20260709 13:02:29.363551 16276 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:29.401983 16199 raft_consensus.cc:2955] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:29.404865 15394 raft_consensus.cc:2955] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:02:29.407370 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57665.6us
I20260709 13:02:29.439443 15323 raft_consensus.cc:2955] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:29.444120 15146 catalog_manager.cc:5697] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:29.460173 16317 ts_tablet_manager.cc:933] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:29.458679 15214 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a64e06dc30ff4dfebdb052a6f7228046. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:29.504375 16317 tablet_copy_client.cc:323] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.195:44417
I20260709 13:02:29.506516 16320 ts_tablet_manager.cc:933] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:29.507079 15409 tablet_copy_service.cc:140] P ee9654803379434388de45d4693e6b16: Received BeginTabletCopySession request for tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:51818)
I20260709 13:02:29.511822 15409 tablet_copy_service.cc:161] P ee9654803379434388de45d4693e6b16: Beginning new tablet copy session on tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:51818: session id = edcf4a6bae7e4781bce325a586109ca5-0fa77b7aa76c4cce87f6d985fe8e1d3a
I20260709 13:02:29.521055 15409 tablet_copy_source_session.cc:215] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:29.525357 16317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:29.526804 16320 tablet_copy_client.cc:323] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:29.528793 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet 68e68ea4eb05497288804ad7aefb241e from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:29.529412 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet 68e68ea4eb05497288804ad7aefb241e from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-68e68ea4eb05497288804ad7aefb241e
I20260709 13:02:29.538278 15334 tablet_copy_source_session.cc:215] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:29.543800 16320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68e68ea4eb05497288804ad7aefb241e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:29.640486 16320 tablet_copy_client.cc:806] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:29.650630 16317 tablet_copy_client.cc:806] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:29.655156 16317 tablet_copy_client.cc:670] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:29.644731 16320 tablet_copy_client.cc:670] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:29.670575 16320 tablet_copy_client.cc:538] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:29.680759 16317 tablet_copy_client.cc:538] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:29.681316 16324 ts_tablet_manager.cc:933] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:29.709990 16317 tablet_bootstrap.cc:492] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:29.716876 16320 tablet_bootstrap.cc:492] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:29.717778 16324 tablet_copy_client.cc:323] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:29.728399 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet 6183201d0cfc47c68ab021f085302aab from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:29.729216 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet 6183201d0cfc47c68ab021f085302aab from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-6183201d0cfc47c68ab021f085302aab
I20260709 13:02:29.753093 15334 tablet_copy_source_session.cc:215] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:29.812242 16324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6183201d0cfc47c68ab021f085302aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:29.823542 16326 ts_tablet_manager.cc:933] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:29.874768 16320 tablet_bootstrap.cc:492] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:29.871268 16326 tablet_copy_client.cc:323] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:29.881445 16320 tablet_bootstrap.cc:492] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:29.882637 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet a64e06dc30ff4dfebdb052a6f7228046 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:29.883231 16324 tablet_copy_client.cc:806] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:29.883394 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet a64e06dc30ff4dfebdb052a6f7228046 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-a64e06dc30ff4dfebdb052a6f7228046
I20260709 13:02:29.883833 16320 ts_tablet_manager.cc:1403] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.167s	user 0.028s	sys 0.016s
I20260709 13:02:29.883873 16324 tablet_copy_client.cc:670] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:29.890918 16320 raft_consensus.cc:359] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:29.898568 16320 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:29.898793 16324 tablet_copy_client.cc:538] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:29.905198 16320 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:29.900492 15260 tablet_copy_source_session.cc:215] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:29.909281 16326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a64e06dc30ff4dfebdb052a6f7228046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:29.915289 16317 tablet_bootstrap.cc:492] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:29.916572 16317 tablet_bootstrap.cc:492] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:29.917459 16317 ts_tablet_manager.cc:1403] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.208s	user 0.019s	sys 0.015s
I20260709 13:02:29.921156 16317 raft_consensus.cc:359] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:29.922214 16317 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:29.923117 16317 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:29.924566 16320 ts_tablet_manager.cc:1434] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:02:29.926584 16317 ts_tablet_manager.cc:1434] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:29.927160 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-68e68ea4eb05497288804ad7aefb241e received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:29.927727 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-68e68ea4eb05497288804ad7aefb241e on tablet 68e68ea4eb05497288804ad7aefb241e with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:29.931535 15409 tablet_copy_service.cc:342] P ee9654803379434388de45d4693e6b16: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-0fa77b7aa76c4cce87f6d985fe8e1d3a received from {username='slave'} at 127.0.0.1:51818
I20260709 13:02:29.932082 15409 tablet_copy_service.cc:434] P ee9654803379434388de45d4693e6b16: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-0fa77b7aa76c4cce87f6d985fe8e1d3a on tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:29.943099 16324 tablet_bootstrap.cc:492] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:29.966536 16326 tablet_copy_client.cc:806] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:29.967402 16326 tablet_copy_client.cc:670] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:29.973704 16326 tablet_copy_client.cc:538] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:29.995154 16326 tablet_bootstrap.cc:492] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:29.995896 16031 raft_consensus.cc:1217] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:30.033128 16031 raft_consensus.cc:1217] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:30.040834 16324 tablet_bootstrap.cc:492] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:30.045984 16326 tablet_bootstrap.cc:492] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:30.042061 16324 tablet_bootstrap.cc:492] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:30.047133 16326 tablet_bootstrap.cc:492] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:30.047663 16324 ts_tablet_manager.cc:1403] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.105s	user 0.026s	sys 0.008s
I20260709 13:02:30.047887 16326 ts_tablet_manager.cc:1403] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.012s
I20260709 13:02:30.058620 16324 raft_consensus.cc:359] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:30.069860 16324 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:30.070708 16324 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:30.073746 16324 ts_tablet_manager.cc:1434] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:02:30.076097 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-6183201d0cfc47c68ab021f085302aab received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:30.076596 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-6183201d0cfc47c68ab021f085302aab on tablet 6183201d0cfc47c68ab021f085302aab with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:30.077755 16326 raft_consensus.cc:359] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:30.078788 16326 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:30.089355 16326 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:30.092811 16326 ts_tablet_manager.cc:1434] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:02:30.096407 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-a64e06dc30ff4dfebdb052a6f7228046 received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:30.096956 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-a64e06dc30ff4dfebdb052a6f7228046 on tablet a64e06dc30ff4dfebdb052a6f7228046 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:30.117758 16031 raft_consensus.cc:1217] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:30.166205 16031 raft_consensus.cc:1217] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:02:30.292032 15420 debug-util.cc:398] Leaking SignalData structure 0x7b080018c880 after lost signal to thread 14142
W20260709 13:02:30.293471 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08001485c0 after lost signal to thread 15182
W20260709 13:02:30.295120 15420 debug-util.cc:398] Leaking SignalData structure 0x7b0800332520 after lost signal to thread 15274
W20260709 13:02:30.297088 15420 debug-util.cc:398] Leaking SignalData structure 0x7b080033fa00 after lost signal to thread 15349
W20260709 13:02:30.298498 15420 debug-util.cc:398] Leaking SignalData structure 0x7b0800335920 after lost signal to thread 15423
W20260709 13:02:30.299906 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08003350c0 after lost signal to thread 16057
I20260709 13:02:30.508524 16271 raft_consensus.cc:1064] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:30.525395 16271 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:30.589424 16269 raft_consensus.cc:1064] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:30.592626 16269 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:30.610100 16031 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:30.612893 16270 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:30.621747 15319 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:30.624006 16269 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:30.624531 15249 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:30.635480 16270 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:30.664222 16031 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:30.685338 16274 raft_consensus.cc:1064] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:30.676584 15394 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:30.669013 16270 raft_consensus.cc:2955] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:30.672544 16271 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:02:30.693303 15250 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:30.673620 15319 raft_consensus.cc:2955] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:30.703075 16334 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:30.715242 16333 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:30.710937 16274 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:30.742753 16032 raft_consensus.cc:2955] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:02:30.747363 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 78634.7us
I20260709 13:02:30.787148 15245 raft_consensus.cc:2955] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:30.796911 15147 catalog_manager.cc:5697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:30.846002 15249 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:30.860577 16333 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:30.897100 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67848.9us
I20260709 13:02:30.915555 16033 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:30.921247 16354 raft_consensus.cc:1064] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:30.925300 16354 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:30.945381 16352 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:02:30.948307 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51372.9us
I20260709 13:02:30.951391 16349 raft_consensus.cc:2955] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:30.953042 16271 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:30.983255 15390 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:30.979833 16031 raft_consensus.cc:2955] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:02:31.091584 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 70561.1us
I20260709 13:02:31.095264 15245 raft_consensus.cc:2955] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.101150 15394 raft_consensus.cc:2955] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.099961 16271 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:02:31.114359 16031 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:31.117389 15319 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:31.125813 16364 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:31.127811 16341 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:31.128489 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66449.3us
I20260709 13:02:31.140746 15392 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:31.144994 16334 raft_consensus.cc:2955] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.148087 15394 raft_consensus.cc:2955] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.167098 16355 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:31.166384 15245 raft_consensus.cc:2955] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.175024 16030 raft_consensus.cc:2955] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.183270 15323 raft_consensus.cc:2955] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.184612 16312 raft_consensus.cc:2955] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.219620 15146 catalog_manager.cc:5697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.224553 16031 raft_consensus.cc:2955] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.244180 15148 catalog_manager.cc:5697] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.256417 15392 raft_consensus.cc:2955] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.286396 15147 catalog_manager.cc:5697] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.302968 15390 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:31.316395 15323 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:31.324942 15245 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:31.326624 16031 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:31.328791 16343 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:31.332616 15319 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:31.336840 16361 raft_consensus.cc:2955] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.347605 16031 raft_consensus.cc:2955] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.361498 16357 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:31.369823 16031 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:31.371366 16349 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:31.372447 15245 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:31.374552 16349 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:31.375566 15134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:31.385679 16267 raft_consensus.cc:2955] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.392228 15249 raft_consensus.cc:2955] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.394333 15244 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:31.407276 15245 raft_consensus.cc:2955] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.409772 16030 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:31.416100 16313 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:31.426498 16364 raft_consensus.cc:2955] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.432034 15398 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:31.433600 15319 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:31.433669 16030 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:31.441886 15148 catalog_manager.cc:5697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.434986 16313 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:31.433602 16033 raft_consensus.cc:2955] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.446434 16274 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:31.451260 16333 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:31.456557 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 68e68ea4eb05497288804ad7aefb241e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:31.465309 15314 tablet_service.cc:1558] Processing DeleteTablet for tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a with delete_type TABLET_DATA_TOMBSTONED (TS 45ddec37d9e741a598bf32f6c9d7e0ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39704
I20260709 13:02:31.465900 15147 catalog_manager.cc:5697] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.471011 15319 raft_consensus.cc:2955] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.479875 16030 raft_consensus.cc:2955] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.488778 16271 raft_consensus.cc:2955] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.499042 16031 raft_consensus.cc:2955] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.521858 15385 tablet_service.cc:1558] Processing DeleteTablet for tablet 68e68ea4eb05497288804ad7aefb241e with delete_type TABLET_DATA_TOMBSTONED (TS ee9654803379434388de45d4693e6b16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39706
I20260709 13:02:31.525424 16373 tablet_replica.cc:333] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:02:31.526778 16373 raft_consensus.cc:2243] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.537874 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a64e06dc30ff4dfebdb052a6f7228046 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:31.538062 16373 raft_consensus.cc:2272] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.538795 15392 raft_consensus.cc:2955] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.554015 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6183201d0cfc47c68ab021f085302aab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:31.554498 15146 catalog_manager.cc:5697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:31.557775 15147 catalog_manager.cc:5697] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.584467 15385 tablet_service.cc:1558] Processing DeleteTablet for tablet a64e06dc30ff4dfebdb052a6f7228046 with delete_type TABLET_DATA_TOMBSTONED (TS ee9654803379434388de45d4693e6b16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39706
I20260709 13:02:31.590862 15236 tablet_service.cc:1558] Processing DeleteTablet for tablet 6183201d0cfc47c68ab021f085302aab with delete_type TABLET_DATA_TOMBSTONED (TS 89940175e5444593aab6b3a025624b5b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59986
I20260709 13:02:31.583817 16374 tablet_replica.cc:333] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:02:31.595453 16374 raft_consensus.cc:2243] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.600795 16374 raft_consensus.cc:2272] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.607321 16373 ts_tablet_manager.cc:1916] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:31.607520 16375 tablet_replica.cc:333] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:02:31.635566 16374 ts_tablet_manager.cc:1916] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:31.653724 16375 raft_consensus.cc:2243] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.654614 16375 raft_consensus.cc:2272] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.663019 16375 ts_tablet_manager.cc:1916] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:31.681123 16373 ts_tablet_manager.cc:1929] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:31.681860 16373 log.cc:1199] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/wals/0fa77b7aa76c4cce87f6d985fe8e1d3a
I20260709 13:02:31.682685 16374 ts_tablet_manager.cc:1929] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:31.683291 16374 log.cc:1199] T 68e68ea4eb05497288804ad7aefb241e P ee9654803379434388de45d4693e6b16: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/wals/68e68ea4eb05497288804ad7aefb241e
I20260709 13:02:31.683691 15132 catalog_manager.cc:5028] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): tablet 0fa77b7aa76c4cce87f6d985fe8e1d3a (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:31.685002 15134 catalog_manager.cc:5028] TS ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): tablet 68e68ea4eb05497288804ad7aefb241e (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:31.685492 16374 tablet_replica.cc:333] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:02:31.686811 16374 raft_consensus.cc:2243] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.687704 16374 raft_consensus.cc:2272] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.691207 16374 ts_tablet_manager.cc:1916] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:31.696842 16375 ts_tablet_manager.cc:1929] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:31.697513 16375 log.cc:1199] T 6183201d0cfc47c68ab021f085302aab P 89940175e5444593aab6b3a025624b5b: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/wals/6183201d0cfc47c68ab021f085302aab
I20260709 13:02:31.699823 15135 catalog_manager.cc:5028] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): tablet 6183201d0cfc47c68ab021f085302aab (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:31.709285 16374 ts_tablet_manager.cc:1929] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:31.709867 16374 log.cc:1199] T a64e06dc30ff4dfebdb052a6f7228046 P ee9654803379434388de45d4693e6b16: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/wals/a64e06dc30ff4dfebdb052a6f7228046
I20260709 13:02:31.711656 15134 catalog_manager.cc:5028] TS ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): tablet a64e06dc30ff4dfebdb052a6f7228046 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:32.790807 15323 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:32.847874 15249 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:32.850503 16376 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:32.865825 15289 consensus_peers.cc:597] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e82f23e062ad47fe80fac622dd633649. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:32.868923 15393 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:32.879983 16334 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:32.945384 16271 raft_consensus.cc:2955] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:32.961885 15245 raft_consensus.cc:2955] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:32.986884 15144 catalog_manager.cc:5697] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:32.984086 15249 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:32.995702 15393 raft_consensus.cc:2955] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.029747 15393 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:33.031368 15319 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:33.034837 16379 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:33.037817 16363 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:33.046352 15214 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0387b757aa040099c98e877245b7bfd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.078420 16378 raft_consensus.cc:2955] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.080559 15393 raft_consensus.cc:2955] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.102923 15319 raft_consensus.cc:2955] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.107714 15147 catalog_manager.cc:5697] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.135527 15249 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:33.162058 15393 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:33.165941 15214 consensus_peers.cc:597] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99211c99c0ce4c1cb82fa7cea0ab410a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.167523 16384 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:33.178184 15319 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:33.179787 16384 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:33.182509 16382 raft_consensus.cc:2955] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.184278 15392 raft_consensus.cc:2955] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.210913 15316 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:33.205646 15147 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:33.240584 15323 raft_consensus.cc:2955] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.276160 15392 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:33.278405 15289 consensus_peers.cc:597] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abb86a150e844b848bc103f128d39a82. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.279590 15249 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:33.281430 16271 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:33.284966 16376 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:33.318984 16271 raft_consensus.cc:2955] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.323006 15245 raft_consensus.cc:2955] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.345068 15393 raft_consensus.cc:2955] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.360532 16401 ts_tablet_manager.cc:933] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:33.359990 15146 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:33.404369 16401 tablet_copy_client.cc:323] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:33.408769 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet e82f23e062ad47fe80fac622dd633649 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:33.409343 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet e82f23e062ad47fe80fac622dd633649 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-e82f23e062ad47fe80fac622dd633649
I20260709 13:02:33.416618 15334 tablet_copy_source_session.cc:215] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:33.420135 16401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e82f23e062ad47fe80fac622dd633649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.462822 16401 tablet_copy_client.cc:806] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:33.463581 16401 tablet_copy_client.cc:670] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:33.478320 16401 tablet_copy_client.cc:538] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:33.522732 16401 tablet_bootstrap.cc:492] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:33.559356 16403 ts_tablet_manager.cc:933] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:33.577041 16401 tablet_bootstrap.cc:492] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:33.578328 16401 tablet_bootstrap.cc:492] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:33.578770 16403 tablet_copy_client.cc:323] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:33.579144 16401 ts_tablet_manager.cc:1403] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.005s
I20260709 13:02:33.584358 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet 99211c99c0ce4c1cb82fa7cea0ab410a from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:33.584946 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet 99211c99c0ce4c1cb82fa7cea0ab410a from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-99211c99c0ce4c1cb82fa7cea0ab410a
I20260709 13:02:33.593780 15260 tablet_copy_source_session.cc:215] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:33.595536 16401 raft_consensus.cc:359] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:33.599714 16403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99211c99c0ce4c1cb82fa7cea0ab410a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.599634 16401 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:33.600438 16401 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:33.648630 16401 ts_tablet_manager.cc:1434] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.016s
I20260709 13:02:33.662529 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-e82f23e062ad47fe80fac622dd633649 received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:33.663017 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-e82f23e062ad47fe80fac622dd633649 on tablet e82f23e062ad47fe80fac622dd633649 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:33.666399 16407 ts_tablet_manager.cc:933] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:33.672458 16403 tablet_copy_client.cc:806] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:33.673233 16403 tablet_copy_client.cc:670] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:33.680343 16403 tablet_copy_client.cc:538] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:33.689441 16407 tablet_copy_client.cc:323] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:33.691416 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet b0387b757aa040099c98e877245b7bfd from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:33.692032 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet b0387b757aa040099c98e877245b7bfd from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-b0387b757aa040099c98e877245b7bfd
I20260709 13:02:33.693542 16403 tablet_bootstrap.cc:492] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:33.699942 16401 ts_tablet_manager.cc:933] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:33.701102 15260 tablet_copy_source_session.cc:215] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:33.712023 16407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0387b757aa040099c98e877245b7bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.732102 16401 tablet_copy_client.cc:323] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:33.734133 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet abb86a150e844b848bc103f128d39a82 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:33.734779 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet abb86a150e844b848bc103f128d39a82 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-abb86a150e844b848bc103f128d39a82
I20260709 13:02:33.757658 15334 tablet_copy_source_session.cc:215] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:33.764281 16401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb86a150e844b848bc103f128d39a82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:33.797503 16401 tablet_copy_client.cc:806] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:33.801357 16401 tablet_copy_client.cc:670] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:33.806569 16401 tablet_copy_client.cc:538] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:33.808671 16031 raft_consensus.cc:1217] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:33.822005 16401 tablet_bootstrap.cc:492] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:33.852980 16407 tablet_copy_client.cc:806] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:33.853744 16407 tablet_copy_client.cc:670] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:33.859891 16407 tablet_copy_client.cc:538] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:33.865382 16403 tablet_bootstrap.cc:492] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:33.875694 16403 tablet_bootstrap.cc:492] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:33.876595 16403 ts_tablet_manager.cc:1403] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.183s	user 0.040s	sys 0.040s
I20260709 13:02:33.883237 16407 tablet_bootstrap.cc:492] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:33.895889 16403 raft_consensus.cc:359] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:33.899519 16403 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:33.899114 16401 tablet_bootstrap.cc:492] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:33.919164 16403 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:33.920678 16401 tablet_bootstrap.cc:492] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:33.928198 16401 ts_tablet_manager.cc:1403] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.106s	user 0.019s	sys 0.007s
I20260709 13:02:33.934584 16403 ts_tablet_manager.cc:1434] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 13:02:33.948554 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-99211c99c0ce4c1cb82fa7cea0ab410a received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:33.949029 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-99211c99c0ce4c1cb82fa7cea0ab410a on tablet 99211c99c0ce4c1cb82fa7cea0ab410a with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:33.941095 16401 raft_consensus.cc:359] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:33.953835 16401 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:33.954921 16401 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:33.960570 16401 ts_tablet_manager.cc:1434] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:02:33.971511 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-abb86a150e844b848bc103f128d39a82 received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:33.972052 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-abb86a150e844b848bc103f128d39a82 on tablet abb86a150e844b848bc103f128d39a82 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:33.988983 16407 tablet_bootstrap.cc:492] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:33.995532 16407 tablet_bootstrap.cc:492] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:33.996392 16407 ts_tablet_manager.cc:1403] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.113s	user 0.023s	sys 0.009s
I20260709 13:02:33.999778 16407 raft_consensus.cc:359] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:34.000950 16407 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:34.001753 16407 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:34.004796 16407 ts_tablet_manager.cc:1434] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:34.006615 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-b0387b757aa040099c98e877245b7bfd received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:34.007051 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-b0387b757aa040099c98e877245b7bfd on tablet b0387b757aa040099c98e877245b7bfd with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:34.074636 16030 raft_consensus.cc:1217] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:34.093439 16030 raft_consensus.cc:1217] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:34.285148 16030 raft_consensus.cc:1217] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:34.338970 16271 raft_consensus.cc:1064] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:34.341554 16271 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:34.365679 16030 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.367210 15244 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.369170 15393 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.373034 16413 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:34.374300 16376 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:34.377031 16349 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:02:34.449506 16376 raft_consensus.cc:2955] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.457221 16380 raft_consensus.cc:1064] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:34.460305 16380 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:34.464026 15244 raft_consensus.cc:2955] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.479929 15398 raft_consensus.cc:2955] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.493925 15146 catalog_manager.cc:5697] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:34.484081 16031 raft_consensus.cc:2955] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.528885 15323 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.529695 16030 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.530663 15393 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.532470 16382 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:34.534397 16382 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:34.540714 16363 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:34.609382 15398 raft_consensus.cc:2955] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.606472 16313 raft_consensus.cc:2955] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.616938 15316 raft_consensus.cc:2955] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.641830 16031 raft_consensus.cc:2955] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.684293 15148 catalog_manager.cc:5697] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.690213 16349 raft_consensus.cc:1064] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:34.700346 16349 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:34.696885 16384 raft_consensus.cc:1064] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:34.721840 15245 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:34.729727 15316 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:34.731612 15394 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:34.731616 16031 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:34.735081 16382 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:34.739513 16363 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:34.740026 16031 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:34.741252 15393 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:34.742856 16415 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:34.743764 16313 raft_consensus.cc:2955] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.744666 16376 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:34.755431 16031 raft_consensus.cc:2955] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.709358 16384 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:34.768711 16415 raft_consensus.cc:2955] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.774822 16030 raft_consensus.cc:2955] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.775420 15392 raft_consensus.cc:2955] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.774822 15398 raft_consensus.cc:2955] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.783349 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e82f23e062ad47fe80fac622dd633649 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:34.787117 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b0387b757aa040099c98e877245b7bfd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:34.812011 15394 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.812366 16033 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.814391 16271 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:34.822749 16349 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:34.834976 15244 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.855391 16271 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:34.857820 15392 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.860044 16382 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:34.860013 16031 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.865702 16313 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:34.885156 15316 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:34.887058 16382 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:34.893182 16413 raft_consensus.cc:2955] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.915385 15249 raft_consensus.cc:2955] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.902026 15394 raft_consensus.cc:2955] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.934849 16380 raft_consensus.cc:2955] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.935320 16033 raft_consensus.cc:2955] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.952629 16031 raft_consensus.cc:2955] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.954113 15146 catalog_manager.cc:5697] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.957463 15144 catalog_manager.cc:5697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.972076 15316 raft_consensus.cc:2955] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.980880 15314 tablet_service.cc:1558] Processing DeleteTablet for tablet b0387b757aa040099c98e877245b7bfd with delete_type TABLET_DATA_TOMBSTONED (TS 45ddec37d9e741a598bf32f6c9d7e0ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39704
I20260709 13:02:34.981545 15394 raft_consensus.cc:2955] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:34.988627 15146 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:35.012249 15323 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:35.018564 16436 tablet_replica.cc:333] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:02:35.019802 16436 raft_consensus.cc:2243] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.022099 15236 tablet_service.cc:1558] Processing DeleteTablet for tablet e82f23e062ad47fe80fac622dd633649 with delete_type TABLET_DATA_TOMBSTONED (TS 89940175e5444593aab6b3a025624b5b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59986
I20260709 13:02:35.023876 15245 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:35.026026 16349 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:35.031154 16436 raft_consensus.cc:2272] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.032897 16031 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:35.039983 16436 ts_tablet_manager.cc:1916] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:35.041224 16349 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:35.053961 16437 tablet_replica.cc:333] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:02:35.060204 16271 raft_consensus.cc:2955] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:35.060519 15249 raft_consensus.cc:2955] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:35.075891 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet abb86a150e844b848bc103f128d39a82 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:35.077590 15144 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:35.090193 16436 ts_tablet_manager.cc:1929] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:35.096750 16436 log.cc:1199] T b0387b757aa040099c98e877245b7bfd P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/wals/b0387b757aa040099c98e877245b7bfd
I20260709 13:02:35.098697 15132 catalog_manager.cc:5028] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): tablet b0387b757aa040099c98e877245b7bfd (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:35.101292 16033 raft_consensus.cc:2955] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:35.106092 16437 raft_consensus.cc:2243] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.106998 16437 raft_consensus.cc:2272] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.109969 16437 ts_tablet_manager.cc:1916] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:35.117834 15249 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:35.132721 15148 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:35.138360 16437 ts_tablet_manager.cc:1929] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:35.138954 16437 log.cc:1199] T e82f23e062ad47fe80fac622dd633649 P 89940175e5444593aab6b3a025624b5b: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/wals/e82f23e062ad47fe80fac622dd633649
I20260709 13:02:35.141844 15135 catalog_manager.cc:5028] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): tablet e82f23e062ad47fe80fac622dd633649 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:35.148488 15385 tablet_service.cc:1558] Processing DeleteTablet for tablet abb86a150e844b848bc103f128d39a82 with delete_type TABLET_DATA_TOMBSTONED (TS ee9654803379434388de45d4693e6b16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39706
I20260709 13:02:35.154568 16438 tablet_replica.cc:333] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:02:35.161631 16033 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:35.161878 15398 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:35.164824 16384 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:35.177115 16363 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:35.222272 16363 raft_consensus.cc:2955] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:35.225734 16033 raft_consensus.cc:2955] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:35.260310 15394 raft_consensus.cc:2955] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:35.279769 15145 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:35.286854 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 99211c99c0ce4c1cb82fa7cea0ab410a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:35.291759 15314 tablet_service.cc:1558] Processing DeleteTablet for tablet 99211c99c0ce4c1cb82fa7cea0ab410a with delete_type TABLET_DATA_TOMBSTONED (TS 45ddec37d9e741a598bf32f6c9d7e0ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39704
I20260709 13:02:35.293123 16436 tablet_replica.cc:333] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:02:35.315065 16438 raft_consensus.cc:2243] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.315912 16438 raft_consensus.cc:2272] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.321179 16438 ts_tablet_manager.cc:1916] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:35.324594 16436 raft_consensus.cc:2243] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.325457 16436 raft_consensus.cc:2272] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.331153 16436 ts_tablet_manager.cc:1916] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:35.411949 16438 ts_tablet_manager.cc:1929] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:35.412695 16438 log.cc:1199] T abb86a150e844b848bc103f128d39a82 P ee9654803379434388de45d4693e6b16: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/wals/abb86a150e844b848bc103f128d39a82
I20260709 13:02:35.415356 15134 catalog_manager.cc:5028] TS ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): tablet abb86a150e844b848bc103f128d39a82 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:35.417178 16436 ts_tablet_manager.cc:1929] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:35.417780 16436 log.cc:1199] T 99211c99c0ce4c1cb82fa7cea0ab410a P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/wals/99211c99c0ce4c1cb82fa7cea0ab410a
I20260709 13:02:35.419477 15132 catalog_manager.cc:5028] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): tablet 99211c99c0ce4c1cb82fa7cea0ab410a (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:36.437625 15325 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
W20260709 13:02:36.461977 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 105623us
W20260709 13:02:36.519275 15289 consensus_peers.cc:597] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79fb071c9f56456cade8cf3a14c85fc3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.521616 15398 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:36.522104 15244 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:36.523805 16349 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.540527 16349 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:36.611022 16415 raft_consensus.cc:2955] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.615033 15244 raft_consensus.cc:2955] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.631366 15398 raft_consensus.cc:2955] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.647234 15244 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:36.654487 15145 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:36.700207 15398 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:36.701129 15323 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:36.703323 16445 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:36.707414 15214 consensus_peers.cc:597] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e5288c8dc0fe4b7aabc37377e0bc0371. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.710430 16445 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:36.740715 16382 raft_consensus.cc:2955] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.745813 15398 raft_consensus.cc:2955] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.772095 15245 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:36.779974 15325 raft_consensus.cc:2955] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:02:36.797205 15214 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b6884fe16f4431a8b08af8e659ece9e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.797480 15398 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:36.798906 16363 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.801057 15325 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:36.803850 16363 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.839668 16382 raft_consensus.cc:2955] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.841739 15398 raft_consensus.cc:2955] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.853874 15325 raft_consensus.cc:2955] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.895426 15398 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:36.908187 15147 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.910526 15147 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:02:36.942564 15363 consensus_peers.cc:597] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b4a8d6a569c4998877fabab1b180c59. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:36.943543 15325 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.945415 15245 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:36.948433 16386 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:36.949674 16270 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:36.970989 16442 raft_consensus.cc:2955] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.972890 15325 raft_consensus.cc:2955] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:36.988713 15249 raft_consensus.cc:2955] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:37.008692 15144 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:37.142946 16462 ts_tablet_manager.cc:933] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:37.145195 16462 tablet_copy_client.cc:323] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:37.147162 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet 79fb071c9f56456cade8cf3a14c85fc3 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:37.147740 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet 79fb071c9f56456cade8cf3a14c85fc3 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-79fb071c9f56456cade8cf3a14c85fc3
I20260709 13:02:37.156404 15334 tablet_copy_source_session.cc:215] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:37.167918 16462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79fb071c9f56456cade8cf3a14c85fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.185778 16462 tablet_copy_client.cc:806] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:37.186489 16462 tablet_copy_client.cc:670] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:37.190863 16462 tablet_copy_client.cc:538] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:37.201169 16462 tablet_bootstrap.cc:492] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:37.229097 16462 tablet_bootstrap.cc:492] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:37.230350 16462 tablet_bootstrap.cc:492] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:37.231169 16462 ts_tablet_manager.cc:1403] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.009s
I20260709 13:02:37.234581 16462 raft_consensus.cc:359] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:37.235534 16462 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:37.236281 16462 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:37.245741 16462 ts_tablet_manager.cc:1434] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 13:02:37.247712 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-79fb071c9f56456cade8cf3a14c85fc3 received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:37.248173 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-79fb071c9f56456cade8cf3a14c85fc3 on tablet 79fb071c9f56456cade8cf3a14c85fc3 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:37.257556 16462 ts_tablet_manager.cc:933] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:37.275163 16462 tablet_copy_client.cc:323] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:37.276911 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet 8b6884fe16f4431a8b08af8e659ece9e from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:37.277554 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet 8b6884fe16f4431a8b08af8e659ece9e from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-8b6884fe16f4431a8b08af8e659ece9e
I20260709 13:02:37.288739 15260 tablet_copy_source_session.cc:215] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:37.302119 16466 ts_tablet_manager.cc:933] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:37.305785 16462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6884fe16f4431a8b08af8e659ece9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.326566 16466 tablet_copy_client.cc:323] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:37.335757 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet e5288c8dc0fe4b7aabc37377e0bc0371 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:37.336352 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet e5288c8dc0fe4b7aabc37377e0bc0371 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-e5288c8dc0fe4b7aabc37377e0bc0371
I20260709 13:02:37.342830 16469 ts_tablet_manager.cc:933] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:37.346006 16462 tablet_copy_client.cc:806] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:37.346683 16462 tablet_copy_client.cc:670] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:37.348376 15260 tablet_copy_source_session.cc:215] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:37.349677 16469 tablet_copy_client.cc:323] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.195:44417
I20260709 13:02:37.352427 15409 tablet_copy_service.cc:140] P ee9654803379434388de45d4693e6b16: Received BeginTabletCopySession request for tablet 3b4a8d6a569c4998877fabab1b180c59 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:51818)
I20260709 13:02:37.352710 16462 tablet_copy_client.cc:538] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:37.353086 15409 tablet_copy_service.cc:161] P ee9654803379434388de45d4693e6b16: Beginning new tablet copy session on tablet 3b4a8d6a569c4998877fabab1b180c59 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:51818: session id = edcf4a6bae7e4781bce325a586109ca5-3b4a8d6a569c4998877fabab1b180c59
I20260709 13:02:37.358319 16466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5288c8dc0fe4b7aabc37377e0bc0371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.362443 15409 tablet_copy_source_session.cc:215] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:37.369156 16469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b4a8d6a569c4998877fabab1b180c59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.379946 16462 tablet_bootstrap.cc:492] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:37.404592 16469 tablet_copy_client.cc:806] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:37.405195 16469 tablet_copy_client.cc:670] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:37.406643 16466 tablet_copy_client.cc:806] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:37.407290 16466 tablet_copy_client.cc:670] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:37.411237 16469 tablet_copy_client.cc:538] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:37.414336 16466 tablet_copy_client.cc:538] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:37.426453 16469 tablet_bootstrap.cc:492] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:37.428762 16466 tablet_bootstrap.cc:492] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:37.433209 16462 tablet_bootstrap.cc:492] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:37.441495 16462 tablet_bootstrap.cc:492] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:37.442356 16462 ts_tablet_manager.cc:1403] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.024s
I20260709 13:02:37.445870 16462 raft_consensus.cc:359] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:37.453187 16462 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:37.454013 16462 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:37.456775 16462 ts_tablet_manager.cc:1434] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:02:37.460384 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-8b6884fe16f4431a8b08af8e659ece9e received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:37.460817 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-8b6884fe16f4431a8b08af8e659ece9e on tablet 8b6884fe16f4431a8b08af8e659ece9e with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:37.473511 16466 tablet_bootstrap.cc:492] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:37.474877 16466 tablet_bootstrap.cc:492] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:37.475756 16469 tablet_bootstrap.cc:492] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:37.476773 16469 tablet_bootstrap.cc:492] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:37.475677 16466 ts_tablet_manager.cc:1403] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.007s
I20260709 13:02:37.478003 16469 ts_tablet_manager.cc:1403] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.016s
I20260709 13:02:37.485654 16469 raft_consensus.cc:359] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:37.489986 16469 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:37.489040 16466 raft_consensus.cc:359] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:37.490629 16466 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:37.491400 16466 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:37.494364 16466 ts_tablet_manager.cc:1434] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 13:02:37.498538 16469 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:37.502604 16469 ts_tablet_manager.cc:1434] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:02:37.504315 15409 tablet_copy_service.cc:342] P ee9654803379434388de45d4693e6b16: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-3b4a8d6a569c4998877fabab1b180c59 received from {username='slave'} at 127.0.0.1:51818
I20260709 13:02:37.504745 15409 tablet_copy_service.cc:434] P ee9654803379434388de45d4693e6b16: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-3b4a8d6a569c4998877fabab1b180c59 on tablet 3b4a8d6a569c4998877fabab1b180c59 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:37.507633 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-e5288c8dc0fe4b7aabc37377e0bc0371 received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:37.508127 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-e5288c8dc0fe4b7aabc37377e0bc0371 on tablet e5288c8dc0fe4b7aabc37377e0bc0371 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:37.532671 16030 raft_consensus.cc:1217] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:37.716725 16030 raft_consensus.cc:1217] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:37.726136 16030 raft_consensus.cc:1217] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:37.738932 16030 raft_consensus.cc:1217] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:02:38.091822 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:38.099749 16439 raft_consensus.cc:1064] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:38.103085 16439 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:38.136040 16363 raft_consensus.cc:1064] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:38.149638 16363 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:38.220146 16031 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:38.222404 16415 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:38.227883 15249 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:38.234683 16439 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:38.252411 16384 raft_consensus.cc:1064] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:38.254806 16384 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:38.275177 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57057.7us
I20260709 13:02:38.278409 15392 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:38.295717 15392 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:38.297396 16445 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:38.329226 15316 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:38.330765 16382 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:38.337752 16475 raft_consensus.cc:1064] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:38.342976 15394 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:38.345687 16382 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:38.351258 15325 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:38.355032 16382 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:38.356766 16475 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:38.381261 16271 raft_consensus.cc:2955] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.384045 16031 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:38.389351 16363 raft_consensus.cc:2955] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.396622 15249 raft_consensus.cc:2955] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.403307 16481 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:38.413897 16031 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:38.414695 16033 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEARNER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:38.416620 16477 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:38.425371 15394 raft_consensus.cc:2955] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.436427 16031 raft_consensus.cc:2955] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.437228 15325 raft_consensus.cc:2955] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.441655 15147 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.449337 15319 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:38.461339 15325 raft_consensus.cc:2955] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.474335 15245 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:38.488943 16477 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:38.491349 16384 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:38.492378 16475 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:38.493615 16384 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:38.457105 16493 raft_consensus.cc:2955] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.517695 16030 raft_consensus.cc:2955] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.530547 16031 raft_consensus.cc:2955] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.537914 15390 raft_consensus.cc:2955] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.544225 16497 raft_consensus.cc:2955] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.553023 15316 raft_consensus.cc:2955] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.556248 15245 raft_consensus.cc:2955] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.569370 16031 raft_consensus.cc:2955] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.575644 15390 raft_consensus.cc:2955] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.617579 15145 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.625707 15145 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.629983 15145 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.661264 15250 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:38.665383 15394 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:38.669975 16031 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:38.671037 15392 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:38.673522 16384 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:38.674435 16491 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:38.679193 16031 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:02:38.680927 16497 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:38.683950 16384 raft_consensus.cc:2955] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.690304 15325 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:02:38.691866 15390 raft_consensus.cc:2955] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.693279 16497 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:38.695227 16031 raft_consensus.cc:2955] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.703948 16475 raft_consensus.cc:2955] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.707362 16033 raft_consensus.cc:2955] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.712617 15144 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.721351 15134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3b4a8d6a569c4998877fabab1b180c59 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:38.721902 15316 raft_consensus.cc:2955] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:38.730914 15325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:38.731686 15325 raft_consensus.cc:606] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:02:38.734419 15147 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.740996 15314 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b6884fe16f4431a8b08af8e659ece9e with delete_type TABLET_DATA_TOMBSTONED (TS 45ddec37d9e741a598bf32f6c9d7e0ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39704
I20260709 13:02:38.754511 15236 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b4a8d6a569c4998877fabab1b180c59 with delete_type TABLET_DATA_TOMBSTONED (TS 89940175e5444593aab6b3a025624b5b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59986
I20260709 13:02:38.760006 15249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:02:38.760655 15249 raft_consensus.cc:606] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:02:38.780499 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b6884fe16f4431a8b08af8e659ece9e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:38.801635 15319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abb86a150e844b848bc103f128d39a82"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:38.802269 15319 raft_consensus.cc:606] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Received request to transfer leadership to TS edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:38.808748 16512 tablet_replica.cc:333] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:02:38.809918 16512 raft_consensus.cc:2243] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.810708 16512 raft_consensus.cc:2272] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.812515 16511 tablet_replica.cc:333] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:02:38.813623 16511 raft_consensus.cc:2243] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:38.815193 16511 raft_consensus.cc:2272] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:38.819137 16511 ts_tablet_manager.cc:1916] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:38.821964 15319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0024621f21043e889d114f180f1dccb"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:38.822731 15319 raft_consensus.cc:606] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
W20260709 13:02:38.825129 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55553.9us
I20260709 13:02:38.829931 15319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:38.830679 15319 raft_consensus.cc:606] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Received request to transfer leadership to TS edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:38.834246 16512 ts_tablet_manager.cc:1916] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:38.839951 15319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:38.841296 15319 raft_consensus.cc:606] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:02:38.842737 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:38.844393 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:38.845098 16511 ts_tablet_manager.cc:1929] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:38.845618 16511 log.cc:1199] T 8b6884fe16f4431a8b08af8e659ece9e P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/wals/8b6884fe16f4431a8b08af8e659ece9e
I20260709 13:02:38.847313 15132 catalog_manager.cc:5028] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): tablet 8b6884fe16f4431a8b08af8e659ece9e (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:38.855064 16512 ts_tablet_manager.cc:1929] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:02:38.855628 16512 log.cc:1199] T 3b4a8d6a569c4998877fabab1b180c59 P 89940175e5444593aab6b3a025624b5b: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/wals/3b4a8d6a569c4998877fabab1b180c59
I20260709 13:02:38.857143 15135 catalog_manager.cc:5028] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): tablet 3b4a8d6a569c4998877fabab1b180c59 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:38.918587 16439 raft_consensus.cc:993] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:38.919127 16439 raft_consensus.cc:1081] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:38.920796 15390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39732
I20260709 13:02:38.921424 15390 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.921778 15390 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.929612 15390 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:38.931979 15390 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:38.932276 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:38.933071 15249 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.932551 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:38.934672 15319 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.935021 15319 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:38.936259 15319 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:38.938604 15319 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.941943 15249 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:38.944315 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:38.945151 16475 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.945742 16475 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:38.946645 16475 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:38.950564 15319 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:38.958832 15144 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 2, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.975508 15249 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:38.980679 16033 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:38.980988 15325 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:38.981421 15319 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:38.982587 16491 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:38.983721 16363 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:38.987828 15390 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:38.990939 16031 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:38.992806 16271 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:38.996816 16349 raft_consensus.cc:993] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:38.997244 16349 raft_consensus.cc:1081] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:38.997045 16485 raft_consensus.cc:2955] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:39.000218 15398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0024621f21043e889d114f180f1dccb"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39732
I20260709 13:02:39.000769 15398 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.001163 15398 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.000770 16481 raft_consensus.cc:2955] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:39.008816 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e5288c8dc0fe4b7aabc37377e0bc0371 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:39.010300 15390 raft_consensus.cc:2955] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:39.012393 16271 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:39.007032 16033 raft_consensus.cc:2955] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:39.017220 15148 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.025664 15325 raft_consensus.cc:2955] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:39.030974 15398 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:39.039213 15398 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:39.044355 15385 tablet_service.cc:1558] Processing DeleteTablet for tablet e5288c8dc0fe4b7aabc37377e0bc0371 with delete_type TABLET_DATA_TOMBSTONED (TS ee9654803379434388de45d4693e6b16 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39706
I20260709 13:02:39.046552 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:39.047197 15316 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.047504 15316 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:39.048403 15316 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:39.049540 15316 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.050779 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:39.050249 15147 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:39.057612 16031 raft_consensus.cc:2955] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:39.061311 15250 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.073257 15250 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:39.076910 15236 tablet_service.cc:1558] Processing DeleteTablet for tablet 79fb071c9f56456cade8cf3a14c85fc3 with delete_type TABLET_DATA_TOMBSTONED (TS 89940175e5444593aab6b3a025624b5b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59986
I20260709 13:02:39.077855 16512 tablet_replica.cc:333] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:02:39.080842 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:39.093477 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 79fb071c9f56456cade8cf3a14c85fc3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:39.096179 16477 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:39.096557 16512 raft_consensus.cc:2243] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.097704 16512 raft_consensus.cc:2272] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.097754 16515 raft_consensus.cc:993] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:39.098417 16515 raft_consensus.cc:1081] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Signalling peer edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:39.100386 16477 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:39.101286 16477 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:39.102159 16512 ts_tablet_manager.cc:1916] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:39.119896 16512 ts_tablet_manager.cc:1929] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:39.120445 16512 log.cc:1199] T 79fb071c9f56456cade8cf3a14c85fc3 P 89940175e5444593aab6b3a025624b5b: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/wals/79fb071c9f56456cade8cf3a14c85fc3
I20260709 13:02:39.117480 15147 catalog_manager.cc:5697] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 2, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.125823 16030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abb86a150e844b848bc103f128d39a82"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:46364
I20260709 13:02:39.126482 16030 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.126845 16030 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.128598 15316 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:39.131192 15135 catalog_manager.cc:5028] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): tablet 79fb071c9f56456cade8cf3a14c85fc3 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:39.134505 16030 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:39.137859 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:39.138468 15249 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.140281 16490 raft_consensus.cc:993] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:39.140857 16490 raft_consensus.cc:1081] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:39.142423 15398 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:02:39.142961 15398 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.143318 15398 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.150175 16481 raft_consensus.cc:993] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:39.150709 16481 raft_consensus.cc:1081] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Signalling peer edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:39.151129 16439 raft_consensus.cc:993] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:39.151609 16439 raft_consensus.cc:1081] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:39.153487 16514 tablet_replica.cc:333] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:02:39.158756 16030 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:39.159765 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:39.157052 16033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:46364
I20260709 13:02:39.161415 15325 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.161839 15325 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:39.160351 16514 raft_consensus.cc:2243] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:39.161854 16033 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.166566 15249 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:39.162706 16514 raft_consensus.cc:2272] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:39.168179 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:39.169119 16500 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:39.171651 16514 ts_tablet_manager.cc:1916] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:39.163151 15325 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:39.164498 15394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39732
I20260709 13:02:39.176767 15394 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.177120 15394 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.162863 16033 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.176102 15325 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.181480 16500 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:39.182634 16500 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:39.183873 15394 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:39.166443 15398 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:39.186336 15398 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:39.186360 15325 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:39.187424 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:39.187549 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:39.188009 15249 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.188079 15319 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.190595 16033 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:39.193393 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:39.194000 15250 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.194553 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:39.195143 15316 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.195451 15316 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:39.195801 15249 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:39.197690 15319 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:39.198606 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:39.198729 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:39.199465 16496 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:39.199712 16477 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:39.200392 16477 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:39.200636 16496 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:39.201246 16514 ts_tablet_manager.cc:1929] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:39.201786 16514 log.cc:1199] T e5288c8dc0fe4b7aabc37377e0bc0371 P ee9654803379434388de45d4693e6b16: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/wals/e5288c8dc0fe4b7aabc37377e0bc0371
I20260709 13:02:39.201342 16477 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:39.196254 15316 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:39.202903 15316 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.197022 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:39.204545 15245 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.204756 16033 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:39.204850 15245 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:39.205694 15245 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:39.201581 16496 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:39.206939 15245 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.207288 15250 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:39.208455 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:39.209301 16517 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:39.209916 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:39.210561 15319 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.210871 15319 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:39.211652 15319 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:39.212778 15319 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.214254 15245 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:39.214392 15394 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:39.219173 15316 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:39.224861 15319 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:39.225040 16517 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:39.226929 15134 catalog_manager.cc:5028] TS ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): tablet e5288c8dc0fe4b7aabc37377e0bc0371 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:39.226061 16517 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:39.232403 15148 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 2, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 2 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.237789 15147 catalog_manager.cc:5697] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 2, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.239545 15147 catalog_manager.cc:5697] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 2, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.250638 15148 catalog_manager.cc:5697] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 2, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 2 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.431171 15319 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.432114 15249 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.432704 16496 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.433418 16477 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.577167 15319 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:39.578423 16517 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:39.590267 15250 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:39.591507 15249 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.592685 16520 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:39.592950 16497 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.612779 15319 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.614315 16475 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.786034 15250 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.795416 16475 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:02:39.808540 15249 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:39.809541 15325 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:39.812211 16517 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:39.827893 15325 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.836431 16536 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:39.836676 15245 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.839159 16517 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:39.847383 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:39.847620 16475 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:39.876405 15316 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.878675 16537 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:39.894438 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52562.9us
W20260709 13:02:39.985594 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54482.1us
I20260709 13:02:40.160322 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:40.213477 15325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:40.214331 15325 raft_consensus.cc:606] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:02:40.218173 15249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:02:40.218778 15249 raft_consensus.cc:606] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:40.221562 15325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "525e3bab033946a090787fa86d1292aa"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:40.222049 15325 raft_consensus.cc:606] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:02:40.224826 15249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:02:40.225461 15249 raft_consensus.cc:606] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Received request to transfer leadership to TS edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:40.228272 15325 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:40.232544 15316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b29a6f3425a941868726620486fe7013"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:40.233141 15316 raft_consensus.cc:606] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Received request to transfer leadership to TS edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:40.235925 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:40.236323 15392 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:40.237633 15249 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:40.237792 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:40.239105 15289 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9e997bc5c2942178cde4c670df97100. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.239375 16538 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:40.240396 16439 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:40.242051 16481 raft_consensus.cc:993] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:40.242595 16439 raft_consensus.cc:1081] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:40.244197 15393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39732
I20260709 13:02:40.244831 15393 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.245270 15393 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.249440 16439 raft_consensus.cc:2955] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.254115 15249 raft_consensus.cc:2955] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.257488 15393 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:40.261407 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:40.257051 15392 raft_consensus.cc:2955] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.262095 15250 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.263470 15393 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:40.266407 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:40.267046 15325 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.267343 15325 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:40.268131 15325 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:40.269205 15325 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.282289 15147 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.285145 15325 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:40.283859 15249 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:40.287225 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:40.288298 16497 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:40.288820 16497 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:40.288997 15250 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:40.289746 16497 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:40.309926 15214 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f537e87ec99a4032a677e62627c567e2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.315994 15392 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:40.315995 15325 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:40.317584 16493 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:40.318763 16490 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:40.329620 16493 raft_consensus.cc:2955] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.331648 15325 raft_consensus.cc:2955] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.351962 15394 raft_consensus.cc:2955] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.361123 15148 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.369611 15393 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:40.360435 15144 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 2, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.383487 15325 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:40.384429 15363 consensus_peers.cc:597] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f20d2caf56534c1ebcf23935582a5f03. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.384987 15250 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:40.385016 16497 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:40.391517 16475 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:40.416230 16536 raft_consensus.cc:2955] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.418363 15250 raft_consensus.cc:2955] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.425843 15325 raft_consensus.cc:2955] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:02:40.435385 15147 catalog_manager.cc:5697] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index -1 to 2, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:02:40.437528 15196 auto_rebalancer.cc:629] Failed to schedule move for tablet 2fe8125185eb4429a9a0a58b14dd8636: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:02:40.539813 16490 raft_consensus.cc:993] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: : Instructing follower edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:40.540289 16534 raft_consensus.cc:1081] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Signalling peer edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:40.542110 16030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:46354
I20260709 13:02:40.542783 16030 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.543202 16030 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.555620 16030 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:40.558457 16030 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:40.559280 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:40.559904 15250 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:40.560194 15250 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:40.560979 15250 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:40.562311 15250 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.562480 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:40.563087 15393 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.572279 15393 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:02:40.573532 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:40.574518 16500 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:40.578390 16439 raft_consensus.cc:993] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:40.578895 16439 raft_consensus.cc:1081] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:02:40.580897 15394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "525e3bab033946a090787fa86d1292aa"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39732
I20260709 13:02:40.581487 15394 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.581841 15394 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.588577 15394 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:40.591995 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:40.592705 15249 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.593014 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:40.593595 15325 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.593892 15325 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:40.594038 15394 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:40.594635 15325 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:40.595844 15325 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.595901 16500 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:40.597095 16500 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:40.602959 15325 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:40.604198 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:40.605050 16536 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:40.605616 16536 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:40.606663 16536 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:40.609231 15249 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:40.611805 15250 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:02:40.629782 15144 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 2 to 3, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 3 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.632681 15148 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 2, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.636579 16490 raft_consensus.cc:993] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: : Instructing follower 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
I20260709 13:02:40.637156 16490 raft_consensus.cc:1081] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Signalling peer 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
I20260709 13:02:40.638868 15325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:39714
I20260709 13:02:40.639415 15325 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.639780 15325 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.646835 15325 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:40.649549 15325 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:40.650823 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:40.651451 15250 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.651762 15250 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:40.652415 15250 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:40.653450 15250 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.659646 16271 raft_consensus.cc:993] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:40.660183 16271 raft_consensus.cc:1081] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Signalling peer edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:40.661288 15250 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:40.662469 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:40.662775 15291 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:40.663069 15394 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.663671 16439 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:40.664091 16439 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:40.665439 16439 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:40.671804 16030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b29a6f3425a941868726620486fe7013"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:46364
I20260709 13:02:40.672502 16030 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.672922 16030 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.691942 15394 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:40.692601 15393 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:40.696206 15148 catalog_manager.cc:5697] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 2, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 2 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.697753 16030 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:40.706669 16030 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:40.707010 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:40.707291 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:40.707681 15325 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:40.707881 15392 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.708017 15325 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:40.708880 15325 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:40.710165 15325 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:40.715292 15392 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:40.716571 15998 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:40.717468 16500 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:40.717964 16500 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:40.718812 16500 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:40.725267 15250 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:40.728914 15325 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:40.733477 16475 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:40.736874 16567 ts_tablet_manager.cc:933] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213)
I20260709 13:02:40.741104 15148 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 2, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 2 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.765878 16570 ts_tablet_manager.cc:933] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:40.777947 16567 tablet_copy_client.cc:323] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.193:43213
I20260709 13:02:40.780458 15260 tablet_copy_service.cc:140] P 89940175e5444593aab6b3a025624b5b: Received BeginTabletCopySession request for tablet f537e87ec99a4032a677e62627c567e2 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:43794)
I20260709 13:02:40.781090 15260 tablet_copy_service.cc:161] P 89940175e5444593aab6b3a025624b5b: Beginning new tablet copy session on tablet f537e87ec99a4032a677e62627c567e2 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:43794: session id = edcf4a6bae7e4781bce325a586109ca5-f537e87ec99a4032a677e62627c567e2
I20260709 13:02:40.785298 15325 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:40.789790 16536 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:40.798035 15260 tablet_copy_source_session.cc:215] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:40.810516 16574 ts_tablet_manager.cc:933] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:40.813416 16567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f537e87ec99a4032a677e62627c567e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.809931 16570 tablet_copy_client.cc:323] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.195:44417
I20260709 13:02:40.818444 15409 tablet_copy_service.cc:140] P ee9654803379434388de45d4693e6b16: Received BeginTabletCopySession request for tablet f20d2caf56534c1ebcf23935582a5f03 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:51818)
I20260709 13:02:40.819031 15409 tablet_copy_service.cc:161] P ee9654803379434388de45d4693e6b16: Beginning new tablet copy session on tablet f20d2caf56534c1ebcf23935582a5f03 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:51818: session id = edcf4a6bae7e4781bce325a586109ca5-f20d2caf56534c1ebcf23935582a5f03
I20260709 13:02:40.845469 15409 tablet_copy_source_session.cc:215] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:40.857738 16574 tablet_copy_client.cc:323] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:02:40.859897 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet b9e997bc5c2942178cde4c670df97100 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:02:40.860512 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet b9e997bc5c2942178cde4c670df97100 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-b9e997bc5c2942178cde4c670df97100
I20260709 13:02:40.866546 16570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20d2caf56534c1ebcf23935582a5f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.868970 16567 tablet_copy_client.cc:806] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:40.869669 16567 tablet_copy_client.cc:670] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:40.878497 15334 tablet_copy_source_session.cc:215] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:40.879832 16567 tablet_copy_client.cc:538] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:40.885207 16574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e997bc5c2942178cde4c670df97100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:40.890434 16570 tablet_copy_client.cc:806] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:40.891120 16570 tablet_copy_client.cc:670] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:40.896888 16570 tablet_copy_client.cc:538] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:40.903995 16567 tablet_bootstrap.cc:492] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:40.906255 16570 tablet_bootstrap.cc:492] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:40.917073 16574 tablet_copy_client.cc:806] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:40.917819 16574 tablet_copy_client.cc:670] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:40.922544 16574 tablet_copy_client.cc:538] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:40.946274 16574 tablet_bootstrap.cc:492] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:02:40.951974 16567 tablet_bootstrap.cc:492] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:40.953141 16567 tablet_bootstrap.cc:492] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:40.974386 16570 tablet_bootstrap.cc:492] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:40.975687 16570 tablet_bootstrap.cc:492] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:40.953979 16567 ts_tablet_manager.cc:1403] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.057s	user 0.014s	sys 0.016s
I20260709 13:02:40.976840 16570 ts_tablet_manager.cc:1403] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.013s
I20260709 13:02:40.979975 16567 raft_consensus.cc:359] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:40.981140 16567 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:40.981917 16567 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:40.982329 16570 raft_consensus.cc:359] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:40.983225 16570 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:40.983914 16570 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:40.988111 16570 ts_tablet_manager.cc:1434] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:02:40.992262 16567 ts_tablet_manager.cc:1434] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:02:40.993221 15409 tablet_copy_service.cc:342] P ee9654803379434388de45d4693e6b16: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-f20d2caf56534c1ebcf23935582a5f03 received from {username='slave'} at 127.0.0.1:51818
I20260709 13:02:40.993734 15409 tablet_copy_service.cc:434] P ee9654803379434388de45d4693e6b16: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-f20d2caf56534c1ebcf23935582a5f03 on tablet f20d2caf56534c1ebcf23935582a5f03 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:40.994815 15260 tablet_copy_service.cc:342] P 89940175e5444593aab6b3a025624b5b: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-f537e87ec99a4032a677e62627c567e2 received from {username='slave'} at 127.0.0.1:43794
I20260709 13:02:40.995301 15260 tablet_copy_service.cc:434] P 89940175e5444593aab6b3a025624b5b: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-f537e87ec99a4032a677e62627c567e2 on tablet f537e87ec99a4032a677e62627c567e2 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:40.999374 15244 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:41.001025 16500 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:41.015785 16574 tablet_bootstrap.cc:492] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:41.016768 16574 tablet_bootstrap.cc:492] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:02:41.017951 16574 ts_tablet_manager.cc:1403] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.012s
I20260709 13:02:41.022966 16574 raft_consensus.cc:359] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:41.029667 16574 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:02:41.030416 16574 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:41.033321 15393 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:41.034861 16500 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:41.036511 16574 ts_tablet_manager.cc:1434] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 13:02:41.038314 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-b9e997bc5c2942178cde4c670df97100 received from {username='slave'} at 127.0.0.1:46848
I20260709 13:02:41.038774 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-b9e997bc5c2942178cde4c670df97100 on tablet b9e997bc5c2942178cde4c670df97100 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:41.078814 15250 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.080245 16481 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.090956 15394 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.097276 15245 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.097849 16271 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.099952 16497 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.140074 15323 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:41.142817 16031 raft_consensus.cc:1217] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:41.142976 16030 raft_consensus.cc:1217] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:41.147403 16587 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:41.198554 16031 raft_consensus.cc:1217] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:41.207006 15323 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:41.208938 16562 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:41.227818 15394 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:41.229207 16500 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:41.238864 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:41.372737 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:41.567373 16475 raft_consensus.cc:1064] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:41.571043 16475 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:41.730616 16031 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:41.732077 16536 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:42.357419 16596 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.358367 16596 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.361954 16596 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.410501 16593 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.411320 16593 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.413971 16593 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:42.414934 16594 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.596s	user 0.001s	sys 0.000s
W20260709 13:02:42.416652 15290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.005s	sys 0.002s
I20260709 13:02:42.419780 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:42.420207 15290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.005s	sys 0.002s
W20260709 13:02:42.422747 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.418314 16602 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.429559 16602 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.431883 16602 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.442526 16475 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:42.443153 16475 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.446382 15325 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:42.445245 16475 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:42.472820 16605 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:42.474418 16605 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.478888 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:42.481339 16605 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:42.483126 16605 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.483794 16605 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:42.484421 15216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.007s	sys 0.001s
W20260709 13:02:42.484793 15216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.009s	sys 0.001s
I20260709 13:02:42.486121 16605 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.488600 16606 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.490314 16606 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.492547 16606 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:42.473182 15364 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.006s	sys 0.004s
W20260709 13:02:42.497709 15364 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.007s	sys 0.005s
I20260709 13:02:42.518327 16587 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:42.518889 16587 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.520921 16587 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:42.524019 16600 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.524629 16600 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:42.549839 16600 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.551227 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.551967 15246 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:42.552645 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.558670 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:42.562821 16601 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:42.563357 16601 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.563802 16601 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.600055 16562 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.600669 16562 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.603927 16562 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.581435 16601 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.606186 16601 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:42.609282 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72614.4us
I20260709 13:02:42.610311 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:42.611016 15243 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:42.601076 16493 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.611323 16600 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.611652 16493 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.611881 16600 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.613812 16600 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.613818 16493 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.618520 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:42.619362 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:42.620837 16599 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.625666 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:42.621588 16599 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.644307 16475 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:42.643386 15243 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:42.645866 16606 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:42.646693 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:42.644456 16604 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.644994 16475 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.648635 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.648721 16605 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:42.651158 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.651549 16605 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.653749 16605 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.654289 16606 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.630759 16493 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.655051 16601 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:42.657848 16601 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:42.658747 16601 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.660584 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:42.668969 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.654313 16604 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.671597 16605 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.672139 16605 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.672916 16604 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.673436 16604 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.675709 16608 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.675407 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:42.680871 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:42.678838 16561 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:42.661053 16490 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.661311 16500 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.676218 16608 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.666801 16562 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:42.691222 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:42.674187 16605 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:42.662664 16493 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.673883 16604 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.694381 16490 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.692777 16500 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.708736 16490 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.684748 16561 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.713229 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:42.713866 15393 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:42.714432 16597 raft_consensus.cc:1064] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:42.714913 16561 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.715260 16598 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.694748 16562 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.717068 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.717365 16608 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:42.717868 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:42.730046 16439 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.698909 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.742684 16599 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.698832 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.715786 16598 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.730850 16439 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.744052 16475 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:42.785714 16611 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:42.791255 16612 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.759033 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:42.834865 16562 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.708736 16500 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:42.788601 16271 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.757967 16363 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.744175 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:42.836359 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2a00 after lost signal to thread 14142
W20260709 13:02:42.876726 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08002e0e00 after lost signal to thread 15182
W20260709 13:02:42.878293 15346 debug-util.cc:398] Leaking SignalData structure 0x7b080009bfa0 after lost signal to thread 15274
W20260709 13:02:42.879379 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08001453a0 after lost signal to thread 15349
W20260709 13:02:42.880649 15346 debug-util.cc:398] Leaking SignalData structure 0x7b080033b240 after lost signal to thread 15423
W20260709 13:02:42.880985 15346 debug-util.cc:398] Leaking SignalData structure 0x7b080033b580 after lost signal to thread 15424
I20260709 13:02:42.777225 16596 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.782733 16605 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.793525 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:42.753630 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:42.818853 16493 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.872123 16030 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:42.873664 16615 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:42.842082 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 144861us
W20260709 13:02:42.882572 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08003392a0 after lost signal to thread 16057
I20260709 13:02:42.883663 16439 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:42.939565 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08002fdc20 after lost signal to thread 16551
I20260709 13:02:42.900835 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.940284 15250 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:42.898988 16606 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.919853 16605 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.920863 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:42.920764 16363 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.776768 16608 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.946502 16608 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.947530 16493 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.948067 16493 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.948766 16608 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:42.924724 16604 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:42.927419 16475 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.930354 16596 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.747082 16561 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:42.827044 16609 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.932873 15148 catalog_manager.cc:5697] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 2, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 2 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:42.973234 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.795533 16490 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.903559 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:42.853711 16599 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:42.853785 16602 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.874764 16271 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.945019 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:42.951079 16363 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:42.938807 16593 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.950147 16493 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:42.932237 16612 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.027062 16271 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.026204 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:02:43.023550 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47271.7us
W20260709 13:02:43.024431 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 81485.4us
I20260709 13:02:43.029294 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.932915 16611 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:43.033143 16271 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:43.033603 16271 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:43.033978 16271 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:42.978760 16606 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:42.971675 16608 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:43.039700 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.039515 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.022497 16604 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:43.046650 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.031600 16607 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.031544 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:42.985523 16475 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.984285 16599 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.034611 16602 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.042363 16606 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:42.950368 16597 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:43.065623 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 91224.5us
I20260709 13:02:43.042559 16605 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.021690 16490 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.029708 16593 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:42.958971 16615 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.071424 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.068326 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:43.073390 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 131677us
I20260709 13:02:43.074602 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:43.075850 16605 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.055330 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.086730 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.031688 16609 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:43.045604 16608 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.050561 16604 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:43.093199 16598 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.111218 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.112396 16599 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.113562 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.119825 16615 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:43.120015 16490 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.126542 16602 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.128855 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.150205 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.151106 15250 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
W20260709 13:02:43.155778 16614 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:02:43.156595 16593 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.166603 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.160660 16596 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.148049 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:43.175267 16607 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.176024 16604 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:43.176432 16609 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:43.177343 16475 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:43.178139 16606 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.184726 16271 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.186262 15319 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:43.189380 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:43.189780 15250 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:02:43.187830 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 66348us
I20260709 13:02:43.190748 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.190815 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:43.187951 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 135652us
I20260709 13:02:43.196725 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.197444 15247 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
W20260709 13:02:43.199054 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 130830us
I20260709 13:02:43.199584 16271 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.201042 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:43.201042 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:43.203871 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.204545 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:43.193531 16608 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:43.205446 16629 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:43.211807 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.215878 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.217234 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.218438 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.219188 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.219830 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:43.220479 16611 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:43.218559 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.204430 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.205891 16629 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:43.229324 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 151548us
I20260709 13:02:43.231590 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.232409 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:43.232970 16620 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:43.233443 16620 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:43.233832 16620 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:43.233999 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.236672 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.240677 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.243867 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.245682 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:43.246917 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:43.248230 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.228947 16593 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:43.250763 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.289886 15392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819"
dest_uuid: "ee9654803379434388de45d4693e6b16"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:46422
I20260709 13:02:43.290759 15392 raft_consensus.cc:606] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:43.251768 16617 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:43.252197 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.252357 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:43.253965 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 159063us
I20260709 13:02:43.278733 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.236433 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:43.252774 16611 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:43.230727 16629 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:43.294843 15215 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.301735 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:02:43.295166 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 43894.1us
I20260709 13:02:43.293205 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.296460 16626 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.293481 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.296671 16475 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:43.303493 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.302493 16599 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.304768 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.303416 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.305996 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.306208 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.307569 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.302469 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:43.308359 16493 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.308735 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.310081 16606 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.310207 16363 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:43.311573 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.311721 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.318826 16631 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.318964 15247 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:43.297588 16490 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:43.319742 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.243856 16627 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
W20260709 13:02:43.377606 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 57973.3us
I20260709 13:02:43.289458 16608 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:43.298372 16617 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:43.379006 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.310714 15246 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:43.294727 16612 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:43.292481 16593 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:43.296756 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:43.378607 16626 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.403519 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.314704 16620 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.391151 16593 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:43.410745 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.412554 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.414336 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.388787 16617 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:43.311499 16611 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:43.415795 16593 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.423190 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.390923 16632 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:43.431020 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53028.4us
I20260709 13:02:43.389559 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.388476 16608 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:43.405287 16612 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:02:43.436187 16612 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:43.436594 16612 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:43.441891 16612 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.444154 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.444703 16606 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:43.464325 16636 log.cc:927] Time spent T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Append to log took a long time: real 0.183s	user 0.008s	sys 0.000s
I20260709 13:02:43.466565 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:43.443800 16612 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:43.442199 16620 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:43.458443 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 79631.6us
I20260709 13:02:43.487694 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.489367 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.489818 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.491106 15244 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:43.492043 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.494199 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.495139 16611 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:43.493289 16604 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.493443 16606 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.497498 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:43.507206 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.508355 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.512382 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.513059 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.513610 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.514340 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.514775 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.515134 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.517189 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:43.517439 16593 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.534610 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:43.535694 16608 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:43.535970 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:43.538309 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.540616 16606 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.540838 16616 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:02:43.501653 16617 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.542312 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:43.542646 15246 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:43.542857 15320 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:43.544301 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 232756us
I20260709 13:02:43.537739 16629 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:43.550772 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:43.551085 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.552685 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:43.555090 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:43.555539 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:43.558090 15242 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:43.546705 16604 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.557082 16475 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:02:43.561878 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.568873 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:43.562037 16634 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.562826 16630 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.573535 15249 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:43.565568 16618 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:43.566946 16629 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:43.557193 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:43.560256 16609 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.570921 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:43.565084 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:43.575822 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.581290 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:43.581506 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:43.571774 16607 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:43.578140 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.582415 16635 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.588999 16616 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.569693 15998 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.590111 16607 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.592087 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:43.590613 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.590922 16490 raft_consensus.cc:1064] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:02:43.597962 15998 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.582988 16624 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:43.600246 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49205.2us
I20260709 13:02:43.606216 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.600427 16500 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.608836 16613 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.605290 16607 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.591457 16618 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:43.610788 16635 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:43.611109 16617 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:43.611692 16618 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.612355 15998 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.613884 16500 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:43.615505 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.619493 15316 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:43.608994 16645 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:43.622040 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.627028 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:43.628980 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:43.608515 16616 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:43.634460 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:43.625438 16493 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:43.627655 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.632266 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:43.619685 16608 raft_consensus.cc:2955] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:43.637619 16634 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:43.634261 16490 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:43.631479 16613 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:43.644109 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.634701 16475 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.632292 16622 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.657436 16033 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:43.632706 15320 raft_consensus.cc:2955] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:43.665582 16271 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:43.667631 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:43.671039 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:43.670296 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.679042 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:43.680856 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.683419 16363 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.683944 16271 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.685225 15321 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:43.685581 15395 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:43.682348 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:43.691435 15213 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.692538 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:43.696085 16363 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.682989 15318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:43.676012 16598 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:02:43.698061 16645 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.698099 16493 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:02:43.718364 15398 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:43.718971 15398 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:43.719305 16493 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:43.719877 16493 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:43.720019 15398 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.725344 15398 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:43.709089 15318 raft_consensus.cc:606] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Received request to transfer leadership to TS edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:43.736181 16493 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:43.737983 16493 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:44.912137 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 1.16485e+06us
I20260709 13:02:44.914592 16627 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:44.915238 16627 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:44.917491 16627 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:44.930938 16630 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:02:44.935143 16608 raft_consensus.cc:993] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: : Instructing follower 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
I20260709 13:02:44.935966 16628 raft_consensus.cc:1081] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Signalling peer 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
I20260709 13:02:44.939213 16634 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:44.940773 16628 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:44.941247 16628 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:44.942304 16628 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:44.944689 16628 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.986243 16619 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:44.987097 16619 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:44.989784 16619 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:44.991132 16490 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:44.991669 16490 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:44.993419 16490 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:44.993631 16625 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:44.994026 16490 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:44.994546 16490 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:44.994433 16625 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:44.996115 15322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:02:44.996452 16490 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:44.996788 15322 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:44.997144 16600 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:44.997207 15322 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:44.997790 16600 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:44.999807 16600 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.000278 16600 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.000725 16600 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.002629 16490 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.002957 16490 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.004139 16625 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.004245 16490 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.005471 15322 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.006850 16600 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.007550 15322 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.009605 16660 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.010213 16660 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.012307 16660 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.017851 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.039793 15318 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:45.041643 16660 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:45.041649 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.405s	user 0.033s	sys 0.042s
W20260709 13:02:45.042879 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.407s	user 0.034s	sys 0.043s
I20260709 13:02:45.050841 16600 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.051474 16600 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.053808 16600 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:45.056104 15398 consensus_meta.cc:287] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.330s	user 0.002s	sys 0.036s
I20260709 13:02:45.056689 15398 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:02:45.057216 16611 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:02:45.057240 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1488) took 1390 ms. Trace:
I20260709 13:02:45.057866 15398 rpcz_store.cc:276] 0709 13:02:43.667277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.667409 (+   132us) service_pool.cc:224] Handling call
0709 13:02:43.667631 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.057006 (+1389375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.057171 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:45.075839 16637 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:45.076472 16637 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.076813 16627 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.077430 16627 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.077795 16439 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.078364 16439 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.078812 16637 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.079649 16627 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.080145 16439 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.085198 16627 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.085973 16593 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.086624 16593 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.087519 15148 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 230) took 2163 ms. Trace:
I20260709 13:02:45.088976 16593 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.085793 16627 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.087812 15148 rpcz_store.cc:276] 0709 13:02:42.923852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.930107 (+  6255us) service_pool.cc:224] Handling call
0709 13:02:45.087436 (+2157329us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:43.034530 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:43.130857 (+ 96327us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:43.130896 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:02:43.130914 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:43.131266 (+   352us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:43.131363 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:43.131400 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:43.131601 (+   201us) tablet.cc:701] Row locks acquired
0709 13:02:43.131619 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:43.131777 (+   158us) write_op.cc:270] Start()
0709 13:02:43.131885 (+   108us) write_op.cc:276] Timestamp: P: 1783602163131731 usec, L: 0
0709 13:02:43.131906 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:02:43.132570 (+   664us) log.cc:844] Serialized 544 byte log entry
0709 13:02:43.584665 (+452095us) op_driver.cc:464] REPLICATION: finished
0709 13:02:43.794722 (+210057us) write_op.cc:301] APPLY: starting
0709 13:02:43.794809 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:43.794914 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:43.795085 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:43.802064 (+  6979us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:43.802278 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:43.802324 (+    46us) write_op.cc:312] APPLY: finished
0709 13:02:44.038390 (+236066us) log.cc:844] Serialized 23 byte log entry
0709 13:02:44.050170 (+ 11780us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:44.050321 (+   151us) write_op.cc:454] Released schema lock
0709 13:02:44.050384 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:44.050799 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:44.050827 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":209766,"apply.run_cpu_time_us":2789,"apply.run_wall_time_us":256047,"num_ops":1,"prepare.queue_time_us":52982,"prepare.run_cpu_time_us":10590,"prepare.run_wall_time_us":182529,"raft.queue_time_us":106294,"raft.run_cpu_time_us":24549,"raft.run_wall_time_us":130439,"replication_time_us":446288,"thread_start_us":284834,"threads_started":4,"wal-append.queue_time_us":81334,"wal-append.run_cpu_time_us":25311,"wal-append.run_wall_time_us":1837835}]]}
I20260709 13:02:45.092027 16627 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.097551 16631 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.102367 16439 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.102991 16439 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.104936 16439 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.105428 16439 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.107288 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 342) took 1427 ms. Trace:
I20260709 13:02:45.107671 16033 rpcz_store.cc:276] 0709 13:02:43.679764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.679904 (+   140us) service_pool.cc:224] Handling call
0709 13:02:43.682533 (+  2629us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.686693 (+  4160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.686725 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.688455 (+  1730us) log.cc:844] Serialized 572 byte log entry
0709 13:02:44.063619 (+375164us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:44.063664 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.064869 (+  1205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.107034 (+1042165us) raft_consensus.cc:1685] finished
0709 13:02:45.107054 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.107186 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":374759,"threads_started":1,"wal-append.queue_time_us":1170237}
I20260709 13:02:45.104352 16637 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.111218 16637 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.116328 16637 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.118903 15242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "705321025dc74b199219f4e541a68efa"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:02:45.119274 16637 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.119588 15242 raft_consensus.cc:606] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:45.119967 15242 raft_consensus.cc:614] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:45.119838 16637 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.122018 16628 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.122419 16625 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.122639 16628 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.123019 16625 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.124778 16628 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.125939 16628 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.126600 16625 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.126484 16628 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.129225 16627 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.129671 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 766) took 1507 ms. Trace:
I20260709 13:02:45.129935 16627 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.130784 15242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:02:45.131424 15242 raft_consensus.cc:606] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Received request to transfer leadership to TS edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:45.130837 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.126811 16599 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.138067 16659 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.098219 16631 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.138653 16659 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.105818 16439 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.140496 16631 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.133906 16593 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.132620 16628 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.141333 16628 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.141431 16660 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.141283 16593 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:45.141973 16628 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.135740 16627 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.136194 16625 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.130142 15320 rpcz_store.cc:276] 0709 13:02:43.622701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.625395 (+  2694us) service_pool.cc:224] Handling call
0709 13:02:43.632322 (+  6927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:43.632559 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:43.741461 (+108902us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.741775 (+   314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.741887 (+   112us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:43.741951 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.742053 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.129570 (+1387517us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4933,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":140}
I20260709 13:02:45.137589 16599 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.152879 16611 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.153324 16627 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:45.153522 16611 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.140774 16439 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.153870 16627 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.154655 16439 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.155468 16599 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.155275 16439 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.155961 16627 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.133014 15318 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:45.135210 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1646) took 1531 ms. Trace:
I20260709 13:02:45.163790 16628 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.163610 15323 rpcz_store.cc:276] 0709 13:02:43.603838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.603949 (+   111us) service_pool.cc:224] Handling call
0709 13:02:45.134518 (+1530569us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:02:45.134750 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.134916 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.134938 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.134974 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:45.135005 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.135060 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.135159 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7009536}
I20260709 13:02:45.136646 16661 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.166373 16637 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.168000 16637 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.168743 16611 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.166658 16661 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.169358 16626 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.135206 15242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:02:45.172101 15242 raft_consensus.cc:606] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Received request to transfer leadership to TS edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:45.142102 16660 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.145320 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1645) took 1541 ms. Trace:
I20260709 13:02:45.140995 16659 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.150547 16593 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:45.140702 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.447s	user 0.061s	sys 0.061s
I20260709 13:02:45.151909 16625 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.138962 16630 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.143959 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.170847 16626 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.182322 16659 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.183071 16439 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.191174 16490 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:02:45.186471 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.493s	user 0.061s	sys 0.061s
W20260709 13:02:45.193781 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 1.5003e+06us
I20260709 13:02:45.208988 16490 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.180487 15324 rpcz_store.cc:276] 0709 13:02:43.603552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.605311 (+  1759us) service_pool.cc:224] Handling call
0709 13:02:45.137713 (+1532402us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:02:45.137982 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.138175 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.138206 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.145008 (+  6802us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:45.145067 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.145138 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.145263 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13442944}
I20260709 13:02:45.183791 16619 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.208355 16599 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.187407 16631 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.220628 16439 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:45.191380 16630 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:45.222558 16619 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.168839 16637 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.236953 16439 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.238050 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.243916 16626 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.244760 16626 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.245399 16626 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.235526 16607 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.246698 16606 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.255604 16439 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.264847 16439 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.259516 16593 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.271698 16439 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.212049 16659 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.252333 16631 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.235809 16599 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.263561 16607 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.283092 15245 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:45.311028 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:45.311712 15250 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:45.313513 16490 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.315229 16675 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.315793 16675 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.318913 16668 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.320194 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.283885 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.269529 16600 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.315243 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.322916 15322 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:45.318049 16675 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.325148 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.326041 15323 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:45.328675 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.328974 16663 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.329499 15249 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:45.329643 15250 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:45.304078 16604 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.333137 15242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:02:45.336304 15242 raft_consensus.cc:606] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Received request to transfer leadership to TS edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:45.280313 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.306295 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.333752 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:45.280778 16627 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.310250 16661 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.312820 16637 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.264818 16606 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.337044 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.321269 16628 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.341975 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.273372 16593 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.319887 16668 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.345929 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.327859 16660 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.334702 16675 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.330466 16600 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.355429 16626 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.344915 15247 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:45.329555 16663 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.424460 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:02:45.425791 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 71802.8us
I20260709 13:02:45.423470 16660 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:45.430150 15243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.754s	user 0.025s	sys 0.026s
I20260709 13:02:45.430546 16670 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.431103 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.347589 16634 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.501753 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.501809 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.355531 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.505061 15246 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:45.505127 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.506315 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.506749 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:45.506922 15246 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:45.482777 16619 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.432698 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.641005 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.641642 15245 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:45.643476 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.433198 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.645879 16439 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.344710 15324 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:45.647943 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.648820 15324 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:45.433378 16666 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:45.439966 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 126352us
I20260709 13:02:45.453291 16677 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.437567 16672 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.464685 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:45.466522 16683 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.485699 16659 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.451932 16675 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.429919 16593 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.465718 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.750268 16701 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.750888 16701 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.751427 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.752147 15242 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:45.753163 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.355484 16606 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.756521 16659 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.465160 16602 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:02:45.759614 16701 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.484429 16599 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.482321 16607 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.486097 16608 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:45.491416 16682 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.491577 16667 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.335345 16676 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.497750 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:45.499842 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.498340 16660 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.499042 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.503939 15318 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:45.504226 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.770136 16608 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:45.773524 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.430781 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.770566 16682 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.775892 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.777242 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.777679 16682 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.508190 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.780180 15322 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:45.343577 16628 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.771082 16676 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.783578 16628 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.784170 16628 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.784898 16676 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:45.502954 15243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.827s	user 0.025s	sys 0.027s
I20260709 13:02:45.350463 16627 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.786059 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 750) took 2141 ms. Trace:
I20260709 13:02:45.434309 16630 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.513130 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.788101 16627 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.508545 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.770828 16667 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.789687 15246 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:45.505055 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.790870 16667 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.791222 15321 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:45.355557 16631 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.517474 16663 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.507654 16670 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.531992 16679 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.792814 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.793480 16679 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:45.547083 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:45.537657 16678 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.794787 16667 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.795043 16670 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.795128 16678 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.795419 16667 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.797639 16678 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.798257 16667 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.799901 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:45.800060 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:45.537007 16680 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.801081 16680 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.801733 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:45.803560 16680 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.549753 16685 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.786562 15243 rpcz_store.cc:276] 0709 13:02:43.644212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.648322 (+  4110us) service_pool.cc:224] Handling call
0709 13:02:43.674003 (+ 25681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:43.674437 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:43.674472 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:43.675523 (+  1051us) log.cc:844] Serialized 572 byte log entry
0709 13:02:45.785596 (+2110073us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:45.785645 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.785734 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:45.785792 (+    58us) raft_consensus.cc:1685] finished
0709 13:02:45.785805 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.785968 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":2109728,"threads_started":1,"wal-append.queue_time_us":371022,"wal-append.run_cpu_time_us":2094,"wal-append.run_wall_time_us":1002127}
I20260709 13:02:45.804713 16685 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.806424 16676 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:45.806967 16676 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.807200 16685 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.807454 16676 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:45.551648 16681 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.552047 16688 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.553645 16673 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.554354 15147 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 128) took 1500 ms. Trace:
I20260709 13:02:45.768899 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.559877 15317 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:45.808421 16681 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.564452 16600 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.565130 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1654) took 1927 ms. Trace:
I20260709 13:02:45.817606 15325 rpcz_store.cc:276] 0709 13:02:43.638244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:43.638348 (+   104us) service_pool.cc:224] Handling call
0709 13:02:45.564244 (+1925896us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5e9c 00007f3666ad5a5b 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:02:45.564487 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.564713 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:45.564750 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:45.564806 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:45.564848 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:45.564920 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:45.565058 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8627840}
I20260709 13:02:45.578742 16669 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.583425 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.585026 16693 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.589138 16625 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.592960 16671 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.588215 16692 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.597800 15396 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:45.605815 16694 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.602355 16637 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.340111 16604 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.612380 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.613157 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.614286 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.616228 16691 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.612380 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.626736 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.627893 15395 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:45.627880 16695 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.636004 16696 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.637180 16500 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:45.651679 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 187080us
I20260709 13:02:45.831460 15323 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:45.820538 16685 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.693050 16033 raft_consensus.cc:2955] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:45.697250 16700 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.650202 16697 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.683955 16683 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.650646 16666 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:45.712283 15290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 2.104s (SENT) [suppressed 1 similar messages]
I20260709 13:02:45.713966 16028 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 LEARNER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:45.718787 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.723105 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.731153 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:45.654017 16672 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.739311 16699 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.740826 16611 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.741470 16675 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.651083 16677 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.745810 15148 catalog_manager.cc:5697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.749444 16698 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.757063 16659 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.766575 16704 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.502063 16634 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.529135 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:45.784657 16628 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.786799 16705 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:45.513588 16668 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.495738 16662 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:45.774951 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.771621 16660 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:45.896270 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.773675 16608 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.558429 16684 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.809434 15147 rpcz_store.cc:276] 0709 13:02:44.052914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.551365 (+1498451us) service_pool.cc:224] Handling call
0709 13:02:45.553257 (+  1892us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0}
I20260709 13:02:45.816813 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.821458 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.825852 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.827504 15390 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:45.819422 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.656337 16439 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:45.900099 15396 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:45.900343 16439 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.900735 16439 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:45.833583 15291 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:45.815408 16673 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.825083 16630 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:45.827117 16692 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.905637 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.836716 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.835561 16691 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.839131 16490 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:45.845594 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:45.835902 16500 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.808585 16688 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.855244 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.911456 15398 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:45.831270 16600 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:02:45.829584 16637 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.843932 16695 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.863677 16611 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.859162 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.867069 16031 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:45.868702 16666 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.830718 16669 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.833469 16694 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.838645 16671 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.879416 16681 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.847707 16685 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.829267 16693 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.849449 16697 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.901386 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:45.932263 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.934116 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:45.936102 16634 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.937029 16683 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.938629 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.941295 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.938910 15399 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:45.870414 16704 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:02:45.838008 16696 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.828603 16706 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:02:45.907438 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.909731 15396 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
W20260709 13:02:45.910332 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 64784.8us
I20260709 13:02:45.924597 16668 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:45.870400 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:02:45.917357 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 83876.6us
I20260709 13:02:45.908231 16659 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.921531 16679 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:45.922991 16677 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.915444 16684 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.869796 16698 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.910424 16490 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:45.910971 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:45.967898 16490 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:45.874797 16699 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:45.948698 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:45.953384 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.949182 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:45.972903 15396 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:45.974664 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:45.907608 16662 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.981907 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.983318 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.978200 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:45.985442 16363 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:45.985827 16363 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:45.986176 16363 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:45.943836 16493 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:45.989794 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.990540 15323 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:45.991037 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:45.991511 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.983700 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:45.992475 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:45.994187 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.002849 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.004415 16689 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:46.004997 16689 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:46.005487 16689 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:45.976625 15394 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:46.008435 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.011207 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.957007 16694 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:45.903599 16705 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.959594 16671 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.952926 16024 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:45.960733 16604 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:45.961391 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:45.935302 16681 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.042966 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.849287 16700 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:45.968323 16490 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:45.971392 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:45.981817 16596 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:45.978440 16668 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:46.001076 16493 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.058390 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.060199 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:02:45.998924 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88036.3us
I20260709 13:02:46.076436 16672 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.046561 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:45.967340 16673 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.041453 16676 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.041706 16657 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
I20260709 13:02:46.042304 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.020071 15395 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:45.966939 16600 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:45.994853 15396 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:45.992004 16670 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.062831 16363 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.036007 16627 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.072786 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.084116 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.045130 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.045221 16681 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:46.047436 16596 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.062114 16682 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.115173 16669 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:46.093842 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.064133 16493 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.104478 16363 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.084843 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.094830 16600 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.040176 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.095211 16670 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:46.101761 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.017846 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:46.131726 16705 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:46.104007 16627 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:46.109974 16681 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.112329 16596 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:46.029942 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:02:46.163182 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 133364us
I20260709 13:02:46.143929 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.144711 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.146648 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.151443 15398 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 1.
I20260709 13:02:46.115260 16691 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:46.196549 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.153235 16600 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.153306 16619 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:02:46.154583 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.133010 16028 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
W20260709 13:02:46.159195 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 141462us
I20260709 13:02:46.201438 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:46.159888 16627 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.162045 16662 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:46.109974 16628 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:46.168334 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:46.116508 16682 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.113806 16611 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:46.190100 16500 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.159289 16670 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.200327 16032 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:46.205549 16439 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.195528 16688 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:46.209426 15291 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:46.190660 16631 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:46.242465 16439 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.185477 16663 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:46.216756 16602 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.251026 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:46.257109 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 728025us
I20260709 13:02:46.213831 16682 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.212525 16625 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:46.240255 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.241055 16631 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:46.199175 16027 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:46.217214 16637 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.157438 16668 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.240456 16704 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:46.299640 16692 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:46.302218 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:46.301363 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 481218us
I20260709 13:02:46.258384 16602 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:46.247506 16663 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:46.281749 16625 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:46.265630 16490 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:46.284397 16631 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:46.288872 16697 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.319856 16490 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:46.320966 16681 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.308485 16602 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:46.335847 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 352187us
W20260709 13:02:46.336614 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 624316us
I20260709 13:02:46.309051 16625 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:46.357447 16696 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.357568 16638 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:46.311825 16685 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:46.308934 16663 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:46.361138 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:02:46.361959 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 57168us
I20260709 13:02:46.371917 15363 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:46.374255 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:46.387096 15365 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:46.388662 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:46.394207 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:46.358177 16638 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:02:46.409327 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 48288.5us
I20260709 13:02:46.430968 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:46.433452 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:46.437884 15325 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:46.435385 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.407938 16705 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.432032 16638 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:46.398016 16662 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:46.398201 16628 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:46.431843 16685 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:46.398341 16691 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:46.466308 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.432327 16611 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.468200 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.408322 16700 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.461484 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.452278 16599 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.452819 16705 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.478451 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.478561 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:46.470325 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.453820 16659 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.475143 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.374732 16699 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:46.466181 16685 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.498829 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:02:46.500185 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 280302us
I20260709 13:02:46.468703 16611 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.502388 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:46.474594 16599 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.488792 16705 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:46.519940 16054 debug-util.cc:398] Leaking SignalData structure 0x7b0800112c00 after lost signal to thread 14142
I20260709 13:02:46.487360 16659 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.554047 16490 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:46.554870 16490 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.505188 16685 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:46.503623 16677 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:46.573771 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.517999 16611 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.530910 16599 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.487998 15998 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:46.571465 16659 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.624943 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.588622 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.634219 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.612232 16681 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:46.588930 16708 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.617323 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:02:46.640426 16054 debug-util.cc:398] Leaking SignalData structure 0x7b080026f560 after lost signal to thread 15182
I20260709 13:02:46.651844 16490 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.669097 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:02:46.671937 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 480718us
I20260709 13:02:46.673369 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:46.675367 16625 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.676577 15325 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:46.678306 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 176027us
I20260709 13:02:46.679679 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:02:46.660426 16689 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.654s	user 0.014s	sys 0.000s
I20260709 13:02:46.648957 16637 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:46.650203 16697 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:46.685359 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.692948 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.661092 16708 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:46.698334 16687 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:46.698809 16687 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:46.699615 16687 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:46.690910 16593 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:46.667609 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 195267us
I20260709 13:02:46.715005 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.702666 16708 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.720783 15320 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:46.751603 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:46.727545 16054 debug-util.cc:398] Leaking SignalData structure 0x7b080035c040 after lost signal to thread 15274
I20260709 13:02:46.751986 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.736415 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:46.732235 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 199881us
I20260709 13:02:46.743799 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.694465 16689 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.703404 16687 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.756794 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.733414 16713 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:46.735013 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.765324 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.766328 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.744508 16593 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:46.770675 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.771965 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:46.773247 16029 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:46.761550 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.774431 16689 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.753420 16721 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:46.780588 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.778887 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.778967 15363 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:46.781258 15249 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:46.782161 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:46.782379 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:46.784274 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:46.768990 16627 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 13:02:46.785899 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.791057 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:46.791985 15322 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:46.796074 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.778025 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.804504 15249 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 1.
W20260709 13:02:46.794790 16596 consensus_meta.cc:287] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.001s
I20260709 13:02:46.785826 16630 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.813757 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:46.810176 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.821736 15214 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:46.823714 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:46.831837 16602 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:46.771783 16713 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:46.793341 16054 debug-util.cc:398] Leaking SignalData structure 0x7b080035cb20 after lost signal to thread 15349
I20260709 13:02:46.843235 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.801918 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:46.811708 16715 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:02:46.778414 16593 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.840193 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:46.823590 16720 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:02:46.813552 16630 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.795089 16627 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:46.855527 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.859583 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.859329 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:46.856252 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.814188 16596 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:46.867404 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 45754.7us
I20260709 13:02:46.869477 15323 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:46.862100 16628 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:46.844421 16681 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:02:46.856588 16630 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.872025 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:46.858423 16684 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.875032 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.877213 16596 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.877750 15241 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:46.879081 16608 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:46.879554 16600 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.000s
W20260709 13:02:46.870211 16054 debug-util.cc:398] Leaking SignalData structure 0x7b080030c5c0 after lost signal to thread 15423
I20260709 13:02:46.857651 16699 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:02:46.884188 16730 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:46.846586 16725 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:02:46.888054 16602 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:46.884865 16593 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.888976 16611 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:46.846809 16637 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:02:46.892417 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.895744 16490 raft_consensus.cc:993] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: : Instructing follower edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:46.898132 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.902130 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 114) took 1399 ms. Trace:
I20260709 13:02:46.913707 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.914186 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:46.914685 16631 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.601s	user 0.004s	sys 0.007s
I20260709 13:02:46.915086 16631 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.916183 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.917354 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.917691 16631 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.907629 16679 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:46.918421 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.918767 16679 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:46.919534 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.919586 16679 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.920701 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.920861 16679 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:46.874068 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:46.900928 15243 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:46.926424 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.909070 16730 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:46.882287 16685 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.868280 16698 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.910506 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:46.921487 16670 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.675s	user 0.008s	sys 0.000s
W20260709 13:02:46.922849 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48838.2us
I20260709 13:02:46.921072 16638 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.913213 16033 rpcz_store.cc:276] 0709 13:02:45.505306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.505438 (+   132us) service_pool.cc:224] Handling call
0709 13:02:45.505694 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:45.692881 (+187187us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:46.017036 (+324155us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.498814 (+481778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.498870 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:46.498918 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.901908 (+402990us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54007c1d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:46.901959 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.902082 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33077,"raft.queue_time_us":4680,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":17354,"spinlock_wait_cycles":429723520,"thread_start_us":481313,"threads_started":1,"wal-append.queue_time_us":599389}
I20260709 13:02:46.903332 15247 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:46.922952 16657 raft_consensus.cc:1081] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Signalling peer edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:46.903442 16600 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.928921 16725 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:46.985107 15244 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:46.938457 16708 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.985998 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:46.990967 16600 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:46.929867 16730 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:46.953330 16054 debug-util.cc:398] Leaking SignalData structure 0x7b080026cee0 after lost signal to thread 16057
I20260709 13:02:46.931823 16713 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:46.993202 15324 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:46.933378 16670 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.994321 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.004011 16599 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:46.999764 15242 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:46.954414 15321 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:47.005059 16670 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:47.000775 16660 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.097s	user 0.009s	sys 0.003s
I20260709 13:02:47.000826 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:46.992570 16725 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.004567 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:46.998883 16593 raft_consensus.cc:2955] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:47.001041 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:47.011657 15248 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:47.012722 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.013836 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.013909 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.014567 16659 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.012869 16602 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:47.015108 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.022413 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:47.016687 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:47.021199 16493 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.863s	user 0.006s	sys 0.006s
I20260709 13:02:47.024286 16705 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.028931 16493 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.010735 16725 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:47.030423 15250 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.031837 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.019649 16602 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:47.035840 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:47.008258 16660 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.026790 16638 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.032627 16705 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:47.042917 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:47.041970 16682 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.735s	user 0.003s	sys 0.008s
I20260709 13:02:47.042917 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.044021 15247 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:47.046659 16611 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:47.046953 16685 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.038363 16602 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.047859 15392 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:47.049572 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.050923 16493 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.052196 15393 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
W20260709 13:02:47.050047 16663 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.674s	user 0.005s	sys 0.004s
I20260709 13:02:47.057180 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.058403 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.066495 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.075776 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.063342 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:47.077610 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.085824 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.101202 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.107643 15399 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:47.079561 16611 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.098160 16705 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.045563 16659 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:47.116600 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:47.119570 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.050964 16708 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:47.099220 16667 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:47.063607 16599 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.116796 15365 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.062968 16026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:46354
I20260709 13:02:47.123028 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:47.064935 16627 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.123274 16026 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:47.123028 16659 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.102030 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.123845 16026 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.124372 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:47.124837 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.051772 16682 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.071724 16663 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.135969 16682 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.136374 16663 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.123450 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:47.117177 16710 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.068833 16608 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.117630 16493 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:47.133507 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.136909 16630 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.150993 15394 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:47.155056 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.155234 16630 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:47.143213 16693 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.140630 16710 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.156098 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 345) took 1390 ms. Trace:
I20260709 13:02:47.156203 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.156606 16030 rpcz_store.cc:276] 0709 13:02:45.765519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.244612 (+479093us) service_pool.cc:224] Handling call
0709 13:02:46.285104 (+ 40492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.285313 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.285335 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.285378 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:46.285406 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.285460 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.155925 (+870465us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b540067dc50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:47.156039 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92210560}
I20260709 13:02:47.157416 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.158905 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.160104 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.153892 16493 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.160841 15148 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49186 (request call id 212) took 1445 ms. Trace:
W20260709 13:02:47.163539 15392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1736) took 1528 ms (client timeout 1767 ms). Trace:
I20260709 13:02:47.163766 16493 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:47.163990 15392 rpcz_store.cc:269] 0709 13:02:45.635054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.907179 (+272125us) service_pool.cc:224] Handling call
0709 13:02:47.163365 (+1256186us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540009bfd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:47.163462 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2535263488}
I20260709 13:02:47.164633 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.165050 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.165766 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.160835 16730 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.167480 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1723) took 1569 ms. Trace:
I20260709 13:02:47.167892 15393 rpcz_store.cc:276] 0709 13:02:45.597595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.598474 (+   879us) service_pool.cc:224] Handling call
0709 13:02:45.598743 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.052615 (+1453872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.167250 (+114635us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54004128d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:47.167417 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3342175104}
I20260709 13:02:47.168373 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.169083 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.170121 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.173877 15393 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:47.173776 16730 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:47.175236 15393 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.176803 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:47.177613 15249 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:47.164654 16602 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.146850 16725 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.126101 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.145918 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.152894 16705 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:47.179653 16689 raft_consensus.cc:993] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: : Instructing follower edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:47.179813 15399 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.151999 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:47.195977 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.196272 16676 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:47.196677 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:47.197497 16698 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.197657 16695 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.191565 15147 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 2 to 3, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 3 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.190768 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.166026 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.188390 15247 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:47.161228 15148 rpcz_store.cc:276] 0709 13:02:45.715573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:45.715728 (+   155us) service_pool.cc:224] Handling call
0709 13:02:47.160760 (+1445032us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:46.647412 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:46.721745 (+ 74333us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:46.721782 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:02:46.724302 (+  2520us) tablet.cc:662] Decoding operations
0709 13:02:46.777112 (+ 52810us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:46.777178 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:46.777205 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:46.777401 (+   196us) tablet.cc:701] Row locks acquired
0709 13:02:46.777422 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:46.777577 (+   155us) write_op.cc:270] Start()
0709 13:02:46.777689 (+   112us) write_op.cc:276] Timestamp: P: 1783602166777527 usec, L: 0
0709 13:02:46.777711 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:46.784370 (+  6659us) log.cc:844] Serialized 603 byte log entry
0709 13:02:46.927706 (+143336us) op_driver.cc:464] REPLICATION: finished
0709 13:02:47.044786 (+117080us) write_op.cc:301] APPLY: starting
0709 13:02:47.044874 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:47.044991 (+   117us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:47.045122 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:47.101660 (+ 56538us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:47.101841 (+   181us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:47.101885 (+    44us) write_op.cc:312] APPLY: finished
0709 13:02:47.121995 (+ 20110us) log.cc:844] Serialized 23 byte log entry
0709 13:02:47.130618 (+  8623us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.130700 (+    82us) write_op.cc:454] Released schema lock
0709 13:02:47.130739 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:47.131096 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.131130 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":116824,"apply.run_cpu_time_us":2394,"apply.run_wall_time_us":86296,"num_ops":1,"prepare.queue_time_us":742122,"prepare.run_cpu_time_us":43291,"prepare.run_wall_time_us":230863,"raft.queue_time_us":63774,"raft.run_cpu_time_us":27279,"raft.run_wall_time_us":101438,"replication_time_us":149831,"thread_start_us":648978,"threads_started":4,"wal-append.queue_time_us":77564}]]}
I20260709 13:02:47.186445 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.186326 15397 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:47.184934 15393 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:47.201622 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:47.196728 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:47.203121 15365 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.182173 15395 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.169085 15390 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:47.201944 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:47.207965 15249 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.210291 15365 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.183071 15317 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:47.206529 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:47.184243 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:47.214648 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.218308 15249 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:47.219655 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:47.220347 15318 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 1.
W20260709 13:02:47.220610 16738 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:02:47.220870 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:47.221098 16663 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.213799 16702 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:47.220534 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:47.224438 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:47.225436 15249 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:47.185563 16689 raft_consensus.cc:1081] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Signalling peer edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:47.225005 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:47.213825 16593 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:02:47.232445 15247 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:47.232559 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:47.233001 16723 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:47.233386 16723 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:47.183552 16026 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.234481 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:47.197499 15248 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.207197 16669 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.225214 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:47.213382 15241 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:47.237331 16638 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:47.238055 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:47.185266 16705 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.236752 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:47.226548 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 349) took 1459 ms. Trace:
I20260709 13:02:47.213479 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:47.239939 16638 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.235728 16710 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:47.207432 16608 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.234191 16723 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.247114 15392 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:47.247325 16723 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:47.247493 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:47.230965 15363 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:02:47.230975 16729 log.cc:927] Time spent T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:02:47.182942 16602 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.238474 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:47.244930 15247 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:47.184674 16725 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.222527 16630 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.241068 16705 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:47.250082 16702 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.250185 16710 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:47.241520 15996 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.259282 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:47.245884 16669 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.240438 16028 rpcz_store.cc:276] 0709 13:02:45.766859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.279676 (+512817us) service_pool.cc:224] Handling call
0709 13:02:47.216614 (+936938us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5eee 0000000000375939 00007f366eb491e0 00007f366ec120c4 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:02:47.223842 (+  7228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.226142 (+  2300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:47.226175 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:47.226264 (+    89us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:47.226306 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.226369 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:47.226489 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12240640}
I20260709 13:02:47.271674 15250 raft_consensus.cc:2955] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:47.275327 16628 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:47.275766 16628 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:47.276628 16628 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.245581 16695 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:02:47.278563 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:47.279247 16698 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:47.279618 16698 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:47.279954 15998 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.280776 16697 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:47.280473 16698 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.281195 16697 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:47.281654 16697 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.281775 16698 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:47.266469 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:47.269268 16033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:46354
I20260709 13:02:47.284124 16033 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:47.284600 16033 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.270084 16710 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.277982 16628 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:47.289973 15399 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.290158 15247 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:47.291322 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.250931 15241 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.294962 15241 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:47.286353 15245 raft_consensus.cc:2955] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:47.306984 16682 raft_consensus.cc:2955] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:47.312121 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.312983 15243 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:47.314606 16693 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:47.281211 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.290534 16608 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:02:47.318729 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 93263.1us
I20260709 13:02:47.319185 16608 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:47.301740 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.311982 15247 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.321504 16363 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:47.322263 16363 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:47.326068 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 57215us
I20260709 13:02:47.328168 15394 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.329013 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:47.330823 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.331398 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.331743 15392 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:47.323367 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.336364 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.328187 15362 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.336454 15399 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:47.259963 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.267925 16026 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:47.346959 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.348623 16363 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.348887 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.354022 15390 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:47.314134 15243 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:47.355922 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.295866 16677 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:47.365020 15250 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.360507 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:47.365829 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.363093 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.289404 16708 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:02:47.354969 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.327243 16693 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.368707 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.382277 15398 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:47.363148 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:02:47.381743 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 104760us
W20260709 13:02:47.371291 16729 log.cc:927] Time spent T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:02:47.290320 16705 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:02:47.373581 16033 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.376863 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.377858 15397 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:47.379220 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.355266 16676 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:47.367332 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:47.319555 16608 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:47.387971 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.386727 16439 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:47.388723 16439 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:47.368911 16667 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:47.391139 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.336270 16716 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:02:47.370510 16660 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:47.391052 15391 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:47.380020 16681 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.403015 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.388213 16676 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:47.417532 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.420989 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.392596 16667 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:47.425709 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:47.433822 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53657.6us
I20260709 13:02:47.439208 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.439853 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.437551 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.441053 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.441334 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:47.441850 16716 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.442274 16716 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:47.444214 16363 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.444739 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.437911 16439 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.444010 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.444680 16363 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.441360 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.449755 15323 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.450575 16363 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.457605 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.459048 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.401710 16679 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:02:47.425210 16676 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.443877 16608 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.462281 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.412827 16611 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:02:47.436192 16667 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.470484 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:47.469249 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:47.453904 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.435806 16742 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:02:47.484241 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:47.490839 16740 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:02:47.443225 16716 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.492148 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.493083 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.498596 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.459719 16741 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:47.519014 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48622.6us
I20260709 13:02:47.510644 15399 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:47.521505 15392 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:47.462157 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 785) took 1083 ms. Trace:
I20260709 13:02:47.514175 16363 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:47.525360 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.541797 15390 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:47.568980 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.570122 15399 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:47.571182 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.572135 15399 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:47.618930 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.620141 15399 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:47.621219 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:47.649545 15399 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:47.639175 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.656123 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.518267 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 64440.2us
I20260709 13:02:47.664551 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.680699 16713 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.681313 16713 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:47.682374 16713 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.683951 16713 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.691103 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.692816 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.695398 16627 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:47.701170 16718 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:02:47.703285 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.519625 16637 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.730367 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.723768 16716 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.568578 16708 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:47.515074 16697 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.752326 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:02:47.752552 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88150.2us
I20260709 13:02:47.754640 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:47.772064 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.731178 16681 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.773453 16741 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.775010 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.755362 16669 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:02:47.778816 16697 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.774168 16637 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:47.781633 16637 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:47.782055 16637 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:47.783799 15248 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.548s	user 0.009s	sys 0.000s
I20260709 13:02:47.784237 15248 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:47.784951 15249 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.784634 15390 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.776826 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.788952 15399 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:47.792395 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.755340 16742 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.794098 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:47.750486 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 426579us
I20260709 13:02:47.748677 16625 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:47.774816 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:47.806023 16033 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:47.797706 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.540791 15320 rpcz_store.cc:276] 0709 13:02:46.379020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.384726 (+  5706us) service_pool.cc:224] Handling call
0709 13:02:46.435094 (+ 50368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.754742 (+319648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.461936 (+707194us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001e55d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:47.462100 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605825792}
I20260709 13:02:47.807763 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.786929 16741 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.796573 15391 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:47.814585 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.813722 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1498) took 1027 ms. Trace:
W20260709 13:02:47.815073 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 231754us
I20260709 13:02:47.815507 15244 rpcz_store.cc:276] 0709 13:02:46.778788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.779471 (+   683us) service_pool.cc:224] Handling call
0709 13:02:46.795746 (+ 16275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.988040 (+192294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.805734 (+817694us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54001a86d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:47.805913 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435048704}
I20260709 13:02:47.796720 15246 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.818642 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.819430 16439 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.813068 16627 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.833621 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.834151 15323 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:47.834406 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.850838 16725 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.851444 15317 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:47.851296 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.852437 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.834842 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:47.835572 16753 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:47.853899 16628 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.002s
I20260709 13:02:47.854493 15316 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
W20260709 13:02:47.837524 16698 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.547s	user 0.005s	sys 0.004s
I20260709 13:02:47.817157 16625 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.837730 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:47.803552 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.841414 16676 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.819730 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.821794 16742 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:02:47.863534 16682 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 13:02:47.839447 15319 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
W20260709 13:02:47.856630 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.857393 15394 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:47.848953 16637 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.862547 16698 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:47.862738 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48890us
I20260709 13:02:47.867174 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.868911 16625 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.869498 16744 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.868216 16681 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:47.870868 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:47.873414 16742 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:47.873805 16753 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:47.873816 16742 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:47.874351 16753 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:47.874863 16741 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:47.875254 16741 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:47.875674 16741 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.875270 16742 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.876869 15147 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 231) took 1171 ms. Trace:
I20260709 13:02:47.877009 16742 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:47.879611 16033 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.885586 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:47.854928 16667 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:47.893384 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 96491us
I20260709 13:02:47.893630 15395 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.893256 15241 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.894517 15241 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.895560 16667 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:47.895773 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.877038 16637 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:47.896848 16744 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.893328 16628 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:47.898737 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.890012 16681 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.899435 16031 raft_consensus.cc:2955] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:47.907213 16681 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:47.897361 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.911090 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:47.879566 16754 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:02:47.917026 16637 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.917865 16637 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:47.925726 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:47.923902 16637 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.928998 16637 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.929850 15243 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.921757 16744 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.875425 16753 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:47.943531 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.945417 16663 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:47.946455 16663 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.946823 16663 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:47.947677 15244 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.947681 16663 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:47.949072 16663 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.950429 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:47.949353 16702 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.950088 16625 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:02:47.952778 15243 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:47.919281 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:47.957206 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 776) took 1056 ms. Trace:
I20260709 13:02:47.922550 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.957631 15249 rpcz_store.cc:276] 0709 13:02:46.900345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.233808 (+333463us) service_pool.cc:224] Handling call
0709 13:02:47.784787 (+550979us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.785336 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:47.957037 (+171701us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540023aad0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:47.957151 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266365184}
I20260709 13:02:47.958703 16745 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.958871 16677 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.959138 16745 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:47.960047 16745 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.960904 16630 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:47.961377 16662 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:47.961784 16662 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:47.877252 15147 rpcz_store.cc:276] 0709 13:02:46.705049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.705200 (+   151us) service_pool.cc:224] Handling call
0709 13:02:47.876809 (+1171609us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:47.226588 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:47.227152 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:47.227189 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:02:47.227205 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:47.227556 (+   351us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:47.227616 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:47.227654 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:47.227838 (+   184us) tablet.cc:701] Row locks acquired
0709 13:02:47.227854 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:02:47.228016 (+   162us) write_op.cc:270] Start()
0709 13:02:47.228123 (+   107us) write_op.cc:276] Timestamp: P: 1783602167227971 usec, L: 0
0709 13:02:47.228141 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:02:47.228792 (+   651us) log.cc:844] Serialized 544 byte log entry
0709 13:02:47.483576 (+254784us) op_driver.cc:464] REPLICATION: finished
0709 13:02:47.484988 (+  1412us) write_op.cc:301] APPLY: starting
0709 13:02:47.485067 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:47.485183 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:47.485289 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:47.485508 (+   219us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:47.485660 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:47.485708 (+    48us) write_op.cc:312] APPLY: finished
0709 13:02:47.485912 (+   204us) log.cc:844] Serialized 23 byte log entry
0709 13:02:47.486078 (+   166us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.486168 (+    90us) write_op.cc:454] Released schema lock
0709 13:02:47.486203 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:47.486558 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.486586 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35558,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":1169,"apply.run_cpu_time_us":1536,"apply.run_wall_time_us":1537,"num_ops":1,"prepare.queue_time_us":546,"prepare.run_cpu_time_us":2443,"prepare.run_wall_time_us":2442,"replication_time_us":234434}]]}
I20260709 13:02:47.962607 16662 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:47.964478 16662 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:47.965512 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.967804 15241 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:47.958714 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.970355 15996 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:47.964533 16608 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:47.976358 16744 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.977033 16744 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:47.979597 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 88) took 1176 ms. Trace:
I20260709 13:02:47.980036 15242 rpcz_store.cc:276] 0709 13:02:46.803311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.838098 (+ 34787us) service_pool.cc:224] Handling call
0709 13:02:47.979360 (+1141262us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54003971d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:47.979490 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341551360}
I20260709 13:02:47.981993 16676 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:47.981859 16699 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:47.983666 16699 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.984004 16699 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:47.984946 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:48.106561 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.113481 16439 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:02:48.114812 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 171107us
W20260709 13:02:48.121486 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.105294 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:48.123171 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:47.923461 16754 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
W20260709 13:02:47.942956 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45652.5us
W20260709 13:02:48.156718 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 186491us
I20260709 13:02:48.159202 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:48.164577 15242 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:02:48.160660 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.164930 15242 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:48.156903 16628 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.156625 16677 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:48.189105 16688 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.193097 16688 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:48.193398 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:48.194150 16688 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.172217 15242 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.157774 16744 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:48.192516 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 76678.9us
I20260709 13:02:48.203868 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:48.206421 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:48.209702 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:48.205082 16439 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:02:48.212801 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:48.203569 16628 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.216293 16439 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.216665 16439 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:48.214485 16688 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.216817 16705 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.219740 15323 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:48.199443 16744 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:48.225845 15213 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:48.227161 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:48.230244 16031 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
W20260709 13:02:48.217988 16757 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:02:48.208683 16677 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:48.233649 16761 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.222615 16439 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.218387 16758 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:02:48.236842 15249 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.232160 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:02:48.259305 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.264444 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.207818 16625 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:02:48.209019 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:02:48.276957 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.232637 16744 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:48.284840 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52772.5us
I20260709 13:02:48.285692 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:48.239065 16754 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:48.262989 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:48.289311 16439 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.301849 15320 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:48.304563 15319 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
W20260709 13:02:48.310745 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 83778.3us
I20260709 13:02:48.221863 16699 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.274379 16679 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:02:48.324082 16025 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:48.288556 16628 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:48.287457 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:48.316064 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:48.311896 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:48.328456 16439 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:48.292290 16753 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.338055 16439 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:48.326025 16760 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:02:48.298933 16695 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.314522 16625 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:48.345825 16628 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:48.365829 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:02:48.326879 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 129105us
I20260709 13:02:48.363193 16754 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:02:48.344095 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 148318us
I20260709 13:02:48.378012 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:02:48.358507 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.376314 16659 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.377512 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:48.380319 15396 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:48.381222 16754 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:48.385883 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.310242 16028 raft_consensus.cc:2955] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:48.388974 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:48.389855 15324 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:48.361774 15246 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
W20260709 13:02:48.393842 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.351625 16765 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:48.331396 16741 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.380034 16659 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:48.400925 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:48.400589 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 75380.5us
I20260709 13:02:48.401131 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:48.396670 16716 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.397948 16730 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:48.399854 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:48.373189 16625 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.409564 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:48.411394 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:48.410310 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:48.352960 16677 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.420435 16761 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.406862 16679 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:48.421336 16679 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.421703 16679 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:48.426920 15393 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:48.413604 16619 raft_consensus.cc:2764] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:02:48.406916 16762 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:02:48.431572 16679 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.432284 16625 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:48.412995 16493 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.433835 16493 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.434345 16493 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:48.435434 16493 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.437021 16493 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.399644 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:48.439345 16759 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.439865 16759 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:48.440858 16759 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.409366 16730 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:48.442534 16730 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:48.446051 16659 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.447459 16659 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.454684 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:48.455611 15325 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:48.455956 16741 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:48.410501 16764 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:48.457789 16764 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:48.459033 16764 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:48.476169 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 80156.6us
I20260709 13:02:48.480218 16688 raft_consensus.cc:2955] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:48.483952 16602 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.484439 16602 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:48.485357 16602 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.442158 16759 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.487071 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:48.487627 15319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:48.488261 15319 raft_consensus.cc:606] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Received request to transfer leadership to TS edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:48.488443 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:48.490017 16602 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.490209 16663 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.491231 16026 raft_consensus.cc:2955] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:48.494091 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:48.495641 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:48.497188 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:48.490353 16611 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.500396 15319 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:48.500752 15322 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:48.502739 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:48.496378 16630 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.505062 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:48.501596 16669 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.506155 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:48.506913 15324 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:48.507539 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:48.507910 16611 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.510056 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:48.511054 16630 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:48.511579 16630 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:48.512511 16630 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.496765 16662 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.519810 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:48.523386 16662 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.526520 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:48.477105 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:02:47.901841 16727 consensus_queue.cc:1175] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "edcf4a6bae7e4781bce325a586109ca5" responder_term: 2 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:48.533180 16695 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.534313 16662 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.540634 16772 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.534951 16669 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:02:48.539186 16770 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.550637 16688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39706 (request call id 70) took 1087 ms. Trace:
I20260709 13:02:48.551110 16688 rpcz_store.cc:276] 0709 13:02:47.470113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.745884 (+275771us) service_pool.cc:224] Handling call
0709 13:02:47.804302 (+ 58418us) log.cc:844] Serialized 508 byte log entry
0709 13:02:48.440910 (+636608us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b1800063460. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:02:48.550539 (+109629us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":372,"raft.run_cpu_time_us":725,"raft.run_wall_time_us":726,"spinlock_wait_cycles":3173632,"thread_start_us":56352,"threads_started":1,"wal-append.queue_time_us":107311}
I20260709 13:02:48.562304 16730 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.572233 16744 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.574069 16033 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:48.579041 15324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:48.579942 15324 raft_consensus.cc:606] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:02:48.580387 15324 raft_consensus.cc:614] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:02:48.539906 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 62907.1us
I20260709 13:02:48.581650 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:48.584375 15324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:02:48.584996 16744 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:48.585107 15324 raft_consensus.cc:606] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:02:48.585505 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1697) took 1139 ms. Trace:
I20260709 13:02:48.585850 16770 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.585851 15316 rpcz_store.cc:276] 0709 13:02:47.446844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.451473 (+  4629us) service_pool.cc:224] Handling call
0709 13:02:47.850810 (+399337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:47.854903 (+  4093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:48.452467 (+597564us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b54001c6bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:48.585305 (+132838us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54001c6bd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:48.585444 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925546240}
I20260709 13:02:48.593437 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:48.600010 16695 raft_consensus.cc:2764] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:02:48.604226 15241 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:48.604806 16730 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:48.602142 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:48.608886 15241 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:48.610965 15246 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:48.613776 16770 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.614517 16695 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.695484 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:48.716738 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:48.750655 15321 raft_consensus.cc:2955] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:02:48.787786 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.787863 16748 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:02:48.788278 15393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1539) took 1329 ms (client timeout 1627 ms). Trace:
W20260709 13:02:48.788695 15393 rpcz_store.cc:269] 0709 13:02:47.458719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.458826 (+   107us) service_pool.cc:224] Handling call
0709 13:02:48.788083 (+1329257us) spinlock_profiling.cc:243] Waited 947 ms on lock 0x7b5400328cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:48.788221 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177439104}
I20260709 13:02:48.788652 16748 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.791396 16748 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:48.799894 16748 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:48.800426 16748 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.802765 16748 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:48.820073 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 405149us
I20260709 13:02:48.820220 16765 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:48.821611 16761 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.821985 16761 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:48.822798 16761 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.824137 16761 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:48.826478 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:48.827740 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.832008 15320 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:48.833406 16771 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:48.835914 16741 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:48.839811 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:48.840732 15321 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.848850 15147 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:48.849634 15321 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:48.855449 15147 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:48.856901 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:48.865513 16699 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.872337 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:48.872797 15244 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:48.881031 15316 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:48.881224 16741 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:02:48.907898 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:48.926827 16638 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.927373 16638 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:48.928398 16638 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.929683 16638 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.934134 16695 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:48.937291 16637 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:48.937824 16637 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:48.938727 16637 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.940853 16637 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:48.940949 16679 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:48.950906 16745 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.954717 16695 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:48.956712 16698 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:48.957181 16698 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:48.957226 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:48.958918 16744 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:48.959470 16744 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:48.959311 16698 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.961143 16698 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:48.961475 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:48.962200 15324 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.969530 15242 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.965747 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:48.972263 16608 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:48.973341 16608 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.985582 16746 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.960471 16744 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:48.986967 16746 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.987365 16681 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:48.987862 16681 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.989163 16746 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:48.989735 16746 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:48.990398 16679 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.990273 16746 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.991384 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:48.992092 15393 raft_consensus.cc:2368] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3.
I20260709 13:02:48.989884 16681 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:48.982860 16699 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:48.998817 16748 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:49.000267 16699 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.000722 15242 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:49.000355 16748 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:48.990869 16679 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.007901 16699 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.008682 16744 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.011027 16744 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:49.012126 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.013502 16698 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.002547 16748 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.013940 15998 leader_election.cc:400] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3.
W20260709 13:02:49.020094 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.018119 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:49.029367 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.029459 15316 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
W20260709 13:02:49.014967 16758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.000s	sys 0.019s
I20260709 13:02:49.032979 16679 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.017886 16746 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.031628 16699 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:49.030571 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:49.033870 16699 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.032300 16748 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:49.035040 16748 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.036058 16699 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.037441 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:02:49.033200 16758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.000s	sys 0.020s
I20260709 13:02:49.037674 16748 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:49.040284 16677 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:49.040751 15324 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:49.040773 16677 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.041437 16677 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.028970 15998 leader_election.cc:403] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:49.016731 16744 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.043176 16770 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.042609 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:49.048961 16742 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:49.049060 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:49.049526 16742 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:49.014431 16608 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:49.054574 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:49.055014 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:49.056607 16602 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:49.057184 16638 raft_consensus.cc:993] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:49.057688 16638 raft_consensus.cc:1081] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Signalling peer edcf4a6bae7e4781bce325a586109ca5 to start an election
I20260709 13:02:49.050819 16742 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.059504 16033 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.060675 15134 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f20d2caf56534c1ebcf23935582a5f03 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:49.061635 16699 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:49.062177 16699 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.063757 16033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:46364
I20260709 13:02:49.064321 16033 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:49.064836 16033 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.064360 16699 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.067133 15324 raft_consensus.cc:2955] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:49.070438 16637 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:49.071852 16759 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:49.072311 16759 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:49.073271 16759 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.075946 16363 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.076395 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.076474 16363 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.077494 16493 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:49.079463 16363 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.071674 16770 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3.
I20260709 13:02:49.081259 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.084820 16033 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.088539 16699 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:49.088843 16759 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.089172 16699 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.090981 15316 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:49.091410 16699 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:49.091852 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 680465us
I20260709 13:02:49.092315 16699 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:02:49.092017 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.092571 15215 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:49.093195 16745 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:49.093317 16765 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.092767 15148 catalog_manager.cc:5697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 4, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New cstate: current_term: 1 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:49.093734 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.094025 16765 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:49.094612 16746 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:49.094506 15148 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 2, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 2 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.095270 16746 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.093663 16745 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.097369 16746 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:49.095263 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 222315us
I20260709 13:02:49.092783 16699 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:49.099705 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.100274 16713 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:49.101064 15246 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.101866 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.094478 16765 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:49.102411 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:49.102813 16765 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.103042 15241 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.103348 15245 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.103725 15249 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:49.104317 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.100788 16713 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.105084 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.105103 15248 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:49.094941 16762 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.106590 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.106300 15243 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.106925 16713 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.107204 15249 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:49.108539 16695 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:49.110035 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.111264 16745 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.111538 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.112769 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.114472 16493 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:49.114916 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:49.115573 15393 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.115921 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:49.116608 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:49.117034 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:49.117363 15396 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:49.117638 15395 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:49.118177 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:49.118405 16493 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:49.118475 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.119016 15392 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:49.120556 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.121500 15242 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:49.118985 16493 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:49.124529 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.124647 15144 catalog_manager.cc:5697] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 3 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.126413 16699 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.125154 16493 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.089427 16031 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:49.129226 15241 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:49.013988 16698 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.130483 16625 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:49.131428 16024 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.132061 16772 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:49.132565 16772 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:49.095009 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.133460 16772 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.134558 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.136775 16762 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:49.137778 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.136854 16698 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.137864 16727 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.143234 15319 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.143503 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.160060 15322 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:49.160372 16028 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:49.150789 15244 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:49.142279 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.161720 15323 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:49.137260 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:49.163093 15393 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:49.138487 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.164044 16727 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:49.164265 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:49.165292 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.165971 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:49.166677 15394 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:49.166011 16727 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.153409 16677 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.168643 15391 raft_consensus.cc:2955] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:49.172047 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:49.172668 15323 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.166613 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.179841 15323 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:02:49.180254 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:49.180846 15394 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.181434 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:49.182385 16698 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:49.182889 16698 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:49.183694 16698 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.188036 16677 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.188619 15394 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:49.189548 16033 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.190606 15392 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.192438 16727 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.192535 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:49.193274 15323 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:49.195091 16762 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:49.196619 16730 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:49.197124 16730 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:49.197214 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:49.197990 15396 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:49.198254 16730 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.199541 16742 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.199810 15395 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.200083 16730 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:49.201787 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.205508 15144 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 2 to 3, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 3 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.206522 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:49.209249 16748 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:49.210093 16748 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:49.213184 16748 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.218320 16730 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:49.219218 16765 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.218468 15236 tablet_service.cc:1558] Processing DeleteTablet for tablet f20d2caf56534c1ebcf23935582a5f03 with delete_type TABLET_DATA_TOMBSTONED (TS 89940175e5444593aab6b3a025624b5b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59986
I20260709 13:02:49.220743 15245 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:49.218936 15145 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 2, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.204720 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.223377 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:49.224449 16493 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.224956 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.225404 16493 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:49.225988 16493 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:49.226563 16493 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.230449 16727 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.223264 15145 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 2, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.218011 15144 catalog_manager.cc:5697] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 2, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 2 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:49.232522 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.193636 15323 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:49.234839 15323 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.251215 15323 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:49.233251 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.259366 16800 tablet_replica.cc:333] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:02:49.278842 16765 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:49.241330 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:49.242619 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:02:49.245141 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.206967 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:49.259452 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.259773 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.283581 16730 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:49.260018 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.284719 15245 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:49.284898 16730 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:49.261435 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.233249 16759 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:49.285553 16730 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.286110 16730 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.294691 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:49.302089 16761 raft_consensus.cc:2955] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:02:49.302152 15132 catalog_manager.cc:4755] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): ChangeConfig:REMOVE_PEER RPC failed for tablet b9e997bc5c2942178cde4c670df97100: Remote error: Service unavailable: leader transfer in progress
I20260709 13:02:49.305500 16699 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:49.306080 16699 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.310693 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:49.311355 16033 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:49.309549 16699 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:49.274947 15145 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.277343 15323 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:49.260779 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.317866 15242 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:49.319202 15996 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:49.320502 16698 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:49.321000 16698 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:49.321880 16698 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:49.261768 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 190448us
I20260709 13:02:49.296469 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:49.309712 16493 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.326857 15145 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 2, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 2 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.297173 16608 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:49.327912 16493 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.328280 16608 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.328770 16608 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.329298 15145 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 2, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 2 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.333876 16800 raft_consensus.cc:2243] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.334895 16800 raft_consensus.cc:2272] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.335824 15242 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:49.338351 16771 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:49.298838 16681 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.339184 16681 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.341233 16681 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:49.299206 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 92312.8us
I20260709 13:02:49.339206 16771 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:49.342548 16771 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:49.298473 16730 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.344388 16800 ts_tablet_manager.cc:1916] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:49.344863 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:49.346158 16730 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.315835 15363 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:49.338608 15242 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.349738 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:49.350334 15322 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.350528 15323 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:49.352596 16681 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:49.353029 16681 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:49.353380 16681 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.354389 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:02:49.299680 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 58414.7us
I20260709 13:02:49.356638 16759 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:49.357501 15322 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:49.357576 16625 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:49.357997 16637 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:49.358078 16625 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:49.358593 16637 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.359095 16625 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.359925 16771 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.360570 16625 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.360622 16637 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.361104 16771 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.363713 16363 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:49.366724 15135 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f537e87ec99a4032a677e62627c567e2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:49.368754 15242 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:49.369251 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.342111 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.370874 16758 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.371196 16759 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.371492 16758 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:49.372970 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 78396.7us
I20260709 13:02:49.373126 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:49.373777 16758 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.373849 16363 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:49.374395 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.374976 16363 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:49.375376 16363 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.377382 16727 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:49.374979 15394 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.374439 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:49.380162 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.380604 16699 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.380909 16758 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:49.378023 16727 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:49.383109 16727 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.384240 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:49.385411 16363 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:49.386624 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 44577.1us
I20260709 13:02:49.386660 15245 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:49.387501 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.387501 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:49.389580 15290 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:02:49.390375 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 89326.4us
I20260709 13:02:49.269275 15147 catalog_manager.cc:5697] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 2 to 3, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.394958 16758 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.395506 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:49.396445 16637 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:49.396829 16637 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.397168 16637 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.398049 16363 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.404240 16681 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.404840 15214 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:49.408648 16761 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.409473 16031 raft_consensus.cc:2955] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:49.412500 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:49.416381 16637 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.419523 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:49.420261 15245 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.421061 16637 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.419518 16033 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:49.423605 15363 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:49.423377 15144 catalog_manager.cc:5697] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 2 to 3, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 3 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.424404 16748 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:49.403600 16800 ts_tablet_manager.cc:1929] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:02:49.405339 15132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9e997bc5c2942178cde4c670df97100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 45ddec37d9e741a598bf32f6c9d7e0ee is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:49.424870 16748 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:49.425422 16800 log.cc:1199] T f20d2caf56534c1ebcf23935582a5f03 P 89940175e5444593aab6b3a025624b5b: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/wals/f20d2caf56534c1ebcf23935582a5f03
I20260709 13:02:49.425714 16748 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.427762 15135 catalog_manager.cc:5028] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): tablet f20d2caf56534c1ebcf23935582a5f03 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:49.406250 16699 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.429875 16637 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:49.430518 16637 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.430966 15245 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:02:49.433802 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.430037 15316 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:02:49.401842 16608 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.436614 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:49.406482 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:49.437729 15322 raft_consensus.cc:2368] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4.
I20260709 13:02:49.438072 16608 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.433983 16637 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.439180 16762 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:49.439429 15213 leader_election.cc:400] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4.
I20260709 13:02:49.439746 15213 leader_election.cc:403] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:02:49.439713 16762 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:49.440632 16762 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.442866 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:49.443574 15249 raft_consensus.cc:2368] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3.
I20260709 13:02:49.443682 15244 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:49.441704 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:49.445291 15243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:02:49.445804 16493 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4.
I20260709 13:02:49.445935 15243 raft_consensus.cc:606] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:49.447714 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:49.448844 16637 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:49.449047 15391 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:49.449566 16637 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:49.450551 16771 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.450771 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:49.450472 16637 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.451413 15394 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:49.452636 15398 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.454378 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:49.456040 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:49.458741 15135 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet f537e87ec99a4032a677e62627c567e2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:02:49.458873 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:49.460873 16771 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:49.461585 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.461850 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 72358.8us
I20260709 13:02:49.464638 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.465363 15245 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:02:49.465526 15241 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:49.467630 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.468583 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:49.407632 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:49.469823 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 62261.5us
I20260709 13:02:49.469988 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:49.473210 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.473896 15245 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:49.474400 16759 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:49.474845 16759 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:49.477285 16759 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.478874 15144 catalog_manager.cc:5697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 2, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 2 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.475210 16625 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:49.475241 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:49.476715 15999 leader_election.cc:400] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3.
I20260709 13:02:49.483532 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:49.474692 16758 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:49.495672 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.484210 16681 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:49.530699 15316 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:49.531010 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:49.531575 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.532238 15321 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:49.502591 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:49.482128 15241 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.484645 16748 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:49.485342 16771 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:49.521334 16770 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:49.521528 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:49.548184 15244 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.521709 16745 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.526772 16677 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:02:49.558485 16745 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.560731 16745 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.521575 16608 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:49.561609 16608 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.563069 16771 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:49.563663 16608 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.520294 16742 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:49.568507 15325 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:49.569587 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.569898 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.570282 15325 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:49.571151 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.521018 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.579358 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.564054 16771 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.475329 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:49.534559 15319 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:49.539677 16493 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:49.540705 16746 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.485137 16625 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:02:49.594129 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.594499 16746 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.594980 16625 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:49.595069 15319 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:49.595525 16625 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:49.596109 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.596760 15319 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:49.596413 16625 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.545890 16748 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:49.550558 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.598685 16748 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.552628 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.553723 16770 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:49.557687 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.525234 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:02:49.585917 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:49.607383 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 82351us
I20260709 13:02:49.585588 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.588091 16363 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:49.588286 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:49.597703 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.591974 15147 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b reported cstate change: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New cstate: current_term: 1 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:49.614496 15320 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:49.596676 16746 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.568857 16742 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:49.610836 15147 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 2 to 3, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.620312 16493 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:49.620733 16493 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:49.621069 16493 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:49.622299 15398 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:49.625630 15147 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 2 to 3, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.630203 15242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:02:49.630861 15242 raft_consensus.cc:606] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:49.572785 16698 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:02:49.619273 15318 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:49.606315 16770 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:49.639294 15147 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 4, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 4 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:49.622633 16699 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:49.658457 15244 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:49.615456 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.610000 15243 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.643050 15391 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:49.623775 16742 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:49.640291 15271 debug-util.cc:398] Leaking SignalData structure 0x7b0800168e00 after lost signal to thread 14142
I20260709 13:02:49.675926 16493 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.633920 16765 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:02:49.669129 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.701781 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:49.702195 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.706413 15318 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:49.708356 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:49.709105 15325 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:49.710301 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.714390 16493 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.718649 16759 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.720898 16759 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.688212 16695 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:02:49.726548 15316 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:49.727628 16033 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:49.733422 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:49.748852 16679 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.760788 16759 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.761945 16758 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.761644 16759 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.762530 16758 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.764748 16758 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.699903 16770 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.749608 16679 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.770076 15242 raft_consensus.cc:630] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Rejecting request to transfer leadership because tablet server 45ddec37d9e741a598bf32f6c9d7e0ee is not a voter in the active config
W20260709 13:02:49.714931 15271 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0e80 after lost signal to thread 15182
I20260709 13:02:49.791446 16033 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:49.798213 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.806155 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:49.711414 15324 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
W20260709 13:02:49.744923 16777 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:02:49.821775 16742 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.824033 16742 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:49.828581 16759 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:49.830600 15321 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:49.814440 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.840153 15319 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:49.841504 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.843017 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:49.844475 16033 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:49.846536 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:49.804499 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:49.832016 15241 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:49.853643 15395 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:49.854771 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:49.855088 15393 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:02:49.811457 16772 consensus_queue.cc:1175] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ee9654803379434388de45d4693e6b16" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 13:02:49.863873 15319 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:49.860426 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.864945 15244 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:49.861123 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:49.865907 15245 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:49.855396 15392 raft_consensus.cc:2376] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3. Re-sending same reply.
I20260709 13:02:49.858318 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:49.866885 15398 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:49.868323 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:49.871876 16493 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:49.872648 16493 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:49.862325 15242 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:49.840219 16770 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:49.809010 16698 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:02:49.811738 16685 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:02:49.862938 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:49.898106 15322 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:49.888959 15316 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.899681 15396 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:49.879396 16608 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 13:02:49.880776 15271 debug-util.cc:398] Leaking SignalData structure 0x7b0800384d40 after lost signal to thread 15274
I20260709 13:02:49.913748 16493 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.850997 15243 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:02:49.936101 15316 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:49.946202 15320 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:49.897622 16695 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.913301 16699 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.915781 16818 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.970806 16699 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:49.913141 16762 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:02:49.980424 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:49.981986 16033 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:49.992082 16699 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:49.973023 16695 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:49.976200 16818 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.013182 16818 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:50.016029 16821 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.101s	user 0.002s	sys 0.000s
I20260709 13:02:49.898212 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:50.167088 15324 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.096061 16679 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.099038 16761 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:50.109313 16031 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:02:50.113116 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.114212 16754 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.119887 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:02:50.080252 15271 debug-util.cc:398] Leaking SignalData structure 0x7b0800341c20 after lost signal to thread 15349
I20260709 13:02:50.126114 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:50.070750 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.070215 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.073379 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:50.075103 15321 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:50.075117 15322 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:02:50.161509 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.093745 15317 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:50.078135 15241 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:50.190748 16758 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.171238 16761 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:50.205677 16679 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:50.213809 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:50.214177 15271 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8960 after lost signal to thread 15423
I20260709 13:02:50.211794 16679 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.214552 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.229065 16787 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.229650 16787 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.231644 16826 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:50.210765 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 54934.5us
I20260709 13:02:50.234916 16695 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.234719 16761 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:50.236862 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 117451us
I20260709 13:02:50.237973 16761 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.238509 16831 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:50.239109 16831 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:50.239665 16831 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.240798 16828 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.241707 15318 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:50.206985 16758 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:50.220468 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 147661us
W20260709 13:02:50.226636 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 57922.6us
I20260709 13:02:50.230068 16787 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.251696 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:50.252409 16830 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:50.254078 16745 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:50.254647 16745 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:50.255127 16745 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.254093 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:50.253954 16830 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:50.266026 15324 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
W20260709 13:02:50.275236 15271 debug-util.cc:398] Leaking SignalData structure 0x7b0800349f20 after lost signal to thread 16057
I20260709 13:02:50.241719 16828 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.266366 16818 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:02:50.283329 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:50.284070 16828 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.284987 16828 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:50.214257 16754 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.271503 16746 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:50.292307 16823 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:50.295117 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.295748 16758 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.296110 16754 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:50.297923 16742 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.298804 16742 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:50.300429 16839 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:02:50.304664 15322 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:02:50.309512 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.311045 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:50.311492 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.312566 15243 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:50.313031 16625 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.313745 16825 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:50.314364 16679 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:50.278646 16830 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:50.328797 16679 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:50.330123 15241 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:50.330248 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:50.301585 16742 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.366323 16024 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:50.330799 15248 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:50.331485 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:50.368762 16029 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:50.332340 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:50.370839 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:02:50.365835 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 159817us
I20260709 13:02:50.372329 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:50.333698 16836 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.374310 16818 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:50.374854 16818 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:50.374572 16765 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:50.375363 16818 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.377447 16727 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:50.378506 16820 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.464s	user 0.002s	sys 0.003s
I20260709 13:02:50.378747 16815 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:50.379192 16815 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:50.379613 16815 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.384009 16772 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:50.373677 16836 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.384626 15289 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:50.384848 16772 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:50.314980 16748 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.716s	user 0.012s	sys 0.008s
I20260709 13:02:50.386267 16748 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.387035 16759 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.387313 16679 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:50.388237 15397 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:50.388760 16772 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.388681 16748 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.352378 16363 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:50.354992 16685 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:50.359233 15244 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:50.359387 15245 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:50.362694 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.355033 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:50.289794 16828 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:50.379528 16837 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:50.338514 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:50.316130 16758 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.390326 15363 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:50.387482 16759 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.401815 16748 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.401691 15145 catalog_manager.cc:5697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 2 to 4, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 4 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.403303 16834 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:50.403980 16759 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:50.406955 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 79938.9us
I20260709 13:02:50.391220 16685 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:50.414091 16625 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:50.416754 16818 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.422793 16625 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.423269 16625 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:50.424522 16818 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.421025 15322 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:50.421403 16836 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.364964 16830 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.428017 16830 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.394131 16837 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:50.406183 16748 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:50.433709 16841 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.181s	user 0.002s	sys 0.000s
W20260709 13:02:50.452148 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.429762 16363 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.438115 16772 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:02:50.433621 16679 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.450820 16828 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:50.450687 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 78552.7us
I20260709 13:02:50.438697 16748 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.418377 16758 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.462961 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.463406 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.456221 16679 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.460602 16826 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:50.471880 15244 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:50.461004 16818 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.468920 16608 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.456089 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.477543 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:50.474507 16679 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.483554 15314 tablet_service.cc:1558] Processing DeleteTablet for tablet f537e87ec99a4032a677e62627c567e2 with delete_type TABLET_DATA_TOMBSTONED (TS 45ddec37d9e741a598bf32f6c9d7e0ee not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39704
I20260709 13:02:50.491498 16681 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.491190 16698 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:02:50.492143 16681 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.494392 15323 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
W20260709 13:02:50.494298 16699 consensus_queue.cc:1175] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "89940175e5444593aab6b3a025624b5b" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:50.508090 16681 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.508538 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.509332 15244 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:50.510428 16837 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.511801 16837 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.504468 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.518754 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:50.521528 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.522372 16835 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.522547 15399 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:50.523082 16835 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.524278 15390 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:50.525576 16835 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.527415 16439 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.527985 16439 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.530789 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.531558 15324 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:50.516151 16363 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.489106 16754 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.476855 16742 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:02:50.530001 16439 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.538404 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.541059 16818 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.542011 16772 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:50.542567 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.542369 16608 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.542794 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.543058 15245 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:50.543583 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.545094 16698 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.465226 16685 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.548112 15397 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:50.548954 16826 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:50.549223 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:50.549415 15241 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:50.552115 15244 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:50.553155 16754 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:50.553258 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 83013.1us
I20260709 13:02:50.578306 15242 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:02:50.588284 15320 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:50.588462 16772 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.590680 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.596549 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:50.583847 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48186.5us
I20260709 13:02:50.506186 16815 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.586858 15322 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:50.561299 16836 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.601099 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.570565 16826 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:50.605278 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.583236 16754 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.602905 15245 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:50.609158 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:50.609571 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.607208 15397 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:50.563961 16825 raft_consensus.cc:476] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:02:50.597450 16685 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.621265 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:50.618666 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:50.611507 16746 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.608994 16439 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.616328 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:50.646607 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:50.597488 16772 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.578508 16831 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.611333 16681 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:50.610028 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.586534 16625 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.656313 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:50.618328 16699 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:50.662925 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.664681 16363 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.660737 16746 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.667169 16829 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.110s
I20260709 13:02:50.667903 15393 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:50.669339 16746 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:50.669507 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:02:50.670801 16844 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:02:50.672900 16846 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 13:02:50.674156 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 91073.5us
I20260709 13:02:50.675031 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:50.676844 15394 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:50.677982 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.679177 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.679944 15394 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:50.681910 15394 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:50.667394 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.683080 16439 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.665089 16363 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.684687 16363 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.687074 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:50.688117 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 105448us
I20260709 13:02:50.609465 16698 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.653606 16681 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.659293 16699 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.693634 15242 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:50.646973 16836 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.696332 15398 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:50.642535 16759 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:50.705399 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 92151.4us
I20260709 13:02:50.705735 15324 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:50.710114 16493 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:50.714859 16493 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:50.670032 16746 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:02:50.715458 16493 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.710963 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:50.710361 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:50.697887 16695 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:50.695461 16681 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:50.699411 16699 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:50.738327 16842 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.265s	user 0.001s	sys 0.001s
I20260709 13:02:50.723769 16695 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:50.740267 16765 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.758319 16815 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:50.759325 16847 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:02:50.751022 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:50.769043 16031 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:50.778146 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:50.764768 16695 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:50.764585 16765 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.795214 16759 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:50.795603 16625 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.797652 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:50.807986 16031 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.795257 16608 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:50.800422 16787 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.003s
I20260709 13:02:50.801088 16742 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.764043 16818 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.801550 16862 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:50.773268 16815 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:50.809404 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 134496us
I20260709 13:02:50.812192 15390 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:02:50.807320 16745 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.552s	user 0.002s	sys 0.012s
I20260709 13:02:50.806591 16765 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.819893 16363 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:50.820677 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 77814.9us
I20260709 13:02:50.828804 16363 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.811587 16742 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:50.824116 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 96799us
I20260709 13:02:50.827507 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:50.813705 16681 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.836251 16698 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.837517 16681 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.839318 16730 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.840042 16730 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.841521 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:50.842257 16028 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:50.844095 16758 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:50.845155 16840 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:50.852398 16849 tablet_replica.cc:333] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:02:50.853976 16849 raft_consensus.cc:2243] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:50.855012 16849 raft_consensus.cc:2272] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:50.851500 16831 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.834339 16742 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.859342 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.860019 15395 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:50.861439 15247 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:50.864894 16625 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:50.866370 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.866660 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.867353 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.867704 15998 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:50.868202 15323 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:50.868841 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.869177 16857 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:50.828274 16745 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.874884 16863 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.875378 16863 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.875730 16863 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.876287 16745 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:50.823401 16862 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.865548 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:50.878191 15398 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:50.867367 15316 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
W20260709 13:02:50.883075 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47882.8us
W20260709 13:02:50.883298 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 50155us
I20260709 13:02:50.830101 16746 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:50.893376 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:50.894382 16493 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.896529 16493 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:50.890043 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 179792us
I20260709 13:02:50.902187 15396 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:02:50.902514 16849 ts_tablet_manager.cc:1916] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:50.902736 15396 pending_rounds.cc:85] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 1
I20260709 13:02:50.903142 15396 pending_rounds.cc:107] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:02:50.903439 15396 raft_consensus.cc:2889] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:50.905911 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.906669 15319 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:50.812214 16787 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:50.900552 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:50.848870 16730 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.930398 16031 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
W20260709 13:02:50.938597 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 54741us
I20260709 13:02:50.941534 15363 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:50.945115 15289 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:02:50.948721 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48270.7us
W20260709 13:02:50.950673 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 85341us
I20260709 13:02:50.952361 15394 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:50.954187 16681 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.956414 16681 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.956853 16681 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:50.957238 15391 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:50.958420 16851 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:50.935231 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:50.953526 16759 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:50.940834 16825 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:50.988162 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.943995 16748 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:50.959836 16745 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:50.968019 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:50.998733 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.994268 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.001627 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:50.985023 15317 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:02:51.011740 15398 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:51.015640 15396 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:51.011950 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.019948 15393 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:51.024804 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:51.025617 15249 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:50.991436 16730 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:02:51.032665 15132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9e997bc5c2942178cde4c670df97100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 45ddec37d9e741a598bf32f6c9d7e0ee is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:51.036613 16439 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.036940 16754 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.037381 16695 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.033658 16863 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.045109 16681 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.047040 16852 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:02:51.047847 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:51.048650 16029 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
W20260709 13:02:51.048012 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 164229us
I20260709 13:02:51.050395 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:51.051664 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:51.052567 16871 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:51.053288 16871 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:51.053391 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:51.054253 16871 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:51.054708 16730 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.056490 16754 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.056799 16730 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.045048 16863 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:50.997611 16745 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.057763 16745 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.062220 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:51.062940 16787 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.063344 16859 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:51.068974 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.073972 15390 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:51.081137 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:51.082084 15390 raft_consensus.cc:2368] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 2. Current term is 3.
I20260709 13:02:51.084609 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:51.063767 16859 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:51.085233 15398 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.097201 16681 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:51.112506 16713 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.113231 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:51.133433 15250 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.099313 16730 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:02:51.115232 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:51.013046 16825 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:51.117508 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55393.2us
I20260709 13:02:51.112737 15246 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:51.072543 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:51.113945 16838 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:02:51.135587 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:51.152040 16685 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:02:51.165490 16625 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:51.099156 16859 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:51.169832 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 77988.9us
I20260709 13:02:51.168687 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:51.176424 16681 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:51.200589 16681 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.201046 16681 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.203394 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:51.177359 16857 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:51.178733 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 103499us
I20260709 13:02:51.179292 16867 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:51.180142 16834 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:51.181119 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 152985us
I20260709 13:02:51.181583 16772 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:51.187008 16862 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.155833 16713 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.186801 16625 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.187366 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:51.157572 16699 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.185025 16742 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.192802 15250 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
W20260709 13:02:51.194691 16837 consensus_meta.cc:287] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.000s
I20260709 13:02:51.196343 16825 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.152645 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:51.198546 16679 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.002s
I20260709 13:02:51.210852 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.269447 15399 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:51.214612 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:51.271112 16028 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.221705 16772 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:51.274830 16772 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:51.276119 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 450329us
W20260709 13:02:51.277565 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 325965us
I20260709 13:02:51.215377 16866 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:51.278925 16866 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:51.279377 16866 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.280381 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:02:51.215003 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46440.3us
I20260709 13:02:51.284487 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:51.285275 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:51.288079 16863 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.288651 16863 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.288887 16852 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:51.229738 16625 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.236757 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:51.290740 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:51.230916 16748 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:51.224478 16713 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.230783 16834 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:51.243371 15318 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:51.292640 16834 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:51.293864 16625 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:51.293686 16834 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.295400 16834 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.243211 16695 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:51.247364 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.249346 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:51.300910 16033 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:02:51.301750 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:51.246466 16826 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.003s
I20260709 13:02:51.303371 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.303907 15325 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.307993 16770 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:51.308609 16770 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.238580 16699 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:51.303102 16826 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.312645 16698 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:51.313242 16698 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.314486 16826 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:51.326625 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:51.328109 16699 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:51.268011 16679 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.331465 16679 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.333132 15394 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:51.250357 16765 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.347929 16840 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.214059 16867 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:51.349347 16867 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:51.350454 16867 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.351763 16867 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.268253 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:51.211632 16836 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.285558 16882 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:51.295420 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:51.355389 16625 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:51.286195 16871 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.355875 16882 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:51.355997 16625 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:51.348753 16840 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.360278 16625 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.284489 16758 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:02:51.363770 16758 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:02:51.230144 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 55598us
I20260709 13:02:51.365288 15215 leader_election.cc:400] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 2. Current term is 3.
I20260709 13:02:51.365572 15215 leader_election.cc:403] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:02:51.364243 16758 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:51.366945 16880 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.369123 16882 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:51.369876 16882 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.377552 16829 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.378376 16829 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.366935 16758 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.245151 16742 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.246246 16745 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.391872 15395 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:51.239494 15249 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:02:51.395262 16745 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:51.356348 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 88221.6us
I20260709 13:02:51.403877 16876 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:51.404439 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.270499 16862 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:02:51.426017 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 130731us
I20260709 13:02:51.426642 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:02:51.427213 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 100765us
I20260709 13:02:51.427734 16829 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.428881 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.429265 15392 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:51.430027 16840 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.430325 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.431718 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.431818 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.433796 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.486191 15393 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:51.486635 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:51.487073 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:51.487488 16033 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:51.486614 15322 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:51.457135 16758 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.488001 15323 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:51.492319 16876 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.440155 16849 ts_tablet_manager.cc:1929] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:51.440619 16765 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.210194 16681 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.252770 15398 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
W20260709 13:02:51.446293 15214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.009s	sys 0.028s
I20260709 13:02:51.446889 16851 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:51.438264 16871 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:51.447505 16759 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:51.449631 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.468079 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:51.455754 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:51.470911 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:51.500357 16836 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.500520 16868 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:51.462510 16770 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.606948 16031 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:02:51.505264 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:51.608040 15214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.011s	sys 0.032s
I20260709 13:02:51.596194 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:51.609704 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 154056us
I20260709 13:02:51.602933 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:51.611333 15249 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
W20260709 13:02:51.607756 16830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.007s	sys 0.005s
I20260709 13:02:51.560412 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.496876 16862 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.546512 16713 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:51.512328 16831 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:51.615710 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 147747us
W20260709 13:02:51.616684 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 129695us
I20260709 13:02:51.610518 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:51.503877 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:51.523394 15325 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:51.620168 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:51.612378 16742 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:51.567991 16885 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.561134 16829 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:51.627471 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:51.634455 15390 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.623939 16033 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:51.504459 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:51.504864 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:51.598417 16838 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.662075 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.560889 16826 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:51.560627 16028 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:51.568455 15318 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:51.642084 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:51.563369 16833 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.625847 16868 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.656087 16851 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:51.622136 16830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.007s	sys 0.005s
I20260709 13:02:51.625847 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:51.560041 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.695676 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.696465 15323 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:51.665166 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:51.631664 16849 log.cc:1199] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/wals/f537e87ec99a4032a677e62627c567e2
I20260709 13:02:51.597645 16876 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.669013 16439 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.672000 15325 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.640398 16852 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:51.636482 16882 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.506431 16698 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.684665 15390 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:51.694634 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.663794 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.472716 16772 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.669817 16770 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:51.640473 16836 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.708290 16439 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:51.710196 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45134.5us
I20260709 13:02:51.561724 16866 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.700672 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.672763 16829 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.680650 16838 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.683521 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:51.666010 16758 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:02:51.745335 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:51.835916 15249 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:51.743033 15320 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 1.
I20260709 13:02:51.744756 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.745832 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:51.837232 16033 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:51.660573 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:02:51.774945 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 64453.8us
I20260709 13:02:51.772929 16883 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:51.695241 16833 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:51.780655 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 70591.4us
W20260709 13:02:51.844910 15362 leader_election.cc:343] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:51.698746 16859 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:51.782573 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 163605us
I20260709 13:02:51.671258 16885 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.783578 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:51.746191 16857 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:51.849923 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:51.787434 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:51.788036 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:51.851087 15398 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:51.746351 16876 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:51.788784 16880 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 2. Current term is 3.
W20260709 13:02:51.774406 16870 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:51.796550 15245 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
W20260709 13:02:51.744239 15247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.019s	sys 0.029s
W20260709 13:02:51.856057 15247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.020s	sys 0.030s
I20260709 13:02:51.816004 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:51.751148 16748 raft_consensus.cc:2764] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:51.654803 16713 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.773633 16754 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:51.791842 16679 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:02:51.748811 16770 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:51.812119 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.820585 16439 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.834384 15325 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:51.783289 16852 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:51.846697 15250 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:51.703416 16759 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.705410 16826 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.853456 15392 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:51.850723 15244 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:02:51.845455 15213 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:51.847440 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:02:51.861333 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45430.1us
I20260709 13:02:51.886950 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:51.860654 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.861371 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:51.864828 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.743494 15393 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:51.860212 15241 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:51.880559 16852 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.893473 16713 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.893777 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.894057 15323 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:51.847687 15318 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:51.895009 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:51.895725 16033 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:51.895797 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.893981 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.897238 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.879930 16681 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.898003 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.880852 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:51.898788 15395 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.899363 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.899626 16838 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.900555 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.888592 15390 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:51.903481 16826 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:51.892253 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:51.860599 16835 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:51.881374 16824 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:51.868512 16825 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:51.894977 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.881680 16849 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39704 (request call id 84) took 1445 ms. Trace:
I20260709 13:02:51.905375 15320 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.905731 16849 rpcz_store.cc:276] 0709 13:02:50.440044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.473033 (+ 32989us) service_pool.cc:224] Handling call
0709 13:02:50.741918 (+268885us) ts_tablet_manager.cc:1151] Deleting tablet f537e87ec99a4032a677e62627c567e2
0709 13:02:50.756001 (+ 14083us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:51.218487 (+462486us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:51.439998 (+221511us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:51.854645 (+414647us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":229421,"thread_start_us":148441,"threads_started":1}
I20260709 13:02:51.907626 15318 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:51.908751 16772 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.881683 16770 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.908622 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.873184 16871 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:51.927549 16713 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:51.928009 16713 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.927862 16871 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.929804 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:51.927600 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:51.931123 15393 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:51.881354 16742 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.932914 16871 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:51.933148 16754 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:51.911777 16863 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.912184 15324 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:51.865479 16862 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:51.914156 16889 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:02:51.849475 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:51.917271 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:51.948587 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 196809us
I20260709 13:02:51.949911 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.921128 15248 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
W20260709 13:02:51.915107 16897 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:02:51.922537 15395 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:51.922616 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.924770 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.951371 15392 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
W20260709 13:02:51.926316 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 81429us
I20260709 13:02:51.933811 16867 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:51.910583 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:51.956490 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:51.969300 15396 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:51.870270 16876 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:51.970304 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.935140 15245 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:51.938851 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.933651 16754 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.928395 16713 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.940960 15398 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:51.889075 15391 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:51.941450 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:51.941721 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:51.942301 16836 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:51.889792 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 232431us
I20260709 13:02:51.915808 15132 catalog_manager.cc:5028] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): tablet f537e87ec99a4032a677e62627c567e2 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:51.866742 16028 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:51.939765 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:51.988618 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:51.932855 16742 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:51.956511 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:51.928380 16868 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.923216 16833 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:51.984438 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:52.000762 15245 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:51.868942 16857 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:51.983438 15318 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:02:51.988664 15132 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72886.4us
I20260709 13:02:51.996272 15324 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.997298 15242 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.011058 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:52.023415 15245 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:02:52.000214 16730 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.004719 16825 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:51.999504 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:52.063004 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:52.070658 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:52.072928 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:52.075770 16906 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:52.077986 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:52.054944 16825 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:52.079277 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:52.080266 16863 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:52.080421 16825 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:52.081027 16863 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:52.081396 16863 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:52.081770 16863 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:52.032320 16868 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:52.086624 16868 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:52.087253 15242 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:52.088976 16868 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:52.090939 16363 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.090988 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:52.091696 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:52.091552 16363 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.092463 15250 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:52.092725 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:52.093500 15241 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:52.093684 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:02:52.094641 16900 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:02:52.096160 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:52.103325 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:52.102133 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:52.101377 15324 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:52.101169 15321 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:52.114940 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:52.116484 16908 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:52.117050 16908 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:52.117280 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:02:52.113574 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 125081us
I20260709 13:02:52.118364 16871 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:52.120244 16830 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:52.121637 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:52.122452 16859 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:52.123021 16835 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:52.123183 16878 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:52.123538 16835 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.123665 16878 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.124123 16878 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.125943 15320 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
W20260709 13:02:52.126505 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 170101us
I20260709 13:02:52.126515 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:52.127228 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:52.127184 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:52.128361 15320 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:52.130149 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:52.074429 16679 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:52.074834 16862 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:52.135268 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:52.036021 16730 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.140030 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:52.142817 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:52.074157 16829 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:52.144789 16915 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.146767 15248 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:52.101470 16906 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:52.134143 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:52.165017 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:52.056982 16876 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.153466 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:52.114149 16772 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:52.161629 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:52.170032 16681 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:52.170768 16024 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:02:52.168586 16823 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:52.136960 16871 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:52.136880 16859 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:52.142127 16840 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:52.241518 16834 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.283416 15319 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:52.086042 16770 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:52.250939 16883 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:52.259526 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:52.263821 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:52.140574 16830 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 13:02:52.137159 16836 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:02:52.177513 16745 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:52.261924 16685 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:52.177695 16772 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.176590 16748 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:52.188077 16713 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:52.300772 16917 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.269071 16859 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:52.246035 16823 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:52.325896 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:52.262007 16840 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.263197 16681 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:52.307484 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:52.306444 16772 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:52.314747 16748 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.322996 16836 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:52.118003 16908 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.321825 16713 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:52.302901 16871 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:52.269695 16915 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.312466 16745 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:52.330976 15393 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:52.357209 16915 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:52.370294 16899 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.609s	user 0.004s	sys 0.002s
I20260709 13:02:52.306900 16679 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:02:52.336624 16836 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:52.333039 16868 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:52.411706 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1847) took 1010 ms. Trace:
I20260709 13:02:52.335909 16840 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.413561 16681 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.417850 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:52.418795 16906 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.420351 16823 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:52.420660 16917 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:52.433267 16831 consensus_meta.cc:287] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.793s	user 0.002s	sys 0.008s
I20260709 13:02:52.414199 15397 rpcz_store.cc:276] 0709 13:02:51.401061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.404206 (+  3145us) service_pool.cc:224] Handling call
0709 13:02:51.431394 (+ 27188us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:02:51.431593 (+   199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.431960 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.431988 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.432500 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:02:51.609540 (+177040us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:51.609579 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.609644 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:52.302691 (+693047us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:02:52.411412 (+108721us) raft_consensus.cc:1685] finished
0709 13:02:52.411444 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:52.411635 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":857,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":118,"spinlock_wait_cycles":107554944,"thread_start_us":176696,"threads_started":1,"wal-append.queue_time_us":246589}
I20260709 13:02:52.435271 15243 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:52.436091 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:52.373898 16871 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:52.365520 16878 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:52.541168 16742 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:52.523923 16859 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.543555 16363 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:52.526206 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:52.455634 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:52.507680 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:52.608182 15393 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:52.533308 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:52.610178 16699 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.525158 16745 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.523111 16730 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:52.615964 16699 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:52.615721 15318 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:52.619400 16699 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:52.614858 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:52.616380 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:52.616379 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:52.629228 15145 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 234) took 2925 ms. Trace:
I20260709 13:02:52.436157 16836 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:52.455205 16748 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:52.628923 15147 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 3, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.653440 15147 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 2 to 3, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.630904 15396 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:52.291707 16834 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:52.606967 16754 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.003s
I20260709 13:02:52.358529 16857 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:52.659333 15391 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:52.662184 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:52.662885 15391 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:52.461194 16868 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:52.603988 16831 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:52.631880 16863 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
I20260709 13:02:52.456359 16770 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:52.478771 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:52.671552 15323 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:52.673453 15321 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:52.630877 15145 rpcz_store.cc:276] 0709 13:02:49.703994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.705939 (+  1945us) service_pool.cc:224] Handling call
0709 13:02:52.629126 (+2923187us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:50.907257 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:50.951652 (+ 44395us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:50.951700 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:02:50.951727 (+    27us) tablet.cc:662] Decoding operations
0709 13:02:50.956226 (+  4499us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:50.956342 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:50.956381 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:50.956781 (+   400us) tablet.cc:701] Row locks acquired
0709 13:02:50.956829 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:02:50.957046 (+   217us) write_op.cc:270] Start()
0709 13:02:50.957224 (+   178us) write_op.cc:276] Timestamp: P: 1783602170956978 usec, L: 0
0709 13:02:50.957255 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:02:50.958021 (+   766us) log.cc:844] Serialized 544 byte log entry
0709 13:02:51.818566 (+860545us) op_driver.cc:464] REPLICATION: finished
0709 13:02:52.247323 (+428757us) write_op.cc:301] APPLY: starting
0709 13:02:52.289114 (+ 41791us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:52.310903 (+ 21789us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:52.349276 (+ 38373us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:52.355370 (+  6094us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:52.355640 (+   270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:52.355683 (+    43us) write_op.cc:312] APPLY: finished
0709 13:02:52.355962 (+   279us) log.cc:844] Serialized 23 byte log entry
0709 13:02:52.356162 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:52.356242 (+    80us) write_op.cc:454] Released schema lock
0709 13:02:52.356298 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:52.356693 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:52.356730 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17243,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":315684,"apply.run_cpu_time_us":2825,"apply.run_wall_time_us":191843,"num_ops":1,"prepare.queue_time_us":324300,"prepare.run_cpu_time_us":11615,"prepare.run_wall_time_us":581595,"raft.queue_time_us":296488,"raft.run_cpu_time_us":18077,"raft.run_wall_time_us":353764,"replication_time_us":788136,"thread_start_us":980889,"threads_started":4,"wal-append.queue_time_us":443367}]]}
W20260709 13:02:52.676196 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 508722us
W20260709 13:02:52.682641 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 145752us
I20260709 13:02:52.708968 16830 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:52.709647 16830 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:52.712031 15393 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:52.716657 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 124) took 1190 ms. Trace:
I20260709 13:02:52.717108 15244 rpcz_store.cc:276] 0709 13:02:51.504699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.504999 (+   300us) service_pool.cc:224] Handling call
0709 13:02:52.687646 (+1182647us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54003976d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:52.695292 (+  7646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557148032}
I20260709 13:02:52.685392 16028 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:52.622888 16772 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:52.672816 16754 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:52.862514 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.006s	sys 0.019s
W20260709 13:02:53.020666 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.007s	sys 0.020s
I20260709 13:02:52.988986 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:52.953984 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:53.023254 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:53.023449 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:53.024547 15250 raft_consensus.cc:2368] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3.
I20260709 13:02:52.961674 16748 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:52.761936 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 53711.4us
I20260709 13:02:52.809070 15314 tablet_service.cc:1558] Processing DeleteTablet for tablet f537e87ec99a4032a677e62627c567e2 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:39704
I20260709 13:02:52.677454 16699 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:52.809969 15289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.048s	sys 0.158s
W20260709 13:02:53.029289 15289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.054s	sys 0.165s
I20260709 13:02:53.029310 16699 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:52.983349 15365 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.953s (SENT) [suppressed 14 similar messages]
I20260709 13:02:53.021908 15244 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:52.764779 16838 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:52.767274 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:53.027253 16024 raft_consensus.cc:2368] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
I20260709 13:02:52.680706 16836 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:53.027485 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:53.028674 16772 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.030941 16754 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:52.795574 16730 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:52.712069 16830 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:53.031699 16920 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:52.802575 16871 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.032500 15289 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:52.820312 16885 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:52.835934 16439 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.038653 15132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9e997bc5c2942178cde4c670df97100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 45ddec37d9e741a598bf32f6c9d7e0ee is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:52.767820 16765 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:52.678401 16863 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.040633 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:52.684058 16868 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:52.767463 16837 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:52.714789 16742 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.327s
I20260709 13:02:53.041342 16905 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:53.025779 16748 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.026105 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:53.055181 16746 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:53.058487 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:53.059039 16904 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:53.060036 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:02:53.091079 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 65080.9us
I20260709 13:02:53.061538 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:53.011144 16915 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:53.072839 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:53.075014 16922 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:53.083734 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:53.062780 16917 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.068621 16867 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:53.072077 16830 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:53.106554 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:53.072685 16439 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:53.086442 16835 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.962s	user 0.010s	sys 0.002s
I20260709 13:02:53.183838 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:53.194979 15392 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.012s	sys 0.025s
W20260709 13:02:53.197518 15392 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.012s	sys 0.026s
I20260709 13:02:53.071846 16838 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.113858 16029 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:53.081796 16920 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:53.194514 15288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.068s	sys 0.130s
I20260709 13:02:53.081596 16730 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.209632 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:53.213016 15288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.069s	sys 0.130s
I20260709 13:02:53.207016 16867 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.214638 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:53.085749 16765 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.215154 16439 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.247076 16439 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:53.105896 16837 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.201846 16835 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.237493 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:53.251508 16835 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.255088 16837 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.114526 16914 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:53.302654 16914 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.305699 16914 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:53.307601 15320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.025s	sys 0.016s
W20260709 13:02:53.308079 15320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.025s	sys 0.016s
I20260709 13:02:53.310040 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 886) took 1248 ms. Trace:
I20260709 13:02:53.268307 15243 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:53.097467 16746 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.106482 16857 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:02:53.099212 16829 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:53.107362 16915 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.106305 16905 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:53.318754 15390 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.150s	user 0.006s	sys 0.048s
I20260709 13:02:53.220155 16864 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:53.212406 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:53.200919 16830 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.154700 16904 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.243842 16922 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:53.243023 16909 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.073s	user 0.032s	sys 0.033s
I20260709 13:02:53.277156 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:53.343439 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66361.4us
I20260709 13:02:53.344374 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:53.278378 16866 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:53.278657 16838 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.280303 16748 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:53.281199 16878 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:53.285638 16730 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:53.289242 16863 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.255975 16754 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:53.104151 16885 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:53.318497 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:53.336848 15249 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:53.265456 16439 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:02:53.337723 15390 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.007s	sys 0.048s
I20260709 13:02:53.269770 16923 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:53.310943 15320 rpcz_store.cc:276] 0709 13:02:52.061196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.162245 (+101049us) service_pool.cc:224] Handling call
0709 13:02:52.162597 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.176043 (+ 13446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.176074 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:52.286808 (+110734us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.308499 (+1021691us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:53.309272 (+   773us) log.cc:844] Serialized 14 byte log entry
0709 13:02:53.309700 (+   428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.309772 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:53.309814 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:53.309827 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:53.309956 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6882,"prepare.queue_time_us":297,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":76689,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":22930,"thread_start_us":973767,"threads_started":1,"wal-append.queue_time_us":994551}
W20260709 13:02:53.340824 15362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.022s	sys 0.016s
I20260709 13:02:53.337690 16829 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.317241 16917 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:53.316536 16876 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.012s	sys 0.033s
I20260709 13:02:53.363300 16829 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:53.365135 16876 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.015s	sys 0.033s
W20260709 13:02:53.358800 15147 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.010s	sys 0.012s
W20260709 13:02:53.365882 15147 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.011s	sys 0.012s
W20260709 13:02:53.341334 16745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.008s	sys 0.017s
I20260709 13:02:53.356123 16837 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:53.366066 16746 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:53.366461 16837 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.366210 16917 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.366883 16837 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:53.357365 16922 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.368714 16917 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.370405 16922 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:53.370985 16922 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:53.371243 16863 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:53.371964 16863 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.371377 16922 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:53.364176 15362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.022s	sys 0.016s
I20260709 13:02:53.349305 16914 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:53.377120 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 1.08356e+06us
I20260709 13:02:53.354393 16864 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.382579 16439 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.384008 16864 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:53.362920 16699 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:53.359045 16909 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.032s	sys 0.034s
I20260709 13:02:53.360409 16838 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.387950 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:53.362164 16885 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:53.374344 16745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.008s	sys 0.018s
I20260709 13:02:53.408703 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:53.409353 15324 raft_consensus.cc:1803] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 1.3
I20260709 13:02:53.409847 15324 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:53.374939 16866 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:53.415109 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:53.378255 16922 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:53.378043 16914 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:53.374344 16923 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.385281 16919 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:53.390511 16754 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:53.438716 16754 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.441202 16754 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.406991 16885 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:53.416908 16838 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.444581 16838 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.445274 16919 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.377640 16863 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.423278 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:53.446769 16866 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:53.447305 16866 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:53.447486 16919 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.428753 16914 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:53.448280 16866 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.427619 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:53.417493 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:53.417182 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:53.451327 15399 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.149s	user 0.019s	sys 0.044s
W20260709 13:02:53.451682 15399 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.019s	sys 0.044s
W20260709 13:02:53.463861 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.416684 16699 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:53.496706 15319 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
W20260709 13:02:53.498919 15394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.618s	user 0.024s	sys 0.039s
W20260709 13:02:53.510211 15394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.629s	user 0.024s	sys 0.039s
W20260709 13:02:53.452360 16759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.972s	user 0.023s	sys 0.022s
I20260709 13:02:53.425827 16864 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:53.511354 16758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.012s	sys 0.038s
W20260709 13:02:53.527701 16759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.025s	sys 0.026s
I20260709 13:02:53.509826 16765 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.522269 16867 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:53.558784 16681 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.017s	sys 0.022s
I20260709 13:02:53.509536 15317 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
W20260709 13:02:53.570094 16758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.012s	sys 0.038s
W20260709 13:02:53.586357 16762 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.008s	sys 0.015s
W20260709 13:02:53.616629 16681 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.017s	sys 0.022s
I20260709 13:02:53.533586 16920 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:53.526801 16699 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:53.624184 16762 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.008s	sys 0.015s
W20260709 13:02:53.646556 15999 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.001s	sys 0.022s
W20260709 13:02:53.647028 15363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.009s	sys 0.022s
W20260709 13:02:53.647467 15363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.009s	sys 0.022s
W20260709 13:02:53.634939 15391 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.000s	sys 0.032s
W20260709 13:02:53.647063 15999 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.001s	sys 0.022s
I20260709 13:02:53.633379 16830 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:53.633165 16915 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:53.654903 15393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.023s
W20260709 13:02:53.665040 15393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.000s	sys 0.024s
W20260709 13:02:53.632455 15314 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.010s	sys 0.012s
W20260709 13:02:53.654311 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 667914us
I20260709 13:02:53.638916 16758 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:53.639462 15996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.007s	sys 0.023s
I20260709 13:02:53.646760 16905 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:53.654150 15391 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.000s	sys 0.033s
W20260709 13:02:53.670221 15996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.007s	sys 0.024s
W20260709 13:02:53.667881 15314 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.011s	sys 0.012s
W20260709 13:02:53.676232 15323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 873) took 1825 ms (client timeout 1842 ms). Trace:
I20260709 13:02:53.664001 16917 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.661788 16904 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:53.697513 15323 rpcz_store.cc:269] 0709 13:02:51.846857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.894693 (+ 47836us) service_pool.cc:224] Handling call
0709 13:02:52.616267 (+721574us) spinlock_profiling.cc:243] Waited 9.85 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5eee 0000000000375939 00007f366eb491e0 00007f366ec120c4 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:02:53.671764 (+1055497us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b54000fb9d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:53.671920 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90716160}
I20260709 13:02:53.667135 16929 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.677985 16906 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.006s	sys 0.013s
I20260709 13:02:53.728926 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:53.671155 16681 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:53.729564 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:53.648581 16837 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.692903 16863 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:53.692272 16868 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:53.672444 16758 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:54.111222 15242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.026s	sys 0.045s
W20260709 13:02:54.151643 15242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.027s	sys 0.046s
I20260709 13:02:54.152616 16868 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:53.743880 15248 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
W20260709 13:02:53.831655 16859 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.019s	sys 0.029s
I20260709 13:02:53.904256 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:54.097276 16840 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.606s	user 0.013s	sys 0.001s
I20260709 13:02:54.160895 16834 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:54.120213 16439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.011s	sys 0.007s
W20260709 13:02:54.161581 16439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.012s	sys 0.007s
I20260709 13:02:53.904412 16867 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:54.162142 16867 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:54.113080 15390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.019s	sys 0.052s
I20260709 13:02:53.729760 16878 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:54.166622 15390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.020s	sys 0.052s
I20260709 13:02:54.166869 16878 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.169139 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1580) took 1331 ms. Trace:
I20260709 13:02:54.183812 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 132) took 1135 ms. Trace:
I20260709 13:02:53.872960 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:54.196143 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1859) took 2047 ms. Trace:
W20260709 13:02:54.157202 16859 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.025s	sys 0.053s
W20260709 13:02:53.743526 16906 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.006s	sys 0.014s
W20260709 13:02:54.157778 16823 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.001s	sys 0.020s
W20260709 13:02:53.821872 15289 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.009s	sys 0.011s
W20260709 13:02:54.208243 15289 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.016s	sys 0.014s
W20260709 13:02:54.209049 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 1.10252e+06us
I20260709 13:02:54.209961 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:02:53.904565 15364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.030s	sys 0.034s
I20260709 13:02:54.155375 16868 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.160615 16840 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:53.767057 16904 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:54.103477 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:54.164652 16699 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:54.188931 16439 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:02:54.203394 16823 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.144s	user 0.001s	sys 0.020s
W20260709 13:02:53.822125 16908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.449s	user 0.024s	sys 0.011s
I20260709 13:02:54.184397 15250 rpcz_store.cc:276] 0709 13:02:53.048693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.048824 (+   131us) service_pool.cc:224] Handling call
0709 13:02:53.055184 (+  6360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.350431 (+295247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.350488 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:53.350547 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:53.350590 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.183558 (+832968us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b540010b154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:54.183608 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.183749 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678227712}
W20260709 13:02:53.822244 16871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.014s
W20260709 13:02:54.195329 15291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.019s	sys 0.015s
I20260709 13:02:54.149740 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:02:54.249137 15291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.019s	sys 0.015s
W20260709 13:02:54.249703 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 933264us
W20260709 13:02:54.251657 15213 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.019s	sys 0.051s
W20260709 13:02:54.252177 15213 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.020s	sys 0.051s
W20260709 13:02:54.252588 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 662919us
W20260709 13:02:53.696308 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 640113us
I20260709 13:02:54.233896 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:02:54.248106 16908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.869s	user 0.029s	sys 0.016s
W20260709 13:02:54.248567 16871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.008s	sys 0.022s
I20260709 13:02:53.804419 16929 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:54.217131 15365 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.174s	user 0.000s	sys 0.048s
I20260709 13:02:53.908999 16923 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.174947 15243 rpcz_store.cc:276] 0709 13:02:52.838121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.866824 (+ 28703us) service_pool.cc:224] Handling call
0709 13:02:53.003843 (+137019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.335674 (+331831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.168747 (+833073us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400449dd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:54.169021 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":573456640}
W20260709 13:02:54.221845 15399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.028s	sys 0.041s
I20260709 13:02:54.219288 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:02:54.352788 15399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.029s	sys 0.045s
W20260709 13:02:54.352990 15365 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.001s	sys 0.067s
I20260709 13:02:54.202059 16946 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:53.822352 15392 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.012s	sys 0.007s
W20260709 13:02:54.353628 15392 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.020s	sys 0.009s
W20260709 13:02:54.199013 16909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.015s	sys 0.043s
I20260709 13:02:53.765473 16917 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.364804 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1587) took 2504 ms. Trace:
I20260709 13:02:54.366544 16917 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:54.238706 16939 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:02:54.239698 16937 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.376s	user 0.000s	sys 0.000s
I20260709 13:02:54.366703 15399 rpcz_store.cc:276] 0709 13:02:51.849159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.851935 (+  2776us) service_pool.cc:224] Handling call
0709 13:02:51.888308 (+ 36373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.935918 (+ 47610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.935964 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.940302 (+  4338us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.148567 (+208265us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:53.456759 (+1308192us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.353569 (+896810us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.353697 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.353744 (+    47us) raft_consensus.cc:1685] finished
0709 13:02:54.353761 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.353903 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114742,"prepare.queue_time_us":1151305,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":1327,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":4718,"thread_start_us":2201144,"threads_started":3,"wal-append.queue_time_us":348343,"wal-append.run_cpu_time_us":13983,"wal-append.run_wall_time_us":1103409}
I20260709 13:02:54.241426 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1601) took 1950 ms. Trace:
I20260709 13:02:54.369856 15393 rpcz_store.cc:276] 0709 13:02:52.290674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.732763 (+442089us) service_pool.cc:224] Handling call
0709 13:02:52.733233 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:52.765897 (+ 32664us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:52.765945 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.028148 (+262203us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.665653 (+637505us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:53.675540 (+  9887us) log.cc:844] Serialized 14 byte log entry
0709 13:02:53.675802 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.675905 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.241115 (+565210us) raft_consensus.cc:1685] finished
0709 13:02:54.241144 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.241341 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22747,"prepare.queue_time_us":9554,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":482270,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":19468,"thread_start_us":637077,"threads_started":1,"wal-append.queue_time_us":1160714}
W20260709 13:02:54.373248 16922 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.935s	user 0.003s	sys 0.006s
I20260709 13:02:54.356966 16746 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:54.382998 16746 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.384392 16946 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.252079 16878 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:54.243775 15363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.006s	sys 0.008s
W20260709 13:02:54.391477 15363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.007s	sys 0.008s
I20260709 13:02:54.246642 16439 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.217712 16942 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:54.196692 15390 rpcz_store.cc:276] 0709 13:02:52.138335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.138468 (+   133us) service_pool.cc:224] Handling call
0709 13:02:52.138754 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:52.138945 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:53.362452 (+1223507us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.185559 (+823107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.185635 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:54.185694 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.185791 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.185964 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18237,"prepare.queue_time_us":1157103,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"thread_start_us":1997435,"threads_started":2}
I20260709 13:02:54.225232 16759 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:54.184655 16863 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.419013 16439 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:54.421291 16863 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.354290 16745 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:54.226001 16868 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:53.873108 16876 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:54.411190 16748 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.018s	sys 0.007s
I20260709 13:02:54.182787 16947 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:54.354564 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 1.37115e+06us
I20260709 13:02:54.439064 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:54.439781 16024 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
W20260709 13:02:54.355216 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 136050us
I20260709 13:02:54.446022 16439 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:54.439064 16947 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.455791 16947 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.443289 16876 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.345336 16837 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.364184 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1593) took 2412 ms. Trace:
W20260709 13:02:54.356850 16909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.016s	sys 0.043s
I20260709 13:02:54.202631 16953 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.249847 16904 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.459964 16439 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:54.351670 16829 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.986s	user 0.010s	sys 0.001s
I20260709 13:02:54.262797 16906 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.292894 16836 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.265599 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:54.408653 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:54.418349 16942 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.396049 16917 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:54.410478 16759 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:54.486917 16759 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.490795 16439 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.491674 16439 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.492297 16439 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:54.494745 16936 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.797s	user 0.003s	sys 0.005s
W20260709 13:02:54.212909 15364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.232s	user 0.035s	sys 0.036s
I20260709 13:02:54.503440 16748 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:54.504210 16863 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:54.504017 16748 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.440784 16868 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.511641 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.434942 16745 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.373869 16922 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:54.401000 15246 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.044s	user 0.010s	sys 0.002s
I20260709 13:02:53.825202 16681 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:54.263294 16885 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.821s	user 0.005s	sys 0.007s
I20260709 13:02:54.433516 16840 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:54.463732 15362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.071s	sys 0.138s
I20260709 13:02:54.456625 15392 rpcz_store.cc:276] 0709 13:02:51.942572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.952227 (+  9655us) service_pool.cc:224] Handling call
0709 13:02:51.952632 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.969349 (+ 16717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.969397 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.985817 (+ 16420us) log.cc:844] Serialized 26 byte log entry
0709 13:02:52.147868 (+162051us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:53.200051 (+1052183us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.354041 (+1153990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.354136 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.354181 (+    45us) raft_consensus.cc:1685] finished
0709 13:02:54.354192 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.354339 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28486,"prepare.queue_time_us":1151807,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":163404,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":14630,"thread_start_us":2212624,"threads_started":3,"wal-append.queue_time_us":282460,"wal-append.run_cpu_time_us":16272,"wal-append.run_wall_time_us":1969068}
W20260709 13:02:54.570207 15362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.071s	sys 0.139s
I20260709 13:02:54.571122 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.437393 16958 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.437912 16867 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:54.415709 16762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.000s	sys 0.015s
I20260709 13:02:54.463402 15363 leader_election.cc:400] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
I20260709 13:02:54.581985 15363 leader_election.cc:403] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:54.548566 16864 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:54.503005 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 94464.7us
I20260709 13:02:54.528177 16439 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.529764 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.532902 16948 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.534258 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 133) took 1472 ms. Trace:
I20260709 13:02:54.534317 16831 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:54.536929 15365 connection.cc:256] RPC call timeout handler was delayed by -1.0889200589999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
I20260709 13:02:54.537297 16742 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.542704 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.591091 15399 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:54.591370 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:54.545295 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:54.594514 15393 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.587332 15245 rpcz_store.cc:276] 0709 13:02:53.064076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.064219 (+   143us) service_pool.cc:224] Handling call
0709 13:02:53.077914 (+ 13695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:53.261341 (+183427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.261385 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:53.261440 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:53.261483 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.533900 (+1272417us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54001a7cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:54.533968 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.534161 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":421289344}
I20260709 13:02:54.547008 16942 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:54.547500 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.480049 16909 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:54.509639 16758 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:54.479656 16829 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.464147 16953 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:54.573318 16961 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:54.483546 16906 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.574215 16681 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:54.574630 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.550627 16837 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:54.575913 16922 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.576596 15322 raft_consensus.cc:2368] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3.
I20260709 13:02:54.579386 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.482415 16836 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:54.582805 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 123605us
I20260709 13:02:54.626323 15399 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:54.271257 16823 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:54.548897 16917 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.586035 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:54.544054 16952 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:02:54.546458 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:54.589560 16679 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:54.599457 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:54.583272 16762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.000s	sys 0.016s
I20260709 13:02:54.600538 15397 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:54.567796 15246 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:54.597930 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:54.614363 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.605867 16699 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:54.576924 16885 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.602313 16951 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:54.633296 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.680322 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.680850 15320 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
W20260709 13:02:54.637058 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51089.5us
I20260709 13:02:54.641925 15398 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:02:54.643191 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.598469 16864 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.626216 16904 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:54.610348 16947 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.577288 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:54.679013 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 421509us
I20260709 13:02:54.680984 15316 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:54.682363 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.599581 16862 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.682935 15321 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:54.684321 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:54.644068 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.642042 16823 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.691953 16830 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:54.692095 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 94280.2us
I20260709 13:02:54.717495 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:54.583084 16958 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.599771 16948 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.639623 16868 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:54.677129 16914 consensus_meta.cc:287] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.229s	user 0.009s	sys 0.006s
I20260709 13:02:54.613262 16742 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:54.782701 16954 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:02:54.784066 16948 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:54.784273 16742 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:54.785058 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:54.785236 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:54.786386 15249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 857) took 1653 ms (client timeout 1780 ms). Trace:
W20260709 13:02:54.786837 15249 rpcz_store.cc:269] 0709 13:02:53.132876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.204002 (+ 71126us) service_pool.cc:224] Handling call
0709 13:02:54.786127 (+1582125us) spinlock_profiling.cc:243] Waited 85.9 ms on lock 0x7b54001a90d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:54.786321 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197650176}
I20260709 13:02:54.789389 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 462) took 1107 ms. Trace:
W20260709 13:02:54.790702 16955 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:02:54.791953 16953 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:54.792562 16965 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 13:02:54.793788 16931 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:02:54.794171 16885 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.795866 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1588) took 2946 ms. Trace:
I20260709 13:02:54.639099 16837 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.742821 16862 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.805032 16864 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:54.805187 16862 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:54.808393 16958 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:54.809065 16914 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.641898 16917 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.789824 16033 rpcz_store.cc:276] 0709 13:02:53.681648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.696033 (+ 14385us) service_pool.cc:224] Handling call
0709 13:02:53.696354 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.422014 (+725660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.422053 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.422101 (+    48us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:54.422134 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.789067 (+366933us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54006fed54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:54.789121 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.789292 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668396800}
I20260709 13:02:54.811164 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:54.812184 16917 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:54.743803 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 182277us
I20260709 13:02:54.750102 16699 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:54.814656 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:54.817018 16863 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:54.818363 16941 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
I20260709 13:02:54.722200 16947 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.716341 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:54.700448 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:54.693548 16960 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 13:02:54.611347 16831 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.675194 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.684203 16748 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:54.715880 15999 leader_election.cc:400] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3.
I20260709 13:02:54.820422 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.796376 15394 rpcz_store.cc:276] 0709 13:02:51.849436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.852117 (+  2681us) service_pool.cc:224] Handling call
0709 13:02:51.852574 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:51.871886 (+ 19312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:51.871932 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.880821 (+  8889us) log.cc:844] Serialized 26 byte log entry
0709 13:02:53.539939 (+1659118us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:53.592709 (+ 52770us) log.cc:844] Serialized 14 byte log entry
0709 13:02:53.611685 (+ 18976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:53.611764 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.498871 (+887107us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b180039c700. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:02:54.795486 (+296615us) raft_consensus.cc:1685] finished
0709 13:02:54.795610 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:54.795780 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19929,"prepare.queue_time_us":71359,"prepare.run_wall_time_us":60,"raft.queue_time_us":57669,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":22050,"spinlock_wait_cycles":39414272,"thread_start_us":1629408,"threads_started":1,"wal-append.queue_time_us":2603756}
I20260709 13:02:54.822026 15397 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:54.822724 15320 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:54.710820 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 136) took 1608 ms. Trace:
I20260709 13:02:54.608202 16909 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.883095 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.747234 16974 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:54.894054 16944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39704 (request call id 87) took 2091 ms. Trace:
I20260709 13:02:54.894696 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.855967 16864 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:54.919425 15249 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:54.920145 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:54.920457 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 203081us
I20260709 13:02:54.922740 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.919092 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:54.926777 15245 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:54.926926 15321 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
W20260709 13:02:54.917538 16959 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
I20260709 13:02:54.928320 15394 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:54.928475 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.932066 15396 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:54.933132 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.933863 15396 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:54.935649 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.936293 15321 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:54.696834 16951 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.930254 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:54.913172 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:54.937129 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.819636 16759 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.938889 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:54.944700 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:54.939064 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.941802 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:54.944031 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:54.945212 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.946163 15390 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:54.946609 15396 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.948387 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.950467 16829 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:54.953341 16746 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:54.954617 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.955343 16823 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.926492 16864 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:54.956079 16864 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.959182 16947 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.959846 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:54.961119 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:54.961736 15243 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:02:54.963318 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.964138 15395 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 1.
I20260709 13:02:54.964346 16946 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:54.965481 15323 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:02:54.966300 15318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 890) took 1583 ms (client timeout 1780 ms). Trace:
W20260709 13:02:54.966744 15318 rpcz_store.cc:269] 0709 13:02:53.383278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.386940 (+  3662us) service_pool.cc:224] Handling call
0709 13:02:54.893521 (+1506581us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5f8c 00007f3666ad5ef6 0000000000375939 00007f366eb491e0 00007f366ec120c4 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:02:54.966203 (+ 72682us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39171968}
I20260709 13:02:54.968003 16746 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.968248 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:54.968703 16746 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:54.969026 16862 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:54.970167 16929 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:54.968029 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.970939 16929 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:54.971335 16929 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:54.971903 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.972132 16929 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:54.972765 15318 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:02:54.973585 16929 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:54.973765 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:54.974418 15248 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:54.973977 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.975910 15318 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:54.977207 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.977941 15318 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:02:54.918354 15317 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:54.979452 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.991137 15323 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:54.981148 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:54.992159 15321 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.992439 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:54.983438 15396 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:54.984786 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.953502 16836 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:54.988341 15393 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
W20260709 13:02:54.989993 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 177102us
I20260709 13:02:54.994606 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:54.931715 16974 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:02:54.979868 16963 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.385s	user 0.000s	sys 0.001s
I20260709 13:02:55.013006 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:55.013232 15319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 895) took 1628 ms (client timeout 1974 ms). Trace:
I20260709 13:02:55.008860 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.014626 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.010639 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.012060 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.013897 15316 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:55.015799 15244 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:55.016716 16972 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:55.017269 16972 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.017400 16974 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.019981 16972 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.020469 16917 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.918200 15246 rpcz_store.cc:276] 0709 13:02:53.087615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.115429 (+ 27814us) service_pool.cc:224] Handling call
0709 13:02:54.696097 (+1580668us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:54.948776 16681 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:55.013610 15319 rpcz_store.cc:269] 0709 13:02:53.384704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.387216 (+  2512us) service_pool.cc:224] Handling call
0709 13:02:55.013078 (+1625862us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b54002edbd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:55.013181 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105284864}
I20260709 13:02:55.021183 16917 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.025506 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:55.025748 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:55.026445 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.027333 16679 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
I20260709 13:02:54.989722 16746 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:55.028525 16958 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:55.028751 16831 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:55.011950 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1602) took 2403 ms. Trace:
I20260709 13:02:55.003392 16905 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:55.004525 16949 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.989959 16829 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.032564 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.058212 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:55.057703 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58437.5us
I20260709 13:02:54.923460 16944 rpcz_store.cc:276] 0709 13:02:52.803191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.807949 (+  4758us) service_pool.cc:224] Handling call
0709 13:02:54.248835 (+1440886us) ts_tablet_manager.cc:1151] Deleting tablet f537e87ec99a4032a677e62627c567e2
0709 13:02:54.893643 (+644808us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:54.893982 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1195978,"thread_start_us":668506,"threads_started":1}
I20260709 13:02:55.039068 16028 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:02:55.039317 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:55.037855 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.083240 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.085750 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.086055 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 856) took 1953 ms. Trace:
I20260709 13:02:55.085795 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:02:55.087029 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47848.5us
I20260709 13:02:55.088330 15319 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:55.088843 15325 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 1.
I20260709 13:02:55.039688 15248 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:55.087970 15242 rpcz_store.cc:276] 0709 13:02:53.132645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.265290 (+132645us) service_pool.cc:224] Handling call
0709 13:02:53.290875 (+ 25585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.296883 (+  6008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.296917 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:53.338089 (+ 41172us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.152062 (+813973us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:54.152101 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.152171 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.085848 (+933677us) raft_consensus.cc:1685] finished
0709 13:02:55.085865 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.086001 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":182,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":18791,"thread_start_us":788454,"threads_started":1,"wal-append.queue_time_us":1056476}
I20260709 13:02:55.047606 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:55.091876 15250 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:55.091921 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:55.092808 15396 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.092696 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:55.037513 15247 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:55.099449 15321 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:55.101188 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:55.102398 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.103114 15321 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:55.084118 15318 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.104694 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.107313 15395 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:02:55.108426 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.110301 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.110993 15396 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:55.100211 16905 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.122573 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.123365 16759 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:55.123675 15316 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:55.090936 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.124409 15317 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:02:55.124629 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.094257 16972 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.125392 16972 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.125985 16972 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.127467 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:55.128013 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.128607 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.128633 15241 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:55.129668 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.092196 16829 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.095095 16882 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:02:55.130820 16882 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:55.131165 16882 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:55.125340 15316 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:55.046792 16862 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:55.092941 16958 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.131870 16829 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:55.249723 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 663603us
I20260709 13:02:55.155053 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.251036 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.251859 16823 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.251920 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:55.252332 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.252542 15390 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.252941 15250 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:55.098690 16762 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.253825 16762 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.254272 16762 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.254633 16951 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:55.255065 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.256425 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.257197 15393 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:55.185412 15398 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:02:55.216109 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:55.194815 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:55.245604 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 142567us
I20260709 13:02:55.194372 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.258071 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.137367 15323 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
W20260709 13:02:55.104447 16981 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:02:55.264631 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.264767 16823 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.265280 15319 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:55.263801 15393 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:55.188413 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.269248 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:55.261754 15390 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:02:55.125236 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.135313 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.273547 15396 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:55.091782 16949 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.275070 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.275592 15325 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:55.277628 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.277721 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:55.274298 16864 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.280019 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.276895 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:55.284438 16864 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:55.279688 16024 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:55.286892 16823 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.295964 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.296756 15250 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:55.268551 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.297601 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.297991 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:55.298897 15325 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.261843 16862 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.304845 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.313697 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.131997 16882 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.311609 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.321982 15250 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:55.322275 15394 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:55.303663 16986 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.323027 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.323138 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.304078 16864 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.323102 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.327579 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.329175 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:55.306356 15241 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
W20260709 13:02:55.304519 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 86270.7us
I20260709 13:02:55.336503 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:55.337021 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.337730 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.338677 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.314364 16987 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:02:55.339191 16958 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.316483 16857 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:55.340462 15248 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:55.345980 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.346498 16857 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.326714 16986 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:55.344311 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 67477.7us
I20260709 13:02:55.346076 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:55.315004 16829 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:55.340504 15325 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:02:55.350144 15393 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:55.353457 16030 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 5: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:02:55.353428 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.353919 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.354205 15319 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
W20260709 13:02:55.350494 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55527.9us
I20260709 13:02:55.354776 15325 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:55.356703 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:55.359812 16990 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:55.360572 16990 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.363898 16990 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:55.367506 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.378821 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.379006 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.379530 15319 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:02:55.380704 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:55.333703 16864 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.379582 16024 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:02:55.381928 15393 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:55.082824 15391 rpcz_store.cc:276] 0709 13:02:52.604933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.031932 (+426999us) service_pool.cc:224] Handling call
0709 13:02:53.032270 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:53.729511 (+697241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:53.742739 (+ 13228us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.122486 (+379747us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.634104 (+511618us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:54.916447 (+282343us) log.cc:844] Serialized 14 byte log entry
0709 13:02:54.931669 (+ 15222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:54.941591 (+  9922us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:54.979266 (+ 37675us) raft_consensus.cc:1685] finished
0709 13:02:54.995764 (+ 16498us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.008006 (+ 12242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3429,"prepare.queue_time_us":373290,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":325656,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":13771,"thread_start_us":1299874,"threads_started":3,"wal-append.queue_time_us":754309}
I20260709 13:02:55.382421 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:55.354936 16829 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:55.355736 16986 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.387557 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.388839 15325 raft_consensus.cc:2376] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3. Re-sending same reply.
I20260709 13:02:55.351858 16762 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.393913 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:55.384994 16026 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:02:55.392107 15319 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:55.391644 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:02:55.389561 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 47573us
I20260709 13:02:55.403177 15289 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:02:55.404616 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 60494.8us
I20260709 13:02:55.391476 16829 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.406003 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.394384 16028 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:55.409622 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.412112 15248 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:55.413091 15249 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:55.413185 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.410346 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.392841 16984 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.409622 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.414093 15242 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 1.
I20260709 13:02:55.399032 15318 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:55.421015 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.423219 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:55.427479 16857 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:55.412850 16949 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.407135 16922 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.402623 16868 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:55.429469 16868 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:55.430656 16868 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.433492 16823 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:55.434882 16823 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:55.435325 16823 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:55.436360 16823 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.442771 16862 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:55.445245 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:55.445930 15391 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.447687 16876 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.450971 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.452430 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.453433 16917 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.455783 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.457111 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.457727 15395 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:02:55.395409 16972 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.459231 15395 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:55.459605 15325 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:55.460768 16972 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.437920 16823 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.467809 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.415693 16989 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:55.470464 16989 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.470954 16989 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:55.472867 16027 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:02:55.472798 16994 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:55.475855 15395 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:55.479122 16864 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:55.481670 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.488238 16905 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:55.491591 15322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 893) took 2107 ms (client timeout 1508 ms). Trace:
W20260709 13:02:55.492192 15322 rpcz_store.cc:269] 0709 13:02:53.384140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.387063 (+  2923us) service_pool.cc:224] Handling call
0709 13:02:55.491295 (+2104232us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002ee5d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:55.491484 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589267200}
I20260709 13:02:55.506764 15321 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.514644 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:55.522500 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:55.525408 16823 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:55.525920 16823 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:55.527177 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:55.528962 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:55.533967 15996 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:55.526352 16823 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.539033 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:55.547572 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:02:55.539314 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 183433us
I20260709 13:02:55.551931 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.552963 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:55.565541 15213 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.565812 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.564431 16922 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.568552 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:55.568761 16922 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.569149 16922 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.556322 15291 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:55.538699 16994 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.569343 16998 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.569576 16993 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:55.573127 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.569959 16996 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:55.582295 15241 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:02:55.574815 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.583957 15244 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:55.575380 16958 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:55.577239 16745 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:55.578548 16837 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.570134 15291 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:55.544178 16992 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.544730 16969 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:55.570478 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.556915 16917 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:55.571471 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:55.599349 15245 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:55.599160 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.581282 16998 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:55.567782 16864 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.544559 16770 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.570254 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:55.613497 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.587811 15248 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:55.524165 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:55.588160 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:55.589483 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.623911 15390 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:55.589816 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.624110 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.591190 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.592821 16909 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.597121 16986 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.602351 15321 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:55.567978 16949 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.610095 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.611343 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:55.608357 16922 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.540036 16972 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:02:55.627883 15390 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:55.635138 15395 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:55.587159 16992 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:55.631544 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:55.641444 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 236075us
I20260709 13:02:55.641927 15245 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:55.598464 16958 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.615238 16770 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:55.587448 16969 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:02:55.637108 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45984.9us
I20260709 13:02:55.609587 16917 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:55.612998 16998 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.636464 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:55.638438 16993 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.623131 16864 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.622884 15391 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:55.681751 16917 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.627094 16837 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.634719 16949 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:55.639490 16863 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:55.639727 16996 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.643309 16958 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.634838 16995 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:55.675160 16969 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:55.687456 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60683.4us
I20260709 13:02:55.643196 16992 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:55.633960 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 217634us
W20260709 13:02:55.689282 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 52939.2us
I20260709 13:02:55.719512 15323 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:55.720024 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:55.721146 15323 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:55.689857 15215 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:55.639181 16754 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:02:55.722091 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:55.631376 16923 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:55.723459 15291 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:55.723774 16876 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:55.724197 16876 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:55.724407 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:55.725008 16905 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.725421 16905 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.725745 16905 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.705294 16837 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:55.728528 16837 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.640950 16829 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.707232 16949 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.731395 16754 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:55.732405 16754 consensus_queue.cc:1243] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:55.723357 16923 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.733397 16923 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.688905 16770 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.738799 15317 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:55.724570 16876 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:55.742926 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:55.745417 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:55.692518 16840 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:02:55.746707 16840 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:55.723392 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:55.747058 16994 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.747558 16994 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:55.747927 16994 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.748415 17001 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.748685 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 1791) took 1112 ms. Trace:
I20260709 13:02:55.748919 17001 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.749140 15320 rpcz_store.cc:276] 0709 13:02:54.637427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.682010 (+ 44583us) service_pool.cc:224] Handling call
0709 13:02:55.748525 (+1066515us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400374e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:55.748627 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287068416}
I20260709 13:02:55.749492 17001 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.752493 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 898) took 1118 ms. Trace:
I20260709 13:02:55.752964 15318 rpcz_store.cc:276] 0709 13:02:54.633782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.421044 (+787262us) service_pool.cc:224] Handling call
0709 13:02:55.421430 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.421680 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.421745 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.422308 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.631608 (+209300us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:55.634250 (+  2642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.643240 (+  8990us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.752246 (+109006us) raft_consensus.cc:1685] finished
0709 13:02:55.752278 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.752431 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":200208,"threads_started":1,"wal-append.queue_time_us":270525}
I20260709 13:02:55.732955 16829 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.747835 15215 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:55.755364 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 273958us
I20260709 13:02:55.756342 16997 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.756629 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:55.757292 16995 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.729112 16958 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.759223 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1886) took 1144 ms. Trace:
I20260709 13:02:55.759620 15392 rpcz_store.cc:276] 0709 13:02:54.615029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.644363 (+ 29334us) service_pool.cc:224] Handling call
0709 13:02:54.644657 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.008083 (+363426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.008130 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.008204 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:55.008249 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.758976 (+750727us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54001964d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:55.759023 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.759160 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835192192}
I20260709 13:02:55.761595 16986 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.762298 16986 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:55.762698 16986 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:55.763550 16922 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:55.764158 16922 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:55.764467 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:55.764670 16947 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:55.765120 16947 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:55.765528 16947 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.766790 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:55.756774 16997 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:55.767933 16997 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.701996 16993 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:55.707439 16863 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:55.782501 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92142.2us
I20260709 13:02:55.790650 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.791694 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:55.792303 15392 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.822276 15242 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:55.822985 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.824254 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.741838 16989 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.764501 16922 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.788152 16999 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:55.747079 16840 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:55.776721 16993 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:55.794870 16863 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:55.839854 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 117793us
I20260709 13:02:55.763453 16986 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.729000 16992 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.855751 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1795) took 1133 ms. Trace:
I20260709 13:02:55.836598 16922 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.848390 16993 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.860253 16857 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.960094 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 899) took 1326 ms. Trace:
I20260709 13:02:55.960561 15319 rpcz_store.cc:276] 0709 13:02:54.634046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.424605 (+790559us) service_pool.cc:224] Handling call
0709 13:02:55.425011 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.425447 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.425474 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.426106 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.692257 (+266151us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:55.692296 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.692731 (+   435us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.959841 (+267110us) raft_consensus.cc:1685] finished
0709 13:02:55.959863 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.960028 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":165669,"threads_started":1,"wal-append.queue_time_us":341701}
I20260709 13:02:55.830569 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:55.719550 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:02:55.963726 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 244252us
I20260709 13:02:55.964762 16905 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.827160 17007 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:55.967402 17007 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.862840 15321 rpcz_store.cc:276] 0709 13:02:54.722532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.633411 (+910879us) service_pool.cc:224] Handling call
0709 13:02:55.633794 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.637621 (+  3827us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:55.701525 (+ 63904us) log.cc:844] Serialized 14 byte log entry
0709 13:02:55.855365 (+153840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.855426 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:55.855469 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.855540 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.855688 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17879,"prepare.queue_time_us":222032,"thread_start_us":189951,"threads_started":2}
I20260709 13:02:55.937846 17012 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:55.943519 16998 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.971496 16998 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:55.955678 16969 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.957265 16994 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.960896 16949 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:55.850399 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:02:55.981757 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 131467us
I20260709 13:02:55.982311 15392 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:55.983551 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:55.988317 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:55.965801 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:55.995283 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:55.969110 16876 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:55.975592 16862 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.008746 15322 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:55.979532 16868 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:55.981699 16829 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:55.991259 17012 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:56.016253 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:56.026696 15392 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:56.021651 16862 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.030990 16862 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:56.034507 16997 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.036948 16997 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.041167 16863 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.053931 16972 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.042881 16949 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.043794 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:56.043805 16989 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.045003 16990 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:55.518188 15132 catalog_manager.cc:5028] TS 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): tablet f537e87ec99a4032a677e62627c567e2 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
I20260709 13:02:56.047680 15148 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 1 to 2, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 2 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:56.048789 16762 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.049553 16923 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.049923 15147 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49186 (request call id 214) took 5629 ms. Trace:
I20260709 13:02:56.018756 16829 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.033897 16837 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.050498 16754 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:56.055266 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:56.058512 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:55.976133 16840 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:56.060323 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 335960us
W20260709 13:02:56.068341 15132 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 550157us
I20260709 13:02:56.053615 16770 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.070051 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.000012 16986 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.063124 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.085588 15392 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.089058 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.089530 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:56.062597 16868 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:55.970119 16947 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.098618 16994 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.098893 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.099905 16992 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:56.100446 16947 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:56.100895 17004 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.157s	user 0.001s	sys 0.002s
I20260709 13:02:56.090716 16864 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:56.101153 16947 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:56.087917 16905 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:56.082137 15324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 1787) took 1465 ms (client timeout 1716 ms). Trace:
I20260709 13:02:56.102571 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1623) took 1073 ms. Trace:
I20260709 13:02:56.103127 15394 rpcz_store.cc:276] 0709 13:02:55.029570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.148585 (+119015us) service_pool.cc:224] Handling call
0709 13:02:56.102405 (+953820us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b5400154fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:56.102510 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142891904}
W20260709 13:02:56.105705 17011 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:02:56.101181 16969 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.084499 15393 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.107637 16770 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.069698 15147 rpcz_store.cc:276] 0709 13:02:50.420513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.437819 (+ 17306us) service_pool.cc:224] Handling call
0709 13:02:56.049827 (+5612008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:53.701606 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:54.188388 (+486782us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:54.193034 (+  4646us) write_op.cc:435] Acquired schema lock
0709 13:02:54.198832 (+  5798us) tablet.cc:662] Decoding operations
0709 13:02:54.280125 (+ 81293us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:54.293959 (+ 13834us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:54.299495 (+  5536us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:02:54.434838 (+135343us) tablet.cc:701] Row locks acquired
0709 13:02:54.434866 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:02:54.459754 (+ 24888us) write_op.cc:270] Start()
0709 13:02:54.464802 (+  5048us) write_op.cc:276] Timestamp: P: 1783602174458486 usec, L: 0
0709 13:02:54.473969 (+  9167us) op_driver.cc:348] REPLICATION: starting
0709 13:02:54.503715 (+ 29746us) log.cc:844] Serialized 921 byte log entry
0709 13:02:55.020659 (+516944us) op_driver.cc:464] REPLICATION: finished
0709 13:02:55.237792 (+217133us) write_op.cc:301] APPLY: starting
0709 13:02:55.238810 (+  1018us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:55.248607 (+  9797us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:55.257889 (+  9282us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:55.264311 (+  6422us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:55.264472 (+   161us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:02:55.264520 (+    48us) write_op.cc:312] APPLY: finished
0709 13:02:55.264731 (+   211us) log.cc:844] Serialized 29 byte log entry
0709 13:02:55.264895 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:55.264979 (+    84us) write_op.cc:454] Released schema lock
0709 13:02:55.265024 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:55.715642 (+450618us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf5e28 00007f366d630581 00007f366d62fd58 00007f366d6349f1 00007f366d6349a9 00007f366d634939 00007f366d634901 00007f366d633b2d 000000000038f354 000000000038f199
0709 13:02:55.715897 (+   255us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:55.715930 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":162174,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":198851,"apply.run_cpu_time_us":2259,"apply.run_wall_time_us":31023,"num_ops":2,"prepare.queue_time_us":997679,"prepare.run_cpu_time_us":40538,"prepare.run_wall_time_us":2036655,"raft.queue_time_us":362742,"raft.run_cpu_time_us":9134,"raft.run_wall_time_us":89306,"replication_time_us":542057,"spinlock_wait_cycles":5165440,"thread_start_us":1121070,"threads_started":4,"wal-append.queue_time_us":128872}]]}
I20260709 13:02:56.110322 17018 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:56.110673 15398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 73) took 1427 ms (client timeout 1811 ms). Trace:
I20260709 13:02:56.110769 17018 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:56.111078 16857 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.010211 16917 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.061671 16958 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.113250 16917 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:56.060940 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 95216.3us
I20260709 13:02:56.113768 16958 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.075723 16754 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:56.115042 16754 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:56.074713 16829 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:56.091771 16868 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:56.118713 16868 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:56.120554 16882 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.122049 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1884) took 1532 ms. Trace:
I20260709 13:02:56.122486 15399 rpcz_store.cc:276] 0709 13:02:54.589266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.640218 (+ 50952us) service_pool.cc:224] Handling call
0709 13:02:54.680306 (+ 40088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:54.697210 (+ 16904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.697256 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:54.697316 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:54.697360 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.121824 (+1424464us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54001545d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:56.121869 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.121992 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38237568}
I20260709 13:02:56.055830 16823 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:56.124708 15132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9e997bc5c2942178cde4c670df97100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 45ddec37d9e741a598bf32f6c9d7e0ee is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:56.125146 16823 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.125481 17017 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:56.126657 16840 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:56.126942 17017 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:56.127511 17017 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:56.128844 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:56.128579 17017 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.131947 16837 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:56.133021 16864 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:56.133337 16996 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.133603 16864 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.134548 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.135125 15396 raft_consensus.cc:2376] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5. Re-sending same reply.
I20260709 13:02:56.089668 15397 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.136013 16864 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:56.098373 15317 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:56.102655 16863 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.111248 17018 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.140934 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.142341 16681 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:56.142839 16681 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:56.077296 16972 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:56.146013 16876 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:56.015187 17001 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:56.111130 15398 rpcz_store.cc:269] 0709 13:02:54.683384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.683565 (+   181us) service_pool.cc:224] Handling call
0709 13:02:56.110459 (+1426894us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400270954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:56.110574 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590843264}
W20260709 13:02:56.149128 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 501848us
I20260709 13:02:56.150521 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.093117 15247 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:56.146477 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 902) took 1509 ms. Trace:
I20260709 13:02:56.153265 15322 rpcz_store.cc:276] 0709 13:02:54.636891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.563002 (+926111us) service_pool.cc:224] Handling call
0709 13:02:55.563442 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.012710 (+449268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.146251 (+133541us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54003e35d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:56.146425 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023487744}
I20260709 13:02:56.151499 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:56.082659 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 233562us
I20260709 13:02:56.158871 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:02:56.102284 15324 rpcz_store.cc:269] 0709 13:02:54.617097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.643078 (+ 25981us) service_pool.cc:224] Handling call
0709 13:02:56.055065 (+1411987us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:02:56.082047 (+ 26982us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5076736}
I20260709 13:02:56.164933 15393 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:56.166558 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:56.168828 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.172919 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:56.174979 15392 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:56.126978 16914 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.086186 16990 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:56.166108 16958 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.179607 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.184639 15396 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.148272 17001 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.152073 17017 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.191305 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:02:56.183753 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 209128us
W20260709 13:02:56.183988 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.188658 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.162729 16972 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:56.194965 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.196676 15213 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.177634 17018 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.205575 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.186650 16837 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:56.221223 15213 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:56.183126 16996 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:56.225215 15396 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:56.227777 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:02:56.243847 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 248659us
I20260709 13:02:56.230545 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.232686 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.233319 16997 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:56.234542 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.234997 16991 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:56.235939 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.237308 16998 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:56.237998 15244 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:56.228925 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.276235 15242 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:02:56.273403 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.238752 17001 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:56.197149 16989 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:56.262148 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:02:56.282786 15362 connection.cc:256] RPC call timeout handler was delayed by -1.0839144399999441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 13:02:56.283715 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 65698.7us
I20260709 13:02:56.265600 15321 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:56.285413 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 260268us
I20260709 13:02:56.287058 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:56.288673 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:56.288879 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.238081 16995 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:56.203517 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.202378 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:56.215521 16864 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:56.190907 16958 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.248481 15397 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:56.296592 15248 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:56.306871 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.307996 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.309106 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.298192 15249 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:56.310662 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 1819) took 1026 ms. Trace:
W20260709 13:02:56.311003 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 89823.1us
I20260709 13:02:56.312342 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:02:56.283370 15362 connection.cc:256] RPC call timeout handler was delayed by -1.0804792979998865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 13:02:56.267935 16837 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:56.302152 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.296833 15363 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:56.314582 15215 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:56.310122 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.311064 15325 rpcz_store.cc:276] 0709 13:02:55.284508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.396492 (+111984us) service_pool.cc:224] Handling call
0709 13:02:56.310497 (+914005us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b54000fb9d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:56.310609 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96084864}
I20260709 13:02:56.282167 17001 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.326639 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.322788 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.292650 16823 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:56.327898 15244 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.327906 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.328603 15242 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:56.327364 15249 raft_consensus.cc:2376] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3. Re-sending same reply.
I20260709 13:02:56.285977 16989 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:56.300328 16759 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.341135 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:56.284777 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.348129 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:56.351694 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.352746 15245 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:56.300645 17021 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:56.354687 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:56.355398 15316 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:56.356369 15316 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:56.360644 16032 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:02:56.303848 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 85114.5us
I20260709 13:02:56.369194 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.357445 15316 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.338536 17001 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.323388 16999 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:56.342823 16989 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.371443 15316 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:56.326870 16770 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:56.380961 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:56.381268 16031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 466) took 2493 ms (client timeout 2606 ms). Trace:
I20260709 13:02:56.373251 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:56.374972 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 62772.3us
I20260709 13:02:56.327880 16923 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.342479 16992 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:56.377292 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.278409 16990 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.378062 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.363814 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:56.389120 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 74610.9us
I20260709 13:02:56.390169 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:56.383809 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:56.354576 16949 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:02:56.381786 16031 rpcz_store.cc:269] 0709 13:02:53.881829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.882760 (+   931us) service_pool.cc:224] Handling call
0709 13:02:54.784901 (+902141us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:02:56.375054 (+1590153us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540043b2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:56.375206 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3571775232}
I20260709 13:02:56.358814 16823 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:56.322607 16028 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:56.316514 16864 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.389827 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.393361 15215 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:56.370069 16995 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:56.343564 17025 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:56.361786 17035 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:56.408043 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:56.400048 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.410998 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:56.411213 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:56.380570 16986 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:56.380987 16770 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:56.404927 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.407284 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:56.413153 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:56.395855 16987 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:56.401188 16949 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:56.432704 17035 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.434943 16949 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.436419 17035 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:56.437032 17035 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:56.437665 17035 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:56.438277 16986 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.397994 17033 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:56.438825 17033 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:56.439196 17033 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.355973 16972 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.399722 16878 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:56.394804 16922 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.443344 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:02:56.448210 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66087.3us
I20260709 13:02:56.452965 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.408311 17025 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.471122 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.445575 16986 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:56.443301 16906 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.483435 15321 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:56.511719 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68456.3us
I20260709 13:02:56.480976 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.512609 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.480520 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:56.414220 16969 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:02:56.513166 15324 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.395292 16993 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.513751 15322 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:56.431847 16862 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:02:56.451057 16837 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.441843 17034 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:02:56.517557 17023 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:02:56.442024 17036 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:56.449342 16992 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:02:56.449285 16987 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:02:56.518914 17013 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.461s	user 0.000s	sys 0.004s
I20260709 13:02:56.519675 16987 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.521492 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.516731 17022 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:56.522298 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:56.448807 16996 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:56.530393 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:02:56.527016 17030 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:02:56.512874 17015 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:02:56.534597 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:02:56.538767 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 138439us
I20260709 13:02:56.479727 17025 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.542083 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:56.432638 16863 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:02:56.485065 17018 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:56.510524 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:56.552802 15247 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:56.514870 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.484117 16958 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:56.521835 16991 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:56.528079 16908 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.568583 16908 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.571121 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.572520 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.573163 15243 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:56.458034 16829 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.575140 16922 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.575459 15250 raft_consensus.cc:2368] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:02:56.480849 16770 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.577427 16829 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:56.535188 16996 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:02:56.579057 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.553587 16923 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:02:56.580158 15321 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:02:56.573995 16986 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:56.562505 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 147368us
I20260709 13:02:56.458077 16878 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:56.540174 17036 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:56.581324 15249 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:56.581832 17036 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.583647 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.584832 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.585409 16878 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.587026 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:56.587478 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.588694 17042 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:56.589440 17042 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.590281 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:56.591264 17042 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.592351 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:56.592681 16986 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.593677 17042 raft_consensus.cc:2764] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:56.594611 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.598735 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 915) took 1486 ms. Trace:
I20260709 13:02:56.601473 15317 rpcz_store.cc:276] 0709 13:02:55.158146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.739751 (+581605us) service_pool.cc:224] Handling call
0709 13:02:55.740065 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.138527 (+398462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.598417 (+459890us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54001e5ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:56.598648 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802324352}
I20260709 13:02:56.602615 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:56.551273 16748 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:56.552030 16862 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:56.610349 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 64725.2us
I20260709 13:02:56.559365 16947 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:56.611227 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:56.615372 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.620049 15321 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:56.559243 17034 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:56.617878 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.622169 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.563102 17022 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:56.626576 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:56.539665 17043 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.607808 16996 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:56.631630 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.632134 15316 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:02:56.632282 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.625658 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.632922 15321 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:56.633252 15319 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:56.624748 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.633543 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:56.542968 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.630676 15392 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:56.636054 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.632503 15316 pending_rounds.cc:85] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 2
I20260709 13:02:56.636955 15316 pending_rounds.cc:107] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:02:56.637310 15316 raft_consensus.cc:2889] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:56.611020 17042 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:56.644847 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:56.638132 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 905) took 2000 ms. Trace:
I20260709 13:02:56.639324 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:56.640545 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.648092 15397 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:56.640590 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:56.642195 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:56.535298 16823 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.611343 16862 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:56.609237 16748 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:56.619427 16947 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:56.643579 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.646193 15316 rpcz_store.cc:276] 0709 13:02:54.637670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.632885 (+995215us) service_pool.cc:224] Handling call
0709 13:02:55.643777 (+ 10892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.355283 (+711506us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b54003b86a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfc1c0 00007f3669bfd231 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c
0709 13:02:56.637913 (+282630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.638070 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71140224}
I20260709 13:02:56.652534 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.663717 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:56.664155 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.664726 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:56.664959 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.654428 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.665318 15316 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:56.655735 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.657089 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:56.657449 15321 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:02:56.666200 15398 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:56.660758 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.662428 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.627511 17014 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:56.663080 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.670121 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.672344 15392 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:56.574121 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.675573 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:56.676517 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.681289 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.669306 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:56.682607 15322 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.663123 15395 raft_consensus.cc:2376] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3. Re-sending same reply.
I20260709 13:02:56.674577 15319 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:56.658118 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:56.685454 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.687134 15399 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:56.610410 16754 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:56.657974 16909 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:02:56.690384 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.528290 16999 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.691887 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:56.541110 16995 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:56.696053 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:56.661792 16748 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:56.658524 16862 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:56.668566 15324 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:56.706121 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:56.709795 15321 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:56.704945 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:56.710419 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49759.9us
I20260709 13:02:56.711831 15321 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:56.712388 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.713011 15321 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:56.714128 15321 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:56.715042 17045 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:56.717224 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.674845 16863 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.674216 17014 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:56.723196 15324 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:56.720640 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.724884 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:56.692672 17042 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:56.691150 16986 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:56.747928 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:56.700949 16864 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:56.739108 16840 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.000s
I20260709 13:02:56.740206 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1606) took 1656 ms. Trace:
I20260709 13:02:56.740283 16993 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:56.741657 17014 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.690442 17021 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:56.695140 16984 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:56.696797 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:56.740840 16947 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.718204 16917 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:56.720467 17018 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.704315 17027 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:56.760514 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:56.762868 16991 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:56.802783 17007 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:56.737047 16914 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:56.741912 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:56.806350 15244 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:56.759303 15317 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:56.816675 15248 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:56.803809 16762 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.886299 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.887419 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:56.895375 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:56.897269 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 198270us
W20260709 13:02:56.702606 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 173912us
I20260709 13:02:56.764066 16994 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:56.855504 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:02:56.937902 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 177485us
I20260709 13:02:56.863484 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.930713 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:56.684319 17041 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.200s
I20260709 13:02:56.875655 16991 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:56.896265 15247 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:56.942214 15996 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:56.898043 16947 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:56.892026 17007 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:56.946448 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:56.746116 16974 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:02:56.878618 16762 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:56.968642 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:02:56.943997 16868 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.825s	user 0.012s	sys 0.003s
I20260709 13:02:56.858155 17027 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:57.039264 17051 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:02:57.045037 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:56.740315 17034 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.055779 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:02:56.980969 17042 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:57.060472 15363 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:57.061020 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 92496us
I20260709 13:02:57.058854 16984 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:56.739746 17022 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:57.062387 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 435870us
I20260709 13:02:57.081821 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:57.026587 17039 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:57.068606 15365 leader_election.cc:336] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.953s (SENT)
I20260709 13:02:57.083129 15365 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:02:57.061969 17028 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.318s	user 0.000s	sys 0.001s
W20260709 13:02:57.078751 16949 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.002s	sys 0.033s
I20260709 13:02:57.087826 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:57.090219 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:02:57.049600 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 74507.3us
I20260709 13:02:57.088598 16032 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:02:57.083791 16754 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.095763 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:57.101855 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:02:57.087858 16949 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.003s	sys 0.033s
W20260709 13:02:57.090590 16972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.000s
I20260709 13:02:57.116472 17027 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:56.970362 17021 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.091529 15317 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:57.126111 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 57562.7us
I20260709 13:02:57.064507 16868 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.092558 17039 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.121984 17061 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:02:57.120986 16972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.008s	sys 0.001s
I20260709 13:02:57.108968 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:57.112226 16998 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:57.086536 17053 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:57.123785 16754 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:57.084744 17042 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:57.145757 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 64082.2us
I20260709 13:02:57.146601 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:57.084306 16991 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.133852 17039 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:57.159936 15322 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
W20260709 13:02:57.146631 16681 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.003s	user 0.008s	sys 0.005s
I20260709 13:02:57.143988 17062 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:57.151477 16864 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:57.170807 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:57.152686 16745 raft_consensus.cc:2764] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:02:57.171335 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:02:57.171792 17033 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.000s
I20260709 13:02:57.174456 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:57.164463 15243 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:57.180500 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:57.154412 16754 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:02:57.166658 16882 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.046s	user 0.011s	sys 0.002s
I20260709 13:02:57.187413 15390 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:02:57.163615 16951 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:57.163511 17053 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:02:57.198973 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.202912 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.208499 15316 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:57.191129 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:56.802838 15246 rpcz_store.cc:276] 0709 13:02:55.084070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.085529 (+  1459us) service_pool.cc:224] Handling call
0709 13:02:56.132858 (+1047329us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800132698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5eee 0000000000375939 00007f366eb491e0 00007f366ec120c4 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:02:56.133028 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.133271 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:56.304596 (+171325us) log.cc:844] Serialized 14 byte log entry
0709 13:02:56.598173 (+293577us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b18002bf5a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:02:56.739791 (+141618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:56.739870 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:56.739919 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.739997 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.740142 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24330,"prepare.queue_time_us":151217,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":22827,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":43787904,"thread_start_us":257787,"threads_started":2,"wal-append.queue_time_us":556009}
I20260709 13:02:57.178680 16974 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:57.164937 16681 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.168000 17027 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:02:57.219135 16032 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:57.219833 15318 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:57.213933 16998 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:57.230346 15396 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:57.213845 16762 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.213791 16923 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.216030 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:57.178705 17062 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.144907 17061 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.187903 17033 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:57.241111 17058 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:02:57.238317 17071 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:57.242852 17071 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.243234 17071 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:57.226351 16823 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:57.230147 16998 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:57.238364 17055 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.199s	user 0.001s	sys 0.001s
W20260709 13:02:57.245810 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 60906.9us
I20260709 13:02:57.223011 16951 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.246512 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:57.247134 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:57.233389 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:57.244331 16029 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:57.223222 16974 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.260063 15398 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:57.255020 16998 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.284456 17060 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.222045 16754 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:57.254815 17001 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.868s	user 0.009s	sys 0.003s
I20260709 13:02:57.238176 17062 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:57.253072 16989 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.862s	user 0.005s	sys 0.007s
W20260709 13:02:57.290917 17025 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.001s
I20260709 13:02:57.238451 17066 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:57.255517 16823 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:57.240451 16923 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.238555 17070 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:57.240384 17063 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:57.249038 17068 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:02:57.319633 16984 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:57.360760 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 879) took 1052 ms. Trace:
I20260709 13:02:57.320003 17062 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:02:57.309785 17001 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.322304 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1626) took 1006 ms. Trace:
I20260709 13:02:57.317420 16989 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.331522 17070 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:02:57.355129 16996 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.005s
I20260709 13:02:57.354120 17027 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:57.321102 17066 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:57.247227 17053 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.317660 17025 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.371119 15249 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:57.358135 17042 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:57.390331 17072 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:02:57.330659 17060 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.392449 17074 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.392820 16989 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.357858 17063 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:57.387573 16862 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.001s
I20260709 13:02:57.370751 15246 rpcz_store.cc:276] 0709 13:02:56.314484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.235259 (+920775us) service_pool.cc:224] Handling call
0709 13:02:57.254961 (+ 19702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.291924 (+ 36963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.294928 (+  3004us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.296516 (+  1588us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:57.307189 (+ 10673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.314680 (+  7491us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.320986 (+  6306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:57.383080 16882 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.390661 15242 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:57.404022 17063 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:57.390913 17017 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.192s	user 0.013s	sys 0.000s
I20260709 13:02:57.381158 16681 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:57.376829 17070 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:57.414121 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 874) took 1107 ms. Trace:
I20260709 13:02:57.419996 16024 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:57.393046 17074 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.422968 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:57.424830 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:57.383569 17066 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:57.425727 15245 rpcz_store.cc:276] 0709 13:02:56.306560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.404548 (+ 97988us) service_pool.cc:224] Handling call
0709 13:02:57.413832 (+1009284us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400315954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:57.414040 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376220032}
I20260709 13:02:57.431571 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:57.421229 15148 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49174 (request call id 238) took 6244 ms. Trace:
I20260709 13:02:57.405259 15243 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:57.380967 16996 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:57.455102 17069 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:02:57.454911 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:57.447824 15241 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
W20260709 13:02:57.448515 17073 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:02:57.455926 17061 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.449779 17063 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:57.457562 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:57.458468 16984 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.458982 17025 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.432554 15148 rpcz_store.cc:276] 0709 13:02:51.176564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.176839 (+   275us) service_pool.cc:224] Handling call
0709 13:02:51.415682 (+238843us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b64090 00007f3669c02f3a 00007f366f9b91cc 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc 00007f366df77392 00007f3667f3548c 00007f3667f348c6
0709 13:02:57.421147 (+6005465us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:56.142355 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:56.142906 (+   551us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:56.142943 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:02:56.142962 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:56.143293 (+   331us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:56.143346 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:56.143375 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:56.143571 (+   196us) tablet.cc:701] Row locks acquired
0709 13:02:56.143587 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:02:56.143738 (+   151us) write_op.cc:270] Start()
0709 13:02:56.143856 (+   118us) write_op.cc:276] Timestamp: P: 1783602176143691 usec, L: 0
0709 13:02:56.143879 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:02:56.144465 (+   586us) log.cc:844] Serialized 544 byte log entry
0709 13:02:56.274243 (+129778us) op_driver.cc:464] REPLICATION: finished
0709 13:02:56.484640 (+210397us) write_op.cc:301] APPLY: starting
0709 13:02:56.511472 (+ 26832us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:56.534259 (+ 22787us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:56.548141 (+ 13882us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:56.548422 (+   281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:56.548587 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:56.548632 (+    45us) write_op.cc:312] APPLY: finished
0709 13:02:56.548860 (+   228us) log.cc:844] Serialized 23 byte log entry
0709 13:02:56.549039 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:56.549119 (+    80us) write_op.cc:454] Released schema lock
0709 13:02:56.549160 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:56.549537 (+   377us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:56.549569 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":293355,"reported_tablets":5,"spinlock_wait_cycles":540680576,"child_traces":[["op",{"apply.queue_time_us":176780,"apply.run_cpu_time_us":2016,"apply.run_wall_time_us":91046,"num_ops":1,"prepare.queue_time_us":189,"prepare.run_cpu_time_us":2469,"prepare.run_wall_time_us":58750,"replication_time_us":130191,"thread_start_us":87157,"threads_started":1}]]}
I20260709 13:02:57.459813 17001 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.462282 17071 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.463032 17074 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.428004 17039 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:57.465570 16748 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.001s
W20260709 13:02:57.433862 17065 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:02:57.466480 17033 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.383756 17027 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:57.448900 17059 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:02:57.469386 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:02:57.431819 17064 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:02:57.426651 16868 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.405444 16862 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.449509 16974 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.488708 15245 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:57.391659 16823 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.416574 16882 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.452481 17041 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:57.489130 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1628) took 1172 ms. Trace:
I20260709 13:02:57.488299 16951 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.488555 17044 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:57.491544 17063 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:02:57.540614 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52365.4us
I20260709 13:02:57.524968 17026 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:57.525563 16681 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.546782 16031 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:57.508013 16748 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:57.549643 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 264699us
I20260709 13:02:57.552037 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:57.556368 16862 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:57.556874 16748 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:57.557250 17074 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:57.551082 16681 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.559190 15395 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:57.559743 16681 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.548034 17026 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:57.564057 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:57.570412 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:57.529120 15243 rpcz_store.cc:276] 0709 13:02:56.314879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.359665 (+1044786us) service_pool.cc:224] Handling call
0709 13:02:57.381470 (+ 21805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.454385 (+ 72915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.486864 (+ 32479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:57.566494 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:57.579831 15391 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:57.580945 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:57.584940 17026 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.576747 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:57.587901 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:57.586972 16681 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:57.587260 16862 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:57.590575 16748 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:57.565454 16868 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:57.589272 17075 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:57.638511 16759 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:57.570801 17082 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:57.626916 17079 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:02:57.614949 17063 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.637533 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:57.639709 15399 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:57.565701 17053 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.567349 17042 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:57.642395 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:57.660362 17053 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.661228 15390 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:57.662611 17053 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:57.662747 16882 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.656431 16868 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.642601 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:57.618010 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:57.619596 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1633) took 1285 ms. Trace:
I20260709 13:02:57.646967 17039 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.649212 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 888) took 1275 ms. Trace:
I20260709 13:02:57.685238 15246 rpcz_store.cc:276] 0709 13:02:56.334032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.430486 (+1096454us) service_pool.cc:224] Handling call
0709 13:02:57.448180 (+ 17694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.448425 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:57.526995 (+ 78570us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.618997 (+ 92002us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.619102 (+   105us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:57.619195 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.619305 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.619505 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":97022,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":138,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":115,"thread_start_us":137548,"threads_started":2,"wal-append.queue_time_us":89845}
I20260709 13:02:57.686429 15245 rpcz_store.cc:276] 0709 13:02:56.373721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.431873 (+1058152us) service_pool.cc:224] Handling call
0709 13:02:57.432165 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.527849 (+ 95684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.648954 (+121105us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b54004498d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:57.649151 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129601920}
I20260709 13:02:57.688269 15246 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:57.689141 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 152) took 1241 ms. Trace:
I20260709 13:02:57.689599 15246 rpcz_store.cc:276] 0709 13:02:56.447554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.687333 (+1239779us) service_pool.cc:224] Handling call
0709 13:02:57.687712 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.688838 (+  1126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.689080 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:57.638335 16969 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:57.690845 16969 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:57.691872 16969 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.693066 16969 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.644641 16862 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:57.694922 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:57.658507 17082 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.673988 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:57.675346 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:57.700497 16030 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:57.676487 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:57.676402 16998 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.646401 16996 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:57.666177 17014 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.821s	user 0.012s	sys 0.000s
I20260709 13:02:57.649777 17066 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.681169 15247 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:57.666563 17041 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:57.657239 16759 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:57.682840 17027 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.688288 15245 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:57.648875 17070 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:57.698992 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 56470.4us
I20260709 13:02:57.706126 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 151) took 1293 ms. Trace:
I20260709 13:02:57.706916 16032 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:57.712932 15247 rpcz_store.cc:276] 0709 13:02:56.412689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.680527 (+1267838us) service_pool.cc:224] Handling call
0709 13:02:57.680937 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.705773 (+ 24836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.706050 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:57.701097 17042 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:57.708220 17082 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.701221 17053 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:02:57.694461 16862 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:57.700903 16878 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:57.729964 16868 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:57.732412 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:57.712061 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 153) took 1262 ms. Trace:
I20260709 13:02:57.712245 15390 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:57.694769 16029 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:02:57.717236 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:57.720441 16748 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:57.720569 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:57.739792 17089 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:02:57.743240 16748 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:57.743691 16748 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:57.721182 17042 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:57.722373 17075 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:02:57.748648 17075 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:57.726434 16909 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:57.749063 17075 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:57.749356 16909 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.750218 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:57.728197 15243 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:57.723089 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 929) took 1066 ms. Trace:
I20260709 13:02:57.753587 15316 rpcz_store.cc:276] 0709 13:02:56.656691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.704653 (+ 47962us) service_pool.cc:224] Handling call
0709 13:02:57.722896 (+1018243us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400084654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:57.723033 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106876160}
I20260709 13:02:57.735136 15245 rpcz_store.cc:276] 0709 13:02:56.450218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.687702 (+1237484us) service_pool.cc:224] Handling call
0709 13:02:57.688073 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.711158 (+ 23085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.712004 (+   846us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:57.754792 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:57.755039 15245 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:57.750048 17075 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.744599 15318 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:57.757557 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 894) took 1152 ms. Trace:
I20260709 13:02:57.758097 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:57.759683 15245 rpcz_store.cc:276] 0709 13:02:56.605609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.754549 (+1148940us) service_pool.cc:224] Handling call
0709 13:02:57.754829 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.757132 (+  2303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.757481 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:57.727028 15246 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:57.739488 15393 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:57.747423 17066 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.747718 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:57.747941 16681 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:57.744720 16748 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.768765 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:57.769119 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:57.769441 16748 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.769665 15316 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:57.769765 15322 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:57.770395 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.771135 16028 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:57.725952 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:57.772454 15324 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:57.715998 16917 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.773265 16909 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.751246 15321 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:57.750386 17089 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.710312 17014 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.774580 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:57.773561 16917 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.787881 15325 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:57.777309 15322 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:57.775054 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:57.788527 15316 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:57.789959 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:57.731395 16908 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:02:57.773290 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:57.792882 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:02:57.794627 15248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 882) took 1485 ms (client timeout 1758 ms). Trace:
W20260709 13:02:57.795150 15248 rpcz_store.cc:269] 0709 13:02:56.309326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.309927 (+   601us) service_pool.cc:224] Handling call
0709 13:02:57.794452 (+1484525us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b540001e854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:57.794573 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144911744}
I20260709 13:02:57.780171 17075 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:57.801827 16996 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:57.797286 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1638) took 1119 ms. Trace:
I20260709 13:02:57.784915 16923 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.785920 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:57.791486 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:57.790565 17089 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:57.784775 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:57.804589 16998 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.808468 15394 raft_consensus.cc:2955] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:02:57.810874 17081 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.222s	user 0.003s	sys 0.000s
I20260709 13:02:57.804557 16997 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:57.803436 15317 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:57.805868 15321 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:02:57.820053 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 56804.9us
I20260709 13:02:57.818912 16997 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:57.805346 15391 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:57.826543 16997 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.807061 15318 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:02:57.792569 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1635) took 1315 ms. Trace:
I20260709 13:02:57.827850 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:57.828101 15246 rpcz_store.cc:276] 0709 13:02:56.477329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.706653 (+1229324us) service_pool.cc:224] Handling call
0709 13:02:57.726853 (+ 20200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.782042 (+ 55189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.790708 (+  8666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:57.828567 15318 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:57.829679 15246 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:02:57.803946 17070 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:57.805809 16862 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.803589 15248 rpcz_store.cc:276] 0709 13:02:56.678055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.796202 (+1118147us) service_pool.cc:224] Handling call
0709 13:02:57.796618 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.796864 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.796901 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.796956 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:57.796999 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.797070 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.797201 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:57.832119 17042 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:57.803377 17014 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.822889 17019 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:57.834652 17019 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:57.835613 17019 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.836792 17019 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:57.825490 15317 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:57.839569 15317 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:57.841338 16759 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:57.802338 16917 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:57.832563 17042 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:57.833180 16862 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:57.804593 15324 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:02:57.809978 17089 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:57.853940 15316 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
W20260709 13:02:57.922426 15242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1627) took 1607 ms (client timeout 1815 ms). Trace:
I20260709 13:02:57.966886 15322 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
W20260709 13:02:57.966722 15242 rpcz_store.cc:269] 0709 13:02:56.314678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.356230 (+ 41552us) service_pool.cc:224] Handling call
0709 13:02:57.922110 (+1565880us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400315454. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:57.922340 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310467968}
I20260709 13:02:57.930877 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 871) took 1625 ms. Trace:
I20260709 13:02:57.880204 15248 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:57.939417 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:57.968502 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:02:57.855427 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.968015 15249 rpcz_store.cc:276] 0709 13:02:56.305545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.596236 (+290691us) service_pool.cc:224] Handling call
0709 13:02:56.596535 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.384173 (+787638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.930626 (+546453us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540001f754. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:57.930813 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780930944}
I20260709 13:02:57.971114 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:57.931914 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:57.972020 15249 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:57.971949 15399 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:57.931058 15291 leader_election.cc:400] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:02:57.972990 15291 leader_election.cc:403] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:02:57.937419 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:57.980490 15244 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:57.861737 16969 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:57.984187 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53289.7us
I20260709 13:02:57.984616 16969 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.985195 16969 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:57.986583 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54753.4us
W20260709 13:02:57.987367 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.988195 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:57.971964 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:02:57.901341 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.989044 15398 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:57.880525 16759 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:57.991899 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:57.985260 16917 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:02:57.982453 16997 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:57.994213 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:57.861516 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 154) took 1004 ms. Trace:
I20260709 13:02:57.917105 17012 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:57.998093 15391 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:57.995522 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.001224 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.002885 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:57.880185 16906 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 13:02:58.003100 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.003584 16025 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:58.004362 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:57.994913 17043 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:58.005038 17043 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:58.005209 15242 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:58.005458 17043 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.009496 15324 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:02:58.009775 15320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 916) took 1369 ms (client timeout 1758 ms). Trace:
I20260709 13:02:57.989485 17053 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:02:58.011164 15320 rpcz_store.cc:269] 0709 13:02:56.640237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.640345 (+   108us) service_pool.cc:224] Handling call
0709 13:02:58.009537 (+1369192us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b54002193d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:58.009709 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927381248}
I20260709 13:02:57.886560 16836 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.109s
I20260709 13:02:57.999164 15246 rpcz_store.cc:276] 0709 13:02:56.850447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.829059 (+978612us) service_pool.cc:224] Handling call
0709 13:02:57.829403 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.830068 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.854485 (+ 24417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:57.899363 16876 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 13:02:58.020097 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.006111 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:58.014964 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 150) took 1602 ms. Trace:
I20260709 13:02:57.998838 17075 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:02:58.016955 15289 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.196:38543 timed out after 1.533s (SENT) [suppressed 23 similar messages]
I20260709 13:02:58.021575 16745 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:58.022095 16745 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:58.011902 16997 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:58.021173 15243 rpcz_store.cc:276] 0709 13:02:56.412338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.577402 (+1165064us) service_pool.cc:224] Handling call
0709 13:02:57.577895 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.756088 (+178193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.014693 (+258605us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540011a8d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:58.014896 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314227072}
I20260709 13:02:58.023439 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:57.998206 17042 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.024307 16997 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.026165 15399 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:02:58.026854 15399 pending_rounds.cc:85] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 1
I20260709 13:02:58.027089 15399 pending_rounds.cc:107] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:02:58.027318 15399 raft_consensus.cc:2889] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.027637 15247 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:58.024338 17042 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:58.028208 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 891) took 1423 ms. Trace:
I20260709 13:02:58.029424 15242 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:58.017047 16998 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.032421 15247 rpcz_store.cc:276] 0709 13:02:56.604740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.713641 (+1108901us) service_pool.cc:224] Handling call
0709 13:02:58.027279 (+313638us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800132698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:02:58.027465 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.028009 (+   544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.028157 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6540544}
I20260709 13:02:58.023494 16745 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.037112 16745 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.000639 17070 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:02:57.365265 15250 rpcz_store.cc:276] 0709 13:02:56.308265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.094798 (+786533us) service_pool.cc:224] Handling call
0709 13:02:57.113011 (+ 18213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.113325 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:57.309642 (+196317us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.360311 (+ 50669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:57.360386 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:57.360444 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.360532 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.360688 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1772,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":2263,"thread_start_us":227491,"threads_started":2}
I20260709 13:02:57.999902 17012 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:57.993914 16754 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:02:58.046904 17012 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.047771 16754 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.048134 17012 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:58.048266 16754 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:58.000069 16748 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:58.051793 15320 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:58.060235 16864 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:58.060909 16864 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:02:58.062695 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.060469 15397 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:58.049404 16917 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.063724 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1926) took 1208 ms. Trace:
I20260709 13:02:58.062111 16864 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.064442 17035 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.064085 15397 rpcz_store.cc:276] 0709 13:02:56.854986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.944429 (+ 89443us) service_pool.cc:224] Handling call
0709 13:02:58.060017 (+1115588us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:02:58.060258 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.063442 (+  3184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.063664 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6648064}
W20260709 13:02:58.067155 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.071630 15320 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:58.064869 17035 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:02:58.077502 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.076323 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:58.080446 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 63522.3us
I20260709 13:02:58.074170 15394 raft_consensus.cc:2955] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:02:58.064461 16864 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:58.086619 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.085704 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.092358 15323 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
W20260709 13:02:58.081063 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.103803 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:02:58.110075 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.110554 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.111299 15250 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:02:58.114701 15323 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:58.114701 15324 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:58.118201 15363 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:58.120944 16032 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:58.120379 17075 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:02:58.112660 16027 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:02:58.126962 17019 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:58.127668 17075 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:58.128026 17075 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:58.126881 16998 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:02:58.128844 17075 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.126816 16908 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:58.137272 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:58.131314 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:58.088523 16754 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.139524 17075 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:58.138748 16908 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:58.150943 17066 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
W20260709 13:02:58.154592 17099 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:02:58.160197 17043 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.162707 16754 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.165172 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 896) took 1559 ms. Trace:
I20260709 13:02:58.165629 15245 rpcz_store.cc:276] 0709 13:02:56.606154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.760798 (+1154644us) service_pool.cc:224] Handling call
0709 13:02:57.761234 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:57.761701 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:57.761743 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:57.784006 (+ 22263us) log.cc:844] Serialized 26 byte log entry
0709 13:02:57.899993 (+115987us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:57.900052 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.900155 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.164234 (+264079us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b2400155558. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f36669939c4 00007f3666991acb 00007f3666b4cdc9 00007f3666b4ca55 00007f3666b4bfb0 00007f36697c2488 00007f36697c2be8 00007f366979a398 00007f366979576a 00007f3669794bb6
0709 13:02:58.164871 (+   637us) raft_consensus.cc:1685] finished
0709 13:02:58.164889 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.165103 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8893,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":14875520,"thread_start_us":81037,"threads_started":1,"wal-append.queue_time_us":234423}
I20260709 13:02:58.143425 16681 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:58.138881 17035 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.153314 16025 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.200484 15399 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:58.201560 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:58.202986 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:58.204145 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:58.204022 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:58.203158 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1927) took 1344 ms. Trace:
I20260709 13:02:58.206198 15396 rpcz_store.cc:276] 0709 13:02:56.859086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.975553 (+116467us) service_pool.cc:224] Handling call
0709 13:02:57.030288 (+ 54735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.230764 (+200476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.202931 (+972167us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54004128d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:58.203093 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":459582208}
I20260709 13:02:58.207026 17071 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:58.207414 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:58.207803 17071 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:58.208499 17071 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.169224 16908 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.173704 16681 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:02:58.220229 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.222347 15396 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:58.222729 15397 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.225080 15396 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:02:58.219323 17104 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:02:58.230449 15399 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.233310 15397 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:58.222532 16681 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.236191 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.245014 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:58.245707 16024 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:58.247305 17080 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.699s	user 0.004s	sys 0.000s
I20260709 13:02:58.250862 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 152) took 1131 ms. Trace:
I20260709 13:02:58.251298 15325 rpcz_store.cc:276] 0709 13:02:57.119233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.119492 (+   259us) service_pool.cc:224] Handling call
0709 13:02:57.135986 (+ 16494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.788432 (+652446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.250606 (+462174us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54002a7bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:58.250796 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498722560}
I20260709 13:02:58.235164 16836 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:58.230058 16974 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:02:58.222142 16862 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:58.253873 16836 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.266873 16862 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.288201 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.301312 15321 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:58.306002 16997 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.302722 17071 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:58.301860 16906 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:02:58.304196 16878 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:02:58.353425 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65337.4us
W20260709 13:02:58.354600 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.366740 17109 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:02:58.370077 17116 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.370672 17116 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.327999 16969 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.350472 17066 consensus_queue.cc:1243] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:02:58.346136 15241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 865) took 2080 ms (client timeout 1605 ms). Trace:
I20260709 13:02:58.380786 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.362028 17040 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.394507 15321 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.396106 15318 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:58.397486 16025 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:02:58.398831 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:58.399107 16862 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:58.399672 16862 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:58.395785 17040 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.400194 16862 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:58.401324 16829 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:58.401255 16862 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.401906 17040 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:58.403910 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1932) took 1305 ms. Trace:
I20260709 13:02:58.404337 15393 rpcz_store.cc:276] 0709 13:02:57.098364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.452480 (+354116us) service_pool.cc:224] Handling call
0709 13:02:57.452765 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.763978 (+311213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.403700 (+639722us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54003d8bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:58.403854 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":658882944}
I20260709 13:02:58.402079 16829 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.391937 17066 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.411664 16829 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:58.412072 16836 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:58.412678 16836 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:58.411564 17066 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.413450 16829 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.413736 16998 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:58.416963 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:58.422049 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:58.424088 17066 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:58.413630 16836 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:58.414307 16998 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:58.400203 16024 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:02:58.430850 16969 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:58.433327 16770 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.428686 16908 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.435424 17068 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:58.435887 17068 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:58.436676 16908 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:58.427872 16836 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:58.436721 17068 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.438390 17068 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.438123 16836 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.438721 17026 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.439494 16836 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:58.439637 15363 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:58.441505 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:02:58.385793 15241 rpcz_store.cc:269] 0709 13:02:56.260881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.264690 (+  3809us) service_pool.cc:224] Handling call
0709 13:02:58.327852 (+2063162us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540011add4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:58.338687 (+ 10835us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2477736704}
I20260709 13:02:58.442178 16024 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.448544 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.428030 17040 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:58.449244 17040 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.449638 17040 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:58.452049 16681 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.443528 17116 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:58.443998 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:58.444288 16998 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.454026 16998 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:58.459398 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:58.454919 16908 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:58.467360 16681 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:58.469437 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.470016 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:58.457757 16754 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:58.473811 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.472541 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:58.476701 16031 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:02:58.476294 16823 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:02:58.479156 17067 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:58.459223 16974 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:02:58.479938 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.480186 16024 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:58.480387 16974 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.473109 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.482062 16754 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.482595 16974 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:58.483815 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.484212 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.484651 16754 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:58.485427 17070 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.472342 17053 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:58.487936 17078 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:02:58.488986 17078 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:58.489317 17078 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:58.489696 15322 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:02:58.490844 16823 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:58.491227 16823 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:58.492009 16823 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.493155 16823 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:58.494979 15390 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.495348 15390 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:58.496307 16032 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:58.496061 15390 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.497145 15390 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.490075 17078 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.501366 17078 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.502488 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.506243 15319 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:58.507519 17060 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:58.508227 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.508985 17067 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.509279 17020 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:58.509541 17067 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.503193 15363 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:58.505169 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:58.515028 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:58.518622 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 872) took 2212 ms. Trace:
I20260709 13:02:58.519045 15244 rpcz_store.cc:276] 0709 13:02:56.305839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.092499 (+786660us) service_pool.cc:224] Handling call
0709 13:02:57.123150 (+ 30651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:57.984152 (+861002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.518360 (+534208us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54001a86d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:58.518550 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1971212032}
I20260709 13:02:58.520866 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1659) took 1328 ms. Trace:
I20260709 13:02:58.521248 15392 rpcz_store.cc:276] 0709 13:02:57.192070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.610072 (+418002us) service_pool.cc:224] Handling call
0709 13:02:58.520224 (+910152us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:02:58.520393 (+   169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.520558 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.520582 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:58.520634 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:58.520663 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.520715 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.520814 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10168192}
I20260709 13:02:58.525091 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:58.525744 15394 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
W20260709 13:02:58.526230 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.526929 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:58.527974 15398 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:58.529745 15390 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:02:58.531726 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.534612 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.538125 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.539803 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:58.540380 15249 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:58.540527 16031 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:58.537859 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.541625 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.542963 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.543633 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:58.473274 16908 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:58.544632 15248 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:58.544909 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.547964 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.548099 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.548470 16974 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:58.548751 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.549063 17053 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:58.547976 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:02:58.601672 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 43918.3us
I20260709 13:02:58.549999 17019 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:02:58.551987 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:58.552074 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:58.552994 16024 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:58.553933 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:58.554549 17070 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:58.554467 17062 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:58.512850 17067 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:02:58.555296 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 52200.9us
W20260709 13:02:58.626152 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.626624 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.627228 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.555325 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:58.628741 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:58.555862 16031 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
W20260709 13:02:58.559075 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.556232 17060 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:02:58.632392 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.539522 17042 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:02:58.602216 17074 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:58.587836 15323 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:58.588402 15242 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:02:58.558786 15390 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:02:58.637701 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.589092 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:58.556731 16969 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:02:58.603468 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67612.1us
W20260709 13:02:58.595525 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49782us
I20260709 13:02:58.589879 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:58.642702 16033 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:58.605049 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:02:58.590286 15291 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.589498 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.607398 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:02:58.632431 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 240969us
I20260709 13:02:58.634955 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.563704 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.635155 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:58.647321 15250 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:58.574038 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:58.638414 15244 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:02:58.638360 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.648312 15242 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:58.605427 17070 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:58.645092 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:58.649217 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:58.651767 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 44470.7us
I20260709 13:02:58.603708 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:58.652570 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:58.585120 17123 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 13:02:58.655769 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:58.652661 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:58.657234 15242 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:58.635711 16862 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:58.659597 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 69404.8us
I20260709 13:02:58.660411 15291 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.665875 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:58.636631 17060 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:58.641484 16969 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.621004 17075 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:02:58.624855 16876 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:02:58.621263 17019 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:58.676816 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.675302 15247 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:02:58.667459 15241 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:58.639292 16681 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:02:58.635732 17040 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.693796 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.695318 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:58.695600 17040 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:58.695749 16994 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:58.696251 17040 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:58.696740 16974 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.697507 15390 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:58.682029 16969 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:58.702696 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:58.704231 15393 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:02:58.704661 15393 pending_rounds.cc:85] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 2
I20260709 13:02:58.704895 15393 pending_rounds.cc:107] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:02:58.705127 15393 raft_consensus.cc:2889] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.707729 15244 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:58.677948 16759 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:58.682334 17021 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:58.692939 15250 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:02:58.671973 17125 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.711460 15249 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:02:58.753185 15249 pending_rounds.cc:85] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 1
I20260709 13:02:58.753455 15249 pending_rounds.cc:107] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:02:58.706918 15390 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
W20260709 13:02:58.753615 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.671554 16995 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:02:58.721980 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65375.9us
I20260709 13:02:58.663839 16862 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.732137 17043 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:58.732934 15397 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.734282 17019 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:58.734342 17070 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.721786 17128 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:02:58.739243 17112 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:58.767423 17112 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:58.768291 16862 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:58.768414 17112 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.769862 17112 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:58.741425 17035 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.705658 16908 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.743070 17060 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.746342 16025 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:58.748476 15245 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:02:58.749099 16905 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.749831 16997 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:02:58.714212 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 61716.3us
I20260709 13:02:58.784734 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:58.648581 16754 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:02:58.754496 15249 raft_consensus.cc:2889] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.763280 15248 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:02:58.722128 17021 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.744941 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:02:58.775769 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:58.726296 17117 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.705549 17124 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:02:58.714709 17116 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:02:58.780267 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:58.791203 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:58.791442 15394 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:58.793639 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:58.790735 17021 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:58.802537 17117 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:58.802590 17116 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:58.804160 16028 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:02:58.810391 17078 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.810722 16969 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.810997 17078 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.815850 17020 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:58.816428 17020 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:02:58.828975 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 239562us
W20260709 13:02:58.832522 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 172189us
I20260709 13:02:58.784590 16905 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:58.784093 16997 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:58.802040 17124 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.837106 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.837653 15318 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:58.848308 16026 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:58.848876 17021 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:58.855764 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 180041us
I20260709 13:02:58.852681 16995 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:58.882350 16863 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.873402 16745 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.865181 16829 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:58.865244 17019 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:58.875790 17067 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:58.851140 17026 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 13:02:58.922494 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 85486.9us
I20260709 13:02:58.921411 16995 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:58.929551 15322 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:58.930058 16995 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.930531 16759 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.933660 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.916085 17019 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:58.935992 16759 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:58.935708 17019 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.936811 16969 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:58.937505 17019 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:58.927392 17135 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.913717 16829 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:58.952992 15322 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:58.921176 17078 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:58.955054 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:58.955637 15395 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:58.955856 15322 raft_consensus.cc:2368] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4.
W20260709 13:02:58.960438 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.961222 15241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:02:58.962189 15241 raft_consensus.cc:606] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:02:58.962692 15241 raft_consensus.cc:614] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:58.965355 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.967593 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.968407 15322 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:02:58.967593 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.972009 15250 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:58.972241 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:58.973605 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.975363 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.976109 15319 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:02:58.977804 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.979688 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:58.981163 15289 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:58.946897 17134 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.990144 15393 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:02:58.990844 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.982811 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:58.987875 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:58.996290 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:02:58.997118 15390 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.002566 15244 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:02:59.004740 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:59.005365 15244 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:02:58.915717 16745 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.918954 16863 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:58.948334 16862 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:58.994117 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 200539us
I20260709 13:02:59.009732 15390 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:02:59.007767 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:58.902895 16997 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:58.983417 16027 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:58.923607 17067 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.017516 15362 leader_election.cc:400] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4.
I20260709 13:02:59.023643 15362 leader_election.cc:403] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:02:59.013855 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.018287 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:59.026707 15250 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.015895 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:59.021811 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.009959 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:59.031214 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:59.011142 17078 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:59.032924 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:59.035192 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:59.041950 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.042953 15390 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:59.054862 16863 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:59.055606 16863 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:59.056766 15318 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:02:59.034653 16770 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.006s
I20260709 13:02:59.058878 15394 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:59.061810 16745 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:59.062263 15144 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 133) took 8353 ms. Trace:
I20260709 13:02:59.062654 15144 rpcz_store.cc:276] 0709 13:02:50.721248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.726980 (+  5732us) service_pool.cc:224] Handling call
0709 13:02:51.060344 (+333364us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b64090 00007f3669c02f3a 00007f366f9b91cc 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc 00007f366df77392 00007f3667f3548c 00007f3667f348c6
0709 13:02:59.062055 (+8001711us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":2788736}
I20260709 13:02:59.063077 16984 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.063393 16025 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:59.063661 16984 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.041720 16969 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:02:59.050526 16681 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:59.068023 16681 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:59.068461 16681 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:59.070619 16030 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:02:59.023259 16829 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.071133 17020 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.032373 17043 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4.
I20260709 13:02:59.072314 17020 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:59.073170 17067 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:59.073992 15321 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:59.076159 15392 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:59.077152 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.077879 15392 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:59.080103 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.080829 15391 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
W20260709 13:02:59.081956 16026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 404) took 1892 ms (client timeout 1533 ms). Trace:
I20260709 13:02:59.021034 16862 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:59.082557 16026 rpcz_store.cc:269] 0709 13:02:57.189282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.192028 (+  2746us) service_pool.cc:224] Handling call
0709 13:02:57.732245 (+540217us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5eee 0000000000375939 00007f366eb491e0 00007f366ec120c4 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:02:59.081754 (+1349509us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540041d2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:02:59.081870 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2492735616}
I20260709 13:02:59.083498 15391 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:59.082015 15396 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:59.084621 16862 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:59.041440 17078 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.069726 17112 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:59.086932 17078 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:59.087630 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 54786.1us
W20260709 13:02:59.090902 17101 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:02:59.032209 17149 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:59.047082 17062 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:59.046665 16997 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.011301 17134 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.042677 17153 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:59.167701 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 151885us
I20260709 13:02:59.163650 15250 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:02:59.090979 17124 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:59.142521 17139 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:59.159626 17121 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:02:59.177266 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88799.4us
I20260709 13:02:59.167814 17021 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:59.204490 15249 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:59.201015 15244 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:02:59.171101 17153 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:59.197386 16984 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:59.213734 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.216562 17134 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:02:59.223376 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.171103 16906 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:59.227852 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 196034us
I20260709 13:02:59.189788 17144 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 13:02:59.234264 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 118456us
W20260709 13:02:59.264863 15365 leader_election.cc:336] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.758s (SENT)
W20260709 13:02:59.265127 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 62505.9us
I20260709 13:02:59.209498 17153 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:59.227057 17140 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:02:59.206920 17121 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.271317 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:59.265882 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:59.265321 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:02:59.274845 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.265801 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.279148 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:59.280339 15392 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
W20260709 13:02:59.282684 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.280896 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.285025 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:59.270248 16906 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:02:59.287145 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:59.277719 17119 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:59.277907 16864 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:59.283686 17142 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.237s	user 0.002s	sys 0.000s
I20260709 13:02:59.266999 16990 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:02:59.295184 17141 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:02:59.297513 17150 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:02:59.298377 17160 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:02:59.300676 17078 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.302565 17133 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.334012 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:59.337689 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:59.338732 15321 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:02:59.347904 15320 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:59.303881 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:02:59.306437 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.290066 17124 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:02:59.307103 17040 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:59.355646 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:59.286600 17112 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:59.325613 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.357589 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.316205 16759 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:02:59.308005 16681 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.287941 15391 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:02:59.294458 17119 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.370350 17119 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:59.370528 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:59.371573 16681 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:59.372192 16984 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:59.372778 16984 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.373235 16984 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:59.363308 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:59.279450 17139 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:02:59.324461 16027 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:59.355481 17040 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.283188 17137 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:02:59.385141 17137 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:59.385610 17137 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:59.386551 17137 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.378610 17159 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:02:59.388183 17159 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:59.388270 15241 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:02:59.358805 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:59.388629 17159 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:59.389417 17033 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:59.389874 17033 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.391252 17121 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:02:59.390278 17033 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.291200 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:59.393209 17078 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:59.353806 17133 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.377708 17124 consensus_queue.cc:1243] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:59.396510 17133 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:59.398876 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:59.399621 16997 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:59.400040 16997 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:59.400447 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:02:59.400904 16997 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.374833 16908 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.370381 17112 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.403149 17053 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:59.402844 16863 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.391263 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:59.405449 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.405532 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:02:59.405751 16030 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:02:59.354914 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:59.329612 16864 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:59.376106 15320 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
W20260709 13:02:59.379668 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.410301 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:59.383860 17070 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:59.384042 17040 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:59.407043 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:02:59.379001 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 335253us
I20260709 13:02:59.408646 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.411999 16908 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:59.413760 16969 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.411254 17139 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:02:59.409705 16864 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:59.402139 16997 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:59.411659 16863 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:59.412235 17112 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:59.432405 17062 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.466900 17122 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:59.468739 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:59.475642 15289 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.389545 17159 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.470994 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:02:59.475718 15242 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:59.464496 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54300.3us
I20260709 13:02:59.465140 17040 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:59.464895 16864 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:59.482965 15365 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.478852 17155 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:59.472108 16863 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.497279 15321 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:02:59.472731 17042 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:59.412178 17067 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:02:59.412334 17020 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:02:59.495340 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:59.431914 16990 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:02:59.494172 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:59.473177 16908 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:59.495759 17158 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:59.419005 16681 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:02:59.433807 17153 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.530426 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:59.472576 17128 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:02:59.479702 17021 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.479568 17134 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.499179 16863 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:59.493832 17155 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:02:59.566391 15242 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:02:59.571409 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:02:59.528232 17060 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.476996 17062 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.526556 17042 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:02:59.492424 17040 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.534871 17124 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.505120 17112 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:59.476897 17167 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 13:02:59.493062 17171 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
W20260709 13:02:59.494951 17053 consensus_queue.cc:1175] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ee9654803379434388de45d4693e6b16" responder_term: 3 status { last_received { term: 2 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:59.581920 17155 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:59.565243 17134 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.604473 16908 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:59.607758 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 126528us
I20260709 13:02:59.609064 15321 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:02:59.636895 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:02:59.581915 17066 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:02:59.633919 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 154243us
I20260709 13:02:59.651769 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:59.565110 17021 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.589735 17158 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:02:59.663161 17158 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.664716 17067 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.665359 17067 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.639991 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:59.667649 17067 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:02:59.642792 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 143790us
W20260709 13:02:59.643968 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 163463us
I20260709 13:02:59.606374 17040 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:59.674794 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.644795 15396 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:59.678360 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.647125 15242 raft_consensus.cc:2376] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4. Re-sending same reply.
W20260709 13:02:59.653952 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.657392 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:02:59.633651 17020 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:59.659861 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:02:59.661710 17169 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:02:59.662088 17021 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:59.694540 15396 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:59.695775 17020 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:59.695961 16906 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:59.696465 16906 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:02:59.696987 17020 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.697304 16906 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.698585 15391 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.701099 16906 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:59.705606 17176 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:59.697013 17021 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:59.707005 17134 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:59.707134 17021 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.707734 17134 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.709378 17021 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:59.710136 17021 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 13:02:59.714720 17174 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:02:59.716907 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.717718 15392 raft_consensus.cc:2393] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:02:59.718621 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.719805 17067 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:59.720250 17067 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.720680 17067 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.681849 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:59.722867 17043 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:59.723466 17043 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.725737 17043 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:59.595206 17172 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.083s
W20260709 13:02:59.728209 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47201.7us
I20260709 13:02:59.728981 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.720278 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.731724 15395 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:02:59.735064 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:59.602025 17124 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.607123 17112 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.654289 16745 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:02:59.740109 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:02:59.767957 15396 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:59.742848 17172 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:59.743794 17043 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.743000 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.745026 16681 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:59.745797 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:02:59.751014 17042 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.756999 17137 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:59.640789 17012 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
W20260709 13:02:59.769205 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.771732 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 901) took 1234 ms. Trace:
I20260709 13:02:59.804749 16030 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:02:59.735827 16996 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.693140 17040 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:59.689507 16990 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.785436 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:02:59.785985 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:02:59.795506 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:02:59.796089 16947 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:59.797672 17153 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:02:59.801138 15392 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
W20260709 13:02:59.802392 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.806350 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 235042us
W20260709 13:02:59.851882 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.778107 17172 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:59.673288 17066 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.782616 16745 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:02:59.828405 17110 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.808646 17182 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:59.859707 17172 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:59.849761 16947 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:02:59.863384 15241 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:02:59.871649 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:59.858443 16770 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:59.872891 15391 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
W20260709 13:02:59.869046 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 211878us
W20260709 13:02:59.875116 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.884541 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:02:59.889104 15289 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:02:59.861819 17141 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:59.845894 17119 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.848728 16996 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:02:59.853587 16990 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:02:59.907065 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:59.916975 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 131602us
I20260709 13:02:59.882900 17158 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.886894 17182 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:59.974926 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:02:59.886471 17110 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:59.980423 17183 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:02:59.981122 17062 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:02:59.962631 17158 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:02:59.962142 16984 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.588s	user 0.013s	sys 0.000s
I20260709 13:02:59.945444 16994 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:59.878646 16770 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:00.013979 16864 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.000s
W20260709 13:03:00.017040 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 231105us
W20260709 13:02:59.979359 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 90337.5us
I20260709 13:02:59.884955 16863 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:00.008749 16974 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.019s	sys 0.014s
W20260709 13:03:00.012396 17033 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.000s
I20260709 13:03:00.012864 16994 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.014487 17043 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:02:59.890758 16681 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:59.966648 16754 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.956144 17141 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:00.099243 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 56407.6us
I20260709 13:02:59.988270 16909 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:00.092624 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.803864 15246 rpcz_store.cc:276] 0709 13:02:58.537201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.539237 (+  2036us) service_pool.cc:224] Handling call
0709 13:02:58.551558 (+ 12321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.758288 (+206730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.762651 (+  4363us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:58.769630 (+  6979us) log.cc:844] Serialized 26 byte log entry
0709 13:02:58.955224 (+185594us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:58.955282 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.771100 (+815818us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540011a3d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:02:59.771185 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.771271 (+    86us) raft_consensus.cc:1685] finished
0709 13:02:59.771292 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.771646 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371427072,"thread_start_us":159123,"threads_started":1,"wal-append.queue_time_us":239988}
I20260709 13:03:00.140939 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:00.152740 16031 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:03:00.144346 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.999732 17182 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:00.158581 17202 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:03:00.158671 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:00.160281 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:00.137645 16974 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.026s	sys 0.018s
I20260709 13:03:00.016866 17198 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.092881 17124 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.084548 17020 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.054885 17186 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.102270 16990 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.102602 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:00.152237 17183 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:00.053548 16745 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.036651 16864 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.198496 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:00.033095 16770 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.203945 17143 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:03:00.168298 17141 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.204198 17186 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.098029 17062 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:03:00.139122 17033 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.170286 16909 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:00.155238 17043 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.143945 16754 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.118613 16969 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:00.253839 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:00.019533 16984 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.206802 16908 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:00.215197 17066 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.255291 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:00.216634 17167 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:00.108732 16905 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.200730 17138 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:00.226256 17181 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.192648 17144 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:03:00.272720 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:00.017220 17110 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.204023 17020 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.246665 17141 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:00.233613 17192 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:00.234369 16681 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:00.193075 17198 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.261219 16996 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.308681 16031 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:00.277365 17119 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.278345 17197 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:00.279242 17066 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:00.259744 16909 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.287002 16745 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.266875 16969 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.321637 17197 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.291702 16905 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.276881 17167 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:00.331219 17191 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:03:00.332742 17204 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:03:00.336314 16984 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.337628 16909 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.340117 16947 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:00.341285 17137 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.000s
I20260709 13:03:00.343004 17033 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.341238 16947 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:00.344528 17043 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.345784 16863 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:00.348834 17067 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.628s	user 0.007s	sys 0.003s
I20260709 13:03:00.349301 17067 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.351528 17198 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.267135 16908 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.278841 17138 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.368391 17172 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.369149 17197 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.319147 17158 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.373020 17157 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:00.373500 17157 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:00.282658 17181 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.295344 17141 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:00.365182 17134 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.000s
I20260709 13:03:00.367367 17159 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:00.383908 17110 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.391420 17167 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.300311 17192 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.394651 17157 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.396986 17157 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:00.312923 17182 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.401552 17186 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.404758 17181 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.382756 17134 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:00.409024 17170 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.842s	user 0.004s	sys 0.001s
I20260709 13:03:00.416927 17172 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.413761 17138 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:00.386113 17155 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.782s	user 0.010s	sys 0.000s
I20260709 13:03:00.419934 17155 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.475896 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:00.479008 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 304616us
I20260709 13:03:00.479936 15248 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:03:00.483137 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.491207 15391 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:00.491384 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1952) took 1468 ms. Trace:
I20260709 13:03:00.483158 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:00.492756 15323 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:00.495551 15394 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:00.496613 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 221) took 1310 ms. Trace:
I20260709 13:03:00.498960 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:00.497259 16026 rpcz_store.cc:276] 0709 13:02:59.185626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.185851 (+   225us) service_pool.cc:224] Handling call
0709 13:02:59.196503 (+ 10652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.212177 (+ 15674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.213920 (+  1743us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.278870 (+ 64950us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.347645 (+ 68775us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:59.350593 (+  2948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.364042 (+ 13449us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.408126 (+1044084us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:00.495669 (+ 87543us) raft_consensus.cc:1685] finished
0709 13:03:00.495720 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.496362 (+   642us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1956,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":12322,"spinlock_wait_cycles":40467840,"thread_start_us":60881,"threads_started":1,"wal-append.queue_time_us":205257}
I20260709 13:03:00.496843 15322 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:00.503664 16030 raft_consensus.cc:2410] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:00.504639 16032 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:00.504859 16969 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.500708 16028 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:03:00.538138 17172 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:00.545393 16754 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.547900 17137 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.549072 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:00.548955 17137 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.550930 15394 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:00.551403 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:00.552542 15244 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:00.325567 17066 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.556726 17138 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:00.557260 17066 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.562834 17042 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:00.563882 17197 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:00.565254 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 66621.2us
I20260709 13:03:00.565096 17197 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.504693 16745 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.568253 17197 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.563922 17042 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.569795 16745 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.563961 17144 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:00.573098 17067 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.580076 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:00.557580 17138 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.478122 15246 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:00.547904 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:00.387548 17070 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.973s	user 0.012s	sys 0.000s
I20260709 13:03:00.539151 17172 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.566211 16864 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.588527 17110 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:00.491899 15398 rpcz_store.cc:276] 0709 13:02:59.022410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.022522 (+   112us) service_pool.cc:224] Handling call
0709 13:02:59.022838 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.023168 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.023197 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.023647 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.726760 (+703113us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b180016c120. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:02:59.917407 (+190647us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:59.922954 (+  5547us) log.cc:844] Serialized 14 byte log entry
0709 13:02:59.923215 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.923311 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.490699 (+567388us) raft_consensus.cc:1685] finished
0709 13:03:00.490875 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.491177 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62858,"prepare.queue_time_us":4456,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":90273,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":20878,"spinlock_wait_cycles":49325952,"thread_start_us":190400,"threads_started":1,"wal-append.queue_time_us":1276658}
I20260709 13:03:00.618358 17122 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.619272 17122 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.636328 15323 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
W20260709 13:03:00.638185 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.638535 17179 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:00.639365 17179 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.640069 17172 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.647291 15242 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:03:00.649103 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:00.655133 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:00.655036 17110 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.656868 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:00.657763 15244 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:00.659730 15397 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:03:00.660166 15397 pending_rounds.cc:85] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 1
I20260709 13:03:00.660450 15397 pending_rounds.cc:107] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:00.660777 15397 raft_consensus.cc:2889] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.661630 17067 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.662436 17067 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.665174 17067 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.650149 15242 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:00.667224 17138 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.667737 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:00.618449 16994 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.669775 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:00.670136 15324 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:00.670708 17042 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.319509 16681 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.671633 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:00.673538 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:00.640960 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:00.674957 16908 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.636974 15319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:03:00.677276 17179 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.657963 17110 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.686558 17122 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.688535 15324 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:00.690326 15319 raft_consensus.cc:606] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
W20260709 13:03:00.698770 15363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.016s
W20260709 13:03:00.699236 15363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.008s	sys 0.016s
I20260709 13:03:00.679478 17137 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:00.729524 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.727345 16908 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.755460 16908 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.717167 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:00.758482 16908 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.727080 17021 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:00.730479 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:00.761397 17021 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:00.761785 15316 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:03:00.732326 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 929) took 1091 ms. Trace:
I20260709 13:03:00.762693 15241 rpcz_store.cc:276] 0709 13:02:59.640913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.641924 (+  1011us) service_pool.cc:224] Handling call
0709 13:03:00.731881 (+1089957us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b540010bb54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:00.732116 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160583552}
I20260709 13:03:00.763319 17021 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.705339 17122 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:00.714169 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:00.716516 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:00.728467 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1666) took 1054 ms. Trace:
I20260709 13:03:00.724318 17020 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.726662 16864 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:00.769678 17021 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:00.768676 15243 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:03:00.787099 17042 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:00.797451 16026 raft_consensus.cc:2368] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3.
I20260709 13:03:00.792549 17144 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:00.803252 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1664) took 1125 ms. Trace:
I20260709 13:03:00.807073 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:00.810844 16024 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:00.810933 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:00.813916 16997 consensus_meta.cc:287] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.342s	user 0.012s	sys 0.008s
I20260709 13:03:00.819453 15243 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:03:00.819769 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 112) took 1150 ms. Trace:
I20260709 13:03:00.820272 15392 rpcz_store.cc:276] 0709 13:02:59.669521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.718350 (+ 48829us) service_pool.cc:224] Handling call
0709 13:03:00.819393 (+1101043us) spinlock_profiling.cc:243] Waited 81.9 ms on lock 0x7b54001d9554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:00.819590 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188426112}
I20260709 13:03:00.821635 15243 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:03:00.824590 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:00.829124 15242 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:00.807977 17122 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.832723 17122 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.833844 17200 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.808526 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:00.835991 17210 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:00.834630 17200 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.836879 17210 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:00.839355 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.805114 16829 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:00.843146 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.804417 17020 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.840095 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:00.839839 17200 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.821782 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:00.851439 15391 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:00.868289 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:00.869213 15392 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:00.869655 16997 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:00.870391 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:00.871367 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 928) took 1231 ms. Trace:
I20260709 13:03:00.871608 17020 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.871794 15245 rpcz_store.cc:276] 0709 13:02:59.639503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.640474 (+   971us) service_pool.cc:224] Handling call
0709 13:03:00.870050 (+1229576us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b5800132698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:00.871288 (+  1238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51241216}
I20260709 13:03:00.873234 17112 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.874655 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 931) took 1233 ms. Trace:
I20260709 13:03:00.878414 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 493) took 1010 ms. Trace:
I20260709 13:03:00.878615 16917 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:00.878929 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.881006 16823 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.881263 17053 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.881676 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1663) took 1208 ms. Trace:
I20260709 13:03:00.884538 17144 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.884824 16030 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:00.885206 17122 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:00.885848 17141 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.887094 17192 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.887662 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:00.888477 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:00.806929 15244 rpcz_store.cc:276] 0709 13:02:59.673215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.669371 (+996156us) service_pool.cc:224] Handling call
0709 13:03:00.669971 (+   600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.670353 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:00.695645 (+ 25292us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.797987 (+102342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:00.798071 (+    84us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:00.798136 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.798300 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.798475 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20751,"prepare.queue_time_us":123437,"raft.queue_time_us":21374,"raft.run_wall_time_us":8205,"thread_start_us":104786,"threads_started":2}
I20260709 13:03:00.890187 17210 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.901871 15242 rpcz_store.cc:276] 0709 13:02:59.672943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.667326 (+994383us) service_pool.cc:224] Handling call
0709 13:03:00.881483 (+214157us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540011a3d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:00.881612 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356585216}
I20260709 13:03:00.904498 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:00.909175 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:00.906191 15392 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:00.787753 15246 rpcz_store.cc:276] 0709 13:02:59.673789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.727146 (+1053357us) service_pool.cc:224] Handling call
0709 13:03:00.727729 (+   583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.728053 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.728079 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:00.728144 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:00.728180 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.728237 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.728362 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:00.799350 16864 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.892554 15248 rpcz_store.cc:276] 0709 13:02:59.641612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.666659 (+ 25047us) service_pool.cc:224] Handling call
0709 13:02:59.874538 (+207879us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800132698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:02:59.874800 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.480952 (+606152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.874297 (+393345us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400315e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:00.874566 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1425458816}
I20260709 13:03:00.842003 17042 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.923944 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:00.934789 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1970) took 1200 ms. Trace:
I20260709 13:03:00.937539 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:00.938913 17193 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:00.943087 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 54687us
I20260709 13:03:00.934598 16823 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.949263 16864 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.949719 16823 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:00.950392 17020 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:00.950585 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 86515.3us
I20260709 13:03:00.951097 17155 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.952049 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:00.939438 17193 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.946761 15316 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:03:00.935259 15394 rpcz_store.cc:276] 0709 13:02:59.730955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.552174 (+821219us) service_pool.cc:224] Handling call
0709 13:03:00.552692 (+   518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.553239 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:00.637409 (+ 84170us) log.cc:844] Serialized 14 byte log entry
0709 13:03:00.931124 (+293715us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:00.931179 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:00.931219 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.931289 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.931429 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":153609,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":24727,"thread_start_us":288532,"threads_started":2}
I20260709 13:03:00.900991 16027 rpcz_store.cc:276] 0709 13:02:59.855148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.857399 (+  2251us) service_pool.cc:224] Handling call
0709 13:03:00.713829 (+856430us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5eee 0000000000375939 00007f366eb491e0 00007f366ec120c4 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:00.865875 (+152046us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17731456}
I20260709 13:03:00.964682 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:00.956745 17053 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.968941 17053 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:00.981208 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:00.971722 17042 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:00.984935 16823 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:00.985484 16823 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.985890 16823 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:00.991102 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 160) took 2023 ms. Trace:
I20260709 13:03:00.991595 15249 rpcz_store.cc:276] 0709 13:02:58.967906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.968363 (+   457us) service_pool.cc:224] Handling call
0709 13:02:58.968664 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:59.208663 (+239999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.990583 (+1781920us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400316854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:00.990915 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532164480}
I20260709 13:03:01.000711 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1958) took 1926 ms. Trace:
I20260709 13:03:01.001186 15397 rpcz_store.cc:276] 0709 13:02:59.074019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.078325 (+  4306us) service_pool.cc:224] Handling call
0709 13:02:59.078643 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.661366 (+1582723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.000452 (+339086us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54002b6454. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:01.000646 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3634448256}
W20260709 13:03:01.001610 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.958741 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:00.973013 17144 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:00.974785 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1971) took 1171 ms. Trace:
I20260709 13:03:00.975621 15318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
W20260709 13:03:00.980593 16905 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.650s	user 0.014s	sys 0.007s
I20260709 13:03:01.010552 15398 rpcz_store.cc:276] 0709 13:02:59.803030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.661242 (+858212us) service_pool.cc:224] Handling call
0709 13:03:00.661697 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.698829 (+ 37132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.698878 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.699591 (+   713us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.776360 (+ 76769us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:00.776417 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.776510 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.974494 (+197984us) raft_consensus.cc:1685] finished
0709 13:03:00.974521 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.974698 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46749,"raft.queue_time_us":38308,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":46811,"thread_start_us":76122,"threads_started":1,"wal-append.queue_time_us":232356}
I20260709 13:03:00.956560 16917 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:00.980792 17182 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:00.980974 17020 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:01.024960 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 110992us
I20260709 13:03:00.961674 17193 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.021328 17182 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:01.027762 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.033010 15363 leader_election.cc:400] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3.
I20260709 13:03:01.033514 15363 leader_election.cc:403] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:01.036074 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.036775 15323 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:03:01.031422 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:01.038305 15249 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.039669 15391 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:01.035743 15250 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:03:01.021716 17137 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.048231 16917 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.048831 16905 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:01.049403 17133 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:01.049614 15247 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:01.033442 17182 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:01.055303 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 118165us
I20260709 13:03:01.023204 15318 raft_consensus.cc:606] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:01.035696 17020 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:01.021418 16997 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.057147 15394 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:03:01.058159 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.082700 17213 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.083709 17213 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.087074 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:01.087838 17125 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.088747 16829 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.088570 17125 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.089390 16829 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.090109 16997 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.090691 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.091684 16829 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.092103 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.092739 16829 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:01.092979 16997 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.093353 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.094645 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.052675 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.055550 16905 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:01.098672 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 216201us
W20260709 13:03:01.099318 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 141689us
I20260709 13:03:01.095759 15248 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:01.054718 17110 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:01.093146 16829 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.111258 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.112224 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.096040 15318 raft_consensus.cc:614] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:01.115929 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:01.117110 17012 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:01.117766 17012 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:01.108331 16917 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.119028 17192 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:01.118960 17012 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.119774 17192 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.106405 17137 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.118954 16917 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.122465 15243 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:03:01.123476 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.124614 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.125348 15243 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:01.126564 17020 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.127115 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.130216 16829 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:01.131954 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:01.133154 15250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 167) took 1856 ms (client timeout 1549 ms). Trace:
W20260709 13:03:01.133637 15250 rpcz_store.cc:269] 0709 13:02:59.276467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.277606 (+  1139us) service_pool.cc:224] Handling call
0709 13:03:01.132900 (+1855294us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b540010b654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:01.133052 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3992490752}
I20260709 13:03:01.135893 15242 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:01.137144 17180 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:01.137605 17180 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.113292 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1954) took 2048 ms. Trace:
I20260709 13:03:01.113852 16759 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:01.114140 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.115120 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:01.104364 17066 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3.
I20260709 13:03:01.102864 16905 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:01.113170 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.126164 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:01.120790 17110 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.137948 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.145406 15324 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.145099 16759 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.145545 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:01.146090 16030 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:01.146647 15998 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:01.147022 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1692) took 1502 ms. Trace:
I20260709 13:03:01.147359 16917 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.150391 15320 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:01.149910 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.109342 17133 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:01.154356 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.160513 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.137988 17180 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:01.162612 15363 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:01.166682 16681 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.170503 15398 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:01.139292 15390 rpcz_store.cc:276] 0709 13:02:59.047876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.048074 (+   198us) service_pool.cc:224] Handling call
0709 13:02:59.087545 (+ 39471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.087873 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.087905 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.088346 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.027062 (+1938716us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18001a9200. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1
0709 13:03:01.052083 (+ 25021us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:01.052129 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.052207 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.057612 (+  5405us) raft_consensus.cc:1685] finished
0709 13:03:01.057631 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.096319 (+ 38688us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":51944,"spinlock_wait_cycles":23492480,"thread_start_us":57298,"threads_started":1,"wal-append.queue_time_us":120844,"wal-append.run_cpu_time_us":1778,"wal-append.run_wall_time_us":1080233}
I20260709 13:03:01.163834 15243 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:01.175832 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:01.176968 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.193141 15320 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:03:01.196028 15320 raft_consensus.cc:606] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:01.196517 15320 raft_consensus.cc:614] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:01.196239 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49768us
I20260709 13:03:01.204121 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:01.205245 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 116920us
I20260709 13:03:01.209748 15248 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:01.159554 15395 rpcz_store.cc:276] 0709 13:02:59.644349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.732261 (+ 87912us) service_pool.cc:224] Handling call
0709 13:02:59.744088 (+ 11827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:59.744635 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.744679 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.816228 (+1071549us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b2c0012d858. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:00.816945 (+   717us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.915373 (+ 98428us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:00.930642 (+ 15269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.943050 (+ 12408us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.138607 (+195557us) raft_consensus.cc:1685] finished
0709 13:03:01.138645 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.146856 (+  8211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1833,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":153,"spinlock_wait_cycles":42102016,"thread_start_us":97461,"threads_started":1,"wal-append.queue_time_us":318913}
I20260709 13:03:01.212760 16759 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.183713 16026 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:01.216080 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:01.216248 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:01.217105 17149 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:01.217209 17021 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:01.217586 17149 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.217644 17021 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:01.218065 17149 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.218137 17021 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:01.219038 17078 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:01.219784 17078 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:01.221124 17078 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.203308 17213 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:01.217134 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:01.223775 15398 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.188172 15246 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:03:01.234009 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 81110.6us
I20260709 13:03:01.216293 17143 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.187877 17066 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:01.240288 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:01.246542 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.246119 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1703) took 1228 ms. Trace:
I20260709 13:03:01.244006 15398 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:01.250946 15392 rpcz_store.cc:276] 0709 13:03:00.018003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.922633 (+904630us) service_pool.cc:224] Handling call
0709 13:03:00.923381 (+   748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.923845 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:00.924893 (+  1048us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.236661 (+311768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.236729 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:01.245734 (+  9005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.245847 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.246036 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24450,"prepare.queue_time_us":332,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":26156,"thread_start_us":286688,"threads_started":1}
I20260709 13:03:01.258447 15390 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.266402 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.267310 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.257711 15318 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:01.268666 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.268827 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.269423 15316 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:01.270073 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:01.270424 17213 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.271070 17213 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.271745 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.272743 15320 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:01.274359 17012 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:01.252993 17143 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.275085 17213 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.275847 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.276448 15325 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:01.276878 17143 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.277364 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.278041 15325 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:01.279444 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.280453 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 114) took 1502 ms. Trace:
I20260709 13:03:01.281028 15396 rpcz_store.cc:276] 0709 13:02:59.777665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.659996 (+882331us) service_pool.cc:224] Handling call
0709 13:03:00.660467 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.694300 (+ 33833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.694370 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.711040 (+ 16670us) log.cc:844] Serialized 26 byte log entry
0709 13:03:00.900263 (+189223us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:00.900320 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.900420 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.280164 (+379744us) raft_consensus.cc:1685] finished
0709 13:03:01.280183 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.280305 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14674,"raft.queue_time_us":39420,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":17520,"thread_start_us":112962,"threads_started":1,"wal-append.queue_time_us":518477}
I20260709 13:03:01.282935 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.284121 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.284667 15396 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:03:01.285648 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.280404 15321 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:01.289291 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.290376 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.291805 15321 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:01.293068 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.297217 16997 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.298780 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.299180 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1700) took 1616 ms. Trace:
I20260709 13:03:01.299517 15399 rpcz_store.cc:276] 0709 13:02:59.683066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.485310 (+802244us) service_pool.cc:224] Handling call
0709 13:03:00.486069 (+   759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.603663 (+117594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.603713 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:00.605578 (+  1865us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:00.605635 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.298778 (+693143us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54003cc154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:01.298836 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.298996 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47170304}
I20260709 13:03:01.300879 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.306586 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 171) took 1448 ms. Trace:
I20260709 13:03:01.307976 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:01.309051 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:01.270450 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.310041 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.311456 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:01.312070 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.312237 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.312692 15391 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:03:01.312997 15250 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:01.314009 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.314828 15318 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:01.267891 15398 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:03:01.315709 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.316359 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.316773 17122 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:01.317173 17122 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.315801 15248 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:01.317313 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.318442 17213 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:01.320122 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.320808 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.321069 17143 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:01.321478 17143 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.321831 17143 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.322547 17012 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:01.323149 17012 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.307031 15241 rpcz_store.cc:276] 0709 13:02:59.858586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.764104 (+905518us) service_pool.cc:224] Handling call
0709 13:03:00.764690 (+   586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.828339 (+ 63649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.828385 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.829028 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.098293 (+269265us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:01.098358 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.098461 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.306322 (+207861us) raft_consensus.cc:1685] finished
0709 13:03:01.306341 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.306506 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17577,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":191,"thread_start_us":266897,"threads_started":1,"wal-append.queue_time_us":401625}
I20260709 13:03:01.326906 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.327968 15396 raft_consensus.cc:2410] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:01.317612 17122 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.328042 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.302019 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:01.318673 15247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1662) took 1646 ms (client timeout 1652 ms). Trace:
I20260709 13:03:01.318130 15391 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:01.316644 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.336345 15398 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:01.305990 15243 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:01.273892 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.338199 15390 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:03:01.332778 15247 rpcz_store.cc:269] 0709 13:02:59.672657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.795135 (+122478us) service_pool.cc:224] Handling call
0709 13:03:01.318418 (+1523283us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003985d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:01.318599 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762970496}
I20260709 13:03:01.191862 16681 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.348232 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.356359 15395 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:01.290441 15325 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:01.352633 15323 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:01.241727 17144 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.353345 17110 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:01.354710 15399 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:01.297782 16997 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.365469 16997 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.372924 15390 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:01.376422 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:01.261827 17042 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:01.375226 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:01.389045 15249 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:01.391108 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1671) took 1465 ms. Trace:
W20260709 13:03:01.401187 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.391563 15245 rpcz_store.cc:276] 0709 13:02:59.920614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.903105 (+982491us) service_pool.cc:224] Handling call
0709 13:03:00.956927 (+ 53822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:00.968240 (+ 11313us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:00.968622 (+   382us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.385211 (+416589us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.385276 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:01.385327 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.385394 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.385521 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1251,"prepare.queue_time_us":10959,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":404399,"threads_started":1}
I20260709 13:03:01.406668 15392 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:01.409688 15398 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:01.411599 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.368060 17137 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.412292 15320 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:03:01.260329 17021 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:01.436802 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.432925 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.438072 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:01.405718 16759 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:01.441586 17213 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:01.442516 17026 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:01.444207 17053 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:01.444567 17053 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:01.445765 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.445559 17053 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.446805 17053 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:01.447368 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.445551 16996 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.451367 16996 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.452163 17138 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.452764 17138 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.453641 16996 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.438159 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.454923 17138 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.455446 17149 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.446847 17121 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.454967 15321 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:01.406286 17200 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.467563 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:01.464291 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 113952us
I20260709 13:03:01.387938 17042 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:01.469142 15391 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:01.398857 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.472421 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.442082 17213 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.480876 15320 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:03:01.467296 17229 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:01.482874 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.484151 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.406854 17066 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.496938 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.474601 17042 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.497526 15323 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.481878 17213 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.482378 17110 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:01.515233 17110 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.517640 17110 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:01.518939 17193 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.504920 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.522583 17192 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.528129 17122 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.502631 17070 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.531914 17070 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.534197 17193 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.534418 17020 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:01.535211 17020 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.535859 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.543483 17149 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:01.543923 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 250523us
I20260709 13:03:01.544858 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:01.545727 17110 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:01.546128 17110 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:01.546532 17110 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.546404 17210 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:01.547438 17210 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.551471 17125 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.551172 17143 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.499943 17247 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.511315 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.506106 17138 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 13:03:01.554857 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 244533us
I20260709 13:03:01.555737 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:01.557327 15319 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:01.555433 15291 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:01.561023 15321 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.500820 17137 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:03:01.476532 17200 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.479439 17121 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.562974 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1966) took 1973 ms. Trace:
I20260709 13:03:01.534171 17070 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:01.573137 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.575147 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.585044 15243 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:01.578962 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.585701 15249 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:01.522855 15317 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:03:01.588029 17245 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.073s	user 0.004s	sys 0.000s
I20260709 13:03:01.588673 17133 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.588754 16829 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.589530 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:01.590366 15241 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.590874 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.591099 16829 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.591679 15242 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:01.591892 15244 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:01.593032 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.593565 17180 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:01.610909 17182 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 13:03:01.611647 17182 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.571270 17213 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.594312 17210 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:01.552245 17247 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.594660 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:01.595135 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 95695us
I20260709 13:03:01.595804 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.564991 16997 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:01.598292 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:01.598479 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.576647 15393 rpcz_store.cc:276] 0709 13:02:59.589238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.589953 (+   715us) service_pool.cc:224] Handling call
0709 13:02:59.590435 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.766176 (+1175741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:00.766219 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:00.797738 (+ 31519us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.052533 (+254795us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:01.158576 (+106043us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.167418 (+  8842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.552009 (+384591us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000267d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:01.552087 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.552154 (+    67us) raft_consensus.cc:1685] finished
0709 13:03:01.562615 (+ 10461us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.562808 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43146,"prepare.queue_time_us":102184,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":44586,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":250,"spinlock_wait_cycles":2619583744,"thread_start_us":241868,"threads_started":1,"wal-append.queue_time_us":537064}
I20260709 13:03:01.599293 17137 consensus_queue.cc:1243] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 2.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:01.601634 17244 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:01.652645 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.574499 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:01.604534 16996 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.585765 17122 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.583084 17141 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:01.594653 16681 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:01.581804 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:01.655169 16025 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.659330 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:01.659960 17137 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:01.660353 17137 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.609366 16905 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.589617 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:01.612318 16823 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.000s
I20260709 13:03:01.554046 17020 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:01.611117 15243 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:01.650590 16031 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:01.611011 17021 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.645680 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:01.652310 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.664233 15399 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.664372 16033 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:01.653666 16030 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:01.652325 16997 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.654666 15323 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:01.657609 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:01.659451 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 77869.3us
I20260709 13:03:01.609174 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.660655 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:01.667601 15324 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.001s
I20260709 13:03:01.667840 15249 raft_consensus.cc:2368] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:01.667965 15324 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:01.643193 16745 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.653076 17244 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.674434 15242 raft_consensus.cc:2368] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4.
I20260709 13:03:01.670341 17193 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:01.677310 17012 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.678067 16997 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.660683 17137 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.679431 16917 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:01.680672 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:01.682207 16759 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:01.685539 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:01.678550 16026 raft_consensus.cc:2368] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4.
I20260709 13:03:01.691831 15247 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:01.691902 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.689271 16745 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.707526 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.709172 16745 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:01.709291 17182 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.694485 16829 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:01.663739 17141 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:01.704146 16030 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:01.704708 17200 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.705112 17180 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.705217 16917 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.710201 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.722105 15249 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:01.698446 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:01.709419 17243 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
W20260709 13:03:01.736018 17251 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.221s	user 0.002s	sys 0.000s
I20260709 13:03:01.716524 15321 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:01.687630 17193 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.723304 15243 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:01.724848 17133 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:01.725484 17247 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.726303 17143 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.663476 16996 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.694199 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.726614 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:01.727377 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.690177 17244 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:01.730780 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.731510 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:01.764762 15316 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:01.732030 15241 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:01.733803 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:01.706781 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 196424us
I20260709 13:03:01.739753 15363 leader_election.cc:400] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4.
I20260709 13:03:01.766386 15363 leader_election.cc:403] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:01.753154 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:01.754499 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 207264us
I20260709 13:03:01.727981 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.672087 16823 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.757587 16033 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:01.715107 17141 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.762533 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.767859 15324 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:01.741156 16997 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:01.767434 15319 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:01.751271 17193 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.777045 16681 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:01.774510 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:01.781764 16024 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:01.775399 16028 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 5. Ops: []
I20260709 13:03:01.775800 16823 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.776371 15318 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.777025 17200 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:03:01.786372 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 105819us
I20260709 13:03:01.787953 16759 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:01.788995 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:01.790216 16759 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:01.790485 17021 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:01.790625 16759 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:01.791079 17021 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:01.791560 17021 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.791625 16759 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.793056 16759 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.797585 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:01.800674 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:01.801343 15324 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:01.802956 15399 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:01.806093 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:01.807055 15319 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.808804 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:01.771607 17133 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:01.795522 16997 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.796671 17247 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:01.822290 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53263.6us
I20260709 13:03:01.823340 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:01.826380 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:01.803426 17138 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.766283 17110 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.804042 16025 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:01.809558 16029 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:01.838353 17143 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:01.838801 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.838503 17133 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.838501 17265 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:01.839964 17197 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:01.832664 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:01.826730 16997 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.864991 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:01.865528 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.872103 15365 leader_election.cc:336] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.735s (SENT)
I20260709 13:03:01.871503 15247 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:03:01.872246 17248 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.351s	user 0.001s	sys 0.001s
I20260709 13:03:01.851996 17143 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.852334 17192 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:01.874756 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:01.885871 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55423.8us
I20260709 13:03:01.833254 17042 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.895828 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:01.896333 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:01.897090 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:01.887084 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:01.850728 17155 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.888319 17213 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:01.891269 17252 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.372s	user 0.000s	sys 0.002s
I20260709 13:03:01.886404 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:01.846724 17138 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.899389 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:01.876792 17197 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.866390 17265 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.848134 17247 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:01.909974 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:01.893038 17143 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:01.915834 17249 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.511s	user 0.003s	sys 0.000s
W20260709 13:03:01.916301 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 195908us
I20260709 13:03:01.894315 17144 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:01.923368 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:01.905170 17182 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:01.903276 17210 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:01.928386 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:01.931391 17246 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:01.931839 17218 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:01.933465 17012 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.943076 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1902) took 1029 ms. Trace:
I20260709 13:03:01.937391 15399 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:01.931450 17213 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:01.935834 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:01.904561 17266 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:01.939015 15390 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:01.908202 17197 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.911566 17265 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:01.948881 16745 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:01.950747 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:01.939787 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:01.953326 17021 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.930033 17144 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.943557 15322 rpcz_store.cc:276] 0709 13:03:00.914149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.925173 (+ 11024us) service_pool.cc:224] Handling call
0709 13:03:00.925524 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:00.962887 (+ 37363us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:03:00.962922 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:01.039502 (+ 76580us) log.cc:844] Serialized 26 byte log entry
0709 13:03:01.378388 (+338886us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:01.378471 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:01.378615 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:01.871575 (+492960us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:01.938191 (+ 66616us) raft_consensus.cc:1685] finished
0709 13:03:01.938222 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:01.942983 (+  4761us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13198,"raft.queue_time_us":33584,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":18640,"spinlock_wait_cycles":76951296,"thread_start_us":282131,"threads_started":1,"wal-append.queue_time_us":453564}
W20260709 13:03:01.959895 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 151171us
I20260709 13:03:01.938055 17246 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.939755 17210 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.944854 17218 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.906780 17155 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.950786 17182 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:01.962297 17026 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:03:01.960843 17012 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:01.986745 17012 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:01.987362 17268 raft_consensus.cc:993] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:03:01.987526 17021 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:01.987869 17268 raft_consensus.cc:1081] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:03:01.987805 17012 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:01.965242 17112 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:01.972409 17144 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:01.954653 17213 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:01.975497 17210 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.943511 16829 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:03:01.952013 17262 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:01.982260 17218 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:01.954537 16996 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.969447 16917 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.953985 17255 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:03:01.996690 17254 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:02.028995 17254 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:02.029984 17254 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.031579 17254 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:02.032116 16829 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:02.032550 16829 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:01.997465 17122 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:02.004551 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:02.035095 16905 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:02.032406 17110 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.974597 17246 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:02.037413 17141 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.001816 17137 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.010887 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 120) took 1254 ms. Trace:
W20260709 13:03:01.989764 17263 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:03:02.040642 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 69307.2us
I20260709 13:03:02.013305 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:02.015303 17066 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.972644 16823 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:03:02.027552 17138 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:01.955772 17266 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.976069 16745 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:03:02.063874 17155 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:02.066737 17261 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:03:02.040860 17021 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:03:02.070153 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:02.070950 16031 raft_consensus.cc:2368] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
I20260709 13:03:02.071707 15318 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:02.073590 17021 consensus_queue.cc:1243] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:02.074204 17021 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:02.074546 17021 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:02.075397 17021 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.076628 17021 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.052851 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:02.062222 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 90497.1us
I20260709 13:03:02.082497 17144 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.083309 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:02.083741 15243 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:02.062065 17213 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.062762 17269 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:02.086995 17269 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.087431 17269 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:02.087783 17247 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:02.071810 17266 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.091485 17042 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:02.094544 17200 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4.
I20260709 13:03:02.026202 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:02.086558 17121 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:02.101516 17266 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.102538 16829 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.015372 17182 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.075754 15363 leader_election.cc:400] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
I20260709 13:03:02.126682 15363 leader_election.cc:403] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:02.052140 15396 rpcz_store.cc:276] 0709 13:03:00.756258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.328680 (+572422us) service_pool.cc:224] Handling call
0709 13:03:01.393303 (+ 64623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:01.526899 (+133596us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:01.527247 (+   348us) log.cc:844] Serialized 14 byte log entry
0709 13:03:01.847103 (+319856us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:01.847159 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:01.847214 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.010636 (+163422us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001d9f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:02.010692 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:02.010829 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18857,"prepare.queue_time_us":4058,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":18973,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":11762,"spinlock_wait_cycles":306555264,"thread_start_us":300499,"threads_started":1,"wal-append.queue_time_us":348748}
I20260709 13:03:02.106730 15395 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
W20260709 13:03:02.107496 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54927.6us
I20260709 13:03:02.108279 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:02.129843 16917 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:02.130321 16917 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:02.130741 16917 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:02.108951 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 82847.8us
I20260709 13:03:02.134955 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:02.112668 15319 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:02.143193 17284 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:02.151196 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 75595.4us
I20260709 13:03:02.156461 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:02.105677 17197 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.093830 17244 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.019196 17264 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 13:03:02.122519 17192 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:02.111442 17155 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:02.176450 16759 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:02.178761 17269 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.126195 17268 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:02.187309 17143 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.189429 17180 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:02.190495 17246 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.212338 17246 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:02.180188 17144 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:02.191644 17137 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:02.217406 17193 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.218976 17266 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:02.180471 16917 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.219648 17193 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:02.143625 16997 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.220362 17193 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:02.220732 17193 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:02.221510 17193 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.191695 17021 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:02.222021 16997 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:02.156461 17042 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.222471 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:02.199921 17192 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:02.227895 17197 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:02.229605 17244 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:02.233839 17268 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:02.199249 15246 raft_consensus.cc:2368] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4.
I20260709 13:03:02.229382 17265 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:02.261477 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 295521us
W20260709 13:03:02.238416 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 103545us
I20260709 13:03:02.224442 16917 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:02.204209 16829 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:02.264665 17218 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.267336 17268 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.269237 17269 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:02.270712 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:02.271394 16028 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:02.252475 17192 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:02.274050 17218 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:02.274878 17218 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:02.251284 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 94903.2us
I20260709 13:03:02.282929 15319 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:02.280471 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 264834us
W20260709 13:03:02.283191 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 320027us
I20260709 13:03:02.284409 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:02.286144 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.287245 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.290570 15319 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:02.295379 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:02.296609 16031 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:02.297528 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:02.300212 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 371867us
W20260709 13:03:02.301621 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 158318us
I20260709 13:03:02.301724 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.302474 15322 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:02.260715 17210 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.285441 17141 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:02.305405 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.310184 15325 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.308197 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:02.311512 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.312273 15320 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.286180 16028 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:02.317301 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.317902 15322 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:02.319622 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.320760 15319 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:02.311463 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:02.321913 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:02.323766 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:02.325209 15291 leader_election.cc:400] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:02.325573 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.326260 15319 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:02.325533 15291 leader_election.cc:403] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:02.328498 17287 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:02.333915 15319 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:02.326087 17218 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.334748 17218 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.336659 17218 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:02.337975 17210 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:02.314702 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:02.339036 16024 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:02.354187 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:02.354784 17143 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:02.355085 16026 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:02.356334 17265 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:02.357535 16027 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:02.357636 16029 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:02.327461 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:02.315807 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:02.365201 15322 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:02.366122 15325 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:02.367256 17287 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.374719 17287 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.377192 17287 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:02.378479 17271 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:02.387811 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.370919 17266 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:02.390204 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:02.392001 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:02.392441 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 91265.6us
I20260709 13:03:02.394891 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.395184 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.319618 17021 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:03:02.402702 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:02.405850 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 84348.8us
I20260709 13:03:02.406534 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:02.380043 17284 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:02.407780 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.408567 15322 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:02.410486 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.413288 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.413455 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.412497 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:02.413928 15319 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:02.415099 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:02.415555 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:02.416222 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.418985 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.419762 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:02.421554 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.421952 17283 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:02.422821 15322 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:03:02.387403 16025 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:02.399184 17255 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:02.423712 15323 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:02.424320 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.404838 17244 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:02.402158 16024 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:02.446548 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.433046 15324 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:02.435567 15319 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
W20260709 13:03:02.430475 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.471814 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56408.5us
I20260709 13:03:02.403697 17271 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:02.473850 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:02.484457 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 67378.1us
I20260709 13:03:02.485486 15323 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:03:02.413091 17133 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:02.419636 17213 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:02.478118 15322 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:02.478480 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:02.483119 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.484412 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:02.487007 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67321.7us
I20260709 13:03:02.489753 15324 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:02.489744 15325 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:02.486546 15291 leader_election.cc:400] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4.
I20260709 13:03:02.490191 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:02.426769 17143 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:02.425293 17278 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:02.492442 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.510114 15291 leader_election.cc:403] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:03:02.512959 15318 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.517225 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:02.521385 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:02.522092 16025 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.522975 17276 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:02.523581 17247 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:02.522881 17282 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:02.526010 17282 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.528182 17246 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:02.528743 17246 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:02.529573 17246 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.522877 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:02.532280 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:02.486306 17244 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:02.478703 17255 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:02.485248 16996 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:02.538352 15325 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:02.542748 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.490885 16905 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:02.532920 17254 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:02.425273 17284 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.545864 15318 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:02.523623 17276 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.512413 17278 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:02.565943 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 79542.1us
W20260709 13:03:02.582732 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.596716 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:02.610589 15291 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:02.603542 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:02.604921 15319 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:03:02.522078 17285 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:02.611588 17268 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:02.562985 17143 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:02.614506 17244 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.620229 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:02.613889 17278 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.619625 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:02.594393 17247 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:02.595779 17287 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4.
I20260709 13:03:02.599385 17254 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:02.624915 17213 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:02.618599 17268 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:02.609687 16905 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:02.640623 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:02.645951 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:02.623256 17266 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:02.623466 17197 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:02.664801 15291 leader_election.cc:400] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4.
I20260709 13:03:02.629448 17286 raft_consensus.cc:2764] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:03:02.639063 17254 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:02.634581 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:02.628397 17247 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:02.676414 16681 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:02.637318 17268 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.680371 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:02.622644 17258 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.256s
I20260709 13:03:02.649893 17210 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:02.662832 17218 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:02.667586 17200 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:02.616472 17255 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:02.700034 15365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.015s	sys 0.009s
W20260709 13:03:02.706007 15365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.015s	sys 0.010s
I20260709 13:03:02.696987 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.658461 17182 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:03:02.675392 17266 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:02.707685 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:02.708930 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 112318us
W20260709 13:03:02.718477 15132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9e997bc5c2942178cde4c670df97100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 45ddec37d9e741a598bf32f6c9d7e0ee is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:02.726356 17143 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.727229 15246 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:02.705451 16905 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.730275 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:02.704967 17290 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:03:02.731070 15243 raft_consensus.cc:2368] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:02.667182 16745 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:03:02.689739 17247 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:02.690379 16027 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:02.695191 17218 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.699509 17200 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.693634 17282 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:02.744849 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:02.744591 17266 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.745551 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:02.763401 15245 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.744849 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:02.747622 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:02.753556 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:02.764951 15247 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:02.630627 17285 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.755053 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:02.755851 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:02.695379 17192 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.758610 15249 raft_consensus.cc:2368] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4.
I20260709 13:03:02.757299 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:02.637341 17271 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.731086 17276 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:02.769272 16031 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:02.792253 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:02.755276 17218 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:02.778120 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:02.759661 17200 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:02.769114 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 159765us
W20260709 13:03:02.796799 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 924665us
W20260709 13:03:02.799301 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.768834 17042 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:03:02.756958 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.777290 17182 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:02.811170 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:02.794868 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:02.819213 15325 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:02.820947 15244 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:02.821961 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:02.823498 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.830931 17294 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:02.831326 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:02.834830 17021 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:02.835381 17303 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:02.836325 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.825981 17301 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:02.837707 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.807996 17042 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
I20260709 13:03:02.843587 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:02.893584 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:02.894845 15242 raft_consensus.cc:2410] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:03:02.844709 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.777479 17278 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:02.852293 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.895830 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 117796us
I20260709 13:03:02.811355 17182 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:02.901300 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:02.885416 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:02.887434 16681 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:02.860760 15322 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:02.790670 17213 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:02.850471 17143 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:02.914585 16681 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.860939 16997 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:02.857802 17303 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:02.918177 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:02.924870 15325 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:02.918133 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:02.926023 15249 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:02.907891 15241 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:02.934720 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:02.935750 15242 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:02.945891 15320 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.000s
I20260709 13:03:02.910774 17210 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:02.946810 15320 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
W20260709 13:03:02.949465 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48248.7us
I20260709 13:03:02.913441 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:02.859169 17021 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:02.929785 17303 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:02.958843 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 116975us
I20260709 13:03:02.923887 16997 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.965588 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:02.969730 15249 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:02.966023 15242 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:02.966279 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:02.971009 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:02.976620 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.987062 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:03.008124 15325 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:03.019845 17265 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:03.020759 17265 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:03.026292 17302 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:03:03.031690 15316 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:02.951323 17210 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:03.033746 17210 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:03.037386 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:03.038703 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 51514.9us
I20260709 13:03:03.040035 16745 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:03.040146 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:03.040863 16745 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:03:03.041653 16025 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.002s
I20260709 13:03:03.043213 17276 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:03.044816 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:03.046044 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:02.968168 17281 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.046893 15317 raft_consensus.cc:2410] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:03.047044 16745 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:03.047665 16745 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:03.048061 16745 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:03.048830 15317 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:03:03.046890 17042 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:03.051137 17304 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:03:03.052583 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:03.056200 17042 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:03.055591 17182 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.057380 17182 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:03.058678 17192 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:02.963394 17284 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:03:03.059662 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:03.061596 17042 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:03.063673 17021 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:03.064131 17285 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:03.064414 17042 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:03.067415 17278 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:03.067902 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.973073 16997 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:03.070084 16745 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.067072 15365 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:03.046800 17281 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:03.090199 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 101588us
W20260709 13:03:03.172487 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 105480us
I20260709 13:03:03.173640 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:03.073843 15245 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:03.176332 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:03.111027 16681 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:02.922021 17143 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.183367 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.184497 15390 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:03.186146 15249 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:03.187763 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:03.189086 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:03.192838 15365 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:03.173803 15999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.887s (SENT) [suppressed 16 similar messages]
I20260709 13:03:03.207420 16681 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:03.014147 17300 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:03.235015 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:03.221860 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 379697us
I20260709 13:03:03.051146 15241 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:03.236179 15291 leader_election.cc:400] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:03.236078 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.237007 15396 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:03.237107 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.237352 15291 leader_election.cc:403] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:03.242985 16030 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:03.243471 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.239198 15245 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:03:03.238404 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.247305 15391 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:03.249653 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.250507 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.256306 15398 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:03.251066 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:03.251401 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.253605 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:03.042155 16025 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:03.219153 17282 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:03.220643 17276 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:03.272552 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:03.273559 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:03.283026 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 88033us
I20260709 13:03:03.283816 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:03.284552 15291 leader_election.cc:400] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4.
I20260709 13:03:03.284633 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.220361 17042 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:03.249420 17125 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:03.290149 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:03.290979 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.268795 17282 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.267253 17300 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:03.315820 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.316645 15393 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:03.316838 15325 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:03.282339 17192 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
W20260709 13:03:03.310060 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67233us
I20260709 13:03:03.313213 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:03.297396 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:03.298316 16745 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:03.286310 17311 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:03.286643 17312 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:03.339612 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49570.1us
I20260709 13:03:03.315234 17282 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:03.353184 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.360806 17119 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:03.386762 17119 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:03.388051 17193 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:03.397878 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:03.399040 15246 raft_consensus.cc:2410] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:03.388080 17119 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.403432 17119 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:03.329869 17298 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:03.329674 17301 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:03.365916 17070 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:03.370502 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:03.371304 16028 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:03.372505 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:03.383213 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.444669 15391 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:03.384017 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.384054 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.340303 17042 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:03.331434 17276 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.309500 17125 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:03.402025 17247 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.643s	user 0.004s	sys 0.005s
I20260709 13:03:03.443311 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.446602 15399 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:03.360934 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:03.356623 17312 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:03.450767 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.404570 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:03.473848 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:03.475400 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:03:03.476171 15246 raft_consensus.cc:606] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:03.423202 17265 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:03.416898 17070 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:03.477566 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 193823us
I20260709 13:03:03.478565 17070 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.424077 17281 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:03.373003 16823 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 13:03:03.495460 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.496028 15246 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:03.497828 17289 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.498833 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 139798us
W20260709 13:03:03.452221 17268 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.747s	user 0.003s	sys 0.007s
I20260709 13:03:03.441596 16745 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:03.454020 17300 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:03.585839 15325 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:03.528210 17254 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.001s
I20260709 13:03:03.470060 17276 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.466092 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:03.590222 16823 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.592423 15391 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:03.593294 17322 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:03.499366 17269 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
W20260709 13:03:03.593133 16027 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.823s	user 0.007s	sys 0.000s
I20260709 13:03:03.596539 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:03.624675 15322 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:03.597278 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 118824us
W20260709 13:03:03.598660 16997 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.004s
I20260709 13:03:03.600499 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:03.492580 17247 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:03.607065 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 183071us
W20260709 13:03:03.613163 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.613432 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 204958us
I20260709 13:03:03.494151 17312 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:03.493378 17042 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:03.440207 17210 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.617594 15390 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:03.594753 17125 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:03.619047 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:03.620698 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:03.630935 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:03.584334 17268 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.648869 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:03.586915 16745 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.583460 17289 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:03.615480 16917 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:03:03.630159 17143 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:03.626245 16027 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:03.663964 15248 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:03.667018 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:03.615729 17254 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:03.698474 15321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 1922) took 1916 ms (client timeout 1502 ms). Trace:
W20260709 13:03:03.699088 15321 rpcz_store.cc:269] 0709 13:03:01.752684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.752838 (+   154us) service_pool.cc:224] Handling call
0709 13:03:03.668568 (+1915730us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b540021a2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:03.668722 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1285087488}
I20260709 13:03:03.700054 17276 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:03.700505 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:03.700924 17316 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:03:03.701370 15241 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:03.702594 16917 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:03.703204 16917 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:03.704262 16917 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.705821 16917 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:03.707155 15317 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:03:03.707787 17247 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:03.708766 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 515) took 1145 ms. Trace:
I20260709 13:03:03.709246 16027 rpcz_store.cc:276] 0709 13:03:02.563493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.595143 (+ 31650us) service_pool.cc:224] Handling call
0709 13:03:03.708650 (+1113507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:03.709807 15317 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:03.710601 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:03.712275 16745 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:03.712478 17210 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:03.742702 17324 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
I20260709 13:03:03.637217 17287 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:03:03.713794 17320 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:03.714509 17268 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:03.715018 15316 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:03.745797 17182 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.688s	user 0.013s	sys 0.000s
I20260709 13:03:03.635648 17315 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:03.632201 16997 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:03.624516 16823 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:03.724912 17303 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.000s
I20260709 13:03:03.726034 15319 raft_consensus.cc:2410] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:03.735409 15393 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
W20260709 13:03:03.736469 15999 leader_election.cc:336] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.549s (SENT)
I20260709 13:03:03.702625 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:03.746807 15395 raft_consensus.cc:2410] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:03:03.751724 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 84790.5us
I20260709 13:03:03.754807 15250 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:03.654623 17322 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:03:03.763583 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:03.769419 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.769820 15242 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 7. Ops: []
I20260709 13:03:03.772619 15391 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:03.763348 17315 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:03.765513 17320 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:03.800930 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:03.808969 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:03.809060 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 72603.4us
W20260709 13:03:03.811077 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 120622us
W20260709 13:03:03.815531 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.816521 16823 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:03.816649 17197 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:03.817188 17197 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:03.817975 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:03.774138 17276 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:03.822700 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:03.755126 17311 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:03:03.824815 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.801479 17026 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.774364 17210 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:03:03.799454 17021 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:03.827495 17218 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.019s	user 0.005s	sys 0.006s
I20260709 13:03:03.834398 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:03.835662 17315 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.851254 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1704) took 1109 ms. Trace:
W20260709 13:03:03.859100 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49035.6us
I20260709 13:03:03.858346 15322 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:03.869094 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.768476 17303 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.826774 17182 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:03.870569 15399 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:03.869455 15250 rpcz_store.cc:276] 0709 13:03:02.741649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.741793 (+   144us) service_pool.cc:224] Handling call
0709 13:03:02.761358 (+ 19565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.764510 (+1003152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.850977 (+ 86467us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b5400398ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:03.851182 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284182784}
I20260709 13:03:03.873404 15395 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:03.846207 17070 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:03.878509 15391 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:03.881332 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.885596 15399 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:03.834388 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:03.887745 15324 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:03.886771 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.888784 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.828349 17282 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.890458 15395 raft_consensus.cc:2368] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:03.890604 16033 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:03.800369 17042 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:03.893607 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:03.894428 15250 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:03.869010 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:03.818121 17197 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.896111 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:03.894906 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:03.899554 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.833160 17330 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:03:03.892362 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 513) took 1418 ms. Trace:
I20260709 13:03:03.866138 17021 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:03.897217 16024 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:03.872527 17218 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.879190 16745 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:03.854072 17312 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.886814 17289 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:03.904770 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.916507 15399 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:03.916567 16823 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:03:03.919209 16823 consensus_queue.cc:1243] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:03.920758 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.922083 15393 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:03.923067 16745 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.924257 17218 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:03.925297 16745 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:03.894641 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:03.926623 17282 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:03.927673 15391 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:03.928023 17327 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:03:03.928861 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:03.916368 17295 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.929958 17295 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:03.906594 17320 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.903255 15241 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:03:03.909476 17200 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.088s	user 0.011s	sys 0.000s
I20260709 13:03:03.932196 17295 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:03.943979 15325 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:03.942209 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:03.904587 17254 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:03.903523 17333 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.899746 17336 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:03.955184 15399 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:03.959873 15250 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:03.959620 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:03.913995 15395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39732
I20260709 13:03:03.906791 17021 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:03.944991 17303 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:03.943698 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 512) took 1536 ms. Trace:
I20260709 13:03:03.944043 17311 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.944334 17197 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:03.946610 17121 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:03:03.904397 16026 rpcz_store.cc:276] 0709 13:03:02.471591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.767991 (+1296400us) service_pool.cc:224] Handling call
0709 13:03:03.824366 (+ 56375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.833760 (+  9394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.858338 (+ 24578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:03.862672 (+  4334us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:03.864929 (+  2257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.875555 (+ 10626us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.889531 (+ 13976us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:03.977098 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:03.991786 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:03.995746 17335 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:03.996181 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:03.996615 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 437) took 1184 ms. Trace:
I20260709 13:03:03.996979 17026 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:03.997546 15392 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:03:03.947520 17200 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:03.961017 17255 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:03:04.205003 17294 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:04.049695 17289 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.215s
I20260709 13:03:04.204077 17021 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:04.263290 16025 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:03:04.204406 17327 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:03:04.015767 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.206187 17295 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:04.255115 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:04.268507 15250 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:04.269393 15393 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:04.269042 17021 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.270141 15249 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:04.270572 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:04.271781 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:04.272385 15393 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:04.271943 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.269397 17295 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.273782 15249 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:04.262709 15392 pending_rounds.cc:85] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 4
I20260709 13:03:04.297644 15392 pending_rounds.cc:107] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:03:04.262051 16029 rpcz_store.cc:276] 0709 13:03:02.407261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.824135 (+1416874us) service_pool.cc:224] Handling call
0709 13:03:03.943605 (+119470us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.147845 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:04.101780 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:04.292259 16917 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.004s
I20260709 13:03:04.262454 16032 rpcz_store.cc:276] 0709 13:03:02.812366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.813970 (+  1604us) service_pool.cc:224] Handling call
0709 13:03:02.842482 (+ 28512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.898461 (+ 55979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.898513 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:02.898573 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:02.898627 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.996371 (+1097744us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b54003e26d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:03.996416 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.996551 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128039680}
W20260709 13:03:04.277001 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.277751 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:04.306957 15323 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 1.
I20260709 13:03:04.278290 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:04.308662 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:04.310045 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:04.001214 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 180) took 1072 ms. Trace:
I20260709 13:03:04.278931 17021 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.279551 17295 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:03.998049 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:04.295898 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1992) took 1097 ms. Trace:
I20260709 13:03:04.298002 15392 raft_consensus.cc:2889] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:04.298112 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.325124 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.151613 17180 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:04.275382 15391 raft_consensus.cc:2368] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3.
I20260709 13:03:04.306707 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:04.311275 15242 rpcz_store.cc:276] 0709 13:03:02.929219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.005859 (+ 76640us) service_pool.cc:224] Handling call
0709 13:03:03.209215 (+203356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.770289 (+561074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.000951 (+230662us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54003976d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:04.001142 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1288727296}
I20260709 13:03:04.277984 17200 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:04.326160 15320 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:04.297009 17322 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:04.330117 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:04.328722 15250 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:04.327514 17296 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:04.339330 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:04.268261 17327 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.005362 17336 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.345463 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:04.344043 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.261842 17311 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.343201 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:04.351009 15249 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:04.321842 17346 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:03:04.348865 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:04.264473 17294 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:03.978524 17333 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.323997 15397 rpcz_store.cc:276] 0709 13:03:03.198076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.219335 (+ 21259us) service_pool.cc:224] Handling call
0709 13:03:03.820310 (+600975us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:03.820542 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.820792 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:04.061943 (+241151us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.295491 (+233548us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.295552 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:04.295601 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.295673 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.295829 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25564,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":37,"raft.queue_time_us":2244,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":1079,"spinlock_wait_cycles":19142528,"thread_start_us":303988,"threads_started":2}
I20260709 13:03:04.260272 17315 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:04.355986 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.378839 15395 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:04.378950 15242 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:03:04.379359 15395 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:04.353092 16917 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:04.380064 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.380221 17336 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.380465 16917 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.381295 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:04.382051 15242 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:04.343151 17296 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:04.004168 17254 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:04.337008 17180 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.375831 17294 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:04.356856 17327 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:04.376401 17283 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:04.382395 15393 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:04.357228 17311 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:04.383826 17333 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.353905 15399 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:04.357106 17289 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:04.387291 15320 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:04.386487 15395 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.387949 17296 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:04.392112 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 314492us
I20260709 13:03:04.412045 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:04.383985 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.350932 17021 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:03:04.394109 15250 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:04.350677 17312 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:04.399137 15249 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
W20260709 13:03:04.407655 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.422394 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:04.410753 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:04.417547 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.418126 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 191) took 1578 ms. Trace:
I20260709 13:03:04.424687 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:04.420125 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:04.422991 15249 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:04.362298 17141 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:03:04.415583 17348 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:04.424984 15320 rpcz_store.cc:276] 0709 13:03:02.839564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.977671 (+138107us) service_pool.cc:224] Handling call
0709 13:03:03.997888 (+1020217us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:04.418037 (+420149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174566656}
I20260709 13:03:04.447810 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.448275 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:04.451659 17342 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:03:04.407827 17315 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.454977 17348 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.456115 17315 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:04.457360 17348 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.393306 17254 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.460028 17254 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:04.460989 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.462374 15242 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:04.466732 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46699.1us
I20260709 13:03:04.462371 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.468459 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.469717 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:04.470516 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:04.472884 15399 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:04.474900 15250 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:04.480454 15249 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:04.481472 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:04.481534 15397 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:04.480705 15399 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:04.484618 15397 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:04.487779 15249 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:04.491990 15399 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:04.494521 15242 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:04.415114 17336 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.414058 17311 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.563639 15397 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:04.421380 17295 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:04.484267 17289 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.493557 17312 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:04.580077 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 104749us
W20260709 13:03:04.585950 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 240089us
I20260709 13:03:04.588368 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:04.590564 15291 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:04.597568 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:04.597585 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:04.576624 16917 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.583837 17303 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.599983 17282 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.632853 17180 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:04.633826 17351 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 13:03:04.642899 17355 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:03:04.644685 17344 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:04.619208 17294 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:04.579784 17336 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.582588 17311 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.670688 17360 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:04.586936 17295 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.631009 17296 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.592710 17289 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.615111 17312 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.669756 17180 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.666363 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:04.673750 17294 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:04.631258 17303 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.680619 17315 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:04.685811 17356 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:04.686725 17360 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:04.687747 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.733750 15249 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:04.681823 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 84329.4us
I20260709 13:03:04.690680 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:04.735152 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:04.688318 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 83704.5us
I20260709 13:03:04.697695 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2010) took 1223 ms. Trace:
I20260709 13:03:04.736356 15392 rpcz_store.cc:276] 0709 13:03:03.474678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.599185 (+124507us) service_pool.cc:224] Handling call
0709 13:03:03.599543 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.333197 (+733654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.697433 (+364236us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54000280d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:04.697622 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914506624}
I20260709 13:03:04.707795 16997 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.712018 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2009) took 1326 ms. Trace:
I20260709 13:03:04.714809 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1997) took 1403 ms. Trace:
I20260709 13:03:04.720170 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1703) took 1980 ms. Trace:
W20260709 13:03:04.743199 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.743811 15248 rpcz_store.cc:276] 0709 13:03:02.739668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.739857 (+   189us) service_pool.cc:224] Handling call
0709 13:03:02.754653 (+ 14796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.710376 (+955723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.719861 (+1009485us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b540023a5d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:04.720088 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2076171520}
I20260709 13:03:04.724294 17284 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:04.678261 15241 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:03:04.664127 17282 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.685658 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:04.682090 17180 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.731809 16029 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:04.742631 15390 rpcz_store.cc:276] 0709 13:03:03.385769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.471702 (+ 85933us) service_pool.cc:224] Handling call
0709 13:03:03.617284 (+145582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.645115 (+ 27831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.711787 (+1066672us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54003d8bd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:04.711949 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334019456}
I20260709 13:03:04.743479 15398 rpcz_store.cc:276] 0709 13:03:03.311106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.332476 (+ 21370us) service_pool.cc:224] Handling call
0709 13:03:04.714615 (+1382139us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b5400270954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:04.714746 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1874408704}
I20260709 13:03:04.682253 17359 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:04.736974 15290 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:04.738216 17360 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:04.760319 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.749521 15241 pending_rounds.cc:85] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 5
W20260709 13:03:04.785773 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 50695.2us
W20260709 13:03:04.815378 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 84518.7us
I20260709 13:03:04.817075 15244 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:04.817756 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 967) took 1004 ms. Trace:
I20260709 13:03:04.818440 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:04.819705 15999 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.617s (SENT)
I20260709 13:03:04.820138 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:04.820757 17361 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.820180 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:04.821416 17361 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.824172 17361 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:04.824747 17361 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:04.840164 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48297.3us
I20260709 13:03:04.840566 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:04.829224 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92345.6us
I20260709 13:03:04.842970 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:04.818372 15244 rpcz_store.cc:276] 0709 13:03:03.813326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.755863 (+942537us) service_pool.cc:224] Handling call
0709 13:03:04.816900 (+ 61037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.817521 (+   621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.817699 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.846143 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:04.848032 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:04.849291 15319 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:04.825232 17361 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.851282 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:04.852808 15324 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:04.816359 15241 pending_rounds.cc:107] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:04.854948 15244 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:04.855650 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 970) took 1041 ms. Trace:
I20260709 13:03:04.856082 15244 rpcz_store.cc:276] 0709 13:03:03.814068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.844433 (+1030365us) service_pool.cc:224] Handling call
0709 13:03:04.852691 (+  8258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.855415 (+  2724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.855598 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.852001 16032 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:04.752290 17284 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.858264 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:04.828821 17315 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:04.739015 17356 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.862321 15324 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:04.868675 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:04.865424 17336 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.826815 17357 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:04.828032 16823 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:04.869735 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:04.844995 17331 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:04.870570 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:04.838296 17358 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:04.850960 17021 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:04.872674 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1008) took 1937 ms. Trace:
W20260709 13:03:04.901669 15999 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.727s (SENT)
I20260709 13:03:04.901655 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:04.875520 15247 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
W20260709 13:03:04.902632 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:04.879271 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.903177 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:04.876014 15321 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:04.901757 15316 rpcz_store.cc:276] 0709 13:03:02.932809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.032651 (+ 99842us) service_pool.cc:224] Handling call
0709 13:03:03.033040 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.744905 (+711865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.869884 (+1124979us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400218ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:04.870059 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1567950720}
I20260709 13:03:04.683145 17141 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.859251 15241 raft_consensus.cc:2889] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:04.908653 15247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1707) took 2160 ms (client timeout 2046 ms). Trace:
I20260709 13:03:04.862493 17354 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:04.912246 15247 rpcz_store.cc:269] 0709 13:03:02.743108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.785324 (+ 42216us) service_pool.cc:224] Handling call
0709 13:03:04.690541 (+1905217us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b5800132698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:04.903775 (+213234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5899008}
I20260709 13:03:04.918558 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:04.873309 17359 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:04.926317 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:04.873695 17357 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.930766 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:04.933145 17357 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:04.931634 17361 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.905844 16823 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.935256 17353 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:04.932673 17303 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.935810 17353 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:04.936153 17303 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.936350 16823 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:04.936702 17303 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.936741 17353 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:04.946892 15318 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:04.951501 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.906059 17021 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:04.909659 17333 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:04.910218 17327 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:04.909319 17138 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:04.957180 15325 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:04.983788 16032 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:04.850453 17294 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.988876 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:04.945600 16024 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:04.941265 17272 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:04.942005 17359 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:04.946352 17331 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:05.022176 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.003062 16681 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:05.023202 16681 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:05.025628 16681 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.949991 17295 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:04.951402 17353 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:04.938987 17362 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:05.031097 17362 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:05.007900 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 77223us
I20260709 13:03:05.007999 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:04.927246 17141 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:04.954114 17021 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:05.043033 15319 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:05.044502 17141 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:05.045558 17141 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.046140 17141 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:05.061367 17141 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:04.981974 17311 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:05.065938 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 147420us
I20260709 13:03:04.989670 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1720) took 1346 ms. Trace:
I20260709 13:03:05.006860 17258 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:05.078161 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:04.954404 17354 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:03:05.019466 17254 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:05.080467 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:05.022553 17180 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:05.079676 16032 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:03:05.021363 17359 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:04.993356 17327 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:05.087700 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:04.990144 17138 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:05.091037 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:05.091979 15243 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:05.092412 15243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1708) took 2349 ms (client timeout 2825 ms). Trace:
W20260709 13:03:05.092769 15243 rpcz_store.cc:269] 0709 13:03:02.743346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.778914 (+ 35568us) service_pool.cc:224] Handling call
0709 13:03:05.090834 (+2311920us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b5800132698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:05.092344 (+  1510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3102464}
I20260709 13:03:05.094696 16996 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:05.094908 17284 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:05.097828 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:05.101761 15243 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:03:05.102890 15999 leader_election.cc:336] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.743s (SENT)
I20260709 13:03:05.103363 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:05.076292 17353 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:05.106906 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:05.108494 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 976) took 1217 ms. Trace:
I20260709 13:03:05.108958 15243 rpcz_store.cc:276] 0709 13:03:03.891295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.093620 (+1202325us) service_pool.cc:224] Handling call
0709 13:03:05.093986 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.108126 (+ 14140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.108426 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:05.114521 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 79711.6us
I20260709 13:03:05.118185 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:05.120491 16033 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 1.
I20260709 13:03:05.083366 17282 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:05.123764 15243 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:05.126391 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1724) took 1122 ms. Trace:
I20260709 13:03:05.126775 15243 rpcz_store.cc:276] 0709 13:03:04.004376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.109842 (+1105466us) service_pool.cc:224] Handling call
0709 13:03:05.123599 (+ 13757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.126103 (+  2504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.126337 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.130817 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:05.131614 16024 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:05.079208 16997 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:03:05.108464 17265 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.144071 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:05.142221 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:05.146060 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:05.147104 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:05.149008 17282 raft_consensus.cc:2764] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:05.149780 17282 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:05.150355 17282 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:05.142974 17373 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:05.133805 17354 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.152776 17282 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:05.152585 17354 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:05.157431 17327 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:05.157886 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1723) took 1409 ms. Trace:
I20260709 13:03:05.068845 17315 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:05.158322 15248 rpcz_store.cc:276] 0709 13:03:03.748651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.745131 (+996480us) service_pool.cc:224] Handling call
0709 13:03:04.754916 (+  9785us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.780323 (+ 25407us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:03:04.780368 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.835668 (+ 55300us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.078191 (+242523us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:05.078285 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.078371 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.157646 (+ 79275us) raft_consensus.cc:1685] finished
0709 13:03:05.157668 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.157820 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24804,"raft.queue_time_us":24976,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":40060,"thread_start_us":214625,"threads_started":1,"wal-append.queue_time_us":305183}
I20260709 13:03:05.144657 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:05.160756 16026 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
W20260709 13:03:05.162216 17365 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:03:05.141589 17347 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:05.164364 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2000) took 1792 ms. Trace:
I20260709 13:03:05.164893 17347 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:05.168349 17265 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:05.164949 15394 rpcz_store.cc:276] 0709 13:03:03.372308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.379920 (+  7612us) service_pool.cc:224] Handling call
0709 13:03:03.380279 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.407630 (+ 27351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.407672 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.417996 (+ 10324us) log.cc:844] Serialized 26 byte log entry
0709 13:03:04.696250 (+1278254us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b1800459160. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:03:04.864811 (+168561us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:04.907910 (+ 43099us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.908178 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.908277 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.163983 (+255706us) raft_consensus.cc:1685] finished
0709 13:03:05.164105 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.164283 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29110,"prepare.queue_time_us":44419,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":4616,"raft.queue_time_us":31994,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":130,"spinlock_wait_cycles":28857088,"thread_start_us":168300,"threads_started":1,"wal-append.queue_time_us":1586231}
I20260709 13:03:05.171502 17265 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:05.111357 17353 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:05.187702 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:05.189275 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:05.187742 17354 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:05.077904 15241 rpcz_store.cc:276] 0709 13:03:03.643012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.579185 (+936173us) service_pool.cc:224] Handling call
0709 13:03:04.628984 (+ 49799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.940887 (+311903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.980013 (+ 39126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.132015 17138 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:05.175814 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 57689.7us
I20260709 13:03:05.189936 16031 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:05.119621 17370 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:05.210141 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:05.210636 17347 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:05.210884 15243 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:05.212064 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:05.209259 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 333018us
I20260709 13:03:05.213238 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:05.206871 17374 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:05.214902 17374 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:05.198123 17254 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:05.216463 17374 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:05.127282 17021 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:05.219763 17192 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:05.220211 17192 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:05.220315 17021 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:05.199937 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:05.221432 15241 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:05.222070 15324 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:05.222802 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:05.223877 15241 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:05.200702 17272 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.145483 17303 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:05.202379 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 972) took 1387 ms. Trace:
I20260709 13:03:05.201944 17331 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:05.203251 17353 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:05.190557 15248 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:05.197144 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:05.221148 17192 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:05.191007 16996 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:05.290740 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:05.291752 15248 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:05.225554 15363 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:05.202180 17258 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:05.230890 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:05.233180 17138 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:05.233752 17363 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:05.236774 15247 rpcz_store.cc:276] 0709 13:03:03.814640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.913718 (+1099078us) service_pool.cc:224] Handling call
0709 13:03:04.914039 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.001584 (+ 87545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.001619 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.017260 (+ 15641us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.183311 (+166051us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:05.187971 (+  4660us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.201998 (+ 14027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.202096 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.202135 (+    39us) raft_consensus.cc:1685] finished
0709 13:03:05.202145 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.202315 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28576,"prepare.queue_time_us":4451,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":54523,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":13106,"spinlock_wait_cycles":13869440,"thread_start_us":173247,"threads_started":2,"wal-append.queue_time_us":117133}
I20260709 13:03:05.273923 15290 leader_election.cc:400] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3.
I20260709 13:03:05.236435 17356 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:05.285646 17021 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:05.290557 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:05.426842 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 201380us
I20260709 13:03:05.235469 17373 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:05.228348 17265 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.264s
I20260709 13:03:05.579443 15290 leader_election.cc:403] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:03:05.576105 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:05.656283 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:05.235774 17347 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.311s
I20260709 13:03:05.657598 15247 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:05.641173 15245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 183) took 2612 ms (client timeout 1549 ms). Trace:
W20260709 13:03:05.649318 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 405287us
W20260709 13:03:05.683770 15245 rpcz_store.cc:269] 0709 13:03:03.028311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.175996 (+147685us) service_pool.cc:224] Handling call
0709 13:03:05.640938 (+2464942us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b540010b654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:05.641078 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142635264}
W20260709 13:03:05.690551 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.453771 17360 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.276563 17284 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.372s
I20260709 13:03:05.546804 17353 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:05.732139 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:05.429068 17270 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.478s
I20260709 13:03:05.451803 17271 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:05.429754 16996 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.306s
I20260709 13:03:05.553650 17387 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.356s
I20260709 13:03:05.753259 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:05.876791 15324 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:03:06.292164 17384 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:05.899883 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.016s	sys 0.022s
W20260709 13:03:06.293489 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.025s	sys 0.028s
I20260709 13:03:06.293007 17384 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.294080 15245 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:06.294859 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 199) took 1109 ms. Trace:
W20260709 13:03:06.295276 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 1.03687e+06us
I20260709 13:03:06.297248 15316 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:05.921175 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 971) took 2106 ms. Trace:
W20260709 13:03:05.810432 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 382543us
I20260709 13:03:05.485441 17377 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:06.295279 15245 rpcz_store.cc:276] 0709 13:03:05.185792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.267891 (+1082099us) service_pool.cc:224] Handling call
0709 13:03:06.293855 (+ 25964us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.294590 (+   735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.294799 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.759048 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:05.758780 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:03:06.192446 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.302302 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 201) took 1115 ms. Trace:
W20260709 13:03:05.897430 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.286973 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:05.759196 17378 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:03:05.666203 17354 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.721042 17286 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:06.298206 15244 rpcz_store.cc:276] 0709 13:03:03.814362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.857058 (+1042696us) service_pool.cc:224] Handling call
0709 13:03:04.874558 (+ 17500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.915430 (+ 40872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.915478 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.930273 (+ 14795us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.206571 (+276298us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:05.210021 (+  3450us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.232059 (+ 22038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.232142 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.920847 (+688705us) raft_consensus.cc:1685] finished
0709 13:03:05.920882 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.921088 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40321,"prepare.queue_time_us":12019,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":51181,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":17963,"thread_start_us":237720,"threads_started":2,"wal-append.queue_time_us":966598}
W20260709 13:03:06.312417 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.013s	sys 0.004s
W20260709 13:03:06.319705 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.013s	sys 0.004s
I20260709 13:03:06.309804 15241 rpcz_store.cc:276] 0709 13:03:05.186421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.635321 (+448900us) service_pool.cc:224] Handling call
0709 13:03:06.302222 (+666901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.759052 17367 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:06.274861 17331 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.309583 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:06.311895 15324 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:06.324996 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:05.876536 17121 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:06.007907 17021 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.325758 17121 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.326594 17021 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.328293 17121 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.329070 17021 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:06.329815 17021 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.731454 17180 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.330202 17021 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.330596 17180 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.324939 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.333062 17021 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.333091 17180 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:05.766683 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:06.333981 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.334695 15324 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:06.335392 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:06.335620 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.336313 15324 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
W20260709 13:03:06.337131 17359 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.221s	user 0.012s	sys 0.000s
I20260709 13:03:06.337235 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.336472 15316 raft_consensus.cc:2410] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:03:06.339123 17357 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.405s	user 0.008s	sys 0.007s
W20260709 13:03:06.339463 17358 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.412s	user 0.005s	sys 0.009s
I20260709 13:03:06.339252 15324 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:06.339984 17358 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:06.340456 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.339938 17357 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.341091 15324 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:06.341522 17384 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:06.342119 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.342806 15324 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:06.343683 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.344885 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:05.731662 17141 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:06.337944 17359 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.346671 17141 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:05.809219 17360 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.305748 17377 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.637416 17363 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.339200 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:06.350675 15321 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:06.354140 17389 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.356701 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:06.357055 17389 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.308476 17271 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.359465 17284 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:06.359763 17389 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.360687 17271 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:06.361073 15395 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:06.369223 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39732 (request call id 1730) took 2501 ms. Trace:
W20260709 13:03:06.369525 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.792411 17379 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.561s
I20260709 13:03:06.349226 17141 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.358045 16027 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:06.369825 15395 rpcz_store.cc:276] 0709 13:03:03.876179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.891069 (+ 14890us) service_pool.cc:224] Handling call
0709 13:03:06.360003 (+2468934us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54003cc154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf1a3d 00007f366ebc1cd0 00007f3668146254 00007f36681461e2 00007f3668146111 00007f366814608c 00007f3668145342 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:06.366418 (+  6415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925336320}
I20260709 13:03:05.759313 17376 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 1.110s
I20260709 13:03:06.366888 17180 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 13:03:06.375600 16029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 445) took 1949 ms (client timeout 1817 ms). Trace:
I20260709 13:03:06.382861 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:06.353425 17377 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:06.382102 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:06.384361 17387 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.372993 17271 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:06.386646 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:06.388700 15244 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:06.374837 17360 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.376112 17121 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.391983 17121 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.384342 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 441) took 2512 ms. Trace:
I20260709 13:03:06.393114 16027 rpcz_store.cc:276] 0709 13:03:03.871757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.875238 (+  3481us) service_pool.cc:224] Handling call
0709 13:03:06.357507 (+2482269us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:06.357714 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.377111 (+ 19397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.384218 (+  7107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6461312}
I20260709 13:03:06.390789 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1721) took 2747 ms. Trace:
W20260709 13:03:06.382858 16029 rpcz_store.cc:269] 0709 13:03:04.424299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.426848 (+  2549us) service_pool.cc:224] Handling call
0709 13:03:06.364208 (+1937360us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540073fad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:06.373318 (+  9110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476115840}
I20260709 13:03:06.386396 17387 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.394196 17121 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.394392 15249 rpcz_store.cc:276] 0709 13:03:03.643231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.740600 (+1097369us) service_pool.cc:224] Handling call
0709 13:03:04.747148 (+  6548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.751794 (+  4646us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:04.985230 (+233436us) log.cc:844] Serialized 14 byte log entry
0709 13:03:05.175083 (+189853us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:05.195290 (+ 20207us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.195498 (+   208us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:05.195547 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.195638 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.390576 (+1194938us) raft_consensus.cc:1685] finished
0709 13:03:06.390599 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.390719 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52784,"prepare.queue_time_us":331799,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":73756,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":46054,"thread_start_us":257431,"threads_started":2,"wal-append.queue_time_us":269116}
I20260709 13:03:06.396905 17387 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:06.390986 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:06.398969 16031 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.378008 17359 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.349565 17367 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.373554 17021 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:03:06.421897 16031 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:06.387859 17347 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.452108 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:06.323916 17286 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.353194 17331 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.408885 17357 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.432013 17360 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:06.471138 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 102938us
W20260709 13:03:06.479599 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 157697us
I20260709 13:03:06.417765 17362 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:03:06.416800 17271 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:06.486912 15393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1751) took 2191 ms (client timeout 1827 ms). Trace:
W20260709 13:03:06.487562 15393 rpcz_store.cc:269] 0709 13:03:04.295073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.308412 (+ 13339us) service_pool.cc:224] Handling call
0709 13:03:06.486568 (+2178156us) spinlock_profiling.cc:243] Waited 73.1 ms on lock 0x7b54000c0154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:06.486772 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168105216}
W20260709 13:03:06.474814 17283 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.990s	user 0.048s	sys 0.071s
I20260709 13:03:06.490247 17289 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:06.490573 17283 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.008s	user 0.048s	sys 0.071s
I20260709 13:03:06.490873 17283 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:06.492085 17286 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:06.491813 17283 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.473205 17360 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:06.509246 17272 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.515920 16024 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:06.506333 17296 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:06.516067 17272 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.506319 17379 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.456691 17347 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.518826 17379 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.521868 17392 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:06.530892 17392 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.531473 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1953) took 1714 ms. Trace:
I20260709 13:03:06.507614 17393 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:06.481277 17021 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:03:06.531898 15323 rpcz_store.cc:276] 0709 13:03:04.817220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.817411 (+   191us) service_pool.cc:224] Handling call
0709 13:03:04.817772 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.901809 (+ 84037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.901849 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.901894 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:04.901930 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.531179 (+1629249us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54001e5fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:06.531245 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.531406 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143940352}
I20260709 13:03:06.509346 17254 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:06.540818 17373 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:03:06.543045 17373 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:06.543445 17373 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:06.543313 17254 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.551434 17347 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:06.552139 17330 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:06.552590 17330 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:06.555665 17271 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:06.556406 15322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 199) took 3057 ms (client timeout 1884 ms). Trace:
W20260709 13:03:06.556833 15242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 978) took 2619 ms (client timeout 2079 ms). Trace:
W20260709 13:03:06.557443 15242 rpcz_store.cc:269] 0709 13:03:03.937087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.391305 (+454218us) service_pool.cc:224] Handling call
0709 13:03:06.556574 (+2165269us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b54001a8bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:06.556736 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89539968}
I20260709 13:03:06.561815 17180 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.562502 15250 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:06.585340 17180 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.563476 17367 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:06.565397 17331 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.566057 17379 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:06.556875 15322 rpcz_store.cc:269] 0709 13:03:03.498677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.648490 (+149813us) service_pool.cc:224] Handling call
0709 13:03:06.556130 (+2907640us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b540016dd54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:06.556302 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479361408}
I20260709 13:03:06.588285 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:06.589218 15322 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:06.547806 17393 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:06.590513 17269 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:06.590052 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:06.590960 17269 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:06.591180 17393 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.591924 17269 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.594779 16917 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:06.595216 16917 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:06.595116 17377 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.596370 16917 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.561990 17363 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:06.569911 16033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 266) took 1474 ms (client timeout 1902 ms). Trace:
I20260709 13:03:06.597708 16917 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.600325 17269 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:06.603495 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.569674 17360 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.572196 17284 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:06.573114 17254 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.533681 17395 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:06.607091 17395 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.607736 17354 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 2. Current term is 3.
I20260709 13:03:06.608719 16028 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:06.609510 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 256) took 1800 ms. Trace:
I20260709 13:03:06.609656 17395 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:06.597710 16033 rpcz_store.cc:269] 0709 13:03:05.095547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.097560 (+  2013us) service_pool.cc:224] Handling call
0709 13:03:06.569733 (+1472173us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54003e26d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:06.569853 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43988352}
I20260709 13:03:06.568360 17373 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.553458 17330 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.611505 17373 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.611510 15363 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:06.611529 17330 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:06.583789 17362 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:06.568843 17343 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.990s	user 0.000s	sys 0.026s
I20260709 13:03:06.603332 17374 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:06.584771 17311 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:06.614455 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.622370 15392 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:03:06.627399 15392 pending_rounds.cc:85] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 2
I20260709 13:03:06.627310 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.624845 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:06.628417 15390 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.628639 15393 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:06.627889 15392 pending_rounds.cc:107] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:03:06.629539 15392 raft_consensus.cc:2889] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.572217 17192 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.693537 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 139) took 2420 ms. Trace:
I20260709 13:03:06.629848 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.718068 15394 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:06.718761 17377 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:06.686671 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.719928 15393 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:06.625324 17362 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.715626 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:06.723290 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:06.674122 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:06.689038 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.724442 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:06.725384 17361 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:06.725469 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.725827 17361 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.726212 17361 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:06.726222 15317 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:06.727492 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.728129 15317 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:06.729193 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.730036 15317 raft_consensus.cc:2410] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:06.710620 17406 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:03:06.731042 17406 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:06.731025 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:06.690490 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1951) took 1873 ms. Trace:
I20260709 13:03:06.689059 17272 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:06.732089 16030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 521) took 2787 ms (client timeout 1879 ms). Trace:
W20260709 13:03:06.732590 16030 rpcz_store.cc:269] 0709 13:03:03.944747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.944887 (+   140us) service_pool.cc:224] Handling call
0709 13:03:06.730879 (+2785992us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:06.731977 (+  1098us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11011328}
I20260709 13:03:06.732084 15320 rpcz_store.cc:276] 0709 13:03:04.816617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.816772 (+   155us) service_pool.cc:224] Handling call
0709 13:03:04.817153 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.902166 (+ 85013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.902196 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.902254 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:04.902286 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.690219 (+1787933us) spinlock_profiling.cc:243] Waited 63.2 ms on lock 0x7b54002a76d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:06.690298 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.690427 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145421568}
I20260709 13:03:06.731593 17406 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:06.734591 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:06.735613 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.679859 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.736398 15325 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:06.737203 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:06.737625 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 258) took 1928 ms. Trace:
I20260709 13:03:06.738065 16025 rpcz_store.cc:276] 0709 13:03:04.809475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.816511 (+  7036us) service_pool.cc:224] Handling call
0709 13:03:04.852200 (+ 35689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.952434 (+100234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.979813 (+ 27379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.989559 (+  9746us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:04.999768 (+ 10209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.737389 (+1737621us) spinlock_profiling.cc:243] Waited 85 ms on lock 0x7b540067edd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:06.737438 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.737563 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195608448}
I20260709 13:03:06.731025 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:06.735257 17406 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.705607 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:06.731357 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:06.716926 15399 rpcz_store.cc:276] 0709 13:03:04.272663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.521410 (+248747us) service_pool.cc:224] Handling call
0709 13:03:06.491009 (+1969599us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:06.491448 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.491479 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:06.492115 (+   636us) log.cc:844] Serialized 52 byte log entry
0709 13:03:06.545321 (+ 53206us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:06.545364 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.545437 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:06.692043 (+146606us) raft_consensus.cc:1685] finished
0709 13:03:06.692062 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.693242 (+  1180us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54000c0150. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:06.693450 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5683,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":15187,"spinlock_wait_cycles":4528531840,"thread_start_us":48159,"threads_started":1,"wal-append.queue_time_us":155477}
I20260709 13:03:06.749122 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.749909 15325 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:06.629570 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.750898 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.751801 15325 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:06.673203 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:06.754396 15316 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:06.754716 15397 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:06.755771 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.755904 17362 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:06.624158 17395 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:06.743611 15996 connection.cc:256] RPC call timeout handler was delayed by -1.6332169549999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:03:06.757145 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.761302 17406 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:06.783339 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.784427 17312 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:06.784647 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.785480 15394 raft_consensus.cc:2410] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:06.626796 17311 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:06.609906 16028 rpcz_store.cc:276] 0709 13:03:04.808749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.815195 (+  6446us) service_pool.cc:224] Handling call
0709 13:03:06.608070 (+1792875us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:06.608329 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.609200 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.609446 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5307776}
I20260709 13:03:06.787977 17356 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:06.788398 17356 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:06.789284 17356 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.790510 17356 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:06.793243 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:06.793944 15999 connection.cc:256] RPC call timeout handler was delayed by -1.3870158760000777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
I20260709 13:03:06.770515 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:06.740437 17361 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.685998 15390 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:06.797412 15399 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:06.798053 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.776859 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:06.799252 16030 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:06.752414 15398 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:06.772661 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:06.801192 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.624099 17254 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.702531 17197 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:03:06.808043 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1019) took 1084 ms. Trace:
I20260709 13:03:06.808696 15321 rpcz_store.cc:276] 0709 13:03:05.723269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.723387 (+   118us) service_pool.cc:224] Handling call
0709 13:03:06.807766 (+1084379us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b54002193d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:06.807959 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100846464}
I20260709 13:03:06.776711 17272 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.759018 17303 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:06.760005 17200 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:06.778496 17282 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:03:06.782017 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.813608 15391 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:06.782143 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.624341 17374 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:06.782728 17395 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.780292 15325 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:06.828830 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:06.829487 15325 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:06.795446 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:06.830993 15242 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:03:06.768851 15214 connection.cc:256] RPC call timeout handler was delayed by -2.4355846509998855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22870000000000001s for a response
W20260709 13:03:06.832333 15214 connection.cc:256] RPC call timeout handler was delayed by -1.6062015289999181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:03:06.832872 15214 connection.cc:256] RPC call timeout handler was delayed by -1.0666775569999345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
I20260709 13:03:06.796186 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:06.834034 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:06.788374 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.774446 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.802996 15390 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:06.803637 17399 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:06.806108 15999 connection.cc:256] RPC call timeout handler was delayed by -1.2259158760000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 13:03:06.845232 15999 connection.cc:256] RPC call timeout handler was delayed by -1.2232158760000402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
W20260709 13:03:06.845570 15999 connection.cc:256] RPC call timeout handler was delayed by -1.1575158760000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 13:03:06.806043 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.848377 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:06.848640 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:06.811223 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:06.811836 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 80552.6us
I20260709 13:03:06.813640 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:06.850658 15243 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:06.850998 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:06.851913 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:06.852329 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 56222.8us
I20260709 13:03:06.852927 15393 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:06.853443 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:06.814550 15395 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:06.814981 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:06.814615 15320 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:06.820272 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:06.815904 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:06.826690 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92602us
I20260709 13:03:06.815116 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:06.838038 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.857293 15390 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:06.838927 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:06.840046 15323 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:06.836689 15392 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:06.858088 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.841014 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:06.860289 15390 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:06.860683 16681 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:06.842000 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:06.861230 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.861132 16681 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.861816 15390 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:06.860353 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.863822 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:06.864082 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:06.839748 17395 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:06.865974 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.866294 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.880046 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.880371 15391 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:06.880550 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1024) took 1155 ms. Trace:
I20260709 13:03:06.880888 15320 rpcz_store.cc:276] 0709 13:03:05.725147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.866042 (+1140895us) service_pool.cc:224] Handling call
0709 13:03:06.880492 (+ 14450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.865975 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:06.881343 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.881923 15399 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:06.873010 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:06.876087 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.883965 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.886042 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:06.886821 15395 raft_consensus.cc:2368] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:06.888234 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.828055 17276 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:06.877575 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:06.813632 15317 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:03:06.888851 15394 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:06.889634 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.887095 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:06.890640 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.900383 15392 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:06.900640 15399 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:03:06.890856 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:06.901405 15325 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
W20260709 13:03:06.891595 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.865250 17354 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:06.895130 16681 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:06.858709 17255 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:06.903599 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:06.888841 17353 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:06.904450 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:06.866077 17270 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:06.878393 17296 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:06.890564 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:06.909256 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:06.909858 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.840240 17271 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:06.814071 17254 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.879289 17320 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:06.828223 17348 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:03:06.816114 17272 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:06.913790 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:06.878577 17367 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:06.914039 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:06.880280 17312 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:06.917184 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:06.878425 17384 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:06.895449 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:06.857200 17399 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:06.894937 17374 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:07.170701 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.012663 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.486557 15398 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:07.487521 15395 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:07.339399 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:07.488759 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:07.489463 15390 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:07.023713 17398 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.490648 17398 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.491283 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:06.913226 17197 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:07.495363 17197 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:07.505045 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.492554 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:07.020741 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:07.052749 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.891175 17276 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:06.914623 17354 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.494374 17312 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.495198 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:07.343042 17403 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.454s	user 0.001s	sys 0.000s
I20260709 13:03:07.495690 17374 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:07.070844 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:07.497400 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 583401us
I20260709 13:03:07.493057 17398 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:07.028030 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:06.891031 17393 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:06.893402 17042 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:07.036612 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:07.573002 15323 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:07.575208 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:07.516132 17330 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:03:07.592585 16033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.000s	sys 0.032s
I20260709 13:03:07.519105 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:07.359987 17356 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.569s	user 0.007s	sys 0.005s
W20260709 13:03:07.553960 15397 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.781s	user 0.006s	sys 0.003s
W20260709 13:03:07.596200 16032 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.034s	sys 0.033s
I20260709 13:03:07.596450 15397 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
W20260709 13:03:07.596701 16032 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.034s	sys 0.033s
I20260709 13:03:07.596810 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.528054 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:07.598294 15393 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:07.598445 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:07.560050 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:07.500727 17271 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:06.923545 17377 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:07.562214 17197 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:07.494042 17296 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:06.898068 17315 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.628s
W20260709 13:03:07.569008 16030 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.762s	user 0.010s	sys 0.000s
I20260709 13:03:07.611124 16030 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:07.020838 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:07.501940 17353 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.493683 17270 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:07.519035 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.582372 17042 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:07.605358 17336 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.005s	sys 0.029s
I20260709 13:03:07.594900 15325 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
W20260709 13:03:07.606200 17402 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.024s	sys 0.066s
I20260709 13:03:07.495186 17399 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:07.509018 17367 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:07.598135 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:07.629271 15243 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:07.600359 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:07.496466 17384 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.553356 17021 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.558388 17312 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:07.603437 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 75507.7us
I20260709 13:03:07.613328 17331 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.566938 17255 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:07.627676 17336 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.005s	sys 0.030s
I20260709 13:03:07.612520 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:07.599565 17406 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.809s	user 0.002s	sys 0.008s
I20260709 13:03:07.510623 17320 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:07.611124 17401 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:07.569490 15246 raft_consensus.cc:2376] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2. Re-sending same reply.
I20260709 13:03:07.623802 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1043) took 1028 ms. Trace:
I20260709 13:03:07.624517 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:03:07.594247 16033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.000s	sys 0.033s
I20260709 13:03:07.660504 17255 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.668649 17255 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:07.601395 17358 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.669994 17358 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:07.671398 17384 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:07.672032 17384 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:07.672207 17358 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:07.630266 15390 raft_consensus.cc:2376] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4. Re-sending same reply.
I20260709 13:03:07.661548 17331 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.673858 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:07.654876 17021 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.665337 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:07.676667 15245 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:07.677032 17021 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:07.621403 17270 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:07.677533 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.610553 17296 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:07.662470 17320 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:07.662670 17401 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.639878 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:07.683302 15318 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:07.662974 15325 rpcz_store.cc:276] 0709 13:03:06.595616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.518733 (+923117us) service_pool.cc:224] Handling call
0709 13:03:07.623721 (+104988us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:07.684587 15242 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:07.685519 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:07.620441 17353 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:07.623248 17042 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:07.659111 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1719) took 3998 ms. Trace:
I20260709 13:03:07.686590 15250 rpcz_store.cc:276] 0709 13:03:03.642792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.548699 (+905907us) service_pool.cc:224] Handling call
0709 13:03:06.562324 (+2013625us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.585594 (+ 23270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.640680 (+1055086us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54001a8bd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:07.640894 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4554195200}
I20260709 13:03:07.626474 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:07.687440 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:07.689414 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.690826 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.693668 15245 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:07.675134 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:07.634467 17367 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:07.603096 17284 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:07.569805 17354 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:07.641757 15316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1023) took 1916 ms (client timeout 2201 ms). Trace:
W20260709 13:03:07.628034 17402 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.025s	sys 0.066s
I20260709 13:03:07.649473 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:07.691298 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:07.692305 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.683115 17401 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:07.672435 17384 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:07.717401 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:07.684196 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 274) took 1287 ms. Trace:
I20260709 13:03:07.720036 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.718663 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:07.723764 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:07.698661 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 132567us
I20260709 13:03:07.528473 17276 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:07.700248 15243 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:07.735368 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.736276 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.660347 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:07.683388 17412 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:03:07.695981 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.739001 15249 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:07.739894 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.740572 15249 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:07.663976 16028 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:07.706207 15316 rpcz_store.cc:269] 0709 13:03:05.724869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.338951 (+614082us) service_pool.cc:224] Handling call
0709 13:03:07.641540 (+1302589us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54002edbd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:07.641674 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":610897152}
I20260709 13:03:07.742830 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:07.743858 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 1981) took 1348 ms. Trace:
I20260709 13:03:07.744264 15316 rpcz_store.cc:276] 0709 13:03:06.395301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.742488 (+1347187us) service_pool.cc:224] Handling call
0709 13:03:07.743785 (+  1297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:07.710430 15241 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:07.713193 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:07.715559 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:07.752725 15244 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:07.707396 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.754065 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.705518 15318 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:07.716589 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:07.723942 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.719386 15325 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
W20260709 13:03:07.699373 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 671415us
I20260709 13:03:07.757138 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:07.757387 17373 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:07.757575 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:07.757959 17373 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.758378 17255 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:07.759111 17255 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:07.760717 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:07.761888 17393 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:07.758028 15390 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:07.762708 17393 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:07.764176 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:07.764062 17393 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.736536 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.767004 15245 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:07.701539 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:07.762032 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:07.768501 17255 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:07.765933 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:07.718724 17384 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:07.778002 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:07.780753 17361 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:07.786613 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 85189.6us
I20260709 13:03:07.790959 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1028) took 2064 ms. Trace:
I20260709 13:03:07.728227 17399 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:07.792167 15316 rpcz_store.cc:276] 0709 13:03:05.726312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.745188 (+2018876us) service_pool.cc:224] Handling call
0709 13:03:07.745539 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.790097 (+ 44558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.790194 (+    97us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.790338 (+   144us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:07.790420 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.790675 (+   255us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.790877 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37642,"raft.queue_time_us":38531}
W20260709 13:03:07.794023 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 74472.5us
I20260709 13:03:07.794516 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:07.794602 15241 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:07.710150 17284 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.800644 17330 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:07.798521 15363 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:07.826360 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:07.822772 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 64663us
I20260709 13:03:07.830094 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:07.831573 15399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.007s	sys 0.030s
W20260709 13:03:07.832005 15399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.007s	sys 0.030s
I20260709 13:03:07.789248 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:07.843886 15323 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:03:07.796155 17398 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:07.825415 17361 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:07.826133 17406 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:07.803153 17422 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:07.859167 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 101664us
I20260709 13:03:07.860525 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:07.862985 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:07.863518 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2025) took 1237 ms. Trace:
I20260709 13:03:07.863838 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1969) took 2926 ms. Trace:
I20260709 13:03:07.831954 17269 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.795884 17399 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:07.863960 15396 rpcz_store.cc:276] 0709 13:03:06.626424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.696823 (+ 70399us) service_pool.cc:224] Handling call
0709 13:03:06.697176 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.697797 (+   621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.697826 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:06.698339 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:03:06.914418 (+216079us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:06.914459 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.914566 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:07.863304 (+948738us) raft_consensus.cc:1685] finished
0709 13:03:07.863326 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.863461 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":215711,"threads_started":1,"wal-append.queue_time_us":384631}
I20260709 13:03:07.868366 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:07.864324 15319 rpcz_store.cc:276] 0709 13:03:04.931956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.939398 (+  7442us) service_pool.cc:224] Handling call
0709 13:03:04.954111 (+ 14713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.043622 (+ 89511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.857970 (+2814348us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b5400077e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:07.858176 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203278080}
W20260709 13:03:07.848528 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49109.1us
I20260709 13:03:07.851305 17421 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.872588 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:07.854923 17361 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:07.882120 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:07.866627 17420 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:07.857033 17398 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.890872 17373 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:07.867813 17428 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:07.872184 17399 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:07.881160 17192 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.120s	user 0.003s	sys 0.009s
I20260709 13:03:07.900964 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1975) took 1549 ms. Trace:
I20260709 13:03:07.880928 17421 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:07.875546 17422 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:07.914127 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.947098 15324 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:07.947465 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2038) took 1094 ms. Trace:
I20260709 13:03:07.889132 17361 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:07.929872 15319 rpcz_store.cc:276] 0709 13:03:06.351641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.881766 (+1530125us) service_pool.cc:224] Handling call
0709 13:03:07.900525 (+ 18759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.900733 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.900749 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.900778 (+    29us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:07.900797 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.900831 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.900917 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:07.947932 15396 rpcz_store.cc:276] 0709 13:03:06.853540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.901407 (+1047867us) service_pool.cc:224] Handling call
0709 13:03:07.946911 (+ 45504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.947113 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.947142 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.947190 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:07.947225 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.947281 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.947411 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:07.871812 17269 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.929221 17425 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:07.915297 17373 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.928422 17434 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:07.993497 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 195046us
I20260709 13:03:07.947774 17426 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.929505 17420 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:07.996212 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1976) took 1644 ms. Trace:
W20260709 13:03:08.001600 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 168970us
I20260709 13:03:07.964313 17192 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.005749 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:07.910045 17312 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.955593 17435 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:08.005209 15319 rpcz_store.cc:276] 0709 13:03:06.352009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.962207 (+1610198us) service_pool.cc:224] Handling call
0709 13:03:07.995532 (+ 33325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.995776 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.995813 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:07.995871 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:07.995915 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.995978 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.996132 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:07.897848 17330 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:07.721541 16029 rpcz_store.cc:276] 0709 13:03:06.396359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.397607 (+  1248us) service_pool.cc:224] Handling call
0709 13:03:06.398010 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:06.467682 (+ 69672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.469001 (+  1319us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:06.484045 (+ 15044us) log.cc:844] Serialized 52 byte log entry
0709 13:03:06.546982 (+ 62937us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:06.547027 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.547103 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:07.661159 (+1114056us) raft_consensus.cc:1685] finished
0709 13:03:07.673943 (+ 12784us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.682283 (+  8340us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59285,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":113679,"threads_started":2,"wal-append.queue_time_us":294495}
W20260709 13:03:08.013492 16024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 269) took 1746 ms (client timeout 2012 ms). Trace:
I20260709 13:03:08.010586 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:08.014052 16024 rpcz_store.cc:269] 0709 13:03:06.267450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.335090 (+ 67640us) service_pool.cc:224] Handling call
0709 13:03:08.013264 (+1678174us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540043b2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:08.013422 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337002240}
I20260709 13:03:08.022517 17422 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:07.997643 17434 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.032527 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 193) took 2848 ms. Trace:
I20260709 13:03:08.035504 17431 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:03:08.003818 17426 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.039474 17421 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.041034 17421 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:08.041710 17421 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:07.955765 17320 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.045082 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1769) took 1265 ms. Trace:
I20260709 13:03:08.045431 15318 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:08.045562 15399 rpcz_store.cc:276] 0709 13:03:06.779369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.901288 (+121919us) service_pool.cc:224] Handling call
0709 13:03:06.907449 (+  6161us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.907834 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.907866 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:06.908340 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.832922 (+924582us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:07.832982 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.833088 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.044827 (+211739us) raft_consensus.cc:1685] finished
0709 13:03:08.044854 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.045017 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1051,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9682,"thread_start_us":924146,"threads_started":1,"wal-append.queue_time_us":1042096}
I20260709 13:03:07.964545 17296 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:08.068459 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 195933us
I20260709 13:03:08.033053 15248 rpcz_store.cc:276] 0709 13:03:05.184045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.651473 (+467428us) service_pool.cc:224] Handling call
0709 13:03:05.651873 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.374813 (+722940us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:06.483305 (+108492us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.534188 (+ 50883us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.534272 (+    84us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:06.534320 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.032260 (+1497940us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b540001e354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:08.032322 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.032465 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1445,"prepare.queue_time_us":173849,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":38,"raft.queue_time_us":2817,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3966,"spinlock_wait_cycles":1661888896,"thread_start_us":144516,"threads_started":2,"wal-append.queue_time_us":90615,"wal-append.run_cpu_time_us":1126,"wal-append.run_wall_time_us":1001604}
I20260709 13:03:08.070212 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.070747 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:08.054878 17434 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.080197 15399 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:08.080935 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1778) took 1154 ms. Trace:
I20260709 13:03:08.080746 17276 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.081308 15399 rpcz_store.cc:276] 0709 13:03:06.926552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.047383 (+1120831us) service_pool.cc:224] Handling call
0709 13:03:08.080016 (+ 32633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.080652 (+   636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.080877 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:08.082330 17444 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:08.083662 17320 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:08.085297 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:08.015304 17377 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:08.002017 17373 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.120493 17373 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:08.087589 15999 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:08.088862 17276 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:08.091290 17392 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:08.092926 17354 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.093775 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1972) took 1796 ms. Trace:
I20260709 13:03:08.135763 15325 rpcz_store.cc:276] 0709 13:03:06.297662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.756528 (+1458866us) service_pool.cc:224] Handling call
0709 13:03:07.756856 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.783863 (+ 27007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.783904 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.789778 (+  5874us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.897009 (+107231us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:07.897056 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.897143 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.093458 (+196315us) raft_consensus.cc:1685] finished
0709 13:03:08.093486 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.093691 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26582,"raft.queue_time_us":32315,"spinlock_wait_cycles":6924032,"thread_start_us":46679,"threads_started":1,"wal-append.queue_time_us":161500}
I20260709 13:03:08.100275 17353 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.010892 17192 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.100781 17384 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:08.102147 17395 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.198s	user 0.014s	sys 0.002s
I20260709 13:03:08.103742 17367 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.104251 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.104808 17420 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.089428 17296 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.106993 17180 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.108737 15247 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 13:03:08.156363 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 982) took 1301 ms. Trace:
I20260709 13:03:08.156865 15247 rpcz_store.cc:276] 0709 13:03:06.854625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.108018 (+1253393us) service_pool.cc:224] Handling call
0709 13:03:08.108413 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:08.155975 (+ 47562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.156291 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:08.104573 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:08.112957 17444 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:08.162976 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.163286 17434 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.164098 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:08.165176 17271 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.165740 17303 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:08.166172 17303 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:08.166565 17303 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:08.167404 15317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 210) took 1425 ms (client timeout 1623 ms). Trace:
I20260709 13:03:08.168143 17384 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:08.168910 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:08.169565 15391 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.173380 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:08.109439 17429 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:03:08.175254 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.113664 17311 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.175858 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2033) took 1397 ms. Trace:
I20260709 13:03:08.175961 15249 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:08.177523 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.115413 17272 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.117663 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:08.124768 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1979) took 1730 ms. Trace:
I20260709 13:03:08.125984 17423 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.127734 16024 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:08.128839 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:08.188408 17271 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:08.130638 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:08.192870 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:08.211155 17423 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.211759 17402 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:08.212200 17402 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.212561 17402 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:08.213347 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.213704 17423 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:08.193086 17448 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.119s	user 0.000s	sys 0.003s
I20260709 13:03:08.192958 17361 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.217630 15397 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:08.182891 17042 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.220882 17042 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:08.167850 15317 rpcz_store.cc:269] 0709 13:03:06.741860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.743295 (+  1435us) service_pool.cc:224] Handling call
0709 13:03:08.167190 (+1423895us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b54001c70d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:08.167336 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39383936}
I20260709 13:03:08.222116 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:08.223461 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:08.224014 15317 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:08.224380 16025 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:08.226763 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:08.175582 17192 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.070690 17284 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:08.138855 15325 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:08.229811 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1980) took 1834 ms. Trace:
I20260709 13:03:08.230264 15325 rpcz_store.cc:276] 0709 13:03:06.395033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.137897 (+1742864us) service_pool.cc:224] Handling call
0709 13:03:08.138601 (+   704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.229595 (+ 90994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.229753 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:08.140021 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:08.123839 17449 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:08.199786 15399 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:08.206631 15323 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:08.121582 17377 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:08.147217 17270 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.151587 17353 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:08.152632 17269 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:08.154460 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1744) took 1311 ms. Trace:
I20260709 13:03:08.124056 17435 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:08.159598 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.191649 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.192332 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:08.249060 15323 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:08.154529 17395 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.181774 15394 rpcz_store.cc:276] 0709 13:03:06.778082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.899882 (+121800us) service_pool.cc:224] Handling call
0709 13:03:06.923805 (+ 23923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.037504 (+113699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.037537 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.136909 (+ 99372us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.811543 (+674634us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:07.811603 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.811707 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.175637 (+363930us) raft_consensus.cc:1685] finished
0709 13:03:08.175664 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.175798 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"thread_start_us":449598,"threads_started":1,"wal-append.queue_time_us":710327}
W20260709 13:03:08.133298 17374 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
I20260709 13:03:08.195154 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:08.231695 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:08.208628 15247 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:08.236054 15290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.543s (SENT) [suppressed 54 similar messages]
I20260709 13:03:08.206532 15320 rpcz_store.cc:276] 0709 13:03:06.394719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.120148 (+1725429us) service_pool.cc:224] Handling call
0709 13:03:08.120508 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.120716 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.120744 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:08.120784 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:08.120820 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.120878 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.124703 (+  3825us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:08.236419 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 96704.9us
I20260709 13:03:08.237433 15391 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:08.196774 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:08.240629 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:08.193715 16028 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:08.176542 17311 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.199467 17398 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:08.249332 16031 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:08.199254 17312 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:08.195068 17354 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:08.259352 15392 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 1. Current term is 3. Ops: []
I20260709 13:03:08.238565 17258 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:08.693410 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1977) took 2337 ms. Trace:
I20260709 13:03:08.796741 15242 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:08.795851 15319 rpcz_store.cc:276] 0709 13:03:06.356308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.034443 (+1678135us) service_pool.cc:224] Handling call
0709 13:03:08.050904 (+ 16461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.069553 (+ 18649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.069580 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:08.085028 (+ 15448us) log.cc:844] Serialized 26 byte log entry
0709 13:03:08.497347 (+412319us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:08.497385 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.497455 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.693164 (+195709us) raft_consensus.cc:1685] finished
0709 13:03:08.693183 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.693331 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18274,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10462,"thread_start_us":311953,"threads_started":1,"wal-append.queue_time_us":568950}
I20260709 13:03:08.800032 16031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 527) took 1948 ms. Trace:
I20260709 13:03:08.800707 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:08.778657 15391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1775) took 1949 ms (client timeout 2215 ms). Trace:
I20260709 13:03:08.335213 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1756) took 1563 ms. Trace:
I20260709 13:03:08.322880 15248 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:08.255923 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.841112 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.841784 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.193799 17180 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:08.248858 17442 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:08.780778 15395 raft_consensus.cc:2376] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4. Re-sending same reply.
I20260709 13:03:08.251874 15245 rpcz_store.cc:276] 0709 13:03:06.843022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.103902 (+1260880us) service_pool.cc:224] Handling call
0709 13:03:08.154395 (+ 50493us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:08.853559 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 621906us
I20260709 13:03:08.196911 17359 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:08.673698 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1971) took 2377 ms. Trace:
W20260709 13:03:08.782389 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 585638us
I20260709 13:03:08.257084 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:08.858217 15323 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:08.859947 15365 connection.cc:256] RPC call timeout handler was delayed by -1.6578777909999189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:03:08.259981 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.338020 16032 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:08.783880 15249 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
W20260709 13:03:08.498538 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 163482us
W20260709 13:03:08.358760 15324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1032) took 2101 ms (client timeout 2395 ms). Trace:
I20260709 13:03:08.543192 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.361969 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.201313 17444 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:08.777904 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:08.250974 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 243333us
I20260709 13:03:08.870316 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.871239 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 988) took 2015 ms. Trace:
I20260709 13:03:08.330627 17361 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:08.527536 15362 leader_election.cc:336] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.824s (SENT)
I20260709 13:03:08.542308 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:08.879118 15390 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 1.
I20260709 13:03:08.869959 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:08.880800 16028 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:08.332033 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:08.886384 17322 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.886940 17322 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.887455 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:08.801749 17360 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:08.889025 17322 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:08.701869 15144 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:08.891754 15144 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:08.843791 17180 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.893802 17180 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.593962 17377 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.786268 17423 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:08.895752 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.896526 15249 raft_consensus.cc:2376] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6. Re-sending same reply.
I20260709 13:03:08.808924 17374 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:03:08.661176 17303 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.898435 16030 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:08.654834 15317 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:08.900105 17303 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:08.519819 17406 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:08.389427 17254 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.900823 17406 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:08.901139 17254 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:08.901490 17254 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:08.902438 15397 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:08.902310 17254 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.902899 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:08.599010 17402 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:08.878715 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 351206us
I20260709 13:03:08.903656 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 154) took 1341 ms. Trace:
I20260709 13:03:08.803669 17270 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:08.804198 17258 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.904384 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:08.905112 16026 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:08.905912 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.804517 17331 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.368683 17426 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.878085 17354 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.805027 16027 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:08.878671 17398 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:08.239622 17384 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.626s
I20260709 13:03:08.907044 17398 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:08.906769 17354 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.907428 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:08.907920 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:08.547607 17433 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.361s
I20260709 13:03:08.908505 15244 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:08.909157 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:08.909427 17354 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:08.357249 15246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1735) took 1562 ms (client timeout 2046 ms). Trace:
I20260709 13:03:08.856076 17359 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:08.910667 17361 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:08.359268 17200 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.807861 17367 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:08.806129 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 999) took 1316 ms. Trace:
I20260709 13:03:08.337126 15399 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:08.911165 17359 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.911882 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 159) took 1014 ms. Trace:
I20260709 13:03:08.900842 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:08.813932 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:08.912335 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:08.912431 15399 rpcz_store.cc:276] 0709 13:03:07.897822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.260861 (+363039us) service_pool.cc:224] Handling call
0709 13:03:08.336888 (+ 76027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.911630 (+574742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.911825 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:08.912957 15325 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 5: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:08.911432 15242 rpcz_store.cc:276] 0709 13:03:07.489781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.794030 (+304249us) service_pool.cc:224] Handling call
0709 13:03:08.805894 (+1011864us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b540011b2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:08.806046 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2229880064}
I20260709 13:03:08.913539 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.913812 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:08.829808 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 986) took 1974 ms. Trace:
I20260709 13:03:08.914052 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.914438 15325 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:08.914796 17258 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:08.914522 15247 rpcz_store.cc:276] 0709 13:03:06.855716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.157864 (+1302148us) service_pool.cc:224] Handling call
0709 13:03:08.208469 (+ 50605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.829377 (+620908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.829724 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:08.838320 15291 leader_election.cc:336] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.046s (SENT)
I20260709 13:03:08.840611 15393 rpcz_store.cc:276] 0709 13:03:06.771500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.893084 (+121584us) service_pool.cc:224] Handling call
0709 13:03:07.598002 (+704918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.598965 (+   963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.334915 (+735950us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54001dae50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:08.335132 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593564032}
W20260709 13:03:08.839653 15391 rpcz_store.cc:269] 0709 13:03:06.829416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.881082 (+ 51666us) service_pool.cc:224] Handling call
0709 13:03:08.168752 (+1287670us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:08.778582 (+609830us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3627392}
I20260709 13:03:08.841535 15319 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:08.922216 15244 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:03:08.925122 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 86880.4us
I20260709 13:03:08.927325 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:08.363516 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1761) took 1586 ms. Trace:
I20260709 13:03:08.196796 17425 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:08.800555 16031 rpcz_store.cc:276] 0709 13:03:06.852079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.852264 (+   185us) service_pool.cc:224] Handling call
0709 13:03:08.098580 (+1246316us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:08.098794 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.784203 (+685409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.799680 (+ 15477us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540073fad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:08.799953 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361906816}
I20260709 13:03:08.925546 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:08.332072 17430 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.428s	user 0.000s	sys 0.003s
I20260709 13:03:08.930182 15393 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:08.931447 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:08.932303 15393 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:08.893929 15144 catalog_manager.cc:5697] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 4, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 4 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.672891 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:08.926342 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:08.934770 15391 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:08.934254 15144 catalog_manager.cc:5697] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:08.853675 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1768) took 2074 ms. Trace:
I20260709 13:03:08.249004 17446 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.935957 15391 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:08.935784 17446 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.936305 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:08.937194 15391 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:08.935531 15392 rpcz_store.cc:276] 0709 13:03:06.779117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.901060 (+121943us) service_pool.cc:224] Handling call
0709 13:03:06.901369 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.820277 (+1918908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.853321 (+ 33044us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002b5f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:08.853599 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3122650368}
I20260709 13:03:08.866120 15241 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:08.938113 17446 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.938652 15392 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:03:08.939019 15392 pending_rounds.cc:85] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 1
I20260709 13:03:08.939262 15392 pending_rounds.cc:107] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:08.939616 15392 raft_consensus.cc:2889] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:08.939343 15144 catalog_manager.cc:5697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:08.940518 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:08.941111 15319 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:08.843431 17362 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.193573 17401 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.941987 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:08.942281 17362 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:08.871799 15248 rpcz_store.cc:276] 0709 13:03:06.856250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.069887 (+1213637us) service_pool.cc:224] Handling call
0709 13:03:08.871013 (+801126us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b540010b654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:08.871165 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":578748800}
I20260709 13:03:08.943572 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.943805 17401 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.944144 15248 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:03:08.944437 17362 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.369799 15396 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:08.945016 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:08.945716 15248 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:08.864908 15324 rpcz_store.cc:269] 0709 13:03:06.257176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.344658 (+ 87482us) service_pool.cc:224] Handling call
0709 13:03:08.358523 (+2013865us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54002ee5d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:08.358674 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3683279104}
I20260709 13:03:08.946125 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2040) took 2057 ms. Trace:
I20260709 13:03:08.946897 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:08.947433 15317 raft_consensus.cc:2393] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:08.947726 15324 raft_consensus.cc:2410] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:08.947643 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.948318 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:08.948856 15324 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:08.949133 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.864382 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 528) took 1993 ms. Trace:
I20260709 13:03:08.949359 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1983) took 2532 ms. Trace:
I20260709 13:03:08.940945 15144 catalog_manager.cc:5697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
W20260709 13:03:08.346252 17439 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.307s	user 0.000s	sys 0.002s
I20260709 13:03:08.520821 17395 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:08.880697 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:08.895987 17377 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:08.478693 17399 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:08.907835 17366 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:08.910256 15246 rpcz_store.cc:269] 0709 13:03:06.795068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.813514 (+ 18446us) service_pool.cc:224] Handling call
0709 13:03:08.356973 (+1543459us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b540010c054. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:08.357151 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142806400}
I20260709 13:03:08.911101 17361 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:08.824998 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.968729 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:08.822892 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:08.969496 16031 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:08.973783 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:08.915733 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:08.793833 15243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.000s	sys 0.005s
W20260709 13:03:08.979387 15243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.001s	sys 0.005s
I20260709 13:03:08.916775 17359 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.918522 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:09.008556 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1973) took 2671 ms. Trace:
I20260709 13:03:09.009152 15325 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:08.920090 15242 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:08.900133 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:08.904012 15397 rpcz_store.cc:276] 0709 13:03:07.562346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.238718 (+676372us) service_pool.cc:224] Handling call
0709 13:03:08.252213 (+ 13495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.902875 (+650662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.903424 (+   549us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54001d9f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:08.903599 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1494899968}
I20260709 13:03:08.687518 17434 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.897495 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:08.911218 17200 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:08.914675 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:08.830858 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:09.014789 15320 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:08.928345 15398 rpcz_store.cc:276] 0709 13:03:06.777179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.865544 (+ 88365us) service_pool.cc:224] Handling call
0709 13:03:08.363274 (+1497730us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400153bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:08.363436 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388137344}
I20260709 13:03:08.923616 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:08.907505 17398 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.933029 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 523) took 2086 ms. Trace:
I20260709 13:03:08.933109 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:08.853675 15395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2042) took 1941 ms (client timeout 1550 ms). Trace:
I20260709 13:03:08.939146 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:08.866892 15250 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:08.942651 15319 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:08.856307 15318 rpcz_store.cc:276] 0709 13:03:06.296848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.755191 (+1458343us) service_pool.cc:224] Handling call
0709 13:03:07.755661 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.045885 (+290224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.673360 (+627475us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400078354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:08.673625 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":665813760}
I20260709 13:03:08.949731 16032 rpcz_store.cc:276] 0709 13:03:06.871049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.337226 (+1466177us) service_pool.cc:224] Handling call
0709 13:03:08.337591 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.864034 (+526443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.864307 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:08.950588 17402 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:08.946738 15396 rpcz_store.cc:276] 0709 13:03:06.888307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.956817 (+1068510us) service_pool.cc:224] Handling call
0709 13:03:08.369517 (+412700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.945017 (+575500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.945968 (+   951us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400153bd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:08.946068 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":865242496}
I20260709 13:03:08.950910 16028 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:08.937196 16027 raft_consensus.cc:2410] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:08.951684 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:08.953313 15391 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:08.875360 15289 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:08.949437 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1982) took 2551 ms. Trace:
I20260709 13:03:09.052523 15324 rpcz_store.cc:276] 0709 13:03:06.398183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.948397 (+2550214us) service_pool.cc:224] Handling call
0709 13:03:08.948676 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.949234 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.949390 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:08.955322 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:08.959877 15322 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:08.959559 15144 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 3 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.055142 15144 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 2 to 3, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 3 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.056865 15144 catalog_manager.cc:5697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:08.967474 15321 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:08.967592 15323 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:09.061247 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:09.010811 17399 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:09.004874 17366 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:09.006806 17361 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:09.009318 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1751) took 2096 ms. Trace:
I20260709 13:03:09.076105 15243 rpcz_store.cc:276] 0709 13:03:06.912504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.178026 (+1265522us) service_pool.cc:224] Handling call
0709 13:03:08.178354 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.178555 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:08.249295 (+ 70740us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.008787 (+759492us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.009009 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:09.009050 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:09.009093 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.009163 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.009268 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29788,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5492,"spinlock_wait_cycles":7303424,"thread_start_us":800460,"threads_started":2,"wal-append.queue_time_us":544663}
I20260709 13:03:09.013378 16024 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:09.078069 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:09.065740 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:09.008944 15316 rpcz_store.cc:276] 0709 13:03:06.337344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.799954 (+1462610us) service_pool.cc:224] Handling call
0709 13:03:07.802459 (+  2505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.830496 (+ 28037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.830529 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.850641 (+ 20112us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.989912 (+139271us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:07.989952 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.990021 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.345498 (+355477us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:09.008200 (+662702us) raft_consensus.cc:1685] finished
0709 13:03:09.008231 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.008499 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30644,"raft.queue_time_us":47084,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7154,"spinlock_wait_cycles":22457728,"thread_start_us":109538,"threads_started":1,"wal-append.queue_time_us":170487}
I20260709 13:03:09.050051 15320 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:09.014483 15245 raft_consensus.cc:2376] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6. Re-sending same reply.
I20260709 13:03:09.102411 15392 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:09.103216 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:09.010985 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:09.104208 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 93287.4us
I20260709 13:03:09.104900 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:09.013947 15249 raft_consensus.cc:2376] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5. Re-sending same reply.
W20260709 13:03:09.022266 15395 rpcz_store.cc:269] 0709 13:03:06.911899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.194891 (+1282992us) service_pool.cc:224] Handling call
0709 13:03:08.853595 (+658704us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.105998 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:09.033381 15241 raft_consensus.cc:2376] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4. Re-sending same reply.
I20260709 13:03:09.020500 16033 rpcz_store.cc:276] 0709 13:03:06.846629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.849436 (+  2807us) service_pool.cc:224] Handling call
0709 13:03:06.887474 (+ 38038us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.663553 (+776079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.663582 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:07.664067 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.795997 (+131930us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:07.796033 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.796920 (+   887us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:08.331470 (+534550us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:08.932735 (+601265us) raft_consensus.cc:1685] finished
0709 13:03:08.932757 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.932969 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15982,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8287,"spinlock_wait_cycles":25744000,"thread_start_us":907236,"threads_started":2,"wal-append.queue_time_us":223634}
I20260709 13:03:09.035427 15390 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:09.022534 15393 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:08.949824 15317 rpcz_store.cc:276] 0709 13:03:06.416610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.948553 (+2531943us) service_pool.cc:224] Handling call
0709 13:03:08.948817 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.949006 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.949038 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:08.949085 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:08.949137 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.949196 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:08.949307 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.050436 15319 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:09.109123 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1048) took 2504 ms. Trace:
I20260709 13:03:09.109486 15319 rpcz_store.cc:276] 0709 13:03:06.605160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.042864 (+2437704us) service_pool.cc:224] Handling call
0709 13:03:09.045702 (+  2838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.108883 (+ 63181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.109069 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.110941 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 213) took 2289 ms. Trace:
I20260709 13:03:09.111256 15319 rpcz_store.cc:276] 0709 13:03:06.821941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.110158 (+2288217us) service_pool.cc:224] Handling call
0709 13:03:09.110482 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.110654 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.110679 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:09.110718 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:09.110746 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.110793 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.110893 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.004506 16026 raft_consensus.cc:2410] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:09.058063 15144 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.067312 15318 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:09.015210 17311 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:09.068711 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 193436us
I20260709 13:03:09.120504 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1986) took 2506 ms. Trace:
I20260709 13:03:09.120905 15318 rpcz_store.cc:276] 0709 13:03:06.613987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.043547 (+2429560us) service_pool.cc:224] Handling call
0709 13:03:09.067075 (+ 23528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.119205 (+ 52130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.120445 (+  1240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:09.070087 15321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1042) took 2474 ms (client timeout 2268 ms). Trace:
W20260709 13:03:09.124032 15321 rpcz_store.cc:269] 0709 13:03:06.595286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.814610 (+219324us) service_pool.cc:224] Handling call
0709 13:03:09.069822 (+2255212us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54002198d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:09.070003 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4842414464}
W20260709 13:03:09.071285 15322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1036) took 2590 ms (client timeout 1824 ms). Trace:
W20260709 13:03:09.125011 15322 rpcz_store.cc:269] 0709 13:03:06.480820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.589811 (+108991us) service_pool.cc:224] Handling call
0709 13:03:09.071069 (+2481258us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b54001e69d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:09.071206 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5431533312}
I20260709 13:03:09.072875 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 209) took 2331 ms. Trace:
I20260709 13:03:09.125967 15323 rpcz_store.cc:276] 0709 13:03:06.741592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.071781 (+2330189us) service_pool.cc:224] Handling call
0709 13:03:09.072197 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.072423 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.072460 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:09.072544 (+    84us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:09.072591 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.072673 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.072807 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.074572 15324 pending_rounds.cc:85] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 4
I20260709 13:03:09.077993 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:09.080006 15316 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:09.127355 15324 pending_rounds.cc:107] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:03:09.127517 15243 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:09.127720 15324 raft_consensus.cc:2889] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:09.127969 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 211) took 2385 ms. Trace:
I20260709 13:03:09.128532 15316 rpcz_store.cc:276] 0709 13:03:06.742153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.079353 (+2337200us) service_pool.cc:224] Handling call
0709 13:03:09.079766 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.127623 (+ 47857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.127897 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.077672 17402 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:09.059744 17422 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.138630 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:09.139382 16024 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 2.
I20260709 13:03:09.098520 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:09.099174 17459 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:09.010684 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1045) took 2414 ms. Trace:
I20260709 13:03:09.142267 15320 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:09.142572 15325 rpcz_store.cc:276] 0709 13:03:06.596181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.008707 (+2412526us) service_pool.cc:224] Handling call
0709 13:03:09.008992 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.010448 (+  1456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.010631 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:09.143739 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 907633us
I20260709 13:03:09.144349 15325 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:09.058456 17141 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.012995 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:09.118975 17401 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:09.148535 16029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.013s	sys 0.031s
I20260709 13:03:09.117259 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:09.154179 15245 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:09.023002 17180 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:09.007897 15365 connection.cc:256] RPC call timeout handler was delayed by -1.3463982460000352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 13:03:09.157039 15365 connection.cc:256] RPC call timeout handler was delayed by -1.327375834999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20720000000000002s for a response
W20260709 13:03:09.157495 15365 connection.cc:256] RPC call timeout handler was delayed by -1.0546104539999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23950000000000002s for a response
I20260709 13:03:09.158644 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:09.159377 16033 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:09.130597 17311 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.160904 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:09.129944 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:09.162438 15249 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:09.123628 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:09.164238 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:09.135407 15243 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:09.166093 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:09.138940 17422 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:09.139608 15316 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:09.135332 15144 catalog_manager.cc:5697] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.212779 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:09.096014 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:09.214397 15247 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:09.119091 17360 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:09.118623 17362 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:09.113382 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.221619 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:09.152223 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:09.223565 15242 raft_consensus.cc:2376] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4. Re-sending same reply.
I20260709 13:03:09.129563 17361 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:09.136540 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:09.170773 15318 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:09.227780 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.167066 17406 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:09.174952 15246 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:09.176900 15317 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:09.182350 17395 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:09.169122 17311 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:09.184471 17180 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:09.186985 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 63434.1us
I20260709 13:03:09.238817 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:09.238920 15247 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:09.239951 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:09.187776 17354 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:09.190596 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:09.246402 15249 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:09.244599 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:09.194672 17377 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:09.155007 17141 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:09.154356 17401 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.197153 17398 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:09.146657 17433 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:03:09.199186 15243 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:09.201556 15245 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
W20260709 13:03:09.155536 16029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.014s	sys 0.032s
I20260709 13:03:09.265266 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1053) took 1550 ms. Trace:
W20260709 13:03:09.202538 15290 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.640s (SENT)
I20260709 13:03:09.255286 17180 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:09.266608 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 64109us
I20260709 13:03:09.263345 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:09.268684 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.269105 15247 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:09.209275 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45145.5us
I20260709 13:03:09.114450 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:09.213702 15144 catalog_manager.cc:5697] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 4, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 4 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.227660 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 215) took 1397 ms. Trace:
I20260709 13:03:09.270989 15318 rpcz_store.cc:276] 0709 13:03:07.830407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.137890 (+1307483us) service_pool.cc:224] Handling call
0709 13:03:09.170261 (+ 32371us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:09.170527 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.227328 (+ 56801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.227590 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10118912}
I20260709 13:03:09.173286 17366 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:09.227939 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 444354us
I20260709 13:03:09.235172 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:09.235112 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:09.233709 17402 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:09.219179 17362 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.215929 17367 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:09.241935 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:09.192783 17421 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:09.250733 17312 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:09.253762 17360 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:09.271911 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:09.289711 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:09.269601 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:09.273993 15144 catalog_manager.cc:5697] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.290405 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:09.234683 17446 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:09.291256 15249 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:09.236948 17270 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:03:09.289852 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:09.255263 17401 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:09.296208 17366 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:09.314890 17366 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:09.315248 15247 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
W20260709 13:03:09.315550 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.316378 17312 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:09.317245 17312 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:09.322788 17398 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:09.292882 17421 consensus_queue.cc:1243] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:09.324978 17399 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:09.325800 17399 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:09.326948 17399 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:09.282920 17362 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:09.291570 15144 catalog_manager.cc:5697] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:09.275908 17180 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:09.265908 15317 rpcz_store.cc:276] 0709 13:03:07.715116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.130756 (+1415640us) service_pool.cc:224] Handling call
0709 13:03:09.168376 (+ 37620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.243008 (+ 74632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.265170 (+ 22162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.300952 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:09.292500 16025 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:09.340262 15144 catalog_manager.cc:5697] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:09.345513 15144 catalog_manager.cc:5697] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 2, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 2 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.347182 17180 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:09.256211 17200 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:09.351605 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 50750us
I20260709 13:03:09.307942 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:09.353330 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45493.6us
I20260709 13:03:09.297072 17446 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:09.254590 17377 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:09.288867 17402 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:09.343330 15250 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:09.351879 15144 catalog_manager.cc:5697] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 2 to 4, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 4 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
W20260709 13:03:09.360872 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.361406 15144 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:09.361658 15249 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:09.364729 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 992) took 2343 ms. Trace:
I20260709 13:03:09.365250 15249 rpcz_store.cc:276] 0709 13:03:07.021117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.341671 (+2320554us) service_pool.cc:224] Handling call
0709 13:03:09.361460 (+ 19789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.364388 (+  2928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.364653 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.354732 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:09.368537 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 991) took 2347 ms. Trace:
I20260709 13:03:09.368984 15250 rpcz_store.cc:276] 0709 13:03:07.020721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.298162 (+2277441us) service_pool.cc:224] Handling call
0709 13:03:09.343157 (+ 44995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.368246 (+ 25089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.368465 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.375379 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:09.373536 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 500090us
W20260709 13:03:09.378961 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.384656 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:09.358544 17446 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:09.403121 15241 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:09.396754 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:09.403806 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1756) took 1784 ms. Trace:
I20260709 13:03:09.356503 17367 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:09.401651 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.349949 17311 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:09.360055 17377 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:09.359301 17398 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:09.414906 16033 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:03:09.404156 15241 rpcz_store.cc:276] 0709 13:03:07.619592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.402617 (+1783025us) service_pool.cc:224] Handling call
0709 13:03:09.402960 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.403568 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.403752 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.415926 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:09.416469 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1757) took 1796 ms. Trace:
I20260709 13:03:09.407194 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1753) took 1904 ms. Trace:
I20260709 13:03:09.416852 15241 rpcz_store.cc:276] 0709 13:03:07.619916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.415734 (+1795818us) service_pool.cc:224] Handling call
0709 13:03:09.416003 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.416163 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.416187 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:09.416226 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:09.416255 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.416306 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.416415 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.417583 15249 rpcz_store.cc:276] 0709 13:03:07.502436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.373219 (+1870783us) service_pool.cc:224] Handling call
0709 13:03:09.406591 (+ 33372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.406794 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.406832 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:09.406878 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:09.406915 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.406980 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.407123 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.412521 15243 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:09.418501 15241 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:03:09.418749 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1755) took 1799 ms. Trace:
I20260709 13:03:09.418999 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1758) took 1766 ms. Trace:
I20260709 13:03:09.419062 15243 rpcz_store.cc:276] 0709 13:03:07.619189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.403143 (+1783954us) service_pool.cc:224] Handling call
0709 13:03:09.403427 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.418500 (+ 15073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.418697 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.419397 15241 rpcz_store.cc:276] 0709 13:03:07.652186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.417881 (+1765695us) service_pool.cc:224] Handling call
0709 13:03:09.418167 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.418802 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.418954 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.420562 15243 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:09.421715 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1759) took 1765 ms. Trace:
I20260709 13:03:09.422845 15250 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:09.422082 15243 rpcz_store.cc:276] 0709 13:03:07.656494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.420001 (+1763507us) service_pool.cc:224] Handling call
0709 13:03:09.420271 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.421490 (+  1219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.421666 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:09.424149 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1754) took 1911 ms. Trace:
W20260709 13:03:09.373348 17455 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.030s	sys 0.040s
I20260709 13:03:09.429821 16032 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:09.430636 15250 rpcz_store.cc:276] 0709 13:03:07.513360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.378065 (+1864705us) service_pool.cc:224] Handling call
0709 13:03:09.415058 (+ 36993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.423291 (+  8233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.424073 (+   782us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:09.431499 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.427983 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.417308 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:09.468937 15318 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:03:09.359979 17425 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:03:09.407191 17384 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:09.405382 17303 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:09.377053 17331 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:03:09.481729 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:09.510515 16030 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:09.422586 17398 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:09.517393 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 100145us
I20260709 13:03:09.518563 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:09.476042 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78314.5us
W20260709 13:03:09.472997 17455 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.030s	sys 0.041s
I20260709 13:03:09.520704 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:09.503803 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:09.515534 17406 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:09.422746 17395 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:03:09.506646 17384 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:09.480239 17332 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 13:03:09.509204 17420 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:03:09.523933 15394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.000s	sys 0.028s
W20260709 13:03:09.601624 15394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.000s	sys 0.028s
I20260709 13:03:09.568375 17332 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:09.602723 17332 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:09.598990 17441 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:09.603432 17441 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.603834 17441 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:09.603436 17254 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:09.552487 16025 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:09.603952 17332 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:09.578675 17374 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:09.607187 17374 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:09.607649 17374 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:09.608100 17374 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:09.613617 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 371742us
I20260709 13:03:09.523129 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:09.542723 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 61094.2us
W20260709 13:03:09.619112 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 96039.5us
I20260709 13:03:09.605906 17332 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:09.624890 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 355349us
I20260709 13:03:09.629724 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:09.639878 15365 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:09.623356 15998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.001s	sys 0.022s
I20260709 13:03:09.642405 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:09.642860 15998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.001s	sys 0.022s
W20260709 13:03:09.643375 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 785719us
I20260709 13:03:09.517575 17398 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:09.559839 17434 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:09.525462 15317 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.641597 17464 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:09.646755 15244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.018s	sys 0.013s
I20260709 13:03:09.646130 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:09.680061 15244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.019s	sys 0.013s
I20260709 13:03:09.681571 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:09.516439 17402 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:09.565016 17406 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:09.524904 17460 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.560763 17384 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:09.610817 17330 raft_consensus.cc:2764] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:03:09.563261 17466 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:09.639799 17395 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:09.650547 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.682891 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 162281us
I20260709 13:03:09.566893 17265 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:03:09.688078 15291 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:09.643697 17303 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:09.695823 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:09.696638 17367 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:09.646104 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:09.674045 17366 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:09.715371 15362 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.010s	sys 0.010s
I20260709 13:03:09.671835 17434 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:09.750463 15362 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.014s	sys 0.010s
W20260709 13:03:09.750869 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 834216us
W20260709 13:03:09.714324 17426 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.018s	sys 0.041s
I20260709 13:03:09.676254 17331 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:03:09.734063 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:09.674906 17354 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:03:09.760808 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 72843.7us
I20260709 13:03:09.764503 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:09.784058 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:09.784166 15320 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:09.677687 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:09.791940 15319 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:09.793642 15316 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:03:09.775959 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 80260.5us
I20260709 13:03:09.692356 17406 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:09.732990 17395 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:09.782421 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.690289 17465 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:09.785915 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 51954.5us
W20260709 13:03:09.786548 15322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.051s	sys 0.070s
W20260709 13:03:09.821074 15322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.051s	sys 0.070s
I20260709 13:03:09.803112 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:09.821404 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:09.750277 17433 consensus_queue.cc:1243] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:03:09.807039 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.827826 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:09.704797 17200 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:09.780977 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 134960us
W20260709 13:03:09.764129 17426 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.020s	sys 0.045s
I20260709 13:03:09.815912 16025 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 3: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:09.815765 17479 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:09.817747 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 206) took 3077 ms. Trace:
I20260709 13:03:09.818475 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1752) took 2898 ms. Trace:
I20260709 13:03:09.836163 15244 rpcz_store.cc:276] 0709 13:03:06.920248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.971011 (+2050763us) service_pool.cc:224] Handling call
0709 13:03:08.971324 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:09.008668 (+ 37344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.008700 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:09.009154 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.680467 (+671313us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:09.680506 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.680569 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.818183 (+137614us) raft_consensus.cc:1685] finished
0709 13:03:09.818208 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.818407 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3571,"raft.queue_time_us":4051,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6287,"thread_start_us":629446,"threads_started":1,"wal-append.queue_time_us":803228}
W20260709 13:03:09.837060 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 329733us
W20260709 13:03:09.821805 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.687042 17464 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:09.790814 17442 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:09.766680 17311 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:09.829074 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:09.875769 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:09.876508 15244 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:09.777245 17466 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:03:09.734742 17360 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:09.796422 17303 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:09.834666 15324 rpcz_store.cc:276] 0709 13:03:06.740726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.073684 (+2332958us) service_pool.cc:224] Handling call
0709 13:03:09.074134 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:09.132007 (+ 57873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.132037 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:09.157248 (+ 25211us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b2c0012b498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:09.185333 (+ 28085us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b2c0012b498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:09.186004 (+   671us) log.cc:844] Serialized 52 byte log entry
0709 13:03:09.561864 (+375860us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:09.561924 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.562023 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.817481 (+255458us) raft_consensus.cc:1685] finished
0709 13:03:09.817503 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.817679 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9552,"spinlock_wait_cycles":56691840,"thread_start_us":375442,"threads_started":1,"wal-append.queue_time_us":570890}
I20260709 13:03:09.837038 17180 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:09.838181 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 193141us
I20260709 13:03:09.791415 17420 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.792171 17367 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:09.845113 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.847568 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 177272us
I20260709 13:03:09.823734 17395 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:09.792884 17425 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:03:09.859272 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:09.832803 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:09.828109 17366 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.839358 17331 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:09.858202 17200 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:09.859906 17458 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:03:09.846848 17442 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:09.838492 17479 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:09.904963 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.904076 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 71419.9us
I20260709 13:03:09.927129 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:09.908456 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 160) took 1922 ms. Trace:
I20260709 13:03:09.808171 17460 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:09.898787 15248 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:09.870327 17465 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:09.902305 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:09.903327 17362 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.003s
I20260709 13:03:09.858922 17480 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:09.900854 17401 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260709 13:03:09.909761 17425 consensus_queue.cc:1243] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:09.898589 17180 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:09.935987 17483 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:09.938174 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 199597us
I20260709 13:03:09.910498 17331 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:09.961553 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.931560 15394 rpcz_store.cc:276] 0709 13:03:07.986074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.934163 (+948089us) service_pool.cc:224] Handling call
0709 13:03:08.934510 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.934713 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:08.935057 (+   344us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.883175 (+948118us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.908012 (+ 24837us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:09.908081 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:09.908136 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.908219 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.908377 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3474,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":574,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":971877,"threads_started":3,"wal-append.queue_time_us":798836}
I20260709 13:03:09.915917 17466 consensus_queue.cc:1243] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:03:09.977670 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 156362us
I20260709 13:03:09.929338 17442 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:09.899691 17311 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:03:09.982813 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:09.927477 17254 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:09.986209 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 85280.9us
W20260709 13:03:09.989301 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 129521us
I20260709 13:03:09.998494 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:09.843155 17434 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:09.994524 17469 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
W20260709 13:03:09.994961 17475 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:03:09.995076 17441 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:09.928288 17479 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:09.999413 15365 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:09.878369 17406 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:09.902899 17420 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:09.916620 17366 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:10.020871 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:09.978719 17180 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:09.982977 17312 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:09.968602 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:09.995896 17471 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:03:09.982662 17465 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:10.033349 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:09.983063 17480 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:09.997491 17254 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:10.044767 15244 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
W20260709 13:03:10.051321 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84512.7us
I20260709 13:03:10.031452 17433 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:09.975718 17362 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:09.978407 17401 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:10.026032 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 204452us
I20260709 13:03:10.011941 17491 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:10.054268 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:10.055851 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 173883us
I20260709 13:03:10.069037 15363 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:10.070541 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.052402 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:10.043411 17312 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.082768 15290 leader_election.cc:400] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:10.052985 17426 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:10.054667 17254 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:10.063437 17477 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:10.062572 17433 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:10.066241 17406 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:10.098049 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 64772.5us
I20260709 13:03:10.011919 17367 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:10.063488 17200 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:10.099143 15290 leader_election.cc:403] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:03:10.145818 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 147421us
I20260709 13:03:10.102190 17509 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:10.146948 15213 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:10.065001 17425 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:10.083388 17312 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:10.048746 17492 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:03:10.109596 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:10.030992 17502 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:03:10.114992 16032 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:10.092617 17465 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:10.118335 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1055) took 1937 ms. Trace:
W20260709 13:03:10.117537 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49381.1us
I20260709 13:03:10.100160 17141 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:10.050349 17360 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:10.053295 17331 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:10.086104 17402 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:03:10.132478 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:10.093628 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 193091us
I20260709 13:03:10.133117 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:10.121942 17359 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.107s	user 0.007s	sys 0.009s
I20260709 13:03:10.152654 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:10.167474 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.120203 17426 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:03:10.129660 17477 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:10.222213 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 139640us
W20260709 13:03:10.277742 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 144716us
I20260709 13:03:10.227109 15321 rpcz_store.cc:276] 0709 13:03:08.180933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.136227 (+955294us) service_pool.cc:224] Handling call
0709 13:03:09.136577 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:09.136800 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.136834 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:09.158027 (+ 21193us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b2c0012b498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:09.158559 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.543059 (+384500us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:09.543101 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.543200 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.110293 (+567093us) raft_consensus.cc:1685] finished
0709 13:03:10.110317 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.118256 (+  7939us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36532992,"thread_start_us":368402,"threads_started":1,"wal-append.queue_time_us":622282}
W20260709 13:03:10.252962 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.278132 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:10.270588 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:10.263585 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 163982us
I20260709 13:03:10.280149 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:10.133817 17508 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:10.136162 17270 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:10.152390 17509 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:10.144507 17481 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:10.200011 17503 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:03:10.200723 17506 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:03:10.273312 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 120719us
I20260709 13:03:10.147387 17483 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:10.219589 17496 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:10.200810 17513 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:10.286340 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.288230 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 141406us
W20260709 13:03:10.285320 17484 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:03:10.263557 17491 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:10.275187 17464 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:10.196672 17425 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:10.311163 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:10.311568 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:10.276091 17141 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:03:10.284214 17477 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:10.332856 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 62380.9us
I20260709 13:03:10.302904 17515 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.309085 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 104921us
I20260709 13:03:10.123560 17480 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:10.296734 17460 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:10.199450 17441 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:10.323800 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:10.302218 17258 raft_consensus.cc:2764] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:10.270713 17520 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:10.295464 17509 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:10.310495 17513 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:10.327010 17494 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:03:10.318957 17489 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:10.322276 17508 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:10.319389 17366 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:10.290477 17514 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:03:10.318552 17270 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:10.318912 17510 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.322841 17501 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:03:10.395534 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 84441.7us
I20260709 13:03:10.331516 17483 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:10.399761 17519 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:10.324035 17481 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:03:10.368287 17362 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:10.383539 17402 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:10.321839 17200 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:10.273399 17433 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:10.321393 17497 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 13:03:10.403101 17518 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:10.403357 17489 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:10.405812 17513 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:10.369688 17401 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:10.416821 17422 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:10.428362 17501 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:10.450877 17483 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:10.370719 17515 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:10.465308 17361 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.231s	user 0.009s	sys 0.006s
W20260709 13:03:10.498735 17512 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:03:10.499221 17505 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:03:10.466441 17481 consensus_queue.cc:1243] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:10.460561 17496 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:10.487818 17433 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:10.522758 17377 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.051s	user 0.012s	sys 0.001s
I20260709 13:03:10.488162 17519 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:10.549935 17524 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:10.550252 17526 raft_consensus.cc:2764] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:10.550686 17524 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:10.551034 17516 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:10.551643 17516 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:10.551805 17524 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:10.552600 17516 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:10.553133 17525 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:10.553838 17507 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:03:10.435655 17510 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:10.570827 17488 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 13:03:10.572088 17332 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.929s	user 0.005s	sys 0.006s
I20260709 13:03:10.576639 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 1988) took 1738 ms. Trace:
I20260709 13:03:10.577224 15322 rpcz_store.cc:276] 0709 13:03:08.838088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.137336 (+299248us) service_pool.cc:224] Handling call
0709 13:03:09.137626 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:09.821436 (+683810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.821466 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:09.830014 (+  8548us) log.cc:844] Serialized 26 byte log entry
0709 13:03:10.031857 (+201843us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:10.031899 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.031973 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.576339 (+544366us) raft_consensus.cc:1685] finished
0709 13:03:10.576369 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.576554 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12719,"raft.queue_time_us":5478,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12929,"thread_start_us":806448,"threads_started":2,"wal-append.queue_time_us":223840}
W20260709 13:03:10.581380 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 264310us
W20260709 13:03:10.567322 17442 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.555s	user 0.002s	sys 0.008s
I20260709 13:03:10.569936 17528 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 13:03:10.532372 17270 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:10.543581 17377 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:10.588636 17518 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:10.638948 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 360868us
I20260709 13:03:10.640170 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:10.677968 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.678668 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.631062 17374 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.022s	user 0.010s	sys 0.005s
I20260709 13:03:10.681746 17366 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:03:10.623662 17442 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:10.580540 17483 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:10.625334 17496 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:10.705384 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 381612us
I20260709 13:03:10.903867 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 296) took 1499 ms. Trace:
I20260709 13:03:11.158365 16027 rpcz_store.cc:276] 0709 13:03:09.404843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.406361 (+  1518us) service_pool.cc:224] Handling call
0709 13:03:10.902940 (+1496579us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:10.903207 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.903428 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:10.903466 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:10.903510 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:10.903573 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.903646 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.903792 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99113344}
W20260709 13:03:10.882774 17384 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.127s	user 0.011s	sys 0.002s
W20260709 13:03:10.928158 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.163182 17384 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:10.712486 17180 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.002s
I20260709 13:03:10.707868 16026 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:11.166765 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.167306 16026 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:11.167425 17180 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.168421 17384 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:10.924997 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 289) took 2741 ms. Trace:
I20260709 13:03:10.637171 17312 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:10.885181 17398 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 1.204s	user 0.005s	sys 0.007s
I20260709 13:03:11.169562 16029 rpcz_store.cc:276] 0709 13:03:08.183394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.209756 (+ 26362us) service_pool.cc:224] Handling call
0709 13:03:08.214442 (+  4686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.253815 (+ 39373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.255311 (+  1496us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:08.643779 (+388468us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b2c00048698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:08.644403 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 13:03:09.265948 (+621545us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:09.265992 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.266075 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.063020 (+796945us) raft_consensus.cc:1685] finished
0709 13:03:10.066375 (+  3355us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.924684 (+858309us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b54004844d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:10.924903 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14564,"raft.queue_time_us":38924,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":44505,"spinlock_wait_cycles":349672576,"thread_start_us":621070,"threads_started":1,"wal-append.queue_time_us":786263,"wal-append.run_cpu_time_us":6524,"wal-append.run_wall_time_us":1606309}
I20260709 13:03:11.172035 17398 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.173703 17258 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.812911 17254 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.004s
I20260709 13:03:11.174788 17258 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.175673 17398 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:11.032470 17303 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.106s	user 0.006s	sys 0.012s
W20260709 13:03:11.176750 17303 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.006s	sys 0.014s
I20260709 13:03:11.177155 17303 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:11.179236 17398 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.991423 17377 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.179193 17303 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.180235 17398 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:11.182647 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.719470 17421 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:03:10.891391 17479 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.843s	user 0.011s	sys 0.000s
I20260709 13:03:11.183509 17366 consensus_queue.cc:1243] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:10.704751 17497 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:10.979749 17406 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.839s	user 0.008s	sys 0.004s
I20260709 13:03:10.704586 17374 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.188045 17497 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:10.925351 17420 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:11.043116 17433 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
W20260709 13:03:11.056252 17465 consensus_meta.cc:287] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.790s	user 0.014s	sys 0.000s
I20260709 13:03:11.010851 17331 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:10.981779 17477 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.000s
I20260709 13:03:11.190891 17465 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:11.191660 17477 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.192852 17479 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:11.184124 15248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1015) took 2181 ms (client timeout 2134 ms). Trace:
I20260709 13:03:10.944512 17510 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:11.152312 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.699892 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58071us
I20260709 13:03:10.697201 17508 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:11.043576 17509 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.000s
I20260709 13:03:11.195959 17421 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:10.877775 17489 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.197037 17509 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:10.715818 17395 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.806s	user 0.009s	sys 0.001s
W20260709 13:03:10.957454 17485 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.021s	user 0.000s	sys 0.008s
I20260709 13:03:11.190040 17497 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.198922 17395 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.199566 17497 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:11.200220 17509 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:11.201010 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.201514 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.204169 17311 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.919610 17513 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.205236 17311 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.205873 17480 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:11.206795 17480 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.207573 17479 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.175328 17254 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.197377 17508 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:10.978762 17540 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:03:11.169310 16026 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.173921 17312 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:11.194629 15248 rpcz_store.cc:269] 0709 13:03:09.002801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.060929 (+ 58128us) service_pool.cc:224] Handling call
0709 13:03:11.183542 (+2122613us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b540025b7d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:11.183809 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1924069248}
I20260709 13:03:11.201707 17258 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.201817 17395 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:11.219372 17442 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:10.708003 17523 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
W20260709 13:03:11.009192 17545 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.199s	user 0.000s	sys 0.002s
W20260709 13:03:10.843256 17487 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.907s	user 0.000s	sys 0.011s
W20260709 13:03:10.700488 17446 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.275s	user 0.009s	sys 0.006s
I20260709 13:03:11.219901 16026 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.212316 17489 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:11.215948 17374 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.012210 17434 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:10.782807 17511 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:10.707406 17527 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:11.197912 17421 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:10.714735 17518 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.233377 17180 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:10.885777 17425 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:10.883785 17515 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:11.261778 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.250018 17254 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.264626 17511 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:11.267047 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1025) took 2260 ms. Trace:
I20260709 13:03:11.275537 17398 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.257959 17311 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.276566 17511 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.275484 15241 rpcz_store.cc:276] 0709 13:03:09.006199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.421273 (+415074us) service_pool.cc:224] Handling call
0709 13:03:09.421557 (+   284us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:09.421887 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.421914 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:09.431197 (+  9283us) log.cc:844] Serialized 52 byte log entry
0709 13:03:09.807606 (+376409us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:09.816602 (+  8996us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.836234 (+ 19632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.836309 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.842474 (+1006165us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:10.943956 (+101482us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b180014f440. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d522 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:11.266437 (+322481us) raft_consensus.cc:1685] finished
0709 13:03:11.266469 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.266793 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19330,"prepare.queue_time_us":9480,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":288554,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":49261,"spinlock_wait_cycles":49596544,"thread_start_us":262800,"threads_started":1,"wal-append.queue_time_us":417718}
I20260709 13:03:10.726963 17519 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.273104 17455 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:03:10.882709 17501 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.271462 17480 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.278146 17511 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:11.290863 17513 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:11.284380 17446 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.293444 17510 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:11.294464 17425 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:03:11.304188 15249 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:11.306041 15241 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:11.306083 17510 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.306763 17446 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.310865 17501 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:11.312043 16026 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:03:11.312650 16026 pending_rounds.cc:85] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 5
W20260709 13:03:11.315375 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.316120 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.315802 15241 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:11.309954 17510 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.329900 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:11.334160 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.339164 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.339628 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.340318 15242 raft_consensus.cc:2410] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:11.340592 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.341375 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.341650 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.342551 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.339082 17200 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:11.345356 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:11.345945 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.347374 16027 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:11.348704 17483 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.349579 17483 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:11.350986 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.352461 17483 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.353654 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:11.339758 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.354598 16033 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:11.354920 15250 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:11.355633 17477 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.342720 17332 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:11.359653 17332 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:11.360301 17265 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:11.361179 17265 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.361076 17332 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.363749 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.364614 15241 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.365640 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:11.336205 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 460163us
W20260709 13:03:11.366842 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.366863 17377 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.367174 17420 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:11.367509 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45253.2us
I20260709 13:03:11.367702 15245 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:11.367820 17377 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.368631 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:11.368865 17513 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.369621 17513 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.370728 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.372586 15243 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:11.366581 17433 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:11.360020 17455 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:11.376008 17433 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:11.376832 17433 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.377311 17433 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.345727 17200 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.368871 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.376132 17455 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:11.320626 16026 pending_rounds.cc:107] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 13:03:11.382522 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.384552 17513 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.367908 17420 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.385804 17421 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.382269 17455 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:11.387563 17420 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.359032 15242 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:11.387208 17455 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.391906 15250 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:11.396987 15241 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:11.389537 16026 raft_consensus.cc:2889] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:11.402879 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.409947 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 295) took 2005 ms. Trace:
I20260709 13:03:11.410733 17200 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.412078 17529 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.407249 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.412810 17529 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.414153 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.414440 17332 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.415134 15242 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
W20260709 13:03:11.415934 17467 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:03:11.416339 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.417287 15242 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:11.417852 17377 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.410531 16026 rpcz_store.cc:276] 0709 13:03:09.404384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.406417 (+  2033us) service_pool.cc:224] Handling call
0709 13:03:09.504064 (+ 97647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.707762 (+1203698us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b5400582120. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfc1c0 00007f3669bfd231 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c
0709 13:03:11.409514 (+701752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.409840 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71654656}
I20260709 13:03:11.419457 17265 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:11.421383 17529 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.423964 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:11.424873 16026 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.425264 16029 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:11.427021 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:11.405162 17425 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.432194 17425 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.435745 16026 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
W20260709 13:03:11.438556 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57295.8us
I20260709 13:03:11.439320 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.440622 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.442256 17518 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.444991 17518 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.447405 17518 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:11.442901 17483 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:11.459972 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 52488.8us
I20260709 13:03:11.465355 17425 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.468319 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.468689 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.469594 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.470707 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.471819 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.473922 15241 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:11.478523 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:11.480098 17200 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:11.488027 15392 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:03:11.453559 17455 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.489179 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.496342 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.482256 17398 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.459995 17265 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:11.484030 17483 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:11.494553 17180 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.504463 15394 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:11.504467 17515 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:11.486037 17446 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:03:11.530504 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.531277 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.511547 17398 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.532660 16028 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:11.537581 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.560940 15246 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:11.561216 15393 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:11.562150 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.562359 17265 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.538599 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:11.539178 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:11.539521 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.542433 17465 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.543004 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.543243 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:11.546772 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.517839 17483 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.556211 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.559856 15241 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:11.565793 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.526155 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:11.567575 15242 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:11.563043 15246 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:11.565433 17527 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.574738 16031 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:11.576771 15244 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:11.565101 17265 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.583376 15395 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:11.583616 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.583623 15245 raft_consensus.cc:2368] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
I20260709 13:03:11.588724 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.596076 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.582701 16029 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:11.569115 17515 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:11.616892 17515 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:11.600840 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 143153us
I20260709 13:03:11.619776 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:11.622581 17480 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:11.596542 17510 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.623337 17510 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.606441 15394 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:11.599640 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.601090 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:11.603086 17519 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:11.610401 15365 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.134s (SENT)
I20260709 13:03:11.599264 17180 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:11.612076 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.612754 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.562209 17511 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:03:11.615059 17465 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.617259 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:11.606402 17527 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.631597 15365 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:11.633601 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.635311 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.638214 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:11.640916 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.642061 17311 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.642733 17311 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.643721 17180 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.645089 17311 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.646415 15396 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:03:11.646600 17558 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:03:11.646427 15250 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:11.647841 15246 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:11.648891 15322 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:11.650079 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:11.650381 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.650867 15320 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:11.652379 15316 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:11.653769 17465 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:11.654218 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1026) took 2608 ms. Trace:
I20260709 13:03:11.650813 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:11.649956 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.655772 15242 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:11.656967 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:11.640486 15244 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:11.676518 15250 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:11.654623 15249 rpcz_store.cc:276] 0709 13:03:09.045854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.459132 (+413278us) service_pool.cc:224] Handling call
0709 13:03:09.518650 (+ 59518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.304810 (+1786160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.653939 (+349129us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400315e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:11.654139 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4105238400}
I20260709 13:03:11.631239 17519 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:11.683600 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.684263 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.683508 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:11.650727 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:11.684510 15241 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:11.654454 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:11.688344 16026 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.689072 15392 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:11.690553 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.691191 15392 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:11.691609 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.692250 15390 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:11.693235 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.693992 17510 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.694530 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.694857 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.695093 15396 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:11.695165 15399 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:11.695901 17527 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.680583 15246 raft_consensus.cc:2376] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4. Re-sending same reply.
I20260709 13:03:11.696118 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.697748 15397 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:11.697856 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 138020us
I20260709 13:03:11.698395 17465 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:11.699239 15398 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:11.700882 15398 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:11.696090 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.701970 17519 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.703011 15396 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:11.703755 17519 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.704257 15396 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:11.702384 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.706182 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.707998 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:11.708842 15319 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:11.709800 17514 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:11.710459 15325 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:11.710484 17514 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.714181 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:11.715282 17483 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.718513 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.688333 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:11.714257 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92012.9us
I20260709 13:03:11.698020 15399 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:11.718297 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:11.722327 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.721501 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.724200 15392 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:11.724648 15325 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:11.728430 15397 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:11.728987 15390 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:11.729508 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.731204 15245 raft_consensus.cc:2410] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:11.725378 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.734525 15249 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:03:11.740211 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.741276 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:11.737870 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:11.738901 15321 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:11.744462 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.745265 15393 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:11.747335 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.680380 17311 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 13:03:11.753767 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66116.2us
I20260709 13:03:11.744158 15324 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:11.736382 17501 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:03:11.748101 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:11.760154 17510 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:11.760375 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:11.761009 17359 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.763197 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:11.766479 17332 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.758409 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.783610 15243 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:11.780890 15250 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:11.754778 17180 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:11.757863 17311 consensus_queue.cc:1243] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:03:11.793867 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.796375 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.800812 15316 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:11.802852 15398 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.800581 17529 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:11.805825 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:11.806645 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 43623.8us
I20260709 13:03:11.807483 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:11.808694 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:11.809585 17434 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:11.810164 17359 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.811081 15390 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:11.812201 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.813170 15243 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:11.814193 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.814334 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.814586 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.815099 15243 raft_consensus.cc:2410] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:11.815321 15397 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:11.815467 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.816000 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.816438 15397 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:11.816725 15391 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:11.816919 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.817597 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.817819 15392 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:11.818642 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.818862 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:11.819135 15322 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:03:11.819689 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.786921 17425 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:11.821218 17425 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:11.821396 15249 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:11.821631 17425 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:11.825242 15249 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:11.802435 17492 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:03:11.828161 17492 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:11.828215 15393 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:11.828642 17492 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.828955 15396 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:11.829016 17492 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:11.830276 15243 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:11.826870 15249 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:03:11.831490 17560 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.257s	user 0.004s	sys 0.001s
I20260709 13:03:11.778951 17510 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:11.832337 15249 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:11.833420 17514 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.834080 15249 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:11.834820 17480 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:11.835597 17480 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.839486 16026 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:11.840481 17442 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:11.832731 17510 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:11.809988 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:11.843727 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.850780 15250 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:11.856055 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.841019 17442 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:11.801798 17332 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.829034 17483 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:11.863453 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53524.3us
I20260709 13:03:11.859997 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:11.861994 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.867628 17529 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:11.867949 17483 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:11.868381 17529 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:11.869438 17529 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.870652 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.871419 15392 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:11.874517 15318 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:11.878648 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:11.879374 15390 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:11.852456 17527 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:11.882903 17442 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.883682 17527 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:11.884892 17527 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:11.878712 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.891455 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:11.895989 15998 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:11.896206 17514 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.896968 17514 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.867628 17332 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:11.897897 17467 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:11.915001 15249 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:11.906591 17501 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.915709 17501 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.916105 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:11.916702 15249 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
W20260709 13:03:11.893339 17433 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:03:11.917946 17501 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:11.951877 17496 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:11.952385 17496 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:11.953372 17496 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:11.959635 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.959981 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:11.917676 17433 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:11.963042 15246 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:11.909912 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:11.926899 17442 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:11.929157 17514 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.930780 17265 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.912669 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:11.914129 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 56588.9us
I20260709 13:03:11.914363 17508 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:11.941273 17359 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.941560 17519 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.945040 17398 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:11.945528 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:11.948028 17562 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.289s	user 0.000s	sys 0.002s
I20260709 13:03:11.965219 15399 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
W20260709 13:03:11.960103 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.969970 15398 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
W20260709 13:03:11.998306 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 85721.6us
I20260709 13:03:11.926076 17434 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:11.967734 15247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.005s	sys 0.020s
W20260709 13:03:12.002223 15247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.005s	sys 0.020s
I20260709 13:03:11.970893 17508 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:12.011626 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.013149 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.015355 16032 raft_consensus.cc:2410] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:12.011689 17508 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.014458 17433 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:12.041991 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:12.042840 16025 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:12.001366 17265 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.003400 17492 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:12.043944 16026 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:03:12.044340 16026 pending_rounds.cc:85] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 5
I20260709 13:03:12.044580 16026 pending_rounds.cc:107] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:03:12.044852 16026 raft_consensus.cc:2889] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:12.045430 17492 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:12.047266 15250 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:12.045445 17265 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:12.054714 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48202.3us
I20260709 13:03:12.055933 15365 leader_election.cc:400] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
I20260709 13:03:12.056342 15365 leader_election.cc:403] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:12.057082 17265 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
I20260709 13:03:12.006759 17519 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.003575 17425 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:12.031169 17496 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.054764 15363 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:12.033672 17501 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:12.057922 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:12.015169 17510 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:12.066939 17332 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:12.081902 16033 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:12.068496 17501 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.070418 17265 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:03:12.075057 17200 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:12.089918 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 284433us
I20260709 13:03:12.085098 16029 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:12.085481 17332 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.087190 17501 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:12.102684 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:12.104290 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:12.106465 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:12.090600 17406 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.036s	sys 0.052s
W20260709 13:03:12.116278 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.144898 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 249108us
W20260709 13:03:12.147068 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 378416us
I20260709 13:03:12.112924 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:12.148942 15399 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
W20260709 13:03:12.150667 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 463065us
I20260709 13:03:12.097999 17332 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:12.154299 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.154870 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 411641us
I20260709 13:03:12.155958 15390 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:12.095296 17200 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:12.172739 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.143375 17406 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.036s	sys 0.053s
I20260709 13:03:12.179877 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:12.139700 17519 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:12.107537 17492 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:12.180948 15398 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.143047 17434 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:12.185510 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:12.212554 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:12.224212 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:12.225044 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:12.225718 15247 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:12.226480 17519 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:12.227589 17180 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:12.228652 17180 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:12.229122 17180 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:12.229254 17574 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:03:12.229343 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:12.230208 17180 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.231724 17180 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:12.233826 17265 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:12.234452 17515 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:12.234978 17515 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.235380 17515 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:12.224344 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:12.238725 15246 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:12.227599 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:12.242579 15393 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:03:12.245615 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.238855 15291 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:12.141999 17508 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:12.142719 17398 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:03:12.228314 17312 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:03:12.255447 15247 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:12.248965 17311 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:12.257017 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:12.208997 17434 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.219177 17529 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.189185 17303 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:03:12.268821 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:12.255060 17519 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:12.292537 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.285898 17434 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:12.327943 15998 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:12.317140 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:12.331903 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.333395 15322 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:12.289134 17425 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:12.339279 15246 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
W20260709 13:03:12.338559 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 133801us
I20260709 13:03:12.285666 17311 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:12.326738 17510 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:12.344451 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:12.352108 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 175329us
I20260709 13:03:12.334825 17489 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:12.315716 17576 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:12.357442 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:12.358297 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:12.370365 15323 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.180047 17465 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 13:03:12.291782 17529 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:12.345325 17577 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:12.341419 17514 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.341292 17579 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:12.314122 17519 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.392927 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:12.392373 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:12.393988 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47004.6us
W20260709 13:03:12.401311 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 175053us
I20260709 13:03:12.399792 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1783) took 1034 ms. Trace:
I20260709 13:03:12.376469 17425 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.410923 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:12.408761 15241 rpcz_store.cc:276] 0709 13:03:11.365780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.751843 (+386063us) service_pool.cc:224] Handling call
0709 13:03:11.758585 (+  6742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.794426 (+ 35841us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:12.151332 (+356906us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.393600 (+242268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.394123 (+   523us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:12.399401 (+  5278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.399508 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.399675 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":423665,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":21696,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"thread_start_us":441895,"threads_started":2}
I20260709 13:03:12.382397 17577 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:12.376153 17578 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:12.386580 17579 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.290930 17492 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 13:03:12.430663 15398 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
W20260709 13:03:12.431054 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 176345us
I20260709 13:03:12.344112 17311 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:12.430380 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 165987us
I20260709 13:03:12.402275 17576 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:12.452345 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 59504.3us
I20260709 13:03:12.453217 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:12.389580 17510 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:03:12.456758 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:12.457449 15393 raft_consensus.cc:2368] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5.
I20260709 13:03:12.455916 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:12.433629 17578 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:12.438519 17579 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:12.407608 17514 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.471323 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:12.474139 15318 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.427269 17425 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:12.484855 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:12.469532 17578 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:12.495779 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:12.495972 17585 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.496580 16032 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:12.496133 17584 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:12.436846 17200 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.497514 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:12.482528 17508 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:12.495869 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:12.486783 17465 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:12.531767 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 100035us
I20260709 13:03:12.533869 15321 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:03:12.540042 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.552543 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:12.553460 16032 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.529338 17576 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.538317 17455 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:12.535065 17465 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:12.563486 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:12.574129 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84162.9us
I20260709 13:03:12.587435 17593 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:12.590322 17596 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 13:03:12.591449 17602 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:12.591879 17602 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:12.592918 17602 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:12.598930 17589 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:03:12.600164 17588 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:03:12.601322 17580 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 13:03:12.609381 17442 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 13:03:12.620173 15242 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:12.621755 15321 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:12.630561 15316 raft_consensus.cc:2410] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:12.625687 15289 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:12.570724 17312 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:12.568727 17455 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:12.579294 16025 pending_rounds.cc:85] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 4
I20260709 13:03:12.542496 17590 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 13:03:12.579780 17572 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:03:12.531044 17585 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.647161 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:12.506150 17577 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.645063 16025 pending_rounds.cc:107] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:03:12.668316 16025 raft_consensus.cc:2889] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:12.669387 17332 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:12.632753 17519 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:12.676839 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.645937 17455 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:12.674834 17180 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:12.644848 17442 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 13:03:12.689049 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 225409us
I20260709 13:03:12.690851 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:12.702968 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:12.709182 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.710134 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 230) took 1003 ms. Trace:
I20260709 13:03:12.700701 17442 consensus_queue.cc:1243] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:12.684727 17433 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 13:03:12.702759 17496 consensus_meta.cc:287] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.005s
W20260709 13:03:12.730191 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.728331 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:03:12.736758 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 257564us
I20260709 13:03:12.705199 17478 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:12.743685 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1782) took 1378 ms. Trace:
I20260709 13:03:12.742406 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:12.679404 17465 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:12.713255 15320 rpcz_store.cc:276] 0709 13:03:11.707092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.707243 (+   151us) service_pool.cc:224] Handling call
0709 13:03:11.707615 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:11.708064 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.708097 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:11.708689 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.029807 (+321118us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:12.029848 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.029914 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:12.709908 (+679994us) raft_consensus.cc:1685] finished
0709 13:03:12.709929 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.710063 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1675,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":173,"thread_start_us":320676,"threads_started":1,"wal-append.queue_time_us":543754}
I20260709 13:03:12.750180 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:12.708230 17514 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:12.752149 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 48440.9us
I20260709 13:03:12.705816 17312 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:03:12.708444 17180 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:03:12.757532 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:12.735581 17425 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:12.747340 17478 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.744279 15245 rpcz_store.cc:276] 0709 13:03:11.365467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.748859 (+383392us) service_pool.cc:224] Handling call
0709 13:03:11.787855 (+ 38996us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:11.847978 (+ 60123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.848018 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:11.873619 (+ 25601us) log.cc:844] Serialized 78 byte log entry
0709 13:03:12.181529 (+307910us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:12.336192 (+154663us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.338897 (+  2705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.338976 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:12.743318 (+404342us) raft_consensus.cc:1685] finished
0709 13:03:12.743352 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.743588 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1057,"prepare.queue_time_us":44900,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":50297,"raft.run_cpu_time_us":342,"raft.run_wall_time_us":13909,"thread_start_us":439476,"threads_started":2,"wal-append.queue_time_us":508136}
I20260709 13:03:12.747161 17519 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:03:12.767446 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.770591 17601 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:12.771365 15362 leader_election.cc:336] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.268s (SENT)
I20260709 13:03:12.752948 17595 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:12.753978 17497 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:12.776000 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:12.750995 17605 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:12.788034 17606 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:12.788540 17606 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:12.788919 17606 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:12.789186 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:12.792460 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:12.794047 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:12.794708 15321 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:12.796015 17434 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:12.798070 17465 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:12.798841 17501 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.004s
I20260709 13:03:12.799276 17501 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.801569 17501 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:12.804018 17515 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.568s	user 0.003s	sys 0.009s
I20260709 13:03:12.804481 17515 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.806540 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:12.807335 15324 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:12.808833 17585 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:12.810546 17332 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:12.773200 17478 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.812142 17578 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:12.814771 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 64784us
I20260709 13:03:12.815750 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:12.815620 15324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fca62166204465d888036a111b60b66"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:03:12.818598 17607 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:12.819413 17607 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:12.783202 17497 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:12.822911 17497 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.825251 17455 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.826351 17425 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:12.826799 17425 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:12.827193 17425 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.829233 15321 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
W20260709 13:03:12.835911 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46791.9us
I20260709 13:03:12.818063 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:12.844758 15318 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:12.838552 16032 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
W20260709 13:03:12.838337 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 71755.8us
I20260709 13:03:12.846159 15319 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:12.840428 15323 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
W20260709 13:03:12.853842 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 399725us
I20260709 13:03:12.783808 17595 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.855315 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:12.855970 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:12.856339 15362 leader_election.cc:336] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.656s (SENT)
I20260709 13:03:12.878840 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:12.880566 17311 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:12.880918 15321 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:12.888235 15246 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:12.828485 17601 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:12.896978 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.897485 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:12.889664 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:12.894841 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:12.908174 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:12.909911 15247 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:12.854660 17600 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:12.911048 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:12.915169 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:12.906791 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:12.917586 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:12.863411 17595 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:12.919770 15243 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:12.915998 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:12.890971 17518 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:12.918219 15244 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:12.918762 15248 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:12.889427 17578 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:12.903694 17585 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:12.920661 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 102732us
I20260709 13:03:12.920717 15245 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:12.915350 15241 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:12.837798 17579 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:12.928998 17515 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:12.918443 17600 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.899997 17332 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:03:12.925846 17492 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:12.922542 17594 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:12.980577 15243 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:12.924996 17618 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:12.931596 17200 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:12.924815 17514 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:12.970382 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.973522 15244 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:12.975759 17478 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:12.962869 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.984771 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 117487us
I20260709 13:03:12.964967 17489 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:03:12.990506 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 134178us
I20260709 13:03:12.948299 17600 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:12.969905 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:13.007053 17514 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.006616 15243 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:03:13.003769 15362 leader_election.cc:336] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.772s (SENT)
I20260709 13:03:13.010311 15246 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:03:12.992507 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59535.6us
I20260709 13:03:12.949575 17576 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:03:12.981050 17433 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.007201 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:13.014775 15242 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:13.015270 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 45503.7us
I20260709 13:03:13.015844 15248 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:13.003142 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:12.983412 17434 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.018095 15241 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:03:13.009366 17514 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:13.019414 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:13.020234 15246 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:12.944873 17585 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.995776 17492 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:13.036194 15249 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:13.036191 15245 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:13.018646 15241 pending_rounds.cc:85] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 5
I20260709 13:03:13.048892 15241 pending_rounds.cc:107] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:03:13.049293 15241 raft_consensus.cc:2889] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:13.062103 17585 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:13.002045 17489 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:13.105350 17611 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:03:13.105228 17492 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.106642 17627 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.107203 17627 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.002171 17618 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:12.976927 17601 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:13.203161 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.110764 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 107051us
I20260709 13:03:13.285723 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:13.196750 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.127504 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.020257 17514 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.062898 17624 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:03:13.287317 15243 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.203609 15246 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:13.038558 17465 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:13.285735 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 250642us
W20260709 13:03:13.285109 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 271025us
W20260709 13:03:13.287015 15362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.674s (SENT) [suppressed 25 similar messages]
W20260709 13:03:13.299095 15362 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.503s (SENT)
I20260709 13:03:13.299582 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:13.295099 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.300101 15998 leader_election.cc:400] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5.
I20260709 13:03:13.300463 15998 leader_election.cc:403] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:13.303047 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:13.066675 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:03:13.116550 17613 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:03:13.074196 17455 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.120875 17501 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.311661 15396 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:13.034789 17433 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.118503 17200 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.313076 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:13.273483 17496 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:13.324946 15399 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:13.303108 17587 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:13.331509 15395 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:13.339869 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:13.340787 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.341650 15323 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:13.347260 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48191.7us
I20260709 13:03:13.320930 17465 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:13.351132 15362 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.904s (SENT)
I20260709 13:03:13.319222 17584 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:13.354362 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:13.326399 17607 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.308600 17514 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.328122 17627 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.348503 16024 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:13.340178 17518 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.358724 15243 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:13.333761 17501 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.374100 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:13.366592 17625 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:03:13.353857 17579 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.307757 17489 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.340023 17519 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:03:13.338959 17496 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.335081 17527 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:03:13.378578 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 78608.3us
I20260709 13:03:13.338701 17200 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.368754 15323 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:13.369177 17265 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:13.362994 17359 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.346897 17515 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:03:13.365952 17398 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5.
W20260709 13:03:13.422140 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52792.7us
I20260709 13:03:13.365960 17584 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:13.431416 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 84912.2us
W20260709 13:03:13.431452 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 80368us
I20260709 13:03:13.355798 17620 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:03:13.445255 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 50904.8us
I20260709 13:03:13.369422 17623 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:03:13.447600 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:13.375787 17607 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.429665 17478 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.366878 17587 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.454581 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:13.457293 15362 leader_election.cc:336] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.557s (SENT)
I20260709 13:03:13.457804 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:13.443820 17489 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:13.453399 17497 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
I20260709 13:03:13.445182 17455 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:13.474021 15243 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:13.479250 17641 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.480326 17584 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:13.483371 17501 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:13.445380 17465 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.466674 17620 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:13.493559 17514 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.446933 17605 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:03:13.495064 17595 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.004s
I20260709 13:03:13.495669 17595 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.496645 17587 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:13.498183 17425 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.000s
I20260709 13:03:13.498466 17640 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:13.498715 17425 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.499394 17640 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:13.500649 17640 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.487010 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 312) took 1695 ms. Trace:
I20260709 13:03:13.501879 16027 rpcz_store.cc:276] 0709 13:03:11.791458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.800521 (+  9063us) service_pool.cc:224] Handling call
0709 13:03:12.859256 (+1058735us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:12.859503 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:12.859974 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:12.860011 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:12.860570 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:03:12.989979 (+129409us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:12.996053 (+  6074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.002063 (+  6010us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:13.454303 (+452240us) raft_consensus.cc:1685] finished
0709 13:03:13.454320 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:13.477646 (+ 23326us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1514,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":28275,"spinlock_wait_cycles":6265216,"thread_start_us":89122,"threads_started":1,"wal-append.queue_time_us":205074}
I20260709 13:03:13.477437 17455 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:13.507778 17607 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.508771 17455 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.467128 17519 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:03:13.477030 17497 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.513506 17497 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.515734 16033 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:13.501109 17425 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:13.516382 17311 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.611s	user 0.006s	sys 0.005s
W20260709 13:03:13.522145 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 91250.6us
W20260709 13:03:13.522545 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65289us
W20260709 13:03:13.525136 15362 leader_election.cc:336] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.601s (SENT)
I20260709 13:03:13.525691 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:13.471800 17618 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.517022 17600 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:13.522660 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.000s	sys 0.004s
W20260709 13:03:13.528180 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.001s	sys 0.004s
I20260709 13:03:13.521908 17514 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:13.528824 17600 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.529515 16029 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:13.530329 17311 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:13.515147 17496 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:13.531127 16032 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:13.526696 17587 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.533543 15289 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:13.541527 17514 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:13.534646 17529 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:13.534556 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:13.535918 17200 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:13.536522 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 80297.9us
I20260709 13:03:13.490918 17527 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.540967 15362 leader_election.cc:336] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.194s (SENT)
I20260709 13:03:13.594750 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:13.542976 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:13.547506 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 99631.5us
I20260709 13:03:13.522269 17620 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:13.561249 17359 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:13.561828 17581 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.155s	user 0.001s	sys 0.014s
W20260709 13:03:13.562207 17629 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:03:13.541783 17595 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.570854 17514 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.613785 17514 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:13.615192 17628 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.605716 17600 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:13.616294 17600 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.584909 15213 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:13.577417 17607 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:13.617074 17607 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.617503 17607 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:13.577585 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 118995us
I20260709 13:03:13.610502 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:13.596844 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53960.7us
I20260709 13:03:13.616701 17600 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:13.615746 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:13.615748 17628 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.622172 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:13.617429 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:13.625028 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.623557 17606 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.834s	user 0.010s	sys 0.003s
I20260709 13:03:13.626691 17595 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:13.627353 15132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9e997bc5c2942178cde4c670df97100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 45ddec37d9e741a598bf32f6c9d7e0ee is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:13.628721 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:13.630142 15399 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:13.630373 17359 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:13.630824 17620 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.631497 17529 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:13.627554 17640 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:13.632741 16027 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:13.632514 17640 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.633477 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:13.605666 17478 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.639528 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:13.639797 17359 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:13.640261 17359 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:13.640697 17628 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.641198 17478 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.642341 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.641140 17359 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.585572 17527 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.623368 17200 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.595708 17618 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
W20260709 13:03:13.658951 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 117994us
W20260709 13:03:13.660152 15362 leader_election.cc:336] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.148s (SENT)
I20260709 13:03:13.660681 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:13.643676 17529 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:13.664424 17529 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.667661 17646 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:13.648196 17647 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.667797 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.667922 17359 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:13.673720 15322 raft_consensus.cc:2368] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7.
I20260709 13:03:13.674523 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:13.677843 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.675190 15395 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:13.655084 17527 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.675801 17647 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.684474 17640 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:13.684912 17529 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.686260 17478 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:13.686811 17587 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:13.691332 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:13.704715 15392 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:13.706722 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:13.691840 17331 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:13.652375 17634 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:03:13.626757 17606 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.652292 17595 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:03:13.703763 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:13.708750 17460 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:13.708930 17529 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:13.695438 17332 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.709954 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:13.711490 17602 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:13.716171 15316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2006) took 1507 ms (client timeout 1926 ms). Trace:
I20260709 13:03:13.703263 15320 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:13.734215 15395 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:13.708896 17645 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.751420 17645 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.736202 15323 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:13.717142 17331 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:13.737795 17607 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.739679 17529 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:13.759876 17331 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.760751 17529 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.761003 17331 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.766382 15324 raft_consensus.cc:606] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:13.766927 15324 raft_consensus.cc:614] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:13.766610 15148 catalog_manager.cc:5697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 5, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 5 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:13.746325 15316 rpcz_store.cc:269] 0709 13:03:12.215630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.227282 (+ 11652us) service_pool.cc:224] Handling call
0709 13:03:13.715857 (+1488575us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54001c66d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:13.716061 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876136192}
I20260709 13:03:13.768548 15148 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 3 to 5, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 5 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.748268 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:13.748893 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 124208us
W20260709 13:03:13.736857 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 119552us
I20260709 13:03:13.768567 15325 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:13.789387 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:13.754024 17645 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:13.816838 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.816915 17460 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:13.827046 17460 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:13.816241 17594 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:13.832994 17594 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:13.841796 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:13.843171 17442 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:13.843261 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:13.844007 17442 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:13.844463 15318 raft_consensus.cc:2410] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:03:13.845080 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.745919 17332 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:13.850539 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.857944 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 273097us
I20260709 13:03:13.846721 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.859164 15319 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:13.852922 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 63625.9us
I20260709 13:03:13.846304 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.845862 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:13.860064 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:13.859412 15213 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:13.867264 15323 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:13.848953 17609 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:13.869774 17489 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:13.870050 17655 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:13.870272 17489 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:13.871619 17433 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:13.872011 17489 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.869791 16026 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:13.873425 17489 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.874123 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:13.870095 17609 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:13.874882 16026 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
W20260709 13:03:13.875425 17637 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.409s	user 0.000s	sys 0.003s
I20260709 13:03:13.875916 17609 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.876299 17460 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.877241 17609 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:13.877643 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:13.878328 16028 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:13.878409 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:13.847182 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.879495 15317 raft_consensus.cc:2376] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4. Re-sending same reply.
I20260709 13:03:13.883960 17332 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:13.845219 17442 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.886917 17442 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:13.891922 17595 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:13.892593 17595 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.900897 15319 raft_consensus.cc:2410] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:03:13.913189 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.904175 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44802.9us
I20260709 13:03:13.915522 15242 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:13.918004 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.919032 15319 raft_consensus.cc:2368] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
I20260709 13:03:13.893703 17600 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.920917 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:13.891949 17478 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:13.911927 17655 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:13.913039 17606 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.928408 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:13.913479 17602 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:03:13.935240 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.936622 15247 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:03:13.939795 15319 raft_consensus.cc:2376] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3. Re-sending same reply.
I20260709 13:03:13.906250 17359 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:13.948563 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.912130 17529 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:13.927428 17478 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:13.916061 17332 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:03:13.952273 17587 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:13.923831 17647 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:13.958400 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:13.975196 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:13.978852 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.982542 15319 raft_consensus.cc:2376] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3. Re-sending same reply.
I20260709 13:03:13.985023 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:13.985703 15247 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:13.989605 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:13.973694 17359 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:13.993069 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:13.995587 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.967180 17620 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:13.997211 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:14.002460 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.005273 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.006825 15241 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:14.006423 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:13.977829 17587 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:14.011782 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:14.013113 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:13.988031 17623 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:14.000502 17595 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:14.021351 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:14.021335 17433 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:14.022859 17584 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:14.023699 17200 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:14.026207 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.003997 17647 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.012571 17596 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.037209 15319 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:14.040807 17518 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.050467 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.032616 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:14.039530 15362 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.678s (SENT)
I20260709 13:03:14.016876 17519 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:14.043851 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.056051 17647 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:14.007356 17655 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
W20260709 13:03:14.059275 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 62186.9us
I20260709 13:03:14.018571 17332 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:03:14.040691 17465 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:14.018817 17602 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:03:14.038682 17623 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.043983 17433 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:14.069890 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.012117 17620 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.078862 17483 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:14.054126 17596 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.081303 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:14.056157 17660 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 13:03:14.089036 17359 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:14.091289 17465 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:14.076069 17647 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:14.092475 17666 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:14.044127 17478 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.049548 17518 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.079809 17641 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:14.098582 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58726 (request call id 15) took 1279 ms. Trace:
I20260709 13:03:14.099108 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:14.120254 15241 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:14.086221 17618 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:14.119658 15324 rpcz_store.cc:276] 0709 13:03:12.815101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.815373 (+   272us) service_pool.cc:224] Handling call
0709 13:03:14.094162 (+1278789us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54002a6cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf4853 00007f366ebc260a 00007f36681487d4 00007f3668148762 00007f3668148691 00007f366814860c 00007f36681478c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:14.094318 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2184318208}
W20260709 13:03:14.126001 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.116170 17634 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:03:14.118387 17641 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:14.131242 17618 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:14.140938 17478 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:14.141661 17620 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:14.142082 17200 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.142719 17200 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.143323 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.144248 15241 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:03:14.145318 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.080523 17661 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:03:14.145841 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:14.146502 17659 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:14.147433 17622 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:14.147440 17659 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:14.148044 17622 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:14.148650 17433 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.148207 17465 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.152216 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.153446 15317 raft_consensus.cc:2410] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:14.155026 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.157490 15324 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:14.143415 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.158458 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.147018 17647 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.159035 15324 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:14.148198 17659 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:14.099556 17483 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:14.155452 17623 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:14.113900 17600 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:14.160431 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.115676 17331 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:14.159933 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:14.063416 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.170569 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:14.174875 15246 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:14.175662 15319 raft_consensus.cc:2368] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7.
I20260709 13:03:14.134533 17529 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:14.199007 17460 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.181334 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.199666 17460 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.200146 15320 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:14.201121 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.148677 17622 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:14.206866 17662 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:03:14.207013 17331 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:14.183789 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:14.190929 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.131929 17641 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.211012 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.212004 17641 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:14.212414 15317 raft_consensus.cc:2410] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:14.214712 17618 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.214437 17331 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.215518 16024 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:14.209424 17646 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:14.217873 17596 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:14.192950 17483 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.195530 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.211155 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "edcf4a6bae7e4781bce325a586109ca5"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:03:14.219539 15246 raft_consensus.cc:606] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Received request to transfer leadership to TS edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:14.219962 15246 raft_consensus.cc:614] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:14.191855 17577 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:14.223313 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.224197 15316 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:14.221364 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.213729 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.225987 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.240759 15319 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:14.241233 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.242146 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.220935 17584 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:14.243373 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:14.294202 15246 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:03:14.305338 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 62040us
I20260709 13:03:14.243002 15316 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:14.214532 17510 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:14.244282 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.323202 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:14.312983 15316 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:14.327106 15246 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:14.218905 17646 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:14.334496 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.286782 17655 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.312346 17626 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:14.336980 15316 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:14.338342 15320 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:14.226989 17596 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:03:14.329824 17489 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:14.211074 17594 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.347599 15316 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:14.341009 17646 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:14.341822 17626 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.374743 16024 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:14.381661 17622 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.383354 15244 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:03:14.390311 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.392316 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.392885 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.393610 15241 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:14.393724 15390 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:14.342697 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.345481 17489 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.385565 15319 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:14.388038 15316 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:14.392899 15392 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:14.258988 17659 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.344187 17655 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.398550 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.411254 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.414985 15390 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:14.400319 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.400394 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.400593 17627 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:14.416482 17627 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:14.416554 15392 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:14.417538 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.417537 17627 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.418908 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.419106 17627 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:14.401037 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.401512 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.422695 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:14.423184 15394 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:14.401654 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.401046 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:14.404170 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:14.424182 15391 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:14.424360 15397 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:14.408106 17578 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.385854 17626 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:14.388444 16024 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:14.414340 15244 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:14.423535 15390 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:14.424372 15396 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:14.413210 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:14.427775 15317 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:14.428927 15319 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:14.410494 17489 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:14.433750 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.437301 15317 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:14.441929 15390 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:14.443490 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:14.445134 15393 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:14.450022 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:14.452387 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.452975 15244 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:14.453696 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.456823 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:14.459007 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:14.459885 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 329) took 1145 ms. Trace:
I20260709 13:03:14.460687 17622 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:14.461508 16024 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.462627 16024 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:14.460222 16032 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:14.464546 17596 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:14.465303 17596 consensus_queue.cc:1243] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:14.467288 17478 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:14.467777 17478 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:14.468178 17478 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:14.470479 15324 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:14.432467 17660 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:14.471370 17660 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:14.472000 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.472604 17660 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.475387 15393 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:14.476563 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:14.476809 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.477964 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:14.478053 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.483089 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.428594 17578 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.486518 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.487304 15322 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:14.489030 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:14.490620 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.491220 15390 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:14.491974 15321 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:14.491247 15318 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:14.495543 15244 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:03:14.496294 15324 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:14.497274 15244 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:14.501273 15244 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:14.440702 17659 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:14.508133 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:14.524879 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.535429 15320 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:03:14.535760 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59300.9us
I20260709 13:03:14.537514 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:14.506469 17667 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.460333 16029 rpcz_store.cc:276] 0709 13:03:13.314245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.318531 (+  4286us) service_pool.cc:224] Handling call
0709 13:03:13.347347 (+ 28816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.553925 (+206578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.459647 (+905722us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54004844d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:14.459830 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379419008}
W20260709 13:03:14.849432 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 311978us
I20260709 13:03:14.640156 15318 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:14.785241 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:14.571394 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.541998 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:14.764806 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.578955 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:14.839764 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 331667us
I20260709 13:03:14.594746 15391 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
W20260709 13:03:14.871835 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 86704.4us
W20260709 13:03:14.585897 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.637228 15322 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
W20260709 13:03:14.614070 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.872944 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:14.872174 15321 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:14.797880 17682 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 13:03:14.533564 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.877445 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:14.842079 17649 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:03:14.884433 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:14.610594 17331 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:14.796819 17529 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:14.851886 17607 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:14.796077 17514 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:14.896803 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.899140 15248 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:03:14.903270 15395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 186) took 1283 ms (client timeout 1540 ms). Trace:
W20260709 13:03:14.877837 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.857131 17600 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:14.906925 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.915210 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:14.882140 17433 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:14.892266 17667 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:14.914203 15321 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:14.924873 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:14.921304 15395 rpcz_store.cc:269] 0709 13:03:13.619634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.622898 (+  3264us) service_pool.cc:224] Handling call
0709 13:03:14.902982 (+1280084us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b540034b7d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:14.903149 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94469504}
I20260709 13:03:14.920905 17514 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:14.940846 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.943332 15320 raft_consensus.cc:2410] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:14.908108 15317 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:14.934684 17667 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.945147 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:14.922699 17628 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:14.949429 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 328) took 1913 ms. Trace:
I20260709 13:03:14.951002 17667 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:14.953536 17514 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.954897 17514 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:14.962612 17667 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.965112 17667 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:14.968544 17489 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:03:14.970980 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:14.951951 16033 rpcz_store.cc:276] 0709 13:03:13.035915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.036088 (+   173us) service_pool.cc:224] Handling call
0709 13:03:13.060892 (+ 24804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:13.520311 (+459419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:14.949214 (+1428903us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54007c1d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:14.949372 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1045583104}
I20260709 13:03:14.974666 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:14.975747 15248 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:14.976840 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:14.977794 15248 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:14.938402 17655 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:14.987141 15317 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:14.935272 17612 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.988981 17612 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:14.991289 17587 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.936475 17693 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:14.973984 17627 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.554s	user 0.004s	sys 0.004s
I20260709 13:03:14.992020 17612 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:14.993141 17587 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:15.019531 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:15.037757 15317 raft_consensus.cc:2368] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5.
W20260709 13:03:15.020145 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 488546us
I20260709 13:03:15.021593 15323 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:03:15.022446 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 99262.4us
I20260709 13:03:15.040869 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:15.025637 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 149630us
I20260709 13:03:14.931213 17626 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.027220 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:15.046116 15248 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
W20260709 13:03:14.997967 16024 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.002s
I20260709 13:03:14.969216 17489 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:14.922958 17529 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.036281 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:15.042361 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.043720 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.047430 15362 leader_election.cc:336] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.639s (SENT)
I20260709 13:03:15.002317 17618 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:15.051929 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.055220 15323 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:03:15.056500 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:15.057125 15320 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:03:15.038364 17693 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:15.062176 15248 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:15.062521 15250 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:03:15.069670 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.070801 15323 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:15.071841 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.072650 15320 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:15.084172 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:15.061796 17618 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:15.066349 16024 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:15.086540 15248 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:15.092795 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1813) took 1464 ms. Trace:
I20260709 13:03:15.094975 15323 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:15.095129 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.093765 15243 rpcz_store.cc:276] 0709 13:03:13.625243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.625372 (+   129us) service_pool.cc:224] Handling call
0709 13:03:15.083994 (+1458622us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b5800132698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:15.088811 (+  4817us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7863168}
I20260709 13:03:15.098279 15320 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:15.099216 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:15.100106 15323 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:15.099069 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.100867 15321 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 6: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:15.101706 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:15.102046 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.086504 17600 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:15.089534 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:15.117046 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.100132 17331 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:15.118777 17331 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.124266 15320 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:15.070981 17693 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.130102 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.130795 15320 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:15.115805 17655 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.131635 17695 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:03:15.134729 17618 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.133666 17655 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.143307 17529 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.145401 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.146108 15391 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 1.
I20260709 13:03:15.147029 17626 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:15.150956 17690 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:03:15.152171 17646 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.754s	user 0.002s	sys 0.010s
I20260709 13:03:15.152622 17646 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.122676 17612 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:03:15.157092 17496 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.157655 17496 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.158809 17489 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:15.159916 17496 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:15.161027 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:15.163375 17594 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.165529 17600 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.169452 17483 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:15.169639 17478 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.701s	user 0.013s	sys 0.000s
I20260709 13:03:15.169926 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:15.170149 17478 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.172359 17478 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.172920 17578 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.175045 17433 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:15.205765 17697 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.206151 17433 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:15.206358 17697 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:15.216710 17669 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.222s	user 0.003s	sys 0.000s
I20260709 13:03:15.220453 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.221381 15398 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:15.221750 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.181815 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1079) took 1032 ms. Trace:
W20260709 13:03:15.195916 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.178092 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.228471 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:15.228775 15317 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:15.229370 15322 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:15.225914 15362 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.674s (SENT)
I20260709 13:03:15.232956 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.233394 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:15.239121 15248 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:15.240765 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:15.164065 17594 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:15.242712 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:15.258262 15318 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:15.222898 15244 rpcz_store.cc:276] 0709 13:03:14.149584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.502810 (+353226us) service_pool.cc:224] Handling call
0709 13:03:14.839072 (+336262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:14.859266 (+ 20194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:14.865782 (+  6516us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:14.886893 (+ 21111us) log.cc:844] Serialized 26 byte log entry
0709 13:03:15.100169 (+213276us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:15.100213 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.100282 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.181078 (+ 80796us) raft_consensus.cc:1685] finished
0709 13:03:15.181210 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.181730 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19549,"raft.queue_time_us":34439,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":9436,"thread_start_us":163705,"threads_started":1,"wal-append.queue_time_us":228206}
W20260709 13:03:15.260046 15362 leader_election.cc:336] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.807s (SENT)
I20260709 13:03:15.260604 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:15.261823 15319 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:15.265443 15243 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:15.276304 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.278973 15396 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:15.277217 15320 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:15.284103 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:15.284246 15362 leader_election.cc:336] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.174s (SENT)
I20260709 13:03:15.284860 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:15.286085 17496 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:15.286973 17496 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:15.288678 17646 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.264771 17602 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:15.257771 17594 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:15.295378 17594 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:15.296844 17655 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.299399 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:15.301057 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.301836 15319 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:15.233958 17697 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.315810 15322 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
W20260709 13:03:15.278445 17659 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.004s
I20260709 13:03:15.329447 17433 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.333524 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:15.334255 16033 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:15.335986 17460 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:15.338948 17665 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.289s	user 0.005s	sys 0.001s
I20260709 13:03:15.339039 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:15.340379 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1811) took 1716 ms. Trace:
I20260709 13:03:15.341527 17705 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:15.340773 15245 rpcz_store.cc:276] 0709 13:03:13.624097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.624213 (+   116us) service_pool.cc:224] Handling call
0709 13:03:13.635104 (+ 10891us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.728140 (+ 93036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.728187 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:13.728856 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:03:13.798923 (+ 70067us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:13.798975 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:13.799083 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.338353 (+1539270us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:15.340103 (+  1750us) raft_consensus.cc:1685] finished
0709 13:03:15.340125 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.340320 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22394,"raft.queue_time_us":43753,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":2192,"spinlock_wait_cycles":9478912,"thread_start_us":138061,"threads_started":2,"wal-append.queue_time_us":309590}
I20260709 13:03:15.343549 16033 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:15.345177 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:15.342335 17705 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:03:15.327387 15318 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:15.350409 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:15.352021 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:15.354205 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:15.344542 17460 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.360743 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:15.365218 15245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92362862adca4227bb6dad04afd638cc"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:03:15.365849 15245 raft_consensus.cc:606] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:15.366302 15245 raft_consensus.cc:614] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:15.320202 17667 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:03:15.376680 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:15.380254 15319 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:15.355598 17628 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.382432 15242 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:15.347556 17587 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:03:15.354745 17478 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.387475 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:15.349095 17496 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:03:15.354735 17655 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:15.391227 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.370865 17659 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:15.395023 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.395855 15398 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:15.375379 17634 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:15.403137 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:15.411052 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.388432 17626 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.415949 15393 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:15.390195 17529 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:03:15.420615 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.425704 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:15.375939 17460 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.393273 17519 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:15.403883 17659 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.429639 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.431033 15318 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:15.390451 17331 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
W20260709 13:03:15.434000 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.417325 17587 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:15.414288 17600 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:15.445633 15398 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:15.392935 17704 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:03:15.404101 17478 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.454833 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.394050 17628 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.431974 17659 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:15.459146 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 174909us
I20260709 13:03:15.461748 15398 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:15.425575 17634 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:15.424487 17626 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.437026 17618 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.473673 15325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1063) took 1799 ms (client timeout 2148 ms). Trace:
W20260709 13:03:15.474558 15325 rpcz_store.cc:269] 0709 13:03:13.673981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.674140 (+   159us) service_pool.cc:224] Handling call
0709 13:03:15.473444 (+1799304us) spinlock_profiling.cc:243] Waited 90.8 ms on lock 0x7b54002a6cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:15.473610 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208809344}
I20260709 13:03:15.477174 17626 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.480657 17518 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:15.482405 17618 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.486878 17594 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:15.486915 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.441478 17587 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:15.488448 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 227) took 1402 ms. Trace:
I20260709 13:03:15.491693 15241 rpcz_store.cc:276] 0709 13:03:14.086356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.165063 (+ 78707us) service_pool.cc:224] Handling call
0709 13:03:15.488278 (+1323215us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400398fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:15.488387 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396531584}
I20260709 13:03:15.442643 17433 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.494338 16030 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:15.494565 17460 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:15.495590 17628 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:15.496354 17602 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.496929 17602 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.499063 17602 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:15.507081 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.500044 17587 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.515085 16033 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:15.515524 17587 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:15.518625 17634 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.520794 17478 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:15.521433 17478 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.521770 17518 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.521883 17478 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.522440 17518 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.524650 17518 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:15.526700 17627 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.527242 17627 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.528461 15394 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:15.529457 17627 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:15.529630 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.530304 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.530697 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.531378 15399 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:15.531526 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.532229 15393 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:15.533090 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.530630 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.534994 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.535357 17265 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:15.535732 17265 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:15.535802 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.536520 15398 raft_consensus.cc:2368] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:15.537529 15398 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:15.491276 17618 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.530309 15394 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:15.539610 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.539721 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.539919 15399 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:15.540486 15390 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:15.535238 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.542531 17478 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:15.534144 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.568027 15394 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:15.598677 16027 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:15.600835 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:15.602281 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:15.603159 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.606746 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:15.606783 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.608053 15399 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 2: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:15.608868 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.610755 15399 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:15.622627 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:15.625478 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.620411 17594 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:15.626789 15390 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:15.629606 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:15.606746 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.626969 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.631016 15397 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:15.626113 15394 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:15.632953 15362 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.550s (SENT)
I20260709 13:03:15.633464 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:15.634339 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.636840 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.639468 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.640631 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.641227 15390 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:15.642738 17442 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:15.644291 17659 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.646682 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.642000 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.612730 17697 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:15.628153 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:15.670385 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 162183us
I20260709 13:03:15.536540 17265 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.673023 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.680666 15394 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:15.626955 17704 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:15.815568 15399 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:03:15.826511 15399 pending_rounds.cc:85] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 2
I20260709 13:03:15.828917 15399 pending_rounds.cc:107] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:03:15.729936 15390 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:15.809731 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1817) took 2172 ms. Trace:
I20260709 13:03:15.699810 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:15.831099 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.831318 15399 raft_consensus.cc:2889] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:15.831642 15395 raft_consensus.cc:2368] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:15.832628 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.831092 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.834384 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.836172 15390 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:15.837114 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.837692 15390 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:15.834115 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:15.839957 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.830549 15247 rpcz_store.cc:276] 0709 13:03:13.637434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.986471 (+349037us) service_pool.cc:224] Handling call
0709 13:03:14.003417 (+ 16946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:14.006970 (+  3553us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:14.007002 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:15.483598 (+1476596us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b2c000014c8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:15.484035 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:03:15.629034 (+144999us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:15.629369 (+   335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.630326 (+   957us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:15.788118 (+157792us) raft_consensus.cc:1685] finished
0709 13:03:15.788158 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:15.809620 (+ 21462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8385,"raft.queue_time_us":7877,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":2403,"spinlock_wait_cycles":6378240,"thread_start_us":144294,"threads_started":1,"wal-append.queue_time_us":245097}
W20260709 13:03:15.841087 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 179839us
I20260709 13:03:15.844852 15148 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 3, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 3 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.660193 17717 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:15.713084 15394 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:15.832926 17518 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:03:15.852476 15390 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:15.798250 16024 raft_consensus.cc:2410] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:03:15.832630 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.652801 17433 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.850746 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.729655 17265 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:15.707952 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.861797 15399 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:15.863827 15395 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:03:15.865388 15391 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:03:15.865983 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 154020us
W20260709 13:03:15.867846 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.875734 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:15.877377 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:15.885520 15390 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:15.885389 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.886653 15325 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:15.886199 15323 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:15.896988 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:15.902498 15392 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:15.875023 17655 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:15.849365 17704 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:15.903856 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:15.936448 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 59690.7us
W20260709 13:03:15.940192 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 79036.4us
I20260709 13:03:15.946887 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:15.950680 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:15.866326 17626 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:03:15.875777 17433 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:15.883273 17660 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:15.903442 17496 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.966221 15393 raft_consensus.cc:2410] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:03:15.949232 17722 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:03:15.919489 17721 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:03:15.952826 17661 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:15.903151 17725 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:03:15.963186 17478 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:15.952605 17655 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:16.118000 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.118461 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1113) took 1062 ms. Trace:
I20260709 13:03:16.127748 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:16.104908 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 208444us
I20260709 13:03:16.125396 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:16.125723 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 89551.7us
I20260709 13:03:16.008767 17515 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:16.144788 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.023806 17726 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:03:16.024814 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.162699 17660 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:16.163735 17607 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:16.162889 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.144368 15317 rpcz_store.cc:276] 0709 13:03:15.055838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.056200 (+   362us) service_pool.cc:224] Handling call
0709 13:03:16.118301 (+1062101us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400412654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:16.118404 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358010624}
I20260709 13:03:16.121544 15244 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:16.104686 17647 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.132638 15243 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:16.119020 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:16.129696 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:16.155218 15246 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:15.972487 17656 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:16.023777 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.022646 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.129940 17594 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:16.133845 17510 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:16.029289 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48608.3us
W20260709 13:03:16.021313 17728 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:16.022658 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.209816 15397 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:16.025744 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:16.164458 17607 consensus_queue.cc:1243] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:16.017657 17646 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.165131 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1816) took 2529 ms. Trace:
I20260709 13:03:16.147881 16033 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
W20260709 13:03:16.155026 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 277755us
I20260709 13:03:16.132288 17442 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:16.023171 17724 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:03:16.020364 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:16.145459 17577 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:16.046192 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.228147 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.021605 17200 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:16.028322 17433 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.020188 17704 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.000973 17717 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 13:03:16.189420 15391 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:16.190647 17312 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.191314 17655 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.191887 17647 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.193863 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 200) took 1314 ms. Trace:
I20260709 13:03:16.242259 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:16.194873 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1078) took 2111 ms. Trace:
W20260709 13:03:16.198879 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.201234 17659 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:16.132997 17740 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:03:16.204445 15316 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:16.221963 17442 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.213441 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:16.213171 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:15.974010 17731 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.242s
I20260709 13:03:16.217926 15998 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.217299 15249 rpcz_store.cc:276] 0709 13:03:13.635926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:13.636043 (+   117us) service_pool.cc:224] Handling call
0709 13:03:13.639647 (+  3604us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:13.813535 (+173888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:13.813570 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:15.664838 (+1851268us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b2c000014c8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:15.711899 (+ 47061us) log.cc:844] Serialized 26 byte log entry
0709 13:03:15.924832 (+212933us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:15.924886 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:15.924990 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:16.164694 (+239704us) raft_consensus.cc:1685] finished
0709 13:03:16.164715 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.165067 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19335,"raft.queue_time_us":48613,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"spinlock_wait_cycles":42089216,"thread_start_us":280855,"threads_started":2,"wal-append.queue_time_us":354435}
W20260709 13:03:16.250181 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.220968 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:16.221401 15397 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:16.221295 16030 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:16.223685 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:16.225708 15244 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:16.013134 17496 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.239528 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:16.240796 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.158088 17478 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.247117 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1097) took 1897 ms. Trace:
I20260709 13:03:16.281292 15316 rpcz_store.cc:276] 0709 13:03:14.349546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.203809 (+1854263us) service_pool.cc:224] Handling call
0709 13:03:16.204206 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.246759 (+ 42553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.247042 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:16.208093 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:16.242501 15396 rpcz_store.cc:276] 0709 13:03:14.879182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.879288 (+   106us) service_pool.cc:224] Handling call
0709 13:03:14.892997 (+ 13709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:15.279479 (+386482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.193555 (+914076us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540026ff54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:16.193767 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886601984}
I20260709 13:03:16.243299 15250 rpcz_store.cc:276] 0709 13:03:14.083747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.473038 (+389291us) service_pool.cc:224] Handling call
0709 13:03:14.473372 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:15.065140 (+591768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.194585 (+1129445us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b540023aad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:16.194798 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1348086016}
I20260709 13:03:16.251896 15391 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:16.282905 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 116403us
I20260709 13:03:16.283067 17740 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:16.248292 17312 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.283731 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:16.282905 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 74921.1us
I20260709 13:03:16.284508 17612 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:16.285356 17312 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:16.286586 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:16.287427 15248 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:16.288086 17265 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:16.288589 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:16.289526 15248 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:16.289667 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:16.290313 15320 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:16.290472 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:16.286679 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:16.292173 15316 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0024621f21043e889d114f180f1dccb"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:03:16.292351 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:16.292770 15316 raft_consensus.cc:606] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:16.210052 17594 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.299242 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:16.211917 17510 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.287336 17518 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:16.212643 17725 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:03:16.293375 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:16.367838 15325 raft_consensus.cc:2410] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:16.368257 17717 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:16.368775 17717 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:16.368911 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:16.370924 17510 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.371101 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:16.370162 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:16.294037 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:16.373014 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89372.4us
I20260709 13:03:16.373260 15325 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:16.294194 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:16.373813 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.373929 15244 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:16.375097 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.375869 15244 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:16.376399 15290 leader_election.cc:400] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:16.377602 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:16.295282 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:16.232292 17577 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:16.293776 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 70170.5us
I20260709 13:03:16.380070 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.380580 15249 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:16.229285 17660 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
W20260709 13:03:16.332796 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46177us
I20260709 13:03:16.353155 17265 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.353300 17612 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:16.394940 17612 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:16.395536 17612 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:16.353675 15395 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:16.354024 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:16.402112 17200 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:16.354275 17692 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:16.402755 17200 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:16.354895 15323 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:16.292521 17659 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:16.402771 15318 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:16.353041 17748 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:16.356279 17697 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:16.358049 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:16.411095 15324 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
W20260709 13:03:16.359311 17733 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.339s	user 0.000s	sys 0.002s
I20260709 13:03:16.413111 17659 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:16.359571 15320 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:16.414050 17659 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.212996 17602 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:03:16.362149 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:16.417306 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:16.418267 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 56197.1us
I20260709 13:03:16.420173 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:16.363406 17739 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:16.372192 15246 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:16.426403 15321 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:03:16.405927 17746 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:16.381875 15248 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:03:16.427579 17746 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:16.227839 17646 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.428259 17746 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:16.430039 17646 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.430312 17731 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:16.431206 15247 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:16.429415 17746 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.425072 17739 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:16.432849 17739 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.433158 17442 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.433929 17739 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:16.388734 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:16.389194 16033 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:16.389405 17607 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.389765 17515 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:16.391429 17727 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 13:03:16.392279 17725 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:16.393574 17514 raft_consensus.cc:3055] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:16.393602 17265 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.351715 17737 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:16.411731 15399 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:16.353086 17743 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:16.416714 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.426916 15321 pending_rounds.cc:85] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 2
I20260709 13:03:16.462991 15321 pending_rounds.cc:107] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:03:16.463299 15321 raft_consensus.cc:2889] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:16.430745 17646 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:16.388051 15398 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.014s	sys 0.015s
I20260709 13:03:16.404111 17200 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.382293 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:16.386757 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:16.446579 15325 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:03:16.474895 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92683.4us
I20260709 13:03:16.447760 16032 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:16.475732 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.448702 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:16.463392 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46816.8us
I20260709 13:03:16.435997 17518 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:16.482424 17442 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.415165 17697 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.483374 17577 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.483966 17577 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:16.484817 17626 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.485090 17737 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:16.457959 17660 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.486050 17737 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:16.484827 17577 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:16.486510 17660 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.487849 17577 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.489048 17660 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.479681 17646 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.477319 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:16.491717 17489 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:16.491890 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.480494 17612 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.481678 17200 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.492255 17489 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:16.482579 17518 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.494319 17518 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:16.494531 17612 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.492892 17442 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:16.471669 17433 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:16.496074 17433 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.496460 17612 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:16.494140 17489 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.498945 17740 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:16.499641 17740 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:16.500005 17740 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:16.492193 17660 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:16.426280 17748 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:16.472612 15398 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.014s	sys 0.015s
I20260709 13:03:16.504621 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.505885 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.446758 17514 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:16.473843 17515 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:16.510866 17728 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:16.536952 15399 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:16.538623 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.539469 15399 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:16.540704 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.541608 15399 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:16.514535 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:16.526165 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:16.531279 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 412295us
I20260709 13:03:16.531956 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:16.442593 17460 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:03:16.544627 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:16.508994 17660 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.533578 15243 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:16.509642 17661 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:16.543687 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:16.570796 15394 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:16.534690 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 283634us
I20260709 13:03:16.511045 17519 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.547327 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.574198 15399 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:16.515434 17607 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:03:16.572999 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58816.1us
I20260709 13:03:16.500905 17740 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.575153 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:03:16.577783 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 278623us
I20260709 13:03:16.580706 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.585345 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1814) took 1056 ms. Trace:
I20260709 13:03:16.586056 15391 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:03:16.584551 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.596941 15391 pending_rounds.cc:85] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 1
I20260709 13:03:16.597414 15391 pending_rounds.cc:107] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:16.597733 15391 raft_consensus.cc:2889] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:16.572193 17660 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.584522 15148 catalog_manager.cc:5697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 4, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 4 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:16.600400 15394 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:16.600814 15393 rpcz_store.cc:276] 0709 13:03:15.529373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.533908 (+  4535us) service_pool.cc:224] Handling call
0709 13:03:16.585138 (+1051230us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540009bad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:16.585284 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925922560}
I20260709 13:03:16.545864 17455 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:16.602849 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 216189us
I20260709 13:03:16.543772 17618 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.604595 15399 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:16.570390 17626 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.575519 17460 consensus_queue.cc:1243] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 2.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:16.607684 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:16.575423 17661 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.578356 17515 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:16.574307 17745 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:16.544872 17742 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:03:16.605176 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:16.602998 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.626914 15399 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:03:16.635802 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 60710.3us
I20260709 13:03:16.639196 15396 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:16.610322 17455 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.607295 17751 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:16.641428 17514 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.622295 17626 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:16.651561 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46997.8us
I20260709 13:03:16.652791 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:16.653976 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 233988us
I20260709 13:03:16.655083 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:16.622669 17607 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.667073 17731 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.668133 17731 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:16.668645 17731 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:16.669117 17731 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:16.632992 17661 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:16.627166 17478 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:16.636624 17740 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:16.682196 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:16.622812 17618 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.669224 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:16.651692 17594 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:16.710325 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:16.670568 17612 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:16.710377 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 130610us
I20260709 13:03:16.670753 17433 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:16.722529 17765 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:16.723453 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54331.8us
I20260709 13:03:16.673034 17496 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:16.715271 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:16.709300 17749 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:16.737313 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 206758us
I20260709 13:03:16.712347 17744 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.711541 17667 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:16.727476 17514 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:16.742578 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.732776 17602 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:16.734427 17265 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:16.745476 17496 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:16.738282 17749 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:16.670454 17745 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.744590 17765 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:16.659472 17748 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.774657 15321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:03:16.757231 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:16.789492 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:16.790472 15248 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:16.756012 17761 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:16.767822 17692 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:16.779552 17749 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.768018 17763 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:16.796473 15245 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:16.794189 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.843024 15397 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:03:16.843393 15397 pending_rounds.cc:85] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 3
I20260709 13:03:16.843622 15397 pending_rounds.cc:107] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:03:16.843851 15397 raft_consensus.cc:2889] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:16.799479 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 62061.4us
I20260709 13:03:16.792620 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:16.845178 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52673.9us
I20260709 13:03:16.786976 17746 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.846470 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:16.830646 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.780224 17496 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:16.838814 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:16.793128 17634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.008s	sys 0.014s
I20260709 13:03:16.841856 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1810) took 1313 ms. Trace:
I20260709 13:03:16.787777 17602 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.791465 17765 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:16.856065 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 257787us
I20260709 13:03:16.852913 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:16.852294 15392 rpcz_store.cc:276] 0709 13:03:15.528237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.534746 (+  6509us) service_pool.cc:224] Handling call
0709 13:03:16.841630 (+1306884us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001554d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:16.841793 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842767744}
I20260709 13:03:16.861560 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:16.856122 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 145825us
I20260709 13:03:16.765239 17515 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:16.866509 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 136898us
I20260709 13:03:16.837061 16027 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:16.842489 17763 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:16.873191 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.852139 17634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.009s	sys 0.015s
I20260709 13:03:16.865794 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:16.899123 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:16.851073 17751 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:16.898396 17455 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:16.903793 17756 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
I20260709 13:03:16.904042 17751 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.894475 15290 leader_election.cc:400] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:16.896476 15392 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:16.860010 17742 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:16.852483 17496 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:16.799186 17489 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:03:16.860219 17460 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:16.867913 17703 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:16.923749 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:16.923091 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 174644us
I20260709 13:03:16.929605 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:16.933035 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 272245us
I20260709 13:03:16.879410 17695 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:16.867621 17529 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:03:16.859814 17602 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.926824 17767 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:03:16.969065 17602 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:16.969802 17660 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.942019 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:16.946064 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1822) took 1308 ms. Trace:
I20260709 13:03:16.977160 15398 rpcz_store.cc:276] 0709 13:03:15.637221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.660120 (+ 22899us) service_pool.cc:224] Handling call
0709 13:03:15.815417 (+155297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:16.507269 (+691852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.507315 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:16.507798 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:03:16.781719 (+273921us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:16.781755 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.781840 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:16.945856 (+164016us) raft_consensus.cc:1685] finished
0709 13:03:16.945874 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:16.946004 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11173,"raft.queue_time_us":74934,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":51890,"thread_start_us":898909,"threads_started":2,"wal-append.queue_time_us":373893}
I20260709 13:03:16.978410 17786 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:16.979102 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:16.872428 17312 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:03:16.943591 17618 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:16.950939 17760 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:16.853186 17746 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.905486 17717 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.997030 17778 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:16.954730 17764 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:03:16.919201 17742 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.997601 17778 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:16.998453 17742 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:17.000629 17778 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:17.001258 17778 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:16.958662 17755 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:03:16.906613 17768 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:03:16.963374 17765 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:17.003690 17200 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.005s
I20260709 13:03:16.941587 17460 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.005002 17460 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:16.965452 17745 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:17.005713 17660 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.966398 17763 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:16.905524 17442 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:03:16.944016 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:17.043105 15392 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:16.974840 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:17.044559 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 69810.8us
W20260709 13:03:16.975515 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 46147.4us
I20260709 13:03:16.982599 17782 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:16.993615 17783 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:16.982978 17695 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:16.995498 17518 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 13:03:16.996410 17746 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:16.982949 17265 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:16.986372 17697 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 13:03:16.996253 17661 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.058827 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:17.079561 17692 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:17.042469 17200 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:17.087260 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 188218us
I20260709 13:03:17.088204 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:17.065400 17763 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:17.003633 17778 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:03:17.060133 17783 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:17.076555 17312 raft_consensus.cc:2764] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:03:17.115281 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 173364us
I20260709 13:03:17.123236 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:17.117449 15998 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:17.149761 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:17.150619 15399 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.075215 17518 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.077869 17697 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.154634 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:17.168445 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 682091us
W20260709 13:03:17.168851 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 247497us
I20260709 13:03:17.101478 17783 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:17.148451 15362 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:17.270851 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 122477us
I20260709 13:03:17.271744 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:17.272888 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:17.274184 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:17.278313 15244 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:17.275246 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:17.281019 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:17.095392 17200 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.296356 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:17.153749 17768 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 13:03:17.301947 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:17.303755 15241 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:17.304104 17774 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:17.304643 17774 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:17.298497 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 127974us
I20260709 13:03:17.148967 17748 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:17.310189 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.314924 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:17.320510 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.173357 17265 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:17.173851 17765 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:17.314894 17774 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:17.333859 17790 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.334662 17790 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.337636 17790 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:17.342797 17796 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.343617 17796 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.344558 17774 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.354144 17774 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:17.294516 17751 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.271122 17442 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:17.294821 17659 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:17.376134 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 61300.9us
I20260709 13:03:17.380138 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:17.294649 17618 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:17.161216 17627 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.172s
I20260709 13:03:17.398569 15242 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:17.399312 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:17.374437 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 101681us
I20260709 13:03:17.407907 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:17.401060 15399 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:17.402904 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:17.403901 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 287222us
I20260709 13:03:17.409629 15390 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:17.381772 16025 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:17.383718 17442 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.394095 17433 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:17.371253 17265 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:17.393849 17478 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:17.395273 17602 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:17.414012 17765 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:17.440086 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:17.450289 15242 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:17.411769 17455 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.439750 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:17.397548 17751 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.440989 17265 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:17.172744 17695 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.294873 17692 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.419287 17659 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.439323 17442 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:17.491304 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.492013 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.457347 17749 consensus_meta.cc:287] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 13:03:17.495802 17659 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:17.457643 17514 consensus_meta.cc:287] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.000s
W20260709 13:03:17.453091 17731 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.001s
I20260709 13:03:17.411597 17618 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:17.491618 17739 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.045s	user 0.011s	sys 0.001s
I20260709 13:03:17.425701 17656 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
W20260709 13:03:17.515708 17742 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.000s
I20260709 13:03:17.453912 17780 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:03:17.450114 17790 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:03:17.492769 17796 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:17.517665 17661 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:17.451705 17792 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:03:17.518743 17731 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.551666 17751 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:17.547605 17618 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:17.526964 17659 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:17.559360 17771 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:17.583052 17771 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.536135 17742 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.552666 17796 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:03:17.549799 17518 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:17.566121 17801 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:17.571928 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 366391us
I20260709 13:03:17.568424 17697 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:17.585220 15363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.017s	sys 0.026s
W20260709 13:03:17.566179 17460 consensus_meta.cc:287] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.000s
I20260709 13:03:17.534133 17739 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:17.590606 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.549294 17753 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:17.601501 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:17.581776 17790 raft_consensus.cc:2764] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:03:17.605310 15363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.017s	sys 0.026s
W20260709 13:03:17.607970 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 560959us
I20260709 13:03:17.584371 17200 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:17.617050 17771 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:17.618705 17801 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.619346 17801 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.619616 17742 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:17.620879 17626 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:17.526508 17749 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:17.607246 15362 connection.cc:256] RPC call timeout handler was delayed by -1.5488056369999867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 13:03:17.635154 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:17.639927 17455 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:17.643312 17740 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.930s	user 0.011s	sys 0.000s
I20260709 13:03:17.644232 15399 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:03:17.645020 15399 pending_rounds.cc:85] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 3
I20260709 13:03:17.645246 15399 pending_rounds.cc:107] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:03:17.645512 15399 raft_consensus.cc:2889] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:17.646608 17792 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:17.647075 17792 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:17.649498 17496 consensus_meta.cc:287] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.004s
I20260709 13:03:17.650049 17496 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.625725 17753 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.675868 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:17.678707 17753 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:17.679356 17647 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:17.621502 17801 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:17.686093 15362 leader_election.cc:336] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.890s (SENT)
I20260709 13:03:17.611591 17460 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.689692 17518 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.690826 17200 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:17.700240 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 273443us
I20260709 13:03:17.726989 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:17.704480 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.712324 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 110948us
I20260709 13:03:17.729518 15321 raft_consensus.cc:606] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:17.713699 17818 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:17.730016 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:17.715871 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 308750us
I20260709 13:03:17.736533 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:17.714542 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.718863 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 311057us
I20260709 13:03:17.737886 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:17.716760 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 278576us
W20260709 13:03:17.687184 15246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.011s	sys 0.018s
W20260709 13:03:17.738821 15246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.011s	sys 0.019s
I20260709 13:03:17.739902 17813 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:17.719447 17790 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:17.740449 17813 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.740573 17790 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:17.740921 17813 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:17.741602 17790 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.742192 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:17.742511 17814 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:17.743707 17810 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.744711 17810 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.720494 17817 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:17.721827 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:17.733078 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:17.749058 15241 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:17.721344 17739 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:17.744508 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:17.756181 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:17.745545 17757 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.881s	user 0.020s	sys 0.024s
W20260709 13:03:17.766768 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 80733.3us
I20260709 13:03:17.732074 17753 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:17.767215 17660 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:17.842314 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:17.806208 17806 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:17.807337 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:17.810527 17809 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:17.771632 17780 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:17.732052 17745 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:17.815761 17812 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:17.815769 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48111.5us
I20260709 13:03:17.852998 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:17.853500 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:17.853826 15394 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:17.815913 17312 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:17.856963 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:17.817973 17749 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:17.820344 17460 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:17.864421 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:17.729256 17518 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.823150 16029 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:17.823280 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:17.856140 17594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.082s	user 0.020s	sys 0.005s
I20260709 13:03:17.875818 16033 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:17.774708 17739 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:17.828611 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:17.828254 17790 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.732661 17647 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:17.879146 17647 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:17.826066 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52679us
W20260709 13:03:17.830699 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 90412.6us
I20260709 13:03:17.884161 17626 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:17.885103 17455 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:03:17.840451 17794 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.517s	user 0.004s	sys 0.000s
I20260709 13:03:17.886974 17626 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:17.841604 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:17.889221 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:17.890210 17789 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:17.849690 17783 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.004s
I20260709 13:03:17.890990 17783 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.882114 17647 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:17.731145 17200 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.893821 17771 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:17.894397 17771 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.894969 17200 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:17.859578 17798 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:17.861510 15291 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:17.855614 15215 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:17.896804 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:17.898159 17455 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:17.898417 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:17.898322 17626 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:17.899124 17455 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:17.899189 17626 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.900249 17626 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:17.900463 17455 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:17.866412 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.870679 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:17.842756 17660 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:17.860811 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:17.890929 17789 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.904081 17660 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:17.859571 17736 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:17.905838 17736 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.906288 17736 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.890339 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:17.822295 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:17.910573 15242 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:17.914749 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:17.849129 17809 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.849625 17731 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:17.732127 17820 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.919476 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:17.921221 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:17.936514 15316 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:17.921506 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:17.922904 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:17.938211 15325 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:17.925498 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:17.939517 15323 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:17.926190 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:17.928028 17798 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.858847 17753 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:17.860124 17496 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:17.933077 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 71667us
W20260709 13:03:17.919414 17594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.020s	sys 0.005s
I20260709 13:03:17.947705 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:17.932898 15319 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:17.955996 15319 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:17.957281 15394 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:17.950038 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:17.954418 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:17.956729 15319 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.960892 15319 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:17.920131 17656 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:17.936568 17814 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:17.735559 17818 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.962690 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:17.966025 15325 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:17.970718 15325 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:17.970736 15316 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.967495 15317 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:17.964165 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 347) took 1598 ms. Trace:
I20260709 13:03:17.860885 17265 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.973253 15319 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:03:17.974968 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:17.975656 15323 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:17.980085 15319 pending_rounds.cc:85] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 2
I20260709 13:03:17.869035 17515 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:03:17.936172 17809 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:17.950520 17812 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:17.978343 15242 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:17.861872 17745 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.980433 15319 pending_rounds.cc:107] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:03:17.980630 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:17.954275 17765 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:17.929065 17780 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:03:17.984311 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:17.988474 15322 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:17.961886 17496 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:18.003988 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:18.030619 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:18.043064 15318 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:18.043717 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:17.930428 17739 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:17.989015 15325 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:18.044437 15319 raft_consensus.cc:2889] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:18.043850 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:18.044456 15242 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:18.048655 15318 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:17.977346 17814 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.057076 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:18.057543 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:18.059587 15325 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:18.062032 15394 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:18.063558 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:18.066529 15319 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:18.041433 15323 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:18.068745 17780 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.995813 17812 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.041221 17691 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:18.069116 17811 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.995853 17740 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:03:17.957242 17798 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:18.070832 17765 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:18.080070 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:18.077334 15242 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.111790 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:18.042075 17810 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:18.086843 15324 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:18.087437 15318 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
W20260709 13:03:18.020097 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.095391 15319 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:18.100663 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:17.985451 16028 pending_rounds.cc:85] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 3
I20260709 13:03:18.107465 17739 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:17.955152 17820 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:18.125442 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:18.065436 17814 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:18.142894 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:18.144359 15318 pending_rounds.cc:85] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 3
I20260709 13:03:18.144667 15318 pending_rounds.cc:107] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:03:18.144932 15318 raft_consensus.cc:2889] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:18.142550 17691 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:18.159111 17691 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:18.160547 17660 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:18.143097 17740 consensus_queue.cc:1243] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:18.168774 17265 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:18.075783 17753 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:18.080271 17812 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:18.173899 15317 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:18.136724 16028 pending_rounds.cc:107] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 2.4
I20260709 13:03:18.127980 17765 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.106921 17811 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:18.205318 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:18.206260 15325 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:18.208989 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:18.169601 17626 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:18.086567 17780 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:18.216739 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:18.217396 15322 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:18.218510 17780 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:18.218654 15322 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:03:18.219534 17829 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:03:18.220077 17826 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.220484 15316 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:18.221803 15316 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:03:18.225207 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.233078 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:18.143365 17496 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
W20260709 13:03:18.211409 17442 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.697s	user 0.009s	sys 0.003s
W20260709 13:03:18.278627 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.279304 15317 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:18.201505 16028 raft_consensus.cc:2889] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:18.226987 17577 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:18.207980 17765 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:18.322805 15395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1839) took 2431 ms (client timeout 1977 ms). Trace:
W20260709 13:03:18.326609 15395 rpcz_store.cc:269] 0709 13:03:15.877927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.023540 (+145613us) service_pool.cc:224] Handling call
0709 13:03:18.308675 (+2285135us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54003d8bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:18.308888 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329600896}
I20260709 13:03:18.333024 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:18.336401 15395 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:18.270615 17824 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.405s	user 0.001s	sys 0.001s
I20260709 13:03:18.270402 17265 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.271746 17518 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:18.272147 17656 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.213617 17813 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:18.220700 17826 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:17.974838 16024 rpcz_store.cc:276] 0709 13:03:16.362116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.362267 (+   151us) service_pool.cc:224] Handling call
0709 13:03:16.362733 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:16.363182 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:16.363226 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:16.363860 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:03:16.711605 (+347745us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:16.713888 (+  2283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:16.717520 (+  3632us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:17.744862 (+1027342us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:17.954594 (+209732us) raft_consensus.cc:1685] finished
0709 13:03:17.957190 (+  2596us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:17.960632 (+  3442us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34628,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"spinlock_wait_cycles":15794944,"thread_start_us":309473,"threads_started":1,"wal-append.queue_time_us":412116}
I20260709 13:03:18.318035 17442 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:18.472949 15395 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:18.330511 17736 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:18.476621 17736 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:18.489711 17832 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:03:18.389387 17577 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:18.421283 17265 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:18.491220 17789 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:18.492825 15316 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 13:03:18.597311 17831 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 13:03:18.598443 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:18.622563 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 254) took 1680 ms. Trace:
I20260709 13:03:18.631708 15248 rpcz_store.cc:276] 0709 13:03:16.942367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.942603 (+   236us) service_pool.cc:224] Handling call
0709 13:03:16.942913 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.653585 (+710672us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:17.653924 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.725399 (+ 71475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:17.725508 (+   109us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:17.726450 (+   942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.621955 (+895505us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b540010b654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:18.622040 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.622473 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":128,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":166,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":86,"spinlock_wait_cycles":1642107136,"thread_start_us":70638,"threads_started":1,"wal-append.queue_time_us":222266}
W20260709 13:03:18.622874 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.624166 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:18.635367 15317 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:18.595569 17634 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:18.598131 17489 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.435345 17656 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:18.580358 17823 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.505s	user 0.001s	sys 0.000s
W20260709 13:03:18.642182 15291 connection.cc:256] RPC call timeout handler was delayed by -2.2654555029999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:03:18.495362 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2140) took 1332 ms. Trace:
W20260709 13:03:18.587136 17821 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.523s	user 0.000s	sys 0.001s
I20260709 13:03:18.647583 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:18.646924 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:18.651612 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1838) took 2773 ms. Trace:
I20260709 13:03:18.681001 15316 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:18.496352 15246 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:18.665773 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:18.688035 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.680455 15317 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:18.696522 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58726 (request call id 17) took 1938 ms. Trace:
I20260709 13:03:18.467222 17810 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:18.722084 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56461.5us
I20260709 13:03:18.722142 15316 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:18.722983 15321 rpcz_store.cc:276] 0709 13:03:16.758623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.758774 (+   151us) service_pool.cc:224] Handling call
0709 13:03:18.696297 (+1937523us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54002ee5d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf4853 00007f366ebc260a 00007f36681487d4 00007f3668148762 00007f3668148691 00007f366814860c 00007f36681478c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:18.696442 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2181159808}
I20260709 13:03:18.620045 17442 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:18.681162 15391 rpcz_store.cc:276] 0709 13:03:15.877673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.283838 (+406165us) service_pool.cc:224] Handling call
0709 13:03:16.585704 (+301866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.598269 (+ 12565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:18.651367 (+2053098us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540009bad0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:18.651521 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":693395200}
I20260709 13:03:18.747524 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:18.680178 15396 rpcz_store.cc:276] 0709 13:03:17.163018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.498065 (+335047us) service_pool.cc:224] Handling call
0709 13:03:17.499500 (+  1435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:17.715810 (+216310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.715860 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:17.724221 (+  8361us) log.cc:844] Serialized 52 byte log entry
0709 13:03:17.934289 (+210068us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:17.934337 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.936498 (+  2161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.495046 (+558548us) raft_consensus.cc:1685] finished
0709 13:03:18.495075 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.495281 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69974,"raft.queue_time_us":106487,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":5332,"thread_start_us":380147,"threads_started":2,"wal-append.queue_time_us":347698}
I20260709 13:03:18.618412 17626 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:18.751679 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:18.752595 15317 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:18.642915 17660 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:18.686439 17667 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:18.754346 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:18.491683 17830 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:03:18.686707 17828 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.715s	user 0.003s	sys 0.000s
I20260709 13:03:18.760068 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:18.645570 17634 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:18.612756 17826 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:18.793874 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:18.801755 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:18.761883 15316 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:03:18.652527 17783 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:18.694837 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:18.802644 15391 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:18.691990 17646 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:18.800617 15317 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:03:18.803012 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:18.809626 17634 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:18.810129 15396 raft_consensus.cc:2368] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:18.747938 17746 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:18.811874 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:18.810586 17783 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.812637 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 225) took 1125 ms. Trace:
I20260709 13:03:18.649324 17577 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:18.815178 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.657541 17489 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:18.797874 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:18.649715 17820 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:18.620963 17792 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:18.749819 17736 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:18.756134 17810 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:18.656877 17814 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:19.103935 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.059883 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:18.812601 15317 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:19.058645 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1102) took 1220 ms. Trace:
I20260709 13:03:19.160311 15250 rpcz_store.cc:276] 0709 13:03:17.838652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.838800 (+   148us) service_pool.cc:224] Handling call
0709 13:03:17.857318 (+ 18518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.071421 (+214103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.071460 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:18.071509 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:18.071549 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.058346 (+986797us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540001e854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:19.058410 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.058573 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491834112}
W20260709 13:03:18.903671 15996 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.004s	sys 0.017s
W20260709 13:03:18.898991 15290 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.024s	sys 0.098s
W20260709 13:03:19.164784 15996 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.013s	sys 0.017s
W20260709 13:03:19.164902 15290 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.033s	sys 0.111s
W20260709 13:03:19.165299 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 883475us
W20260709 13:03:19.165443 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 940511us
I20260709 13:03:19.061874 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1099) took 1227 ms. Trace:
W20260709 13:03:18.900709 15324 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.020s
I20260709 13:03:18.816452 15391 rpcz_store.cc:276] 0709 13:03:17.687352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.811621 (+1124269us) service_pool.cc:224] Handling call
0709 13:03:18.812580 (+   959us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:19.167238 15324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.004s	sys 0.026s
I20260709 13:03:18.902859 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:19.057891 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2141) took 1894 ms. Trace:
I20260709 13:03:19.168761 15399 rpcz_store.cc:276] 0709 13:03:17.163357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.569272 (+405915us) service_pool.cc:224] Handling call
0709 13:03:17.569602 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.645924 (+ 76322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.057513 (+1411589us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b54000271d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:19.057800 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170795264}
I20260709 13:03:19.171085 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1854) took 1229 ms. Trace:
W20260709 13:03:19.009598 15243 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.025s	sys 0.077s
I20260709 13:03:19.184293 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:18.938216 17811 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:19.184836 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:18.910368 17460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.008s	sys 0.016s
I20260709 13:03:19.167037 15246 rpcz_store.cc:276] 0709 13:03:17.834912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.836315 (+  1403us) service_pool.cc:224] Handling call
0709 13:03:19.061562 (+1225247us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b5400317254. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:19.061786 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1360981888}
I20260709 13:03:18.821884 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 216) took 1780 ms. Trace:
I20260709 13:03:18.930197 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 215) took 1934 ms. Trace:
I20260709 13:03:19.174130 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:19.185710 17460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.016s	sys 0.027s
I20260709 13:03:19.187449 16030 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 2: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:03:19.063760 17754 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 2.299s	user 0.007s	sys 0.007s
I20260709 13:03:19.187861 17792 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:19.171912 15243 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.028s	sys 0.079s
I20260709 13:03:19.186959 15392 rpcz_store.cc:276] 0709 13:03:16.996091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.062110 (+ 66019us) service_pool.cc:224] Handling call
0709 13:03:17.062609 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.408570 (+345961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.408614 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:17.425952 (+ 17338us) log.cc:844] Serialized 26 byte log entry
0709 13:03:17.858705 (+432753us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:17.859044 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.859242 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.859347 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.929890 (+1070543us) raft_consensus.cc:1685] finished
0709 13:03:18.929922 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.930112 (+   190us) inbound_call.cc:177] Queueing success response
0709 13:03:19.094595 (+164483us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b18002c3560. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
Metrics: {"prepare.queue_time_us":107,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":66287,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":7242,"spinlock_wait_cycles":79283456,"thread_start_us":777508,"threads_started":2,"wal-append.queue_time_us":548637}
W20260709 13:03:18.849385 17812 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.000s
I20260709 13:03:19.199676 17818 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:19.206382 17587 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:18.842535 17809 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.794s	user 0.013s	sys 0.000s
I20260709 13:03:19.185657 15391 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:19.229717 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2151) took 1284 ms. Trace:
I20260709 13:03:19.230144 15391 rpcz_store.cc:276] 0709 13:03:17.945585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.184577 (+1238992us) service_pool.cc:224] Handling call
0709 13:03:19.229638 (+ 45061us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:19.206848 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1100) took 1370 ms. Trace:
W20260709 13:03:19.210117 15245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 250) took 2684 ms (client timeout 1792 ms). Trace:
I20260709 13:03:19.006552 17265 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:18.938834 17455 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.019s	sys 0.007s
I20260709 13:03:19.218691 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:19.269474 15392 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:18.825821 17797 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.462s	user 0.011s	sys 0.000s
I20260709 13:03:18.794162 17667 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:18.814738 17813 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:19.185923 15393 rpcz_store.cc:276] 0709 13:03:17.042036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.426205 (+384169us) service_pool.cc:224] Handling call
0709 13:03:17.440527 (+ 14322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.440956 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.440998 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:17.465067 (+ 24069us) log.cc:844] Serialized 26 byte log entry
0709 13:03:17.751083 (+286016us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:17.751124 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.751201 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.821631 (+1070430us) raft_consensus.cc:1685] finished
0709 13:03:18.821653 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.821817 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149138,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":10825,"thread_start_us":223925,"threads_started":1,"wal-append.queue_time_us":448105}
I20260709 13:03:19.171681 15390 rpcz_store.cc:276] 0709 13:03:17.941871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.059466 (+1117595us) service_pool.cc:224] Handling call
0709 13:03:19.171005 (+111539us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:18.811300 17746 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:19.161408 17814 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:19.234287 15245 rpcz_store.cc:269] 0709 13:03:16.525742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.525869 (+   127us) service_pool.cc:224] Handling call
0709 13:03:19.201054 (+2675185us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54000ad554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:19.210045 (+  8991us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583855360}
I20260709 13:03:18.827663 17783 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:19.312649 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:19.228449 17839 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:19.288727 17455 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.027s	sys 0.009s
I20260709 13:03:19.184463 17736 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:19.226217 17510 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:03:19.234323 15243 rpcz_store.cc:276] 0709 13:03:17.836654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.836766 (+   112us) service_pool.cc:224] Handling call
0709 13:03:17.837201 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:17.849974 (+ 12773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.850026 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:17.856810 (+  6784us) log.cc:844] Serialized 52 byte log entry
0709 13:03:18.200506 (+343696us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:18.221406 (+ 20900us) log.cc:844] Serialized 14 byte log entry
0709 13:03:19.206475 (+985069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.206559 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:19.206611 (+    52us) raft_consensus.cc:1685] finished
0709 13:03:19.206624 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.206786 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21261,"prepare.run_wall_time_us":35132,"raft.queue_time_us":95819,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":194,"spinlock_wait_cycles":21488000,"thread_start_us":1225836,"threads_started":2,"wal-append.queue_time_us":562742}
W20260709 13:03:19.253119 17822 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.996s	user 0.033s	sys 0.039s
I20260709 13:03:19.269382 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:19.184259 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.184202 16029 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
W20260709 13:03:19.312853 15318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.009s	sys 0.020s
I20260709 13:03:19.233601 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 352) took 1616 ms. Trace:
W20260709 13:03:19.562456 15290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.640s (SENT) [suppressed 14 similar messages]
W20260709 13:03:20.157701 15318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.836s	user 0.019s	sys 0.048s
W20260709 13:03:20.158476 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 596015us
W20260709 13:03:19.528148 15322 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.230s	user 0.034s	sys 0.011s
W20260709 13:03:20.159960 15322 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.862s	user 0.044s	sys 0.021s
I20260709 13:03:20.160460 15390 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
W20260709 13:03:19.873106 15363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.167s	user 0.002s	sys 0.011s
W20260709 13:03:20.162261 15363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.457s	user 0.005s	sys 0.014s
W20260709 13:03:20.163960 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.873318 15364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.143s	user 0.032s	sys 0.051s
W20260709 13:03:20.165063 15364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.435s	user 0.036s	sys 0.053s
W20260709 13:03:19.558774 15394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2148) took 1788 ms (client timeout 1876 ms). Trace:
I20260709 13:03:19.346094 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:19.426586 16031 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.115s	user 0.000s	sys 0.045s
W20260709 13:03:20.168994 16031 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.864s	user 0.001s	sys 0.050s
I20260709 13:03:20.169384 15393 raft_consensus.cc:2410] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:19.566620 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1101) took 1728 ms. Trace:
W20260709 13:03:19.526379 15323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.220s	user 0.015s	sys 0.016s
W20260709 13:03:20.173683 15323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.867s	user 0.015s	sys 0.034s
W20260709 13:03:20.167430 15394 rpcz_store.cc:269] 0709 13:03:17.770219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.863005 (+ 92786us) service_pool.cc:224] Handling call
0709 13:03:19.558497 (+1695492us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b5400154ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:19.558685 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211194112}
W20260709 13:03:20.143757 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 926228us
I20260709 13:03:20.161476 15391 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
W20260709 13:03:20.171065 15321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.271s	user 0.016s	sys 0.012s
W20260709 13:03:19.378808 15325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.019s	sys 0.019s
W20260709 13:03:19.565090 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:19.497762 15216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.033s	sys 0.051s
I20260709 13:03:19.229975 17587 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:19.394651 15392 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
W20260709 13:03:20.189427 15392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1849) took 2248 ms (client timeout 2127 ms). Trace:
W20260709 13:03:19.231156 17753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.013s	sys 0.016s
W20260709 13:03:19.245028 17765 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.831s	user 0.009s	sys 0.007s
W20260709 13:03:19.344774 15365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.000s	sys 0.025s
W20260709 13:03:20.175459 15321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.275s	user 0.017s	sys 0.012s
W20260709 13:03:20.175593 15325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.761s	user 0.021s	sys 0.046s
W20260709 13:03:20.176590 15216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.697s	user 0.036s	sys 0.057s
W20260709 13:03:20.181929 15391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2146) took 2409 ms (client timeout 2310 ms). Trace:
W20260709 13:03:19.227154 17749 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.015s	sys 0.014s
I20260709 13:03:20.170737 15244 rpcz_store.cc:276] 0709 13:03:17.838317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.838557 (+   240us) service_pool.cc:224] Handling call
0709 13:03:19.210473 (+1371916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:19.210692 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:19.210722 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:19.210782 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:19.210834 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.210915 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.566345 (+355430us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000ad550. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:19.566531 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3104415488}
W20260709 13:03:20.204463 17749 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.898s	user 0.029s	sys 0.031s
I20260709 13:03:20.200379 17862 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.206146 17749 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.205565 17862 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.207265 15241 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:19.403829 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1841) took 3525 ms. Trace:
I20260709 13:03:20.208092 15397 rpcz_store.cc:276] 0709 13:03:15.878435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.286322 (+407887us) service_pool.cc:224] Handling call
0709 13:03:16.842678 (+556356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:16.844257 (+  1579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.403567 (+2559310us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54001554d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:19.403756 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1278777600}
I20260709 13:03:20.209360 17862 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:20.210573 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:20.212302 15244 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:03:20.213065 15245 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:20.213927 17647 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.187304 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.155542 17518 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.499s	user 0.002s	sys 0.016s
W20260709 13:03:19.303274 17655 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.013s	sys 0.016s
W20260709 13:03:20.189826 15392 rpcz_store.cc:269] 0709 13:03:17.940663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.218419 (+1277756us) service_pool.cc:224] Handling call
0709 13:03:20.189357 (+970938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:19.527529 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 490) took 2784 ms. Trace:
W20260709 13:03:20.196312 15365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.467s	user 0.006s	sys 0.052s
W20260709 13:03:20.197201 15391 rpcz_store.cc:269] 0709 13:03:17.765767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.269073 (+1503306us) service_pool.cc:224] Handling call
0709 13:03:20.175192 (+906119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:20.172896 17725 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:20.172924 16027 rpcz_store.cc:276] 0709 13:03:17.613195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.618312 (+  5117us) service_pool.cc:224] Handling call
0709 13:03:17.618673 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.676003 (+ 57330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.676040 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:17.676085 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:17.676128 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.208715 (+1532587us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b5400631354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:19.216787 (+  8072us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:19.229937 (+ 13150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131353984}
I20260709 13:03:20.179592 17839 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.202796 17587 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:20.195956 17753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.748s	user 0.030s	sys 0.045s
I20260709 13:03:20.203927 17765 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:20.183451 15390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1846) took 2221 ms (client timeout 2816 ms). Trace:
W20260709 13:03:20.291656 15390 rpcz_store.cc:269] 0709 13:03:17.939903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.296739 (+1356836us) service_pool.cc:224] Handling call
0709 13:03:20.161234 (+864495us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:20.271005 17655 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.965s	user 0.016s	sys 0.051s
I20260709 13:03:20.214207 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:19.866287 16028 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.245s	user 0.007s	sys 0.025s
I20260709 13:03:20.261270 15399 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:20.255256 17695 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.268384 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:20.269243 15248 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:20.271515 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:20.130400 17844 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:03:20.271754 15245 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:19.528484 17799 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.274844 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:20.188134 15393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1851) took 2229 ms (client timeout 2273 ms). Trace:
I20260709 13:03:20.278209 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:20.158751 17612 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:19.343753 17810 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:19.417328 17515 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.204210 17607 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.280395 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.236934 17809 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:19.564410 17771 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:20.200800 17822 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.973s	user 0.037s	sys 0.053s
W20260709 13:03:20.195274 17667 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.002s
I20260709 13:03:20.280356 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2070) took 2347 ms. Trace:
I20260709 13:03:20.283941 17795 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.382690 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:20.313863 17843 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.261844 17518 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.615s	user 0.002s	sys 0.016s
I20260709 13:03:20.285899 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:20.196372 17740 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.174265 17489 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.315518 17753 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:03:20.288825 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:19.268916 17812 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.293151 15246 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:20.414309 15395 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:20.352829 17799 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.195035 17861 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.220170 16029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 359) took 1493 ms (client timeout 1819 ms). Trace:
W20260709 13:03:20.412541 17737 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.053s	sys 0.063s
I20260709 13:03:20.268472 17862 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.422894 17737 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.053s	sys 0.063s
I20260709 13:03:20.214493 17647 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.423102 17862 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.424993 17862 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:20.425271 17647 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:20.425719 15242 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:03:20.267167 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:20.311383 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:20.426614 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:20.301517 17627 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.371410 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.462934 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.463474 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.426398 15397 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:20.464509 17763 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:20.465054 17763 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.352705 15394 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:20.467350 17763 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:20.467862 17763 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:20.468286 17763 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.468874 17799 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:20.351985 15393 rpcz_store.cc:269] 0709 13:03:17.941138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.296968 (+1355830us) service_pool.cc:224] Handling call
0709 13:03:20.170057 (+873089us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:20.418015 16029 rpcz_store.cc:269] 0709 13:03:18.697442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.726942 (+ 29500us) service_pool.cc:224] Handling call
0709 13:03:20.180852 (+1453910us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:19.427279 17746 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:20.295631 16028 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.674s	user 0.010s	sys 0.025s
I20260709 13:03:20.310199 17455 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.305606 17847 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:03:20.304586 17433 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:20.281100 17725 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:20.304495 17845 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.381665 15320 rpcz_store.cc:276] 0709 13:03:17.921705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.922703 (+   998us) service_pool.cc:224] Handling call
0709 13:03:17.922992 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.923196 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:17.923487 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.268387 (+2344900us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b18002d64c0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a
0709 13:03:20.268579 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:20.268629 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:20.268693 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.268756 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.268898 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"prepare.queue_time_us":3099,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"spinlock_wait_cycles":57426560,"thread_start_us":4767,"threads_started":1,"wal-append.queue_time_us":231838,"wal-append.run_cpu_time_us":1257,"wal-append.run_wall_time_us":1009822}
W20260709 13:03:20.387224 17854 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:03:20.388968 17809 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.391456 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:20.353622 17612 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:20.395586 15319 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:20.475390 15394 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:20.302263 17767 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:20.473069 17763 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:20.414817 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:20.277567 16025 rpcz_store.cc:276] 0709 13:03:16.742873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.756860 (+ 13987us) service_pool.cc:224] Handling call
0709 13:03:16.786447 (+ 29587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:17.453146 (+666699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:19.490914 (+2037768us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b540065e354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:19.527396 (+ 36482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1210164608}
I20260709 13:03:20.294826 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:20.482311 15244 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 13:03:20.483053 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 188329us
I20260709 13:03:20.312784 17695 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.480029 17455 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:20.298316 15324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.128s	user 0.051s	sys 0.053s
I20260709 13:03:20.421619 15395 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:20.375923 17607 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.374421 17515 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.206156 17745 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.487531 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:20.488612 15395 raft_consensus.cc:2368] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:20.206774 17749 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.383701 17667 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.405526 17795 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.426478 15390 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:20.484539 17736 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:20.471067 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:20.527448 15393 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:20.373026 15391 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:20.471312 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2090) took 2286 ms. Trace:
I20260709 13:03:20.470425 17627 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.422503 17861 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.411636 17740 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.477210 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 573) took 2613 ms. Trace:
I20260709 13:03:20.528481 15322 rpcz_store.cc:276] 0709 13:03:18.184981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.219465 (+ 34484us) service_pool.cc:224] Handling call
0709 13:03:18.219779 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.297359 (+ 77580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.297388 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.297897 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.160615 (+1862718us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:20.160671 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.160774 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.471097 (+310323us) raft_consensus.cc:1685] finished
0709 13:03:20.471116 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.471258 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77111,"raft.queue_time_us":77996,"spinlock_wait_cycles":16023296,"thread_start_us":1862367,"threads_started":1,"wal-append.queue_time_us":2117419}
I20260709 13:03:20.536092 16026 rpcz_store.cc:276] 0709 13:03:17.863610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.868859 (+  5249us) service_pool.cc:224] Handling call
0709 13:03:20.391217 (+2522358us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:20.477120 (+ 85903us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15129472}
I20260709 13:03:20.477267 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2088) took 2371 ms. Trace:
I20260709 13:03:20.352164 17587 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:20.478953 15394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2145) took 2724 ms (client timeout 3212 ms). Trace:
W20260709 13:03:20.539966 15394 rpcz_store.cc:269] 0709 13:03:17.754722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.274473 (+2519751us) service_pool.cc:224] Handling call
0709 13:03:20.478879 (+204406us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:20.225487 17853 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:03:20.407713 17843 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.484001 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:20.484125 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2089) took 2375 ms. Trace:
I20260709 13:03:20.550393 15325 rpcz_store.cc:276] 0709 13:03:18.108990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.209948 (+100958us) service_pool.cc:224] Handling call
0709 13:03:18.216721 (+  6773us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.298278 (+ 81557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.298324 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.298875 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.196995 (+1898120us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:20.197030 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.197096 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.483940 (+286844us) raft_consensus.cc:1685] finished
0709 13:03:20.483957 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.484070 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":168278,"raft.queue_time_us":81253,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":13087,"thread_start_us":1782383,"threads_started":1,"wal-append.queue_time_us":2088462}
W20260709 13:03:20.486610 15324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.316s	user 0.051s	sys 0.053s
I20260709 13:03:20.552767 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 254) took 2565 ms. Trace:
I20260709 13:03:20.489853 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:20.486408 17862 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:20.440881 15316 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:20.475495 17433 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.534204 15390 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:20.529940 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:20.526822 17765 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:20.537478 15318 rpcz_store.cc:276] 0709 13:03:18.106344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.143880 (+ 37536us) service_pool.cc:224] Handling call
0709 13:03:18.144187 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.145416 (+  1229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.145447 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:18.154420 (+  8973us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.158524 (+2004104us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:20.158586 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.158880 (+   294us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.477043 (+318163us) raft_consensus.cc:1685] finished
0709 13:03:20.477066 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.477198 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1836672,"threads_started":1,"wal-append.queue_time_us":2044367}
I20260709 13:03:20.480760 17767 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.543753 17667 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.476120 17725 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.555215 15395 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:20.553251 15324 rpcz_store.cc:276] 0709 13:03:17.986958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.127670 (+140712us) service_pool.cc:224] Handling call
0709 13:03:18.174348 (+ 46678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:18.174648 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:19.170222 (+995574us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.552334 (+1382112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:20.552405 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:20.552454 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.552523 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.552683 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34173,"prepare.queue_time_us":143680,"prepare.run_cpu_time_us":8593,"prepare.run_wall_time_us":93061,"thread_start_us":2316810,"threads_started":2,"wal-append.queue_time_us":1201490}
I20260709 13:03:20.475833 17845 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:20.559149 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 75211us
I20260709 13:03:20.489136 17839 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.583604 15392 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:20.557215 17778 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.584671 15391 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:20.536120 17783 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:20.592988 15390 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:20.597774 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2142) took 3293 ms. Trace:
I20260709 13:03:20.597890 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 220) took 3134 ms. Trace:
I20260709 13:03:20.598148 15391 rpcz_store.cc:276] 0709 13:03:17.304266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.581781 (+3277515us) service_pool.cc:224] Handling call
0709 13:03:20.582178 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.597524 (+ 15346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.597723 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:20.594411 15246 raft_consensus.cc:2410] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:20.526397 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 570) took 2677 ms. Trace:
I20260709 13:03:20.596321 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 221) took 3072 ms. Trace:
I20260709 13:03:20.602164 15395 rpcz_store.cc:276] 0709 13:03:17.524042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.595496 (+3071454us) service_pool.cc:224] Handling call
0709 13:03:20.595814 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.595996 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.596020 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:20.596060 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:20.596094 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.596149 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.596264 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:20.603945 15395 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:03:20.604242 15395 pending_rounds.cc:85] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 4
I20260709 13:03:20.604435 15395 pending_rounds.cc:107] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:03:20.604636 15395 raft_consensus.cc:2889] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:20.605254 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 224) took 2970 ms. Trace:
I20260709 13:03:20.605538 15395 rpcz_store.cc:276] 0709 13:03:17.634825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.603340 (+2968515us) service_pool.cc:224] Handling call
0709 13:03:20.603611 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.605032 (+  1421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.605200 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:20.598274 15390 rpcz_store.cc:276] 0709 13:03:17.463850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.589606 (+3125756us) service_pool.cc:224] Handling call
0709 13:03:20.592815 (+  3209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.597686 (+  4871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.597843 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:20.592602 15363 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:20.585210 17736 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:20.599511 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 363) took 1783 ms. Trace:
I20260709 13:03:20.608675 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 226) took 2921 ms. Trace:
W20260709 13:03:20.609922 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 396360us
I20260709 13:03:20.609230 15395 rpcz_store.cc:276] 0709 13:03:17.687719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.607020 (+2919301us) service_pool.cc:224] Handling call
0709 13:03:20.608003 (+   983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.608364 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.608391 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:20.608429 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:20.608460 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.608515 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.608624 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2307}
I20260709 13:03:20.611109 15392 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
W20260709 13:03:20.644522 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.593652 17812 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:20.673360 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58767.4us
I20260709 13:03:20.650002 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:20.671641 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.695214 15395 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:20.685243 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:20.609728 16033 rpcz_store.cc:276] 0709 13:03:18.815795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.192049 (+376254us) service_pool.cc:224] Handling call
0709 13:03:19.233571 (+ 41522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:19.233858 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:19.296883 (+ 63025us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.597117 (+1300234us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:20.597182 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:20.597223 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.599351 (+  2128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.599463 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":525475,"prepare.queue_time_us":78709,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":57,"raft.queue_time_us":660914,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":41268,"thread_start_us":774280,"threads_started":2,"wal-append.queue_time_us":1119157}
I20260709 13:03:20.673789 16031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 572) took 2811 ms. Trace:
I20260709 13:03:20.699646 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:20.698400 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 67362.8us
I20260709 13:03:20.601466 17510 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:20.601711 17839 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:20.602016 17799 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.640759 17807 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.703248 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 313065us
I20260709 13:03:20.638007 17765 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:20.709139 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:20.711174 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2087) took 2629 ms. Trace:
I20260709 13:03:20.712275 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:20.642944 17822 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:20.646325 17783 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:20.722477 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:20.685209 17455 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:20.607740 17778 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.721711 15323 rpcz_store.cc:276] 0709 13:03:18.081621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.143374 (+ 61753us) service_pool.cc:224] Handling call
0709 13:03:18.143711 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:18.147363 (+  3652us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.147407 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:18.202099 (+ 54692us) log.cc:844] Serialized 52 byte log entry
0709 13:03:20.174157 (+1972058us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:20.703786 (+529629us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.710749 (+  6963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.710846 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.710897 (+    51us) raft_consensus.cc:1685] finished
0709 13:03:20.710916 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.711100 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9711,"raft.queue_time_us":11932,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":12952,"thread_start_us":2334064,"threads_started":2,"wal-append.queue_time_us":2152094}
W20260709 13:03:20.736809 15321 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.010s	sys 0.009s
I20260709 13:03:20.696376 17763 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:20.713330 17792 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.525s	user 0.014s	sys 0.002s
I20260709 13:03:20.699420 17762 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.699221 17862 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:20.709420 17812 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:20.710285 17810 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.751502 15247 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.017s
I20260709 13:03:20.700675 17871 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:20.762574 15996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.000s	sys 0.032s
I20260709 13:03:20.726380 17765 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:20.780354 15996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.033s
W20260709 13:03:20.799688 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 624740us
I20260709 13:03:20.720611 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:20.779491 15247 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.006s	sys 0.018s
I20260709 13:03:20.720774 17863 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:20.713513 17870 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:20.813416 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 91008us
I20260709 13:03:20.706346 17868 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:03:20.714371 17776 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:03:20.867427 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:20.868546 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:20.836716 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:20.869253 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:20.841140 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:20.824553 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.863430 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:20.870604 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.713533 17510 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.809377 17765 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:20.884642 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:20.786036 17836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.350s	user 0.025s	sys 0.024s
I20260709 13:03:20.721107 17839 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.726629 17799 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.799800 17872 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.744634 17822 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.894466 15243 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:20.912050 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:20.912693 15243 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 2.
I20260709 13:03:20.747545 17783 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.913200 17872 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.915753 17839 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.916610 17872 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.918658 17889 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:20.918907 17783 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:20.919157 17740 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:20.799176 17785 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:20.879307 17879 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:03:20.919901 17740 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:20.948231 17785 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.950901 17785 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.951300 17767 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.951542 17785 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:20.952308 17785 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:20.952664 17785 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.952785 17843 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:20.953068 17785 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:20.953933 17795 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:20.947844 17872 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:20.809075 17810 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.954716 17872 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:20.955732 17872 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.867385 17607 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:20.726799 17807 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.957353 17612 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.866950 17863 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.958523 17807 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:20.886885 17864 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:03:20.957384 17872 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:20.960279 17863 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:20.961694 17778 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.962630 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:20.963055 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 220815us
I20260709 13:03:20.963570 15243 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:20.906567 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 194412us
I20260709 13:03:20.750769 17874 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.156s
I20260709 13:03:20.964540 15290 leader_election.cc:400] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:20.919799 17783 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:20.956379 17810 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:20.980186 15243 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:20.899286 17836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.510s	user 0.034s	sys 0.029s
I20260709 13:03:20.800987 17812 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.781625 17763 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.836612 17792 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:03:20.978960 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:20.981528 15323 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:20.994918 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:20.995620 15323 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:20.996608 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:20.996800 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:20.997149 15323 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:20.998057 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:20.998667 15324 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:20.983862 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:21.000828 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.919237 17889 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:20.899737 17627 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:20.979244 17807 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.991902 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:20.808605 17862 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:20.992126 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:20.992633 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:21.010636 15318 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:20.994865 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:21.012404 15317 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:20.920120 17433 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:20.997367 15322 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:20.920497 17749 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:21.003387 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 139886us
I20260709 13:03:20.893123 17737 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:20.807709 17762 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:20.880707 17890 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.067128 15395 raft_consensus.cc:2410] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:20.819883 17871 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:21.044622 15324 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:21.015241 17736 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:20.601974 16028 rpcz_store.cc:276] 0709 13:03:17.849061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.852639 (+  3578us) service_pool.cc:224] Handling call
0709 13:03:17.961624 (+108985us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:18.442737 (+481113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:18.448146 (+  5409us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:18.620819 (+172673us) log.cc:844] Serialized 52 byte log entry
0709 13:03:20.481040 (+1860221us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:20.483474 (+  2434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.491809 (+  8335us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.494591 (+  2782us) raft_consensus.cc:1685] finished
0709 13:03:20.515461 (+ 20870us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.524556 (+  9095us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4543,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6218,"thread_start_us":1856065,"threads_started":1,"wal-append.queue_time_us":1519213}
I20260709 13:03:20.872171 17870 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:21.058004 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 221372us
I20260709 13:03:21.085045 17893 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:21.015727 17807 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:21.059639 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:21.004055 17783 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:21.006331 17889 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:21.015017 17839 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:20.990578 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 122108us
I20260709 13:03:21.035117 17861 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:21.078604 17759 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.081702 17822 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:21.031793 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:21.036686 17737 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.127614 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:21.162781 15322 raft_consensus.cc:2410] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:21.108033 15325 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:21.074895 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:21.163240 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 131417us
I20260709 13:03:21.164111 15317 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:21.128903 15323 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:21.035110 17607 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:21.126633 17836 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:03:21.135010 17759 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:21.079507 17717 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:21.076372 17890 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:21.086714 17587 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:03:21.138964 15245 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:21.140622 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:21.081733 17876 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:03:21.086148 17785 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:21.201536 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:21.165690 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1136) took 2942 ms. Trace:
I20260709 13:03:21.170459 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:21.168542 17737 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:21.091176 17799 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:21.197170 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.193737 15396 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
W20260709 13:03:21.192865 17884 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:03:21.204694 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:21.217188 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:21.218765 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:21.148984 17839 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:21.179502 17776 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:21.203402 17785 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:21.209084 17898 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.188571 17749 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:21.203774 15321 rpcz_store.cc:276] 0709 13:03:18.222776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.794723 (+571947us) service_pool.cc:224] Handling call
0709 13:03:18.795112 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:18.811302 (+ 16190us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:18.826621 (+ 15319us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.196470 (+1369849us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.204034 (+  7564us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.204188 (+   154us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:20.738382 (+534194us) log.cc:844] Serialized 14 byte log entry
0709 13:03:21.162015 (+423633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.165255 (+  3240us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.165337 (+    82us) raft_consensus.cc:1685] finished
0709 13:03:21.165376 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.165590 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39804,"prepare.queue_time_us":773964,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":79,"raft.queue_time_us":227991,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":35024,"spinlock_wait_cycles":1133312,"thread_start_us":2213845,"threads_started":3,"wal-append.queue_time_us":1512778}
I20260709 13:03:21.205224 15391 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:21.213737 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:21.185724 17607 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:21.241901 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:21.242570 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:21.184660 17861 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:03:21.229933 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:21.231580 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1137) took 3008 ms. Trace:
I20260709 13:03:21.231783 17890 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:21.232445 17812 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:21.226488 17736 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:21.211297 17587 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:21.185527 17822 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:03:21.237432 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:21.238054 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:21.223475 17863 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:21.220961 17810 raft_consensus.cc:2764] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:21.246986 17901 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.248575 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:21.250412 15316 rpcz_store.cc:276] 0709 13:03:18.223019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.803274 (+580255us) service_pool.cc:224] Handling call
0709 13:03:18.829871 (+ 26597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.558292 (+1728421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.231283 (+672991us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400374e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:21.231515 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3682804608}
I20260709 13:03:21.252166 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:21.252830 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 218) took 3949 ms. Trace:
I20260709 13:03:21.252954 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:21.266681 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53948.4us
I20260709 13:03:21.248560 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:21.234746 17798 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:21.257964 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:21.294907 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1850) took 1012 ms. Trace:
I20260709 13:03:21.240264 17776 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:21.261149 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:21.245929 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:21.262250 16030 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:03:21.328064 15289 connection.cc:256] RPC call timeout handler was delayed by -1.0009519509999336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260709 13:03:21.266855 16033 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:21.284242 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:21.284579 15241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 261) took 3429 ms (client timeout 2214 ms). Trace:
I20260709 13:03:21.329710 15396 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:21.285248 16032 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:21.285830 15249 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:03:21.329229 15241 rpcz_store.cc:269] 0709 13:03:17.855263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.890030 (+ 34767us) service_pool.cc:224] Handling call
0709 13:03:21.284352 (+3394322us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b540011a8d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:21.284510 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5282628992}
I20260709 13:03:21.267063 15394 rpcz_store.cc:276] 0709 13:03:17.303244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.550738 (+3247494us) service_pool.cc:224] Handling call
0709 13:03:20.551027 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.587991 (+ 36964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.588038 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:20.588101 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:20.588165 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.252590 (+664425us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b54002bb6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:21.252635 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.252774 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84394240}
W20260709 13:03:21.310848 17905 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:03:21.314623 15350 heartbeater.cc:646] Failed to heartbeat to 127.13.206.254:45539 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.206.254:45539 timed out after 15.000s (SENT)
I20260709 13:03:21.315970 17607 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:21.262828 17736 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:21.307067 17862 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:21.345239 15148 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.346206 17736 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:21.347096 15148 catalog_manager.cc:5697] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 2 to 3, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:21.262451 17763 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:20.697680 16031 rpcz_store.cc:276] 0709 13:03:17.862636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.862844 (+   208us) service_pool.cc:224] Handling call
0709 13:03:17.929788 (+ 66944us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.930168 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:17.930195 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:17.956588 (+ 26393us) log.cc:844] Serialized 26 byte log entry
0709 13:03:18.194582 (+237994us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:20.169475 (+1974893us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.673293 (+503818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.673406 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:20.673468 (+    62us) raft_consensus.cc:1685] finished
0709 13:03:20.673486 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:20.673692 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60628,"prepare.queue_time_us":836965,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":52,"raft.queue_time_us":61852,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":27302,"thread_start_us":2491390,"threads_started":3,"wal-append.queue_time_us":350464,"wal-append.run_cpu_time_us":3376,"wal-append.run_wall_time_us":1420659}
I20260709 13:03:21.349141 17798 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:21.351581 15148 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.353721 15148 catalog_manager.cc:5697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 2, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 2 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.368146 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:21.374557 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:21.243695 17749 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:21.262024 17896 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:21.240514 17898 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:21.263980 17863 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:21.295378 15246 rpcz_store.cc:276] 0709 13:03:20.282927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.414826 (+131899us) service_pool.cc:224] Handling call
0709 13:03:21.286214 (+871388us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540010b154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:21.294830 (+  8616us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303770496}
I20260709 13:03:21.350090 17798 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:21.385069 17759 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:21.299650 17836 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:03:21.386551 17765 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:21.386919 17612 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:21.387441 17807 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:21.376366 17607 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:21.387989 17798 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:21.388897 17749 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:21.389214 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 222) took 3801 ms. Trace:
I20260709 13:03:21.389601 15391 rpcz_store.cc:276] 0709 13:03:17.587861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.599276 (+3011415us) service_pool.cc:224] Handling call
0709 13:03:20.599575 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.241776 (+642201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.388972 (+147196us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54003cc154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:21.389153 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392035584}
I20260709 13:03:21.336467 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2084) took 3327 ms. Trace:
I20260709 13:03:21.390861 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:21.391170 15319 rpcz_store.cc:276] 0709 13:03:18.009387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:18.128475 (+119088us) service_pool.cc:224] Handling call
0709 13:03:18.128784 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.478585 (+2349801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.336204 (+857619us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54001c61d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:21.336406 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5212538112}
I20260709 13:03:21.386093 17515 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:21.374825 15215 connection.cc:256] RPC call timeout handler was delayed by -1.9473721319999413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 13:03:21.335621 17778 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:21.376561 15395 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 1.
W20260709 13:03:21.377128 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 92988.7us
I20260709 13:03:21.172196 15318 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:21.379796 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:21.398330 15316 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:21.398645 15321 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:21.241278 17783 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:21.380959 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:21.384593 17776 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:21.333946 15394 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:21.392473 15391 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:03:21.392458 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:21.386996 17863 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:21.376230 17896 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:21.399276 17778 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:21.388914 17798 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:21.400362 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:21.400725 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:21.296320 17901 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:21.401298 17759 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:21.380723 17839 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:21.322707 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:03:21.395093 15215 connection.cc:256] RPC call timeout handler was delayed by -1.8132721319999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
I20260709 13:03:22.161383 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1849) took 1898 ms. Trace:
I20260709 13:03:22.245891 15391 pending_rounds.cc:85] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 3
I20260709 13:03:22.246553 15391 pending_rounds.cc:107] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:03:22.204795 17909 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:22.247411 15391 raft_consensus.cc:2889] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:22.248886 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1845) took 4316 ms. Trace:
W20260709 13:03:22.193465 15213 connection.cc:256] RPC call timeout handler was delayed by -1.9743954970000459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1584s for a response
I20260709 13:03:22.228644 17910 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.249326 15391 rpcz_store.cc:276] 0709 13:03:17.932763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.391846 (+3459083us) service_pool.cc:224] Handling call
0709 13:03:21.392141 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.248329 (+856188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.248741 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:21.404788 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1844) took 3472 ms. Trace:
I20260709 13:03:22.251065 15394 rpcz_store.cc:276] 0709 13:03:17.932516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.333326 (+3400810us) service_pool.cc:224] Handling call
0709 13:03:21.333710 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.404351 (+ 70641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.404715 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.251986 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.252578 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:22.252925 15391 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 1.
I20260709 13:03:22.254437 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.254818 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.255520 15391 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:22.246387 15244 rpcz_store.cc:276] 0709 13:03:20.262849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.483003 (+220154us) service_pool.cc:224] Handling call
0709 13:03:20.483378 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.483686 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.483712 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.485425 (+  1713us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.555809 (+ 70384us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:20.555863 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.555963 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:22.160569 (+1604606us) raft_consensus.cc:1685] finished
0709 13:03:22.160663 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.161083 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":337,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":11451,"thread_start_us":69907,"threads_started":1,"wal-append.queue_time_us":877590}
I20260709 13:03:22.256737 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.257846 15391 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
W20260709 13:03:21.622248 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.259883 15391 pending_rounds.cc:85] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 2
W20260709 13:03:22.249701 15213 connection.cc:256] RPC call timeout handler was delayed by -1.9617954970000255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 13:03:22.269824 15213 connection.cc:256] RPC call timeout handler was delayed by -1.9473954970001159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 13:03:21.419984 15291 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:21.435568 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.266705 17910 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:22.267525 15318 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:22.248097 17909 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:22.266324 15215 connection.cc:256] RPC call timeout handler was delayed by -1.6313426660000232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
W20260709 13:03:22.284590 15213 connection.cc:256] RPC call timeout handler was delayed by -1.9266954970000825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:03:22.285862 15213 connection.cc:256] RPC call timeout handler was delayed by -1.745795497000131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
I20260709 13:03:22.286538 15391 pending_rounds.cc:107] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:03:22.287112 15391 raft_consensus.cc:2889] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:22.289975 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 64392.9us
W20260709 13:03:22.291822 15213 connection.cc:256] RPC call timeout handler was delayed by -1.7115954970000757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
W20260709 13:03:22.292527 15215 connection.cc:256] RPC call timeout handler was delayed by -1.5567721319999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.231s for a response
W20260709 13:03:22.296732 15213 connection.cc:256] RPC call timeout handler was delayed by -1.5873954970001023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
W20260709 13:03:22.297405 15213 connection.cc:256] RPC call timeout handler was delayed by -1.5810954970000921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:03:22.297796 15213 connection.cc:256] RPC call timeout handler was delayed by -1.5711954970000761s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 13:03:22.298197 15213 connection.cc:256] RPC call timeout handler was delayed by -1.4973954970000705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 13:03:22.298576 15213 connection.cc:256] RPC call timeout handler was delayed by -1.3209954970001263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.231s for a response
W20260709 13:03:21.400349 17900 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.106s	user 0.003s	sys 0.004s
W20260709 13:03:21.924043 17737 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.000s
W20260709 13:03:21.521166 17902 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:03:21.442672 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:22.319124 17759 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:22.319661 15316 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:22.323376 17871 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:21.461499 17904 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.863s
I20260709 13:03:22.325027 15395 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:03:21.403913 15396 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:22.330561 17717 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.331502 17717 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:22.331924 17901 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:22.326205 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1850) took 4385 ms. Trace:
I20260709 13:03:21.408627 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:21.409714 15398 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:22.335496 15395 rpcz_store.cc:276] 0709 13:03:17.940899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.268993 (+4328094us) service_pool.cc:224] Handling call
0709 13:03:22.296364 (+ 27371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:22.325719 (+ 29355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.326076 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.347977 17801 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.351284 17801 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.353072 17910 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:22.353899 17911 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:22.356094 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.356305 17911 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.357118 15244 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:22.360026 17911 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.360934 17911 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:22.368976 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.369724 17909 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.371320 17759 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:22.372787 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:22.373538 17759 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:22.374781 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:21.615466 17889 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.376348 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.377329 15316 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:22.373720 15318 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:22.342805 17717 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:22.335798 17916 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.338920 17898 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:22.337205 16028 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:22.381317 17904 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:22.387009 17904 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.386899 17896 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:22.388129 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2144) took 4657 ms. Trace:
I20260709 13:03:22.388562 17896 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:22.389438 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:22.382059 15290 leader_election.cc:336] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.640s (SENT)
I20260709 13:03:22.382558 15320 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:22.381460 17778 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:22.383298 17725 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:22.384959 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:22.377882 17889 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:22.380336 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 937596us
I20260709 13:03:22.387631 17904 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:22.377919 15148 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 2, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:22.392179 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:22.383004 17737 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.404738 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.409575 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:22.415006 17877 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.606s	user 0.016s	sys 0.016s
I20260709 13:03:22.418411 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:22.420053 15392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2159) took 2154 ms (client timeout 2092 ms). Trace:
W20260709 13:03:22.420591 15392 rpcz_store.cc:269] 0709 13:03:20.265368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.271248 (+  5880us) service_pool.cc:224] Handling call
0709 13:03:22.419528 (+2148280us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540009bad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:22.419812 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643665280}
I20260709 13:03:22.421972 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1842) took 2209 ms. Trace:
I20260709 13:03:22.422474 15250 rpcz_store.cc:276] 0709 13:03:20.211974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.212116 (+   142us) service_pool.cc:224] Handling call
0709 13:03:20.212437 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:20.212814 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.212839 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:20.213426 (+   587us) log.cc:844] Serialized 52 byte log entry
0709 13:03:20.607037 (+393611us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:20.702682 (+ 95645us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.703140 (+   458us) log.cc:844] Serialized 14 byte log entry
0709 13:03:20.703362 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.703464 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:22.413691 (+1710227us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:22.421476 (+  7785us) raft_consensus.cc:1685] finished
0709 13:03:22.421511 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.421766 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3713,"prepare.queue_time_us":568753,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":2136,"raft.queue_time_us":44432,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":11327,"spinlock_wait_cycles":35014016,"thread_start_us":455312,"threads_started":2,"wal-append.queue_time_us":491718}
I20260709 13:03:22.426350 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 499) took 1148 ms. Trace:
I20260709 13:03:22.426573 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:22.426898 16028 rpcz_store.cc:276] 0709 13:03:21.257049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.335058 (+ 78009us) service_pool.cc:224] Handling call
0709 13:03:22.402901 (+1067843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.361920 17911 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.431535 15394 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:22.433442 15316 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:22.434600 17725 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:22.435863 17717 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:22.436269 17717 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:22.436805 17737 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.437522 17717 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:22.434643 15324 raft_consensus.cc:2376] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4. Re-sending same reply.
I20260709 13:03:22.438809 17717 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:22.439733 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:22.440579 15324 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:22.443097 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.444202 15316 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:22.445477 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:22.446568 15399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 1848) took 4506 ms (client timeout 2120 ms). Trace:
I20260709 13:03:22.448300 17909 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:22.450811 15399 rpcz_store.cc:269] 0709 13:03:17.940431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:19.183997 (+1243566us) service_pool.cc:224] Handling call
0709 13:03:22.446107 (+3262110us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002b5554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:22.446392 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473485696}
I20260709 13:03:22.451491 17909 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.451952 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:22.451493 15392 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:22.454041 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2152) took 4502 ms. Trace:
I20260709 13:03:22.454813 15392 rpcz_store.cc:276] 0709 13:03:17.951348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.448144 (+4496796us) service_pool.cc:224] Handling call
0709 13:03:22.451036 (+  2892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.453758 (+  2722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.453954 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.456528 15395 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:22.388619 15390 rpcz_store.cc:276] 0709 13:03:17.730800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.637296 (+2906496us) service_pool.cc:224] Handling call
0709 13:03:20.639979 (+  2683us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.657068 (+ 17089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.657119 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.708648 (+ 51529us) log.cc:844] Serialized 26 byte log entry
0709 13:03:21.013931 (+305283us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:21.013981 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.014166 (+   185us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:22.387571 (+1373405us) raft_consensus.cc:1685] finished
0709 13:03:22.387613 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.387917 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10710,"raft.queue_time_us":1535,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":57613,"thread_start_us":204372,"threads_started":1,"wal-append.queue_time_us":489888}
I20260709 13:03:22.458618 17915 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:22.460803 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1855) took 4515 ms. Trace:
I20260709 13:03:22.461228 15395 rpcz_store.cc:276] 0709 13:03:17.942095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.385235 (+4443140us) service_pool.cc:224] Handling call
0709 13:03:22.400307 (+ 15072us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.456963 (+ 56656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.457154 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.428145 17762 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:22.465334 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.462368 17909 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.466183 17725 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:22.474244 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 155460us
I20260709 13:03:22.459851 17737 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:22.467870 17915 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.473877 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1847) took 2254 ms. Trace:
I20260709 13:03:22.480424 15242 rpcz_store.cc:276] 0709 13:03:20.218537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.218669 (+   132us) service_pool.cc:224] Handling call
0709 13:03:20.219067 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:20.429622 (+210555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.472497 (+2042875us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54001a7cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:22.472945 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474668928}
I20260709 13:03:22.486795 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.489744 15246 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 2.
I20260709 13:03:22.489799 17656 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:22.491951 15395 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:22.466674 17916 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:22.492786 15214 connection.cc:256] RPC call timeout handler was delayed by -1.6476523909999514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
I20260709 13:03:22.494634 15250 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:22.495796 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2154) took 4357 ms. Trace:
I20260709 13:03:22.496213 15395 rpcz_store.cc:276] 0709 13:03:18.136487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.462000 (+4325513us) service_pool.cc:224] Handling call
0709 13:03:22.480730 (+ 18730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.493517 (+ 12787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.493776 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.498441 17845 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:22.480836 17725 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:22.500727 15214 connection.cc:256] RPC call timeout handler was delayed by -1.5918523909999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 13:03:22.503203 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1103) took 4664 ms. Trace:
I20260709 13:03:22.503731 15249 rpcz_store.cc:276] 0709 13:03:17.838957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.852537 (+ 13580us) service_pool.cc:224] Handling call
0709 13:03:21.285614 (+3433077us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:21.331628 (+ 46014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.502639 (+1171011us) spinlock_profiling.cc:243] Waited 3.37 s on lock 0x7b540011a8d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:22.502939 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7742224640}
I20260709 13:03:22.511668 17915 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.516757 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:22.500976 17737 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.528198 17737 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.535768 17899 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:22.536011 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:22.536374 17899 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:22.538061 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:22.539173 16025 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:22.542337 15214 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:22.543680 17519 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:22.544266 17519 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.544696 17519 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:22.551337 17725 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.552837 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1148) took 1575 ms. Trace:
I20260709 13:03:22.553267 15320 rpcz_store.cc:276] 0709 13:03:20.977098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.977210 (+   112us) service_pool.cc:224] Handling call
0709 13:03:22.552581 (+1575371us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400085054. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:22.552752 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3146392960}
W20260709 13:03:22.554458 17917 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:03:22.556115 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1852) took 4614 ms. Trace:
I20260709 13:03:22.557072 17798 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:22.561264 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:22.565348 15316 raft_consensus.cc:2410] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:22.548111 15318 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:22.556556 15396 rpcz_store.cc:276] 0709 13:03:17.941402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.330157 (+4388755us) service_pool.cc:224] Handling call
0709 13:03:22.330838 (+   681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.331627 (+   789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.331660 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:22.332317 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.379044 (+ 46727us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:22.379432 (+   388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.386266 (+  6834us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:22.555745 (+169479us) raft_consensus.cc:1685] finished
0709 13:03:22.555764 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.555920 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1538,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":104,"thread_start_us":46240,"threads_started":1,"wal-append.queue_time_us":117433}
W20260709 13:03:22.571126 15398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 223) took 4953 ms (client timeout 1643 ms). Trace:
W20260709 13:03:22.571657 15398 rpcz_store.cc:269] 0709 13:03:17.617799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.633988 (+ 16189us) service_pool.cc:224] Handling call
0709 13:03:22.566041 (+4932053us) spinlock_profiling.cc:243] Waited 3.77 s on lock 0x7b5400154fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:22.570912 (+  4871us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8678976768}
I20260709 13:03:22.572523 16025 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:22.572722 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.573261 15398 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:22.573465 15320 raft_consensus.cc:2376] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8. Re-sending same reply.
I20260709 13:03:22.537736 17899 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.572016 15396 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:22.575239 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2156) took 2310 ms. Trace:
I20260709 13:03:22.573984 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2157) took 2309 ms. Trace:
I20260709 13:03:22.575666 15396 rpcz_store.cc:276] 0709 13:03:20.264427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.571371 (+2306944us) service_pool.cc:224] Handling call
0709 13:03:22.571831 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.574943 (+  3112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.575162 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.576260 15398 rpcz_store.cc:276] 0709 13:03:20.264746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.572555 (+2307809us) service_pool.cc:224] Handling call
0709 13:03:22.572935 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.573702 (+   767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.573906 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.574477 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.575500 17899 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:22.578725 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2096) took 1190 ms. Trace:
I20260709 13:03:22.580173 15318 rpcz_store.cc:276] 0709 13:03:21.377231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.345800 (+968569us) service_pool.cc:224] Handling call
0709 13:03:22.567276 (+221476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.582931 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.584894 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.587663 15320 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:22.588356 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2163) took 2283 ms. Trace:
I20260709 13:03:22.588686 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.588877 15398 rpcz_store.cc:276] 0709 13:03:20.305189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.577058 (+2271869us) service_pool.cc:224] Handling call
0709 13:03:22.587536 (+ 10478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.587936 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.587960 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.588019 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:22.588086 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.588154 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.588269 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.589529 15320 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:22.590994 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.591678 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.591818 15323 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:22.593392 15317 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:22.593797 15317 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:22.590760 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.595059 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:22.602563 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 124461us
I20260709 13:03:22.606653 15320 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:03:22.610988 17920 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:03:22.613173 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2164) took 2234 ms. Trace:
I20260709 13:03:22.613718 15398 rpcz_store.cc:276] 0709 13:03:20.378766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.589973 (+2211207us) service_pool.cc:224] Handling call
0709 13:03:22.597732 (+  7759us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.612714 (+ 14982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.612746 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.612819 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:22.612860 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.612933 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.613098 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.615988 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 227) took 2231 ms. Trace:
I20260709 13:03:22.616406 15398 rpcz_store.cc:276] 0709 13:03:20.405978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.614843 (+2208865us) service_pool.cc:224] Handling call
0709 13:03:22.615320 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.615603 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.615631 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.615706 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:22.615750 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.615808 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.615930 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15104}
I20260709 13:03:22.617270 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:22.600250 17911 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.618188 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 370) took 1310 ms. Trace:
I20260709 13:03:22.624521 16030 rpcz_store.cc:276] 0709 13:03:21.307642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.616824 (+1309182us) service_pool.cc:224] Handling call
0709 13:03:22.618118 (+  1294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.624958 17871 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:22.626029 15319 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:22.631045 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2099) took 1251 ms. Trace:
I20260709 13:03:22.630970 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2153) took 4667 ms. Trace:
W20260709 13:03:22.628078 15397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2147) took 4858 ms (client timeout 3507 ms). Trace:
I20260709 13:03:22.632509 15396 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:22.631496 15319 rpcz_store.cc:276] 0709 13:03:21.377983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.599388 (+1221405us) service_pool.cc:224] Handling call
0709 13:03:22.625556 (+ 26168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.626630 (+  1074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.628910 (+  2280us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:22.637840 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 58239.9us
I20260709 13:03:22.638196 15317 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:22.639658 15317 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:22.641494 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.642066 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.642640 15244 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:22.643074 15248 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:22.644454 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:22.645274 15250 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:22.634725 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2158) took 2369 ms. Trace:
I20260709 13:03:22.648878 15396 rpcz_store.cc:276] 0709 13:03:20.265050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.582494 (+2317444us) service_pool.cc:224] Handling call
0709 13:03:22.608103 (+ 25609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.634462 (+ 26359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.634668 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.646828 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.654718 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:22.632306 15397 rpcz_store.cc:269] 0709 13:03:17.768108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.220507 (+2452399us) service_pool.cc:224] Handling call
0709 13:03:22.626427 (+2405920us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b54001545d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:22.626619 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46696704}
I20260709 13:03:22.650363 15249 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
W20260709 13:03:22.658697 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.631680 15399 rpcz_store.cc:276] 0709 13:03:17.963403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.451829 (+4488426us) service_pool.cc:224] Handling call
0709 13:03:22.452257 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.452672 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:22.583009 (+130337us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.630585 (+ 47576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.630653 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:22.630720 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.630793 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.630914 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":130287,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"thread_start_us":173403,"threads_started":2}
I20260709 13:03:22.636268 17910 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:22.668578 15241 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:22.669070 17783 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.669718 17783 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.636722 17911 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:22.675310 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2155) took 2411 ms. Trace:
I20260709 13:03:22.678282 17915 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.678934 17915 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:22.681703 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1857) took 4455 ms. Trace:
I20260709 13:03:22.682195 15392 rpcz_store.cc:276] 0709 13:03:18.225941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.465848 (+4239907us) service_pool.cc:224] Handling call
0709 13:03:22.493967 (+ 28119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.510628 (+ 16661us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:22.600621 (+ 89993us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.681366 (+ 80745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.681418 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:22.681464 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.681526 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.681634 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18004,"prepare.queue_time_us":51970,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":22313,"thread_start_us":77505,"threads_started":2}
I20260709 13:03:22.684155 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:22.685151 15392 raft_consensus.cc:2368] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:22.686280 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.686987 15392 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:22.687909 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.688742 15392 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:22.689565 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.690321 15392 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:22.691318 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.691962 15392 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:22.692871 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.694141 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:22.694717 15392 raft_consensus.cc:2376] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5. Re-sending same reply.
I20260709 13:03:22.695982 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.697194 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.698583 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:22.699802 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.700913 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.702021 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.702728 15392 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:22.703609 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.704340 15392 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:22.705054 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.705526 15399 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:22.706259 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2165) took 1334 ms. Trace:
I20260709 13:03:22.706629 15399 rpcz_store.cc:276] 0709 13:03:21.371575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.664738 (+1293163us) service_pool.cc:224] Handling call
0709 13:03:22.705065 (+ 40327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.705968 (+   903us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.706174 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.707721 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.708683 15399 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:22.710536 16030 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:22.711265 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.711851 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.712002 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.712244 15249 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:22.709487 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.713801 15399 raft_consensus.cc:2410] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:22.675899 15395 rpcz_store.cc:276] 0709 13:03:20.264055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.507315 (+2243260us) service_pool.cc:224] Handling call
0709 13:03:22.564499 (+ 57184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.671412 (+106913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.671443 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.674876 (+  3433us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:22.674944 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.675035 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.675232 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13631,"raft.queue_time_us":39536}
I20260709 13:03:22.718772 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.719758 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.720175 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.720880 15245 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:22.636899 17904 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:22.722541 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:22.722640 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.723371 15248 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:22.723608 15249 raft_consensus.cc:2393] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:22.724256 17904 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:22.726949 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.728135 15247 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:22.720882 15244 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:22.721899 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:22.731053 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.706852 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.739951 17695 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:22.748538 17922 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:03:22.748909 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 1.32882e+06us
W20260709 13:03:22.749590 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 1.66454e+06us
I20260709 13:03:22.750039 17923 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.750280 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:22.750711 17923 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:22.751248 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 226652us
I20260709 13:03:22.751516 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:22.752249 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:22.752424 17910 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:22.753057 17910 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.753428 17923 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.753450 17910 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:22.761271 17801 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.766754 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2093) took 1426 ms. Trace:
I20260709 13:03:22.767242 15321 rpcz_store.cc:276] 0709 13:03:21.340457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.379505 (+ 39048us) service_pool.cc:224] Handling call
0709 13:03:21.398454 (+ 18949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:21.399638 (+  1184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.766352 (+1366714us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54003e30d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:22.766567 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40789760}
I20260709 13:03:22.769405 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:22.770370 16033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 500) took 1395 ms (client timeout 1659 ms). Trace:
W20260709 13:03:22.770754 16033 rpcz_store.cc:269] 0709 13:03:21.374514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.768944 (+1394430us) service_pool.cc:224] Handling call
0709 13:03:22.770304 (+  1360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.775758 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:22.779574 15396 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:03:22.780012 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.780210 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.781982 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.781358 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.782688 15244 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 2.
I20260709 13:03:22.787358 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 233) took 1777 ms. Trace:
I20260709 13:03:22.787787 15396 rpcz_store.cc:276] 0709 13:03:21.009648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.667791 (+1658143us) service_pool.cc:224] Handling call
0709 13:03:22.735965 (+ 68174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.787051 (+ 51086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.787293 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.788442 15324 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:22.789865 15250 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:22.730082 17916 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:22.792431 15241 raft_consensus.cc:2410] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:22.792845 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:22.793524 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.793639 16029 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:22.794888 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:22.795662 16030 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
W20260709 13:03:22.796362 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 456508us
I20260709 13:03:22.797974 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:22.798262 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.799316 15323 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:22.799597 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:22.800913 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.801155 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:22.801349 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2094) took 1460 ms. Trace:
I20260709 13:03:22.802546 17801 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:22.802986 17801 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.803386 17801 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:22.804940 17783 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.805354 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1854) took 2270 ms. Trace:
I20260709 13:03:22.805548 17783 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:22.745967 17510 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:22.808045 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.806960 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.802103 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:22.806844 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.812898 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.829247 15242 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:22.830034 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.831008 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.831485 17771 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:22.832261 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.833045 15241 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:22.831048 15322 raft_consensus.cc:2410] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:22.812381 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:22.809837 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1847) took 4869 ms. Trace:
I20260709 13:03:22.836107 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.801797 15325 rpcz_store.cc:276] 0709 13:03:21.340777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.348354 (+  7577us) service_pool.cc:224] Handling call
0709 13:03:21.348703 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.319555 (+970852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.319609 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.319672 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:22.319709 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.800965 (+481256us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b5400403dd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:22.801011 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.801196 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227719936}
I20260709 13:03:22.792443 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:22.811510 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.807471 17765 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.842320 17845 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:22.843288 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:22.842833 15245 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:22.845938 17870 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:22.814138 17911 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:03:22.842809 17845 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:22.846781 17695 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:22.847119 17845 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:22.848227 15399 raft_consensus.cc:2410] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:03:22.848848 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 56517.6us
I20260709 13:03:22.849638 15399 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:22.835492 15391 rpcz_store.cc:276] 0709 13:03:17.940177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.258808 (+4318631us) service_pool.cc:224] Handling call
0709 13:03:22.259466 (+   658us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:22.546789 (+287323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.546831 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:22.548383 (+  1552us) log.cc:844] Serialized 52 byte log entry
0709 13:03:22.586510 (+ 38127us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:22.587646 (+  1136us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.588002 (+   356us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.588151 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.588216 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:22.809593 (+221377us) raft_consensus.cc:1685] finished
0709 13:03:22.809612 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.809775 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19643,"prepare.queue_time_us":93006,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":1421,"raft.queue_time_us":45460,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":412,"thread_start_us":283325,"threads_started":2,"wal-append.queue_time_us":82682}
I20260709 13:03:22.850657 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:22.851213 15399 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:03:22.851903 15391 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:22.846154 15249 raft_consensus.cc:2410] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:22.834010 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:22.853705 15250 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:22.825572 15317 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:22.855225 15248 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:03:22.856065 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.840946 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:22.869809 15396 raft_consensus.cc:2410] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:22.854804 15392 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:22.874037 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2095) took 1479 ms. Trace:
I20260709 13:03:22.874274 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.874593 15317 rpcz_store.cc:276] 0709 13:03:21.376777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.592682 (+1215905us) service_pool.cc:224] Handling call
0709 13:03:22.593162 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.855319 (+262157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.855954 (+   635us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:22.807799 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:22.877758 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 75729.1us
I20260709 13:03:22.811890 17916 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:22.883288 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2169) took 1486 ms. Trace:
I20260709 13:03:22.884101 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:22.884264 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.786603 17753 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:03:22.886580 15394 rpcz_store.cc:276] 0709 13:03:21.397366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.254265 (+856899us) service_pool.cc:224] Handling call
0709 13:03:22.871290 (+617025us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400195ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:22.883200 (+ 11910us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":398088064}
I20260709 13:03:22.806171 17783 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:22.887297 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:22.888239 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 65788us
I20260709 13:03:22.805773 15243 rpcz_store.cc:276] 0709 13:03:20.535313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.981041 (+445728us) service_pool.cc:224] Handling call
0709 13:03:20.996370 (+ 15329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:20.996611 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:21.010066 (+ 13455us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.804410 (+1794344us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b1800276340. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a
0709 13:03:22.804745 (+   335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.804818 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:22.804920 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.805003 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.805192 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14131,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":32,"raft.queue_time_us":1705,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":116972928,"thread_start_us":34654,"threads_started":1,"wal-append.queue_time_us":203130,"wal-append.run_cpu_time_us":2323,"wal-append.run_wall_time_us":1137484}
I20260709 13:03:22.890529 15322 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:22.891602 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.887015 16030 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:22.874907 17695 raft_consensus.cc:2764] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:03:22.907930 15242 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:22.875434 17656 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:22.908130 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:22.911226 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.921640 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.806464 17863 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:22.923321 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 55771.1us
I20260709 13:03:22.922842 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:22.924638 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 229) took 2157 ms. Trace:
I20260709 13:03:22.925572 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.886528 17916 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:22.929481 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.925089 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.912477 17510 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:22.935992 15319 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:22.927374 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.938192 15324 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:22.938560 15390 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:22.885076 17931 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:22.925068 15398 rpcz_store.cc:276] 0709 13:03:20.762282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.617505 (+1855223us) service_pool.cc:224] Handling call
0709 13:03:22.617902 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.627726 (+  9824us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:22.646813 (+ 19087us) log.cc:844] Serialized 14 byte log entry
0709 13:03:22.919568 (+272755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:22.919623 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:22.919678 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.919742 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.919869 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3509,"prepare.queue_time_us":28261,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":237954,"threads_started":1}
I20260709 13:03:22.941392 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.942206 17736 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:22.942750 17736 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:22.943152 17736 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:22.942991 17783 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:22.949698 15325 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:22.954454 15320 raft_consensus.cc:2376] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7. Re-sending same reply.
I20260709 13:03:22.955580 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:22.956367 15320 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 5: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:22.957188 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.959728 15317 raft_consensus.cc:2410] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:22.962411 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.958345 15323 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:22.931653 17916 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:22.963332 15322 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:22.967862 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.971081 15321 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
W20260709 13:03:22.972500 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 164828us
I20260709 13:03:22.979480 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 228) took 2571 ms. Trace:
I20260709 13:03:22.980115 15390 rpcz_store.cc:276] 0709 13:03:20.408603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.614900 (+2206297us) service_pool.cc:224] Handling call
0709 13:03:22.615283 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:22.948880 (+333597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.979174 (+ 30294us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54001955d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:22.979398 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743041664}
I20260709 13:03:22.941995 17931 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:03:22.985399 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 78241.8us
I20260709 13:03:22.991499 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:22.991534 15318 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:22.989892 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:22.975250 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:22.967679 15148 catalog_manager.cc:5697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 2, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 2 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.000089 17816 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:23.000828 17816 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:23.002892 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 56922us
I20260709 13:03:23.004810 15363 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.006798 17898 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:23.007493 17898 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:23.008742 17898 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:23.010389 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 81664.2us
I20260709 13:03:23.012259 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:23.012408 15144 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 235) took 20307 ms (client timeout 15000 ms). Trace:
W20260709 13:03:23.014566 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 82651.4us
I20260709 13:03:23.014736 17911 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:23.015237 17911 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:23.015460 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.015728 17911 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:23.016927 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:23.020488 17910 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:22.993003 17931 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.023389 15320 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:23.025633 15148 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 2 to 5, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 5 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.028267 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.028909 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.002362 17801 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.013855 15324 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:23.032475 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.036192 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.040844 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.040999 17918 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.150s
I20260709 13:03:23.042074 16028 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:23.043123 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:23.043792 17915 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:23.044042 15318 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
W20260709 13:03:23.044508 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 114543us
I20260709 13:03:23.044790 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:23.045403 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:23.046168 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.046445 17798 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:23.047151 16025 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:23.048107 17939 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:23.048214 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.048807 17939 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:23.049671 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.050397 16033 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
W20260709 13:03:23.051887 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.052361 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.052994 17911 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.054188 17923 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:23.054651 17923 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.055009 17923 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:23.058815 17910 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:23.062551 17899 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:23.053027 16026 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
W20260709 13:03:23.070490 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53627.8us
I20260709 13:03:23.037840 17695 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:23.079479 17695 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:23.080380 17771 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:23.080546 17695 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:22.962009 17519 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:23.083815 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:23.084662 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 48587.5us
I20260709 13:03:23.090764 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.101826 17753 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:23.001994 17816 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.102196 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.102398 17753 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:23.103704 17753 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:23.102602 15241 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:23.100023 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:23.109174 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.101878 17510 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:23.065371 17901 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:03:23.111244 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:23.094923 17915 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:23.111618 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.108543 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:23.095615 17783 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:23.128472 15390 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.049829 17939 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.106940 17717 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:23.013036 15144 rpcz_store.cc:269] 0709 13:03:02.707226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.714434 (+  7208us) service_pool.cc:224] Handling call
0709 13:03:23.012028 (+20297594us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:10.052993 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:10.200106 (+147113us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:10.200178 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:03:10.200233 (+    55us) tablet.cc:662] Decoding operations
0709 13:03:10.313955 (+113722us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:10.314029 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:10.314057 (+    28us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:03:10.451908 (+137851us) tablet.cc:701] Row locks acquired
0709 13:03:10.451948 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:03:10.454750 (+  2802us) write_op.cc:270] Start()
0709 13:03:10.454942 (+   192us) write_op.cc:276] Timestamp: P: 1783602190452068 usec, L: 0
0709 13:03:10.454963 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:10.628356 (+173393us) log.cc:844] Serialized 7172 byte log entry
0709 13:03:11.081229 (+452873us) op_driver.cc:464] REPLICATION: finished
0709 13:03:11.085132 (+  3903us) write_op.cc:301] APPLY: starting
0709 13:03:11.085262 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:11.085778 (+   516us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:11.085945 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:11.088374 (+  2429us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:11.088828 (+   454us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:03:11.088903 (+    75us) write_op.cc:312] APPLY: finished
0709 13:03:11.089502 (+   599us) log.cc:844] Serialized 125 byte log entry
0709 13:03:11.090966 (+  1464us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:11.091185 (+   219us) write_op.cc:454] Released schema lock
0709 13:03:11.091267 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:11.091702 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:11.091739 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29038,"reported_tablets":35,"spinlock_wait_cycles":939904,"child_traces":[["op",{"apply.queue_time_us":3527,"apply.run_cpu_time_us":5392,"apply.run_wall_time_us":6602,"num_ops":18,"prepare.queue_time_us":271676,"prepare.run_cpu_time_us":19092,"prepare.run_wall_time_us":1022820,"raft.queue_time_us":8265,"raft.run_cpu_time_us":1426,"raft.run_wall_time_us":9821,"replication_time_us":626069,"spinlock_wait_cycles":449408,"thread_start_us":490027,"threads_started":4,"wal-append.queue_time_us":360563,"wal-append.run_cpu_time_us":6056,"wal-append.run_wall_time_us":1032908}]]}
I20260709 13:03:23.136029 17801 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:23.140072 15996 connection.cc:256] RPC call timeout handler was delayed by -2.167042097000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 13:03:23.171756 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.172844 16026 raft_consensus.cc:2410] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:03:23.172760 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 75098.7us
I20260709 13:03:23.128645 17753 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:23.129771 17915 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:23.174278 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 128987us
W20260709 13:03:23.184187 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 57284us
I20260709 13:03:23.186472 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:23.187423 17931 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.133419 17717 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.217011 17717 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:23.189859 17845 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.219609 17863 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:23.133086 17771 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:03:23.191432 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:23.114341 17899 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:03:23.189947 17915 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:23.230244 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 48823.7us
I20260709 13:03:23.237020 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.235075 17941 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:23.236227 17937 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:03:23.287328 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.298945 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:23.299016 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 312558us
I20260709 13:03:23.291613 15324 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:23.298058 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.303314 16033 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
W20260709 13:03:23.306830 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 79548.9us
I20260709 13:03:23.233490 17870 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:23.309880 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.310539 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.321859 15243 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:23.321712 15247 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:23.322742 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.316717 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.318830 17910 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.356695 16026 raft_consensus.cc:2368] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
W20260709 13:03:23.357191 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 174823us
W20260709 13:03:23.357797 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.308302 17901 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:23.366133 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 68940.3us
I20260709 13:03:23.369522 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:23.289510 17916 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:23.318718 17941 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:23.372241 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 185926us
I20260709 13:03:23.380129 15390 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:23.373464 17870 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.386149 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.310741 17519 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:23.390602 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.362792 17901 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:23.400668 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:23.401721 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 80390.6us
I20260709 13:03:23.403605 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.355780 17736 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.367996 17778 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.412938 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:23.419246 17942 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:03:23.419342 17792 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:23.420246 17736 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:23.420164 17792 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.423135 17792 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:23.424599 17947 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:03:23.327366 17899 consensus_queue.cc:1243] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:23.313959 17918 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 13:03:23.425724 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:23.427440 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 135522us
I20260709 13:03:23.395254 17931 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:23.444205 16033 raft_consensus.cc:2368] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8.
I20260709 13:03:23.371289 17910 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.426985 17863 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:23.454712 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 55069.6us
W20260709 13:03:23.455148 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 154845us
I20260709 13:03:23.404633 17901 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:23.449378 17736 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:23.452070 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.465739 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:23.465443 17863 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:23.400315 17870 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:23.452721 17778 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.479121 15290 leader_election.cc:400] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:23.479575 15290 leader_election.cc:403] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:03:23.477524 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 83267.7us
I20260709 13:03:23.482858 15365 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:23.470520 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:23.473917 17736 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.487881 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:23.476194 17863 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:23.499257 17778 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:23.488941 17898 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:23.502427 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.503912 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.504922 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.492919 17955 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:23.492960 17944 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:23.496454 17656 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:03:23.506759 17944 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.507243 17944 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:23.507062 17915 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:23.508735 17910 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:23.515384 16033 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:23.479279 17909 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:23.521126 17915 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:23.479319 17845 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:23.519593 17695 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:23.532249 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:23.510588 17736 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:23.538568 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:23.549436 15249 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:23.520354 17519 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:23.522981 17816 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:23.520236 17909 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.530493 17695 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:23.555604 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 87367.3us
I20260709 13:03:23.556639 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:23.559866 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:23.564015 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:23.553205 17519 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:23.567389 17519 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:23.567665 17870 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:23.579695 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:23.580830 17943 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.352s	user 0.002s	sys 0.000s
I20260709 13:03:23.581727 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:23.511226 17941 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.582451 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 234) took 1348 ms. Trace:
I20260709 13:03:23.582839 15397 rpcz_store.cc:276] 0709 13:03:22.234041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.666549 (+432508us) service_pool.cc:224] Handling call
0709 13:03:22.669063 (+  2514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.669438 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.669463 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:22.670047 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.992564 (+322517us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:22.992596 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.992688 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.580039 (+587351us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:23.582112 (+  2073us) raft_consensus.cc:1685] finished
0709 13:03:23.582135 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.582386 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4428160,"thread_start_us":322075,"threads_started":1,"wal-append.queue_time_us":428328}
I20260709 13:03:23.555680 17695 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:23.579979 17923 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 13:03:23.558631 17909 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:23.591104 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:23.593037 17915 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:23.563012 17955 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:23.588860 17783 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:23.589514 17923 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:23.590344 17931 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:23.551172 17845 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:03:23.589849 17904 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:23.606263 17923 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:23.606559 17904 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:23.594281 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:23.560087 17916 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:23.600183 17931 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.607831 17931 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:23.609002 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.609733 15246 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:23.594548 17955 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.604564 17518 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:23.605278 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:23.599611 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:23.618615 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 43805.9us
I20260709 13:03:23.619184 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.581570 17863 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:23.628940 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 69123.5us
W20260709 13:03:23.630483 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 106788us
I20260709 13:03:23.607723 17904 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:23.636889 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.610908 17955 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:23.616355 17518 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:23.643891 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:23.644848 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45368.7us
I20260709 13:03:23.647710 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.628415 17915 raft_consensus.cc:2764] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:23.627584 17778 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:23.648424 15250 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:23.633509 17911 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:23.648660 17518 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:23.679116 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.682034 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.683076 15245 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:23.683314 17946 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.456s	user 0.006s	sys 0.004s
I20260709 13:03:23.684190 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.685227 15243 raft_consensus.cc:2410] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:03:23.686689 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 92567us
I20260709 13:03:23.687485 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:23.688280 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:23.647612 17966 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:23.690327 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:23.652370 17778 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.652381 17961 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:23.694989 17870 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:23.695506 17961 raft_consensus.cc:697] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:23.696080 17962 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:23.696578 17961 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:23.697456 17656 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:23.697561 17964 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:23.697924 17656 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:23.693208 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 53195.4us
I20260709 13:03:23.691515 17915 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:23.694801 15999 leader_election.cc:336] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.792s (SENT)
I20260709 13:03:23.757434 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:23.634791 17941 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
W20260709 13:03:23.752012 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 108322us
W20260709 13:03:23.737242 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:23.707747 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.723137 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:23.699904 17898 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:23.716143 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:23.698127 17964 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:23.699407 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:23.797166 15245 raft_consensus.cc:2368] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:23.797010 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.720358 17944 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:23.710597 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:23.709709 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.698629 17798 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:23.725124 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:23.711570 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:23.724253 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:23.711005 15320 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:03:23.750976 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.693193 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.727702 15289 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:23.691586 17966 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:23.692266 17904 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:23.836447 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 46007.6us
I20260709 13:03:23.689078 17816 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:23.694178 17778 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:23.795804 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.759215 17656 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:23.794672 16030 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:03:23.798947 17958 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:03:23.842154 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 154839us
I20260709 13:03:23.839134 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:23.845212 17898 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:23.846405 15324 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:03:23.847030 17971 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:23.757985 17923 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:23.875592 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 70587.4us
I20260709 13:03:23.854684 15241 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:23.808454 17911 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:23.802503 17798 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:23.880810 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 223267us
I20260709 13:03:23.846316 17868 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:23.888545 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:23.888831 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44300.3us
W20260709 13:03:23.886430 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 159445us
I20260709 13:03:23.889667 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.891657 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.874910 17898 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:23.861737 16029 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:23.848162 17966 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:23.855944 17899 raft_consensus.cc:2764] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:03:23.913271 15320 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:03:23.896394 15289 leader_election.cc:400] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:23.916463 15289 leader_election.cc:403] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:23.916782 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:23.918493 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 288382us
W20260709 13:03:23.906268 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 285348us
I20260709 13:03:23.886842 17911 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:23.929458 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.930218 15249 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:23.921218 15243 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
W20260709 13:03:23.909946 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 193863us
I20260709 13:03:23.912286 17898 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:23.932363 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 219) took 6490 ms. Trace:
I20260709 13:03:23.933552 15289 leader_election.cc:400] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8.
I20260709 13:03:23.942543 15289 leader_election.cc:403] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:23.950162 15999 leader_election.cc:336] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.214s (SENT)
I20260709 13:03:23.950706 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:23.952932 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:23.978545 17798 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.981560 15325 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:03:23.984833 15321 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:23.985257 16025 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:23.985954 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:23.934191 17863 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:23.987406 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:23.936725 17792 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:23.988379 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56270.5us
I20260709 13:03:23.906611 17923 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:24.180217 17901 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.000s
I20260709 13:03:23.934688 17979 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.903972 17964 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:23.961301 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:23.941392 15393 rpcz_store.cc:276] 0709 13:03:17.303515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.550407 (+3246892us) service_pool.cc:224] Handling call
0709 13:03:22.637475 (+2087068us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:22.677193 (+ 39718us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:22.677267 (+    74us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:22.786906 (+109639us) log.cc:844] Serialized 26 byte log entry
0709 13:03:22.922422 (+135516us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:22.922464 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:22.927206 (+  4742us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:23.429294 (+502088us) raft_consensus.cc:1685] finished
0709 13:03:23.429310 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:23.755766 (+326456us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54001545d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:23.793707 (+ 37941us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35937,"raft.queue_time_us":34210,"raft.run_cpu_time_us":3532,"raft.run_wall_time_us":57896,"spinlock_wait_cycles":4698971008,"thread_start_us":118902,"threads_started":1,"wal-append.queue_time_us":187618}
I20260709 13:03:24.184998 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:23.950187 17956 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.054297 15249 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:24.075747 17725 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:24.144767 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 211387us
I20260709 13:03:24.078917 15243 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:24.192368 16030 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
W20260709 13:03:24.103410 17717 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.813s	user 0.013s	sys 0.000s
W20260709 13:03:24.256596 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 306440us
W20260709 13:03:24.265839 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.266335 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.038486 17899 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8.
W20260709 13:03:24.176956 17519 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
W20260709 13:03:24.054819 17975 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 13:03:24.185966 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 149402us
W20260709 13:03:24.149600 17695 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.000s
I20260709 13:03:24.051000 17980 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.224s
I20260709 13:03:24.267961 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:24.272686 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 317118us
I20260709 13:03:24.270012 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:24.182749 17944 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:24.279067 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:24.276887 17695 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.286798 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:24.293691 17695 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:24.281855 17916 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:24.272742 17717 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:24.294660 17656 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:24.295804 15248 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:24.265432 17961 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:24.144150 17939 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.138s
W20260709 13:03:24.296787 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.297384 17910 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:24.316182 17798 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:24.317291 17909 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.000s
I20260709 13:03:24.290930 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:24.281347 17725 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.321412 17725 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:24.323645 17955 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.667s	user 0.004s	sys 0.006s
I20260709 13:03:24.324056 17695 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:24.324510 17656 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:24.300298 17863 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:24.325102 17736 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.758s	user 0.011s	sys 0.000s
I20260709 13:03:24.257050 17979 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.325285 17863 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.325637 17736 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.286940 17984 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:03:24.327354 17979 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:24.112454 17911 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.327968 17736 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:24.304883 17970 log.cc:927] Time spent T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Append to log took a long time: real 0.391s	user 0.002s	sys 0.000s
I20260709 13:03:24.305022 17778 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.328883 17911 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:24.207471 17901 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:24.327354 17863 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:24.296936 15242 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 7. Ops: []
I20260709 13:03:24.330578 17778 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:24.307332 15393 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:24.324157 17955 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.277467 17519 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:24.333472 17931 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.000s
I20260709 13:03:24.300709 17915 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:24.334028 17519 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:24.334864 17753 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:24.324783 17695 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:24.337369 17695 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:24.330159 17717 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:24.337998 17964 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.340958 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:24.343329 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.344695 17845 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:24.344888 16029 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
W20260709 13:03:24.294950 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 110028us
I20260709 13:03:24.333901 17955 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:24.371029 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:03:24.359683 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 454076us
I20260709 13:03:23.959458 17816 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.370303 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:24.394372 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47664.2us
I20260709 13:03:24.395579 15394 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:24.396219 15390 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:24.394369 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:24.399029 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:24.399832 15399 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:24.400182 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 438975us
I20260709 13:03:24.400521 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:24.400816 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:24.406418 15398 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:24.371434 17987 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:24.428172 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:24.429495 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 155980us
I20260709 13:03:24.387488 17915 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:24.430819 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:24.394176 17984 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:24.430413 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.432608 15249 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 3: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:24.436823 15246 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:24.333935 17931 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.411167 17695 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:24.443856 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:24.439708 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:24.440397 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.440749 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:24.446869 15391 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:24.390939 17519 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:03:24.452419 15291 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:24.443948 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:24.420598 17987 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:24.372802 17909 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.453954 15397 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:24.449425 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48972.4us
I20260709 13:03:24.462152 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:24.463315 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:24.464061 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:24.464833 15242 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:24.455309 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:24.456036 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:24.457187 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:24.436858 17984 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:24.439772 17904 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.593s	user 0.005s	sys 0.006s
I20260709 13:03:24.436416 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:24.444598 17792 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:24.427245 17753 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 13:03:24.466980 17518 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.000s
I20260709 13:03:24.482788 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:24.467262 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:24.468273 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:24.470144 17931 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:24.412247 17966 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:24.465951 15245 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:24.454355 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:24.473850 17983 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:03:24.484808 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:24.468299 17898 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.509s	user 0.005s	sys 0.004s
I20260709 13:03:24.509564 15244 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:24.462591 17987 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.512506 17960 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
W20260709 13:03:24.512862 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44696.9us
I20260709 13:03:24.513389 18001 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:24.516038 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:24.544839 15396 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:24.518054 15242 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:24.509781 17518 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:24.519337 17981 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:24.519862 17977 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:24.520890 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.521879 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:24.525105 15248 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:24.521862 15391 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
W20260709 13:03:24.525094 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 72752.5us
I20260709 13:03:24.452980 17717 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:24.508033 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:24.533496 15246 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:24.532509 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 84855.4us
W20260709 13:03:24.535486 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92559.9us
I20260709 13:03:24.536177 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.536154 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:24.541204 15397 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:24.542447 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:24.491268 17910 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:24.567564 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46779.5us
I20260709 13:03:24.568475 15241 raft_consensus.cc:2368] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7.
I20260709 13:03:24.481805 17783 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:24.563827 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.561707 15243 raft_consensus.cc:2376] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7. Re-sending same reply.
I20260709 13:03:24.570454 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:24.575620 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:24.578986 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:24.579962 15395 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:24.582085 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.574543 17783 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:24.584623 17783 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.585642 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:24.586329 15242 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.586774 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:24.586947 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:24.587212 15250 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:03:24.587236 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:24.589283 15245 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.554910 18001 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:24.560523 17931 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:24.558252 17977 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:24.591675 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:24.592109 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:24.570099 17863 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.557674 17845 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:03:24.594594 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:24.594820 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:24.574146 17717 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:24.541988 17519 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:03:24.592455 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:24.610107 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.568235 17695 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:24.632738 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 158851us
I20260709 13:03:24.542255 17898 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.595427 17980 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.609515 17939 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:24.650290 17776 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:24.651145 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:03:24.651662 17994 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:03:24.652621 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60647.2us
W20260709 13:03:24.667025 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 98463.9us
I20260709 13:03:24.642552 17845 consensus_queue.cc:1243] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:24.654105 17996 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:24.654932 17989 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:24.643718 17753 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:03:24.656538 15396 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:24.519330 17792 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.638581 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:24.680399 15391 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.542719 17915 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:24.662446 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 75749.3us
W20260709 13:03:24.649369 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 75409us
I20260709 13:03:24.683725 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.683871 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:24.593312 18001 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.596427 17931 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:24.670459 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.653229 17816 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:03:24.671584 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 107854us
I20260709 13:03:24.622957 17977 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:24.670008 17956 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:24.684641 15396 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:24.687456 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:24.671550 17725 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.690053 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.664934 17901 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:24.657480 17863 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.701068 15397 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:24.674670 17989 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:24.702840 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:24.703181 17997 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:03:24.712070 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:24.716289 15399 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
W20260709 13:03:24.716439 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47498.5us
I20260709 13:03:24.711290 15242 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:24.689132 17931 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:24.718968 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.719431 17695 raft_consensus.cc:2764] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:03:24.623319 17984 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.720090 18007 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:24.720834 17984 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:24.720876 17816 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.721621 17816 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.723933 17816 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:24.724552 17816 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:24.718839 17992 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:24.720108 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:24.726639 18008 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:03:24.728062 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 245) took 1013 ms. Trace:
I20260709 13:03:24.728530 15395 rpcz_store.cc:276] 0709 13:03:23.714626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.714803 (+   177us) service_pool.cc:224] Handling call
0709 13:03:23.715122 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.580644 (+865522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.727775 (+147131us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540026ff54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:24.727995 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988372736}
I20260709 13:03:24.704406 17898 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:24.715368 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:24.730688 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60349.4us
I20260709 13:03:24.672873 17980 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.726321 17909 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:24.691437 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:24.734540 15399 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:24.714735 17989 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:24.735431 17911 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:24.746272 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.748122 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:24.710867 17996 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:24.743602 15391 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:24.752281 15395 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:24.740849 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.708817 17725 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.756790 17725 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:24.757114 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 242) took 1201 ms. Trace:
I20260709 13:03:24.757511 15398 rpcz_store.cc:276] 0709 13:03:23.555814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.557248 (+  1434us) service_pool.cc:224] Handling call
0709 13:03:23.557552 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:24.407089 (+849537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.756868 (+349779us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b54001d9f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:24.757043 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1926723328}
I20260709 13:03:24.759059 15398 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:24.762315 18008 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:24.762822 18008 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:24.768800 18008 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:24.772034 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:24.772497 18003 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.783654 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1872) took 1105 ms. Trace:
I20260709 13:03:24.784092 15250 rpcz_store.cc:276] 0709 13:03:23.678322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.680365 (+  2043us) service_pool.cc:224] Handling call
0709 13:03:23.680756 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.587680 (+906924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.783383 (+195703us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b540010c054. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:24.783592 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083994368}
I20260709 13:03:24.788784 17923 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:24.739893 17776 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:24.779202 15395 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:24.797818 15320 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:24.815546 15391 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:03:24.816627 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:24.825305 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 135344us
I20260709 13:03:24.736287 17992 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:24.830466 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84377.2us
W20260709 13:03:24.833411 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 82011.7us
I20260709 13:03:24.736999 17966 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:24.826289 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:24.847442 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.779793 18008 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.856527 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:24.858991 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 111003us
I20260709 13:03:24.859889 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.860247 18009 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:24.861338 17956 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:24.865768 17656 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:24.866287 17656 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:24.867165 17656 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:24.868163 17656 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.782516 17980 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:24.872479 17960 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:24.833915 18007 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:24.875653 18007 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:24.876081 18007 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:24.712144 17717 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:24.878427 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:24.780030 17911 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:24.834010 17518 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:24.903409 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 43599.9us
I20260709 13:03:24.910856 15291 leader_election.cc:400] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7.
I20260709 13:03:24.879616 17910 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:24.890017 17845 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:24.916787 15291 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.926259 17955 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:24.926738 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.927603 17955 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:24.911545 18009 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:24.928983 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:24.899677 17863 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:24.901811 17956 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:24.948482 15245 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:24.958807 17910 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:24.931788 17845 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:24.963156 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:24.963230 17939 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 13:03:24.970558 18006 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:03:24.970726 18009 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.973080 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:24.973898 17910 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:24.974360 17910 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.974778 17910 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:24.979812 17989 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:24.988700 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.982976 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:24.962002 17956 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:03:24.969237 17996 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:24.994331 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:24.994374 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:25.013207 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.015134 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:25.017123 17995 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:25.014109 18020 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
I20260709 13:03:25.018039 17995 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:25.018213 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:25.018704 17995 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.019091 17995 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:25.019702 17916 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:25.019881 17845 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.009829 18016 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:24.999496 17792 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:25.035086 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1881) took 1219 ms. Trace:
I20260709 13:03:25.036725 15244 rpcz_store.cc:276] 0709 13:03:23.795393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.795543 (+   150us) service_pool.cc:224] Handling call
0709 13:03:25.014745 (+1219202us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b5400119ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:25.014876 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497016192}
I20260709 13:03:25.039405 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:24.993765 18010 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:25.045709 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:25.048801 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:25.004688 17996 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:25.037585 17964 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.699s	user 0.001s	sys 0.011s
I20260709 13:03:25.069327 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:24.968719 17911 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.072072 17783 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.073163 15247 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:25.074584 15392 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:25.075992 17783 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:25.080226 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44366.8us
I20260709 13:03:25.081076 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:25.082513 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:25.082690 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 273) took 1147 ms. Trace:
I20260709 13:03:25.088138 15320 rpcz_store.cc:276] 0709 13:03:23.935470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.935646 (+   176us) service_pool.cc:224] Handling call
0709 13:03:25.082519 (+1146873us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400078854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:25.082631 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234336128}
I20260709 13:03:25.040345 17792 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:25.114740 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:25.121024 18005 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.393s	user 0.002s	sys 0.001s
W20260709 13:03:25.125494 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44497.2us
I20260709 13:03:25.126371 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:25.126681 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:25.127517 17988 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:25.127965 17988 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:25.128464 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:25.128247 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:25.132223 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:25.132964 15318 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:25.137153 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:25.138537 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:25.061372 18003 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:25.064113 17992 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:25.146118 15391 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:25.146291 15324 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:25.173892 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:25.147389 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:25.175100 15397 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:25.148231 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:25.176224 15396 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
W20260709 13:03:25.149490 18021 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:03:25.150672 17753 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:25.151356 17960 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:25.152237 18014 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:25.155194 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:25.147411 15317 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:25.158286 15319 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:25.159327 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:25.161201 15323 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:25.077771 17996 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:25.164319 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:25.081678 17909 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:25.167119 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:25.198989 15320 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:25.167707 17964 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:25.083676 17956 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:25.183035 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78316.8us
I20260709 13:03:25.204803 15365 leader_election.cc:400] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7.
I20260709 13:03:25.205166 15365 leader_election.cc:403] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:25.185773 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 191532us
I20260709 13:03:25.083173 17955 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.114s
I20260709 13:03:25.090149 17999 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:25.103550 17916 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:25.108256 17792 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:25.202304 15396 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 5. Ops: []
I20260709 13:03:25.237754 15396 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:03:25.080436 18010 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.128331 17988 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:25.186869 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:25.204991 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:25.211700 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:25.238790 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.239743 15393 pending_rounds.cc:85] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 3
I20260709 13:03:25.245617 15393 pending_rounds.cc:107] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:03:25.246016 15393 raft_consensus.cc:2889] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.240974 15391 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:25.246050 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:25.162109 17776 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:25.192642 17519 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:25.235443 17999 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:25.245631 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:25.251087 17987 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.691s	user 0.010s	sys 0.000s
I20260709 13:03:25.251183 17999 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.233276 17656 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:03:25.249617 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:25.213009 18023 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:03:25.249028 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:25.255394 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 50736.1us
I20260709 13:03:25.257159 15245 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:25.207580 17992 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:25.233296 17736 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7.
I20260709 13:03:25.234800 17984 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:25.287259 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:25.279862 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:25.287544 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:25.191615 17910 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.266620 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:25.182725 17931 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.290278 15322 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:25.256662 17845 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:25.270839 15362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.555s (SENT) [suppressed 45 similar messages]
I20260709 13:03:25.263381 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:25.294170 15324 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:25.308866 15397 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
W20260709 13:03:25.322476 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.244518 17964 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:25.348855 17964 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:25.273002 17977 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.001s
I20260709 13:03:25.353333 17977 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.356966 15390 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:25.251609 17987 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.358217 15242 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:25.359524 17987 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:25.360764 17977 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:25.361994 18014 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.362690 18014 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.365594 18014 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.368616 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:25.298949 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:25.374588 15321 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:03:25.375036 15321 pending_rounds.cc:85] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 1
I20260709 13:03:25.375378 15321 pending_rounds.cc:107] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:03:25.375600 15321 raft_consensus.cc:2889] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.270046 17916 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:25.375064 15318 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:25.285190 17992 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:25.300896 17984 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.277612 18010 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.399700 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:03:25.382263 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 118967us
I20260709 13:03:25.343058 17979 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:25.401371 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:25.402307 15317 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:25.264197 17962 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.115s
W20260709 13:03:25.386494 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 87632.2us
I20260709 13:03:25.395869 16026 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:25.398662 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:25.399103 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53751.8us
I20260709 13:03:25.266407 17939 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:03:25.336315 18008 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.413827 15249 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:25.262138 18017 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
I20260709 13:03:25.434538 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:25.435637 15245 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:25.379782 17909 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:03:25.403103 15996 leader_election.cc:336] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.840s (SENT)
I20260709 13:03:25.381695 17992 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:25.401561 17941 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:25.335054 17695 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:03:25.268388 17967 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 13:03:25.432720 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:25.402788 17984 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:25.447091 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 240741us
W20260709 13:03:25.414390 18005 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:03:25.449445 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 48171.7us
I20260709 13:03:25.398051 17977 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:25.383347 17845 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:25.464836 17977 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:25.465391 17845 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.465770 17977 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.443787 17909 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:25.450755 17941 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:25.464021 18001 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.763s	user 0.007s	sys 0.004s
I20260709 13:03:25.408025 15324 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:25.398633 17989 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.456552 17979 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:25.462637 17656 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:03:25.502282 17656 consensus_queue.cc:1243] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:25.476465 17939 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:25.480571 17941 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:25.518556 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:25.412928 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 364224us
I20260709 13:03:25.457000 17783 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:25.457026 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:25.400092 17944 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:03:25.527871 17939 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:25.443637 17904 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:25.528873 17904 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:25.529464 17979 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:25.423791 17955 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:03:25.446866 17999 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:25.529955 17904 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.531139 17904 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:25.453464 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 50399.8us
I20260709 13:03:25.442973 18008 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.534917 15395 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:25.489420 18029 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:25.536026 18008 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.486865 18001 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.528093 17944 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:25.537091 17931 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.537432 17962 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:25.537904 17962 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:25.538431 15246 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:25.538753 17962 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.539531 17955 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:25.539914 17955 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:25.540858 17955 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:25.540848 18030 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:03:25.497208 17990 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:25.443264 18026 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 13:03:25.528801 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 71851.4us
I20260709 13:03:25.535845 18029 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.547043 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:25.550001 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:25.551296 15397 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
W20260709 13:03:25.545823 18007 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.669s	user 0.006s	sys 0.008s
I20260709 13:03:25.517117 17909 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.553251 17863 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:25.552848 18007 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.553727 17863 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.554100 17863 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:25.554347 16027 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:25.558652 18007 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:25.565811 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:25.566058 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:25.567478 18031 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:25.567683 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:25.567778 18010 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:25.568681 15248 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:25.554019 17909 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:25.570468 18014 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:25.571210 18014 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:25.572376 18014 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:25.573354 17995 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.554s	user 0.003s	sys 0.007s
I20260709 13:03:25.575639 15316 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:25.576119 15249 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:25.577346 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:25.577461 17988 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.581966 17910 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.582187 18029 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:25.582350 15242 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:25.525388 17916 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.583711 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:25.547205 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 141653us
I20260709 13:03:25.559314 15325 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:25.561178 17992 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.542078 17955 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:25.586038 15249 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:25.514178 17989 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.595211 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:25.600304 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:25.601891 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:25.605033 15392 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:25.547830 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66744.1us
W20260709 13:03:25.538450 17991 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.772s	user 0.004s	sys 0.000s
I20260709 13:03:25.606853 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:25.610128 15397 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:25.524899 17956 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:25.612941 15390 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:25.538200 18001 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.613099 15245 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:25.608947 18009 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:25.573822 17995 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.610543 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:25.607115 17717 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:25.623874 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:25.620787 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 186311us
I20260709 13:03:25.624349 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:25.625140 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:25.625936 15248 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:25.626272 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:25.626374 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:25.614490 17910 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:25.641717 15399 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:25.642066 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:25.642659 15392 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:25.619222 18029 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.647069 15396 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:25.624459 17717 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.654976 17998 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:25.662410 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:25.655651 18029 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.666548 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:25.656697 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:25.656865 18041 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.657382 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:25.657500 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:25.612661 17989 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.608937 17783 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:03:25.659880 17776 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:25.661580 18045 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:25.661458 17996 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.655181 17717 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:25.596705 17792 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.670585 15325 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:25.663259 15998 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:25.694016 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:25.644589 17910 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:25.699330 15316 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:25.699442 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:25.651969 17931 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.710500 15242 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:25.718304 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 447489us
I20260709 13:03:25.720583 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:25.721355 15245 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:25.722653 17987 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:25.654892 17988 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:25.656775 17992 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.624156 17956 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.725167 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:25.655018 18026 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:25.673563 18001 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:25.662784 17998 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:25.646778 17997 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:03:25.737388 15324 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:03:25.737092 15320 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:25.739610 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:25.736150 15362 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.917s (SENT)
I20260709 13:03:25.749843 17960 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:03:25.765339 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:25.796516 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 103585us
W20260709 13:03:25.797022 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 125448us
I20260709 13:03:25.722489 17845 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
W20260709 13:03:25.806020 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.859911 15245 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
W20260709 13:03:25.821636 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.722182 18045 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:25.823959 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 213497us
I20260709 13:03:25.736670 17964 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 13:03:25.717172 18041 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.846014 15316 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:25.846472 17992 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:25.847597 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:25.871008 15318 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:25.848222 17997 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:25.849462 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:25.871995 15324 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:25.852001 17960 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:25.850507 18048 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:25.822573 18017 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:03:25.718945 18010 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:25.827589 17989 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.736439 17931 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.797377 17965 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 13:03:25.873157 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:25.850096 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:25.864523 17915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.011s	sys 0.015s
W20260709 13:03:25.868322 17978 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.097s	user 0.005s	sys 0.020s
I20260709 13:03:25.853200 18013 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.194s
I20260709 13:03:25.888819 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:25.972292 15318 raft_consensus.cc:2410] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:25.822885 18026 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:25.894575 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 158442us
I20260709 13:03:25.973143 15325 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
W20260709 13:03:25.973891 15362 leader_election.cc:336] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 3.100s (SENT)
I20260709 13:03:25.974511 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:25.888936 18010 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:25.879698 17992 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.984480 17931 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.985554 17992 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:25.874639 17997 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:25.986860 17997 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:25.987730 18018 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.155s	user 0.009s	sys 0.000s
I20260709 13:03:25.987836 18026 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:25.988344 17997 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:25.988916 18013 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:25.988816 17863 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.989352 18013 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:25.990159 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.882918 17910 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:25.966009 17978 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.199s	user 0.005s	sys 0.021s
I20260709 13:03:25.851094 18054 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:03:25.906148 17998 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:25.961084 18041 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:25.961392 18058 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.105s	user 0.003s	sys 0.000s
I20260709 13:03:25.961891 18017 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:25.962304 17792 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:25.962809 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:26.022485 15324 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:25.898700 18045 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:25.966334 15316 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
W20260709 13:03:25.981761 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:25.982820 17995 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:25.983150 17979 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:25.983726 17898 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:25.985361 17931 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:25.985244 17717 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:25.937449 17915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.013s	sys 0.015s
I20260709 13:03:25.992547 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:25.960614 18029 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:25.986014 17984 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.001s
I20260709 13:03:25.997869 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:26.060176 15318 raft_consensus.cc:2376] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8. Re-sending same reply.
I20260709 13:03:26.061398 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:25.999028 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.015903 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:26.017758 15245 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:03:26.020476 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:26.027168 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 160818us
I20260709 13:03:25.990664 18010 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.044802 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:26.050200 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 196317us
I20260709 13:03:26.050530 15244 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:26.091890 15316 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:26.054929 15323 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:26.041549 17941 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.006s
I20260709 13:03:26.058522 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 393) took 1586 ms. Trace:
I20260709 13:03:26.076406 17910 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:26.101169 18034 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:26.101720 18034 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:26.102651 15316 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:26.104032 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.104709 15316 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:26.105875 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:26.106542 15316 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:26.076932 18052 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.122s	user 0.003s	sys 0.000s
I20260709 13:03:26.078506 17931 consensus_queue.cc:1243] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:26.079144 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:26.059091 17979 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:26.081235 17984 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:26.082684 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:26.114892 15249 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.073761 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:26.087116 16031 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:03:26.087185 17904 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.003s
W20260709 13:03:26.088790 17909 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.004s
I20260709 13:03:26.021847 17960 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.090013 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:26.075009 15318 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:26.093837 15324 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:26.129609 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.129801 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.130625 15324 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:26.090413 15325 raft_consensus.cc:2410] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:25.990288 18013 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.095697 16029 rpcz_store.cc:276] 0709 13:03:24.456146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.463434 (+  7288us) service_pool.cc:224] Handling call
0709 13:03:24.533356 (+ 69922us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:24.633270 (+ 99914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:24.633379 (+   109us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:24.690919 (+ 57540us) log.cc:844] Serialized 26 byte log entry
0709 13:03:24.832392 (+141473us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:24.832442 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:24.832541 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:25.986952 (+1154411us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:25.990950 (+  3998us) raft_consensus.cc:1685] finished
0709 13:03:25.993875 (+  2925us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.042841 (+ 48966us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96314,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":8253,"spinlock_wait_cycles":158050048,"thread_start_us":149718,"threads_started":2,"wal-append.queue_time_us":119989}
I20260709 13:03:26.097023 17964 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:26.097483 17998 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:26.021930 18017 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:26.110867 15399 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:26.118360 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.118963 15395 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:26.121719 15323 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:26.112994 17979 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:26.055272 17996 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:26.145681 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:26.155928 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.194808 17695 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:26.195308 17695 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:26.195791 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:26.152915 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.196422 15324 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:26.196762 18013 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:26.197435 18042 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.238s	user 0.000s	sys 0.006s
I20260709 13:03:26.176250 17960 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.110292 17916 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:26.106587 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:26.110147 17863 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:26.129084 17999 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.009s
I20260709 13:03:26.159718 17995 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:26.161688 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:26.162410 17984 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:26.234159 15319 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:26.162560 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:26.165827 17956 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:26.159525 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.132305 17931 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
W20260709 13:03:26.174922 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.189512 15395 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:26.130295 15318 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:26.202320 15249 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:26.240847 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:26.202807 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 43821.7us
I20260709 13:03:26.241523 15322 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.125869 15316 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:26.127768 17898 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:26.205683 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:26.212098 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.245636 15395 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:26.227826 18061 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:03:26.247241 17995 consensus_queue.cc:1243] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:03:26.228680 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56121.1us
I20260709 13:03:26.248793 18016 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.248996 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:26.249445 18016 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.250324 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:26.250926 18065 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:26.252089 17792 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:26.252146 17989 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:26.252938 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:26.253185 17904 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.253823 17904 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.232107 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:26.256240 15390 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:26.211583 17776 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:03:26.169098 17964 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:26.236346 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:26.242710 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:26.270823 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:26.242678 15324 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:26.245710 15391 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:26.247835 17995 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:26.258383 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:26.259042 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:26.274819 15249 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:26.275792 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:26.102720 18034 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.217687 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:26.283047 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65456.7us
I20260709 13:03:26.258951 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:26.259634 15323 raft_consensus.cc:2376] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5. Re-sending same reply.
I20260709 13:03:26.284245 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:26.284466 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:26.277333 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:26.278716 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:26.285605 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:26.125960 17941 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:26.272710 17995 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:26.280517 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:26.288342 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:26.312610 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.315243 15323 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:26.316480 16031 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
W20260709 13:03:26.316582 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45848.7us
I20260709 13:03:26.317667 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:26.319453 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.320819 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:26.326711 15362 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:26.327988 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.328680 15323 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:26.329727 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.304291 15322 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:26.330615 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:26.331439 15390 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:26.332829 15323 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:26.330626 15395 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.330082 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:26.344761 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:26.346854 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:26.349645 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.354041 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:26.362375 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:26.363077 15325 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:26.365583 15316 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:03:26.367350 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:26.297622 17977 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:26.311270 17999 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:26.367350 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:26.360450 17992 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:26.251824 18016 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:26.361485 17904 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:26.341043 17956 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:26.289480 17984 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:03:26.417884 18071 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:26.418008 17977 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:26.418609 18059 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:03:26.327131 17955 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:26.371728 15322 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:26.424427 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:26.359534 17915 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:26.312103 17987 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:03:26.288786 18029 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:03:26.341802 18026 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:26.269917 17898 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:26.435638 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 90994.5us
I20260709 13:03:26.240262 18017 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:26.443073 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:26.486934 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.457578 15391 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:26.464072 15390 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:26.459785 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:26.460924 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 182298us
I20260709 13:03:26.488950 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:26.489746 15390 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.495858 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2130) took 1240 ms. Trace:
I20260709 13:03:26.483856 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:26.496541 15317 rpcz_store.cc:276] 0709 13:03:25.255593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.256965 (+  1372us) service_pool.cc:224] Handling call
0709 13:03:25.273452 (+ 16487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.433535 (+160083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.495479 (+1061944us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400218ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:26.495767 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295836416}
I20260709 13:03:26.484763 18075 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:26.445667 18078 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:26.621837 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.576948 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.458120 17915 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.625810 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:26.623828 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:26.627247 15392 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:26.626611 15391 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:26.442674 17999 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:26.448161 17992 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:26.636503 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.639219 15317 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:03:26.646414 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:26.415413 17964 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:26.487193 17955 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:26.492782 17984 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:26.648734 18077 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:26.648969 18069 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:26.649451 18060 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:26.649963 17941 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:26.650667 18076 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:03:26.648844 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:26.663751 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 316950us
I20260709 13:03:26.645134 18017 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:26.655611 18080 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:03:26.656143 18085 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:26.446972 17995 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:26.660347 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 383058us
W20260709 13:03:26.640568 18073 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:03:26.661478 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:26.655052 17909 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:26.630504 17915 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.665486 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:26.666185 15317 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:03:26.667831 17910 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.569s	user 0.000s	sys 0.010s
I20260709 13:03:26.668872 15391 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:26.645304 18075 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:26.672542 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:26.688151 15243 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:26.658211 18007 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:26.673367 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 318682us
W20260709 13:03:26.673744 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 171069us
I20260709 13:03:26.679996 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:26.681422 15393 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:26.648919 18063 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:26.658115 18026 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:26.683545 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.685528 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 61790.8us
I20260709 13:03:26.685983 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 286) took 1008 ms. Trace:
I20260709 13:03:26.657958 17984 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:26.629709 18009 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.705574 15317 rpcz_store.cc:276] 0709 13:03:25.677918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.646744 (+968826us) service_pool.cc:224] Handling call
0709 13:03:26.665859 (+ 19115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.685666 (+ 19807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.685922 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:26.689683 15390 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:26.696859 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:26.710752 15390 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:26.710577 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:26.716521 15395 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:26.668457 17964 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:26.705708 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:26.705750 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:26.717080 15393 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:26.682118 17909 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.681085 17955 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:26.732044 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66623.7us
I20260709 13:03:26.731344 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:26.734707 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:26.727061 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:26.735764 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:26.736660 15393 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:26.729658 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:26.702316 15325 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:26.737893 15392 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:26.739955 15325 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:26.742367 15391 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:26.739018 17910 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:26.707911 18077 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:03:26.739107 17909 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:26.744995 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1206) took 1047 ms. Trace:
I20260709 13:03:26.745570 15325 rpcz_store.cc:276] 0709 13:03:25.694542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.739310 (+1044768us) service_pool.cc:224] Handling call
0709 13:03:26.739608 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.741372 (+  1764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.741578 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:26.747888 15325 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:26.750797 18079 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:03:26.753540 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:26.754994 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:26.755836 15247 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:26.758567 17909 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.762669 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:26.763447 16027 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:26.764429 18092 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:26.765609 17979 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:26.766708 18074 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 13:03:26.769758 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1164) took 1702 ms. Trace:
I20260709 13:03:26.773895 17909 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:26.778884 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49906.3us
I20260709 13:03:26.772725 16027 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:26.779536 18077 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.782588 17771 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:26.796480 17717 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:26.771481 17518 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:26.770509 18041 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:26.805804 18072 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:26.817044 17997 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.828s	user 0.009s	sys 0.003s
I20260709 13:03:26.691840 18007 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:26.806994 18051 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:26.717289 18009 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:26.712990 18063 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.808382 18059 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:26.717365 17995 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.713953 18026 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:26.810055 18029 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:03:26.784684 17998 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.004s
I20260709 13:03:26.783411 17898 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:26.771862 18010 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.669s	user 0.006s	sys 0.003s
W20260709 13:03:26.775209 18013 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 13:03:26.789534 17984 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:26.817310 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:26.821599 15390 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:26.663797 18060 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.816629 15241 rpcz_store.cc:276] 0709 13:03:25.066929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.069132 (+  2203us) service_pool.cc:224] Handling call
0709 13:03:25.094696 (+ 25564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.243154 (+148458us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:25.468321 (+225167us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.768135 (+1299814us) spinlock_profiling.cc:243] Waited 988 us on lock 0x7b1800273580. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a
0709 13:03:26.768411 (+   276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:26.768491 (+    80us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:26.768553 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.769433 (+   880us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54000ad054. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:26.769490 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.769673 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":303165,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":20323,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":343059200,"thread_start_us":257305,"threads_started":2,"wal-append.queue_time_us":186960,"wal-append.run_cpu_time_us":1015,"wal-append.run_wall_time_us":1001230}
I20260709 13:03:26.818594 17989 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:26.847872 18041 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:26.859573 16030 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:26.827219 17518 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:26.852627 18007 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:26.819936 17771 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:26.869609 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 52390.7us
I20260709 13:03:26.726507 17992 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:26.893157 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:26.898181 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:26.909466 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:26.930456 18099 raft_consensus.cc:2764] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:26.892088 17898 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:26.866068 18010 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.898515 17717 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:26.951046 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:26.923259 17984 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:26.857012 18072 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.857178 18051 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.928655 18075 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:26.922169 18092 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:26.872507 17989 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.942588 18013 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:26.947683 17966 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:26.988303 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:26.964349 17898 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:27.003101 17898 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.004154 15249 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:26.976428 17771 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.994714 17717 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:26.995514 18075 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:26.995260 18092 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:26.996063 18056 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.941s	user 0.004s	sys 0.000s
I20260709 13:03:26.998623 18010 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:26.930523 17518 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.008680 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:27.006654 17960 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.808s	user 0.009s	sys 0.004s
I20260709 13:03:27.028753 17518 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:27.011348 17979 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:27.015353 18075 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:26.986739 17915 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.017184 17771 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:27.035776 17979 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:27.036753 17979 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:27.036280 17911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.649s	user 0.000s	sys 0.014s
W20260709 13:03:27.038043 17911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.652s	user 0.000s	sys 0.015s
I20260709 13:03:27.038775 17979 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.039999 15250 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:27.018292 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 287) took 1326 ms. Trace:
I20260709 13:03:26.988389 17966 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:27.034387 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:27.043766 17966 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.045496 17966 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:27.045202 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:27.046833 17717 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:27.047412 17717 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.047891 17717 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:27.048825 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:27.050587 17980 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:27.051405 17980 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:27.052803 17980 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.062366 15317 rpcz_store.cc:276] 0709 13:03:25.691533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.707413 (+1015880us) service_pool.cc:224] Handling call
0709 13:03:26.749454 (+ 42041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.749698 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:26.923765 (+174067us) log.cc:844] Serialized 14 byte log entry
0709 13:03:27.017871 (+ 94106us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:27.017934 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:27.017987 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.018063 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.018211 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":261690,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":4953,"raft.queue_time_us":144,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7732,"thread_start_us":267485,"threads_started":2}
I20260709 13:03:26.991180 18013 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.069437 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:27.070328 16027 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:27.075369 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:27.030689 18060 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:27.032965 18086 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:27.078706 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:27.074162 18013 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:27.092720 17980 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:27.096410 17962 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:27.090567 18060 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:27.098007 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 513) took 2280 ms. Trace:
I20260709 13:03:27.099072 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1894) took 1535 ms. Trace:
I20260709 13:03:27.101667 17717 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.104158 18026 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.106383 15323 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:27.075927 18099 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:27.115746 15242 rpcz_store.cc:276] 0709 13:03:25.563780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.583433 (+ 19653us) service_pool.cc:224] Handling call
0709 13:03:25.583863 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.717534 (+133671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.098818 (+1381284us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540025bcd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:27.099011 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290682240}
I20260709 13:03:27.114760 16026 rpcz_store.cc:276] 0709 13:03:24.817466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.817860 (+   394us) service_pool.cc:224] Handling call
0709 13:03:24.839194 (+ 21334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.435130 (+595936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.097689 (+1662559us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b5400632c54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:27.097911 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279698304}
W20260709 13:03:27.126068 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 50848.4us
I20260709 13:03:27.080261 18086 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:27.125418 17992 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:03:27.128505 18063 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:27.130555 17717 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:27.132408 17915 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:27.132823 17989 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:27.082788 18009 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.173480 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:27.166561 15396 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:03:27.181488 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54569.9us
I20260709 13:03:27.193866 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:27.194485 17915 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.198338 17915 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:27.200444 18113 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:03:27.200650 17915 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:27.202581 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.203519 17717 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:27.203730 17992 consensus_queue.cc:1243] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:27.204234 17717 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:27.204804 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.205061 17989 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:27.203773 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.206755 15396 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
W20260709 13:03:27.206406 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.205510 17989 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:27.210290 17979 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:27.210896 17989 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.207912 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:27.212482 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.212981 15998 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:27.215583 15397 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:27.185758 18099 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.195508 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2200) took 2051 ms. Trace:
I20260709 13:03:27.214498 17989 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:27.217353 17960 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:27.191074 17980 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.192363 18026 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.205237 17717 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.226361 18086 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.123859 18060 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.231649 15394 rpcz_store.cc:276] 0709 13:03:25.144449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.199174 (+ 54725us) service_pool.cc:224] Handling call
0709 13:03:25.240288 (+ 41114us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:25.265909 (+ 25621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.265941 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:25.346888 (+ 80947us) log.cc:844] Serialized 52 byte log entry
0709 13:03:25.645273 (+298385us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:25.965079 (+319806us) log.cc:844] Serialized 14 byte log entry
0709 13:03:26.094597 (+129518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.094678 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:26.995381 (+900703us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:27.135131 (+139750us) raft_consensus.cc:1685] finished
0709 13:03:27.195247 (+ 60116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.195435 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63373,"prepare.queue_time_us":78916,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":114325,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":204,"spinlock_wait_cycles":15872256,"thread_start_us":567023,"threads_started":3,"wal-append.queue_time_us":487692}
I20260709 13:03:27.193768 18112 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:03:27.235106 17960 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:27.242930 18013 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.231246 18099 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.267580 18007 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.268746 18099 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:27.270828 18060 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:27.257058 18086 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:27.274793 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.269922 18007 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.257721 17960 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:27.244844 17980 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.280783 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:27.242656 18026 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.278054 17992 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.273959 18077 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:27.261819 18013 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.299275 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 296) took 1058 ms. Trace:
W20260709 13:03:27.304368 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.299928 15247 rpcz_store.cc:276] 0709 13:03:26.240591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.757389 (+516798us) service_pool.cc:224] Handling call
0709 13:03:26.757723 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.892953 (+135230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.892983 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:26.893028 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:26.893058 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.298929 (+405871us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54003971d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:27.298991 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.299188 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310473600}
I20260709 13:03:27.301409 17995 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.310295 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:27.286391 17992 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.313498 16026 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:27.310024 18010 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:27.325805 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.316445 17998 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:27.312263 18026 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:27.312767 17995 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.340334 15243 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:27.322522 18084 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:03:27.353123 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.353799 15321 raft_consensus.cc:2376] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6. Re-sending same reply.
I20260709 13:03:27.354935 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.355520 15321 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:27.340617 17771 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:27.360064 17771 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.362475 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:27.364353 15397 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:03:27.366669 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:27.367308 15393 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:27.367669 15321 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:27.369851 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.370661 15395 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:27.370985 15397 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:27.373132 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46742.6us
W20260709 13:03:27.374650 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.379343 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 75175.2us
I20260709 13:03:27.333353 18010 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.381260 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.382011 15321 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:27.407136 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.407744 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.410573 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.411772 15395 raft_consensus.cc:2393] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:27.405503 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:27.414386 15391 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:27.415239 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.412923 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.420143 15395 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:27.379840 18115 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:27.434517 15321 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:27.435537 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:27.435377 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.379968 18084 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 13:03:27.437887 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.406917 17918 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.430640 17939 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.439539 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.434404 18115 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:27.409376 17980 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:27.450515 15321 raft_consensus.cc:2376] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6. Re-sending same reply.
I20260709 13:03:27.455430 17939 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.456104 17519 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:27.439460 18059 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.451570 17771 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.434556 17964 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:27.447479 17909 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:27.471717 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:27.460597 18013 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.490873 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.439831 17911 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:27.460129 17967 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:03:27.501565 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.502367 15395 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:27.450743 17918 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.488933 17916 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:27.510594 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.496930 17990 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:27.468973 18059 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.503619 17992 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:27.561538 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.492517 17964 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.511399 17995 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.501717 18115 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.515493 17990 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:27.515713 17916 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:27.632032 18124 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:03:27.631629 17695 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.633229 18051 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:27.636260 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1154) took 3109 ms. Trace:
I20260709 13:03:27.637003 17990 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.638439 17990 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:27.636374 18117 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:03:27.604475 18016 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:27.625051 18010 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.636782 15246 rpcz_store.cc:276] 0709 13:03:24.527050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.638536 (+111486us) service_pool.cc:224] Handling call
0709 13:03:24.638837 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.538847 (+900010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.636032 (+2097185us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540001e854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:27.636202 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068434304}
I20260709 13:03:27.627627 17911 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:27.650609 17918 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.650655 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:27.653633 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 280) took 1980 ms. Trace:
I20260709 13:03:27.653941 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 298) took 1412 ms. Trace:
I20260709 13:03:27.655230 17978 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:27.668319 15241 rpcz_store.cc:276] 0709 13:03:26.241175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.867570 (+626395us) service_pool.cc:224] Handling call
0709 13:03:26.867882 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.870711 (+  2829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.870741 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:26.870784 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:26.870815 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.653691 (+782876us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b540010b654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:27.653743 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.653879 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6016768}
I20260709 13:03:27.659902 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:27.658871 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:27.655440 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:27.672096 15318 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:27.665067 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:27.657280 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:27.676497 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.659474 17992 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:27.654073 15316 rpcz_store.cc:276] 0709 13:03:25.673968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.366307 (+692339us) service_pool.cc:224] Handling call
0709 13:03:26.417016 (+ 50709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.547349 (+130333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.547403 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.625997 (+ 78594us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.835923 (+209926us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:26.836004 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.653210 (+817206us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400375354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:27.653276 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.653318 (+    42us) raft_consensus.cc:1685] finished
0709 13:03:27.653331 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.653568 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298096512,"thread_start_us":167379,"threads_started":1,"wal-append.queue_time_us":210274}
I20260709 13:03:27.673712 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.683495 15318 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:27.705160 15393 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:27.689771 17939 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.706557 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:27.707458 16027 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:27.707825 17978 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.708429 17519 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:27.708513 17978 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.711043 17965 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:27.710853 17916 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.711813 17965 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:27.658842 18122 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:27.722436 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.723232 15316 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:27.658928 17995 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:27.669956 17960 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.688503 17989 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.687433 17931 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.681841 17918 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:27.645768 18016 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.670992 17911 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.703071 17992 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.765408 15318 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:27.784091 18016 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:27.791663 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 98164.2us
I20260709 13:03:27.742983 17931 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.751466 17918 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:27.741007 17995 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.744900 17989 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.815182 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.816078 15318 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:27.819044 15316 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:27.820129 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:27.828562 15318 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:27.834190 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:27.836145 15318 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:27.837714 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:27.776997 17909 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:27.839310 15318 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:27.846777 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:27.847379 15318 raft_consensus.cc:2376] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7. Re-sending same reply.
I20260709 13:03:27.848209 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:27.848785 15318 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:27.849562 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:27.852015 15318 raft_consensus.cc:2410] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:03:27.825209 18086 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.551s	user 0.004s	sys 0.009s
I20260709 13:03:27.853395 15316 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:27.804073 17965 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.860862 17909 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.862959 17918 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.868201 17989 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:27.868359 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1911) took 1674 ms. Trace:
I20260709 13:03:27.870399 15243 rpcz_store.cc:276] 0709 13:03:26.193677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.708647 (+514970us) service_pool.cc:224] Handling call
0709 13:03:27.868170 (+1159523us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400316354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:27.868299 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391930112}
I20260709 13:03:27.875310 18139 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.854071 17964 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:27.877877 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.879413 17960 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.882402 18135 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:27.883008 18057 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.897s	user 0.000s	sys 0.014s
I20260709 13:03:27.883496 17931 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.884938 15399 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:27.879846 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:27.884130 17931 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:27.886341 15392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2207) took 1767 ms (client timeout 2158 ms). Trace:
W20260709 13:03:27.887651 15392 rpcz_store.cc:269] 0709 13:03:26.117868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.118002 (+   134us) service_pool.cc:224] Handling call
0709 13:03:27.884426 (+1766424us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54001545d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:27.884595 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994596608}
I20260709 13:03:27.876116 17978 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.883122 18135 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.894358 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1188) took 2241 ms. Trace:
W20260709 13:03:27.897229 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.902036 15320 rpcz_store.cc:276] 0709 13:03:25.648097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.648294 (+   197us) service_pool.cc:224] Handling call
0709 13:03:25.648678 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.845522 (+196844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.888744 (+2043222us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b54002193d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:27.888962 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202808064}
I20260709 13:03:27.904557 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.905282 15320 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:27.889299 16027 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:27.910347 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:27.911751 17978 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:27.912452 17978 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.914779 17911 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.915076 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.915307 17978 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.917469 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:27.925443 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:27.925937 18086 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:27.926139 15317 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:27.927832 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:27.927832 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:27.929409 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:27.889472 17931 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.934628 17992 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.937314 17931 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.942446 18094 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:27.942945 18094 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:27.943079 18059 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:27.943841 18094 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.944998 18094 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:27.945171 18072 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:27.947456 17967 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:27.947983 17967 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:27.948989 17967 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:27.953006 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:27.956414 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.957602 15317 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:27.961262 15396 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:27.963181 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:27.966423 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:27.967377 15317 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:27.969918 15320 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:27.971086 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:27.971481 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:27.972352 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:27.973914 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.977111 17995 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:27.964998 18086 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:27.977478 15320 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:27.978096 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1215) took 1891 ms. Trace:
I20260709 13:03:27.884896 18139 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:27.978447 15320 rpcz_store.cc:276] 0709 13:03:26.086378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.976902 (+1890524us) service_pool.cc:224] Handling call
0709 13:03:27.977189 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.977863 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.978039 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:27.979566 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:27.925531 17863 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:27.982375 15320 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:27.983950 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 288) took 1778 ms. Trace:
I20260709 13:03:27.978268 18086 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.016853 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:27.995033 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:27.990520 15394 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:27.950891 18010 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:28.000821 16030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 518) took 1943 ms (client timeout 2246 ms). Trace:
W20260709 13:03:28.022903 16030 rpcz_store.cc:269] 0709 13:03:26.057619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.057761 (+   142us) service_pool.cc:224] Handling call
0709 13:03:28.000649 (+1942888us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b5400550ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:28.000764 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1681370496}
I20260709 13:03:27.962713 18007 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:27.991493 18082 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.306s	user 0.004s	sys 0.012s
W20260709 13:03:28.026316 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.021608 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:27.995996 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.000196 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 290) took 3129 ms. Trace:
I20260709 13:03:27.961210 17931 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.035741 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:27.981550 18071 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:28.046942 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2137) took 2183 ms. Trace:
W20260709 13:03:28.049494 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.972317 18129 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:27.993808 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:28.047516 15325 rpcz_store.cc:276] 0709 13:03:25.863042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.748966 (+885924us) service_pool.cc:224] Handling call
0709 13:03:26.749250 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.871626 (+122376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.871667 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.891394 (+ 19727us) log.cc:844] Serialized 26 byte log entry
0709 13:03:27.033261 (+141867us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:27.033325 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.027613 (+994288us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540021a7d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:28.027661 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.027706 (+    45us) raft_consensus.cc:1685] finished
0709 13:03:28.027718 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.046869 (+ 19151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":318,"raft.queue_time_us":445,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":4258,"spinlock_wait_cycles":279784192,"thread_start_us":89981,"threads_started":1,"wal-append.queue_time_us":171320}
W20260709 13:03:28.053946 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 60198.5us
I20260709 13:03:28.028091 15397 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:28.054437 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.054726 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.055053 15390 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:28.027878 15250 rpcz_store.cc:276] 0709 13:03:24.871267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.871412 (+   145us) service_pool.cc:224] Handling call
0709 13:03:24.871756 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.040487 (+2168731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.999939 (+959452us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b540010ca54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:28.000123 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4986021120}
I20260709 13:03:27.981263 17992 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:27.982774 17863 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:27.994758 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:27.982823 18084 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:27.984365 15320 rpcz_store.cc:276] 0709 13:03:26.205670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.980458 (+1774788us) service_pool.cc:224] Handling call
0709 13:03:27.982193 (+  1735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.983638 (+  1445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.983897 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.055372 15325 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:28.069829 18150 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:28.070745 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.028817 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.071094 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:28.072095 17909 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:28.051774 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:27.995253 17995 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:27.989606 18139 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.000553 18135 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:28.024197 18054 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:28.022506 18010 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:28.065781 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.073701 18010 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:28.072512 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.074115 18145 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.074442 15322 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:28.074733 18145 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.075431 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.075670 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:28.076050 15322 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:28.076514 18060 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:28.076939 18060 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.073241 18139 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:28.077215 18145 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:28.077490 18139 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.078518 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.078532 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:28.077307 18060 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:28.079712 18145 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:28.080184 18145 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.080538 18145 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:28.081012 18139 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:28.083165 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.083587 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.083770 15320 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:28.084836 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.083592 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.085631 15322 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:28.086740 15322 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:28.081712 18010 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.072495 17909 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.087283 15213 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:28.087313 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 289) took 1881 ms. Trace:
I20260709 13:03:28.089450 18010 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.084718 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.053323 18129 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.120148 18139 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.120299 18129 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.120841 18139 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.123601 18060 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.104458 15322 rpcz_store.cc:276] 0709 13:03:26.206006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.086220 (+1880214us) service_pool.cc:224] Handling call
0709 13:03:28.086563 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.087101 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.087263 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.127612 18060 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.128484 15322 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:28.130298 15322 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:28.050631 18007 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:28.133977 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2210) took 2010 ms. Trace:
I20260709 13:03:28.135776 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:28.136519 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:28.137336 15320 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:28.138388 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.137873 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:28.123828 17771 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:28.148509 18139 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.147964 17863 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.152119 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.153609 18084 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:28.154636 18084 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.159236 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:28.163820 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 76591.7us
I20260709 13:03:28.164920 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:28.149853 17863 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:28.166441 17911 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:28.167052 18142 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:03:28.167225 17911 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.168856 17911 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:28.169289 17911 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:28.169697 17911 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:28.170434 18017 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:28.170655 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.050750 18071 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.053151 17989 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:28.061722 17965 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:28.143097 18124 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:03:28.143399 17992 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:28.134429 15398 rpcz_store.cc:276] 0709 13:03:26.123280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.123518 (+   238us) service_pool.cc:224] Handling call
0709 13:03:26.123873 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:26.154057 (+ 30184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.154090 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:26.154987 (+   897us) log.cc:844] Serialized 26 byte log entry
0709 13:03:26.373022 (+218035us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:26.373064 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.373130 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:27.990805 (+1617675us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:28.133693 (+142888us) raft_consensus.cc:1685] finished
0709 13:03:28.133717 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.133919 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22791,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":117,"spinlock_wait_cycles":4459776,"thread_start_us":148863,"threads_started":1,"wal-append.queue_time_us":462055}
I20260709 13:03:28.053690 17931 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.186712 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.187813 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:28.190205 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:28.183933 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.192865 15398 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:03:28.191881 15320 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
W20260709 13:03:28.193493 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.137306 17909 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.177827 17960 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:03:28.200547 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:28.202174 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 166490us
I20260709 13:03:28.197142 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.202731 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.181639 16027 raft_consensus.cc:2410] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:03:28.204425 16030 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:28.182716 18071 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:28.206935 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.210475 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:28.195695 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.189554 17519 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.214042 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:28.215533 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:28.178426 18081 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.182s	user 0.000s	sys 0.002s
I20260709 13:03:28.212456 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.218149 16024 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
W20260709 13:03:28.212800 17990 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.004s
I20260709 13:03:28.221078 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:28.148003 17771 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.223749 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:28.224082 15320 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:03:28.225015 18151 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:03:28.197849 18010 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:28.182178 18007 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.229193 15321 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:28.217142 17989 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:28.197243 17980 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:03:28.253989 15398 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:28.253769 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:28.222210 17964 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.243590 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 606) took 1112 ms. Trace:
I20260709 13:03:28.245335 17695 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:28.226804 17783 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:28.248129 17771 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:28.221004 17960 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:03:28.251235 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.204720 18145 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.217561 17519 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:28.289737 15319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2129) took 3073 ms (client timeout 2172 ms). Trace:
I20260709 13:03:28.260943 16026 rpcz_store.cc:276] 0709 13:03:27.131254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.137517 (+  6263us) service_pool.cc:224] Handling call
0709 13:03:28.243379 (+1105862us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54004759d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:28.243517 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295355776}
I20260709 13:03:28.225276 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.265719 17931 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.266732 18013 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:28.232702 17995 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:28.296495 17792 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:28.300135 17792 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.303761 17792 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:28.303915 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.281962 15321 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:28.304641 15394 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:28.230772 15320 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 13:03:28.285575 18149 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:28.290284 15319 rpcz_store.cc:269] 0709 13:03:25.202215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.235254 (+ 33039us) service_pool.cc:224] Handling call
0709 13:03:28.275132 (+3039878us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54001e69d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:28.275268 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173002624}
I20260709 13:03:28.305603 18149 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.305991 18149 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.250514 17992 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.306336 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.307544 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:28.308061 15319 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:28.310619 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.298780 18013 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:28.314393 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1229) took 1018 ms. Trace:
I20260709 13:03:28.314518 18013 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.315909 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.316083 18013 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:28.316568 15321 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:28.314880 15320 rpcz_store.cc:276] 0709 13:03:27.296367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.229888 (+933521us) service_pool.cc:224] Handling call
0709 13:03:28.230522 (+   634us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:28.305487 (+ 74965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.314331 (+  8844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.317807 18017 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:28.298802 18152 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.318511 18152 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.321240 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:28.323467 18059 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:28.255959 18010 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.285899 17783 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.226259 18140 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:03:28.256933 18150 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:28.324067 15319 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:28.339677 15324 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:28.345873 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.368623 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 291) took 1063 ms. Trace:
I20260709 13:03:28.368875 16026 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:28.340698 15392 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:03:28.370159 15392 pending_rounds.cc:85] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 5
I20260709 13:03:28.370443 15392 pending_rounds.cc:107] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:03:28.370836 15392 raft_consensus.cc:2889] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:28.334599 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.372087 15398 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:28.367728 15289 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:28.368996 15324 rpcz_store.cc:276] 0709 13:03:27.305297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.339003 (+1033706us) service_pool.cc:224] Handling call
0709 13:03:28.339339 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.368340 (+ 29001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.368564 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.375373 15289 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:28.376891 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:28.269323 17964 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.384759 15289 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:28.385545 15324 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:03:28.386881 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:28.363756 18137 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.488s	user 0.002s	sys 0.000s
I20260709 13:03:28.391302 15324 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:28.338627 18034 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.337196 17998 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:28.331909 18010 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.395012 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:28.396849 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.383033 16029 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 4: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:28.401198 17695 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.401865 17695 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.404709 17695 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:28.365805 17771 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:28.406306 17695 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:28.406999 17771 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.407200 17695 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.356330 17978 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.409550 17771 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.364710 18033 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:28.324179 18059 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:28.408905 15250 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:28.376112 17992 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:28.416597 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.383852 17931 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:28.388096 17792 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:28.340027 17960 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:28.409768 17783 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:28.412425 15241 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:28.379182 18140 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:28.386881 15319 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:28.417502 15243 raft_consensus.cc:2410] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:03:28.437968 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.398594 18155 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.463405 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.502655 15245 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:28.505084 15241 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:28.397869 17998 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:28.389988 18088 raft_consensus.cc:2764] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:28.510826 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.405531 17965 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:28.492286 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:28.409639 17978 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:28.493707 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 98785.2us
I20260709 13:03:28.329475 18149 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.500118 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.464178 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:28.470613 18010 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.506417 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:28.522578 15247 raft_consensus.cc:2410] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:03:28.465826 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.329859 18129 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.516782 15248 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:28.517596 17998 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.416949 17992 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:28.494053 17792 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.537559 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.538972 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.540704 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.546172 15390 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:28.547869 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.549819 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.493211 18139 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.530436 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.503944 18054 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:28.555207 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.535805 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.520562 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:28.549736 15242 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:28.551945 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.553604 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:28.557643 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:28.562745 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:28.563975 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:28.565136 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.527189 18135 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.412675 18033 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.573900 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:28.543828 17792 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.579605 17988 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:28.581369 18049 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:28.581939 18094 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:28.613229 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:28.582651 17992 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.615860 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:28.590438 17960 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.533008 18140 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.591365 17695 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:28.592044 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.543408 17916 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:03:28.611073 15244 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:28.561769 17998 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:28.627460 17965 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:28.627970 17965 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.628357 17965 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.542585 18010 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.630825 17519 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.632171 18010 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.560143 18054 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:28.633752 18054 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:28.633908 18033 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.634943 17964 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.508620 18150 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.538280 17863 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:03:28.620770 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:28.543653 17980 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:03:28.606645 18049 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:28.670509 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 262) took 2463 ms. Trace:
I20260709 13:03:28.671029 15399 rpcz_store.cc:276] 0709 13:03:26.206935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.207166 (+   231us) service_pool.cc:224] Handling call
0709 13:03:27.884809 (+1677643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.886518 (+  1709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.670265 (+783747us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54001545d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:28.670439 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3857385344}
W20260709 13:03:28.646687 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.647020 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.647214 17992 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:28.647599 17988 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:28.677496 15396 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:28.680042 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.649712 18129 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.639712 18140 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.612684 18135 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.690582 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.651120 17911 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.652200 18149 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.657102 17909 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.658588 18071 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.664180 18041 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.514901 18155 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.614626 17944 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:28.642514 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.707432 15390 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
W20260709 13:03:28.707986 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.673702 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:28.568095 18139 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.619766 17990 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:28.688494 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.692085 15248 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:28.716248 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.692029 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.718159 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.626597 18094 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:28.674820 18049 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:28.696357 18154 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.673652 18007 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.703852 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.676350 18088 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:28.686038 18014 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.709059 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:28.675906 17988 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:28.670651 16029 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:28.712751 15246 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:28.712874 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.685009 16027 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 3.
I20260709 13:03:28.570538 18059 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.693694 18060 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:28.737556 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:28.714973 17990 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:28.692593 17771 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:03:28.732951 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.733738 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.766084 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.767562 15248 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:28.740049 15324 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:28.728073 18007 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.743182 18139 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.737498 18014 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.747874 18152 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.738538 17988 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:28.753476 15321 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 7. Ops: [5.4-5.4]
I20260709 13:03:28.755317 17911 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.763269 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:28.764247 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.778627 16024 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:28.773473 16030 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:28.775185 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2144) took 1036 ms. Trace:
I20260709 13:03:28.779472 15321 rpcz_store.cc:276] 0709 13:03:27.739871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.752878 (+1013007us) service_pool.cc:224] Handling call
0709 13:03:28.753239 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.774921 (+ 21682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.775136 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.781351 15321 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:28.765743 17990 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.740038 18010 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:28.782090 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2147) took 1039 ms. Trace:
I20260709 13:03:28.784044 15321 rpcz_store.cc:276] 0709 13:03:27.743138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.780528 (+1037390us) service_pool.cc:224] Handling call
0709 13:03:28.780918 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.781770 (+   852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.782021 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.786465 15321 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:28.787355 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2148) took 1036 ms. Trace:
I20260709 13:03:28.787791 15321 rpcz_store.cc:276] 0709 13:03:27.750905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.785821 (+1034916us) service_pool.cc:224] Handling call
0709 13:03:28.786267 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.787049 (+   782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.787290 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.790798 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.792268 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:28.764592 18162 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.803551 18007 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.805418 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.806097 15390 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:28.797994 15324 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:28.809023 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2145) took 1066 ms. Trace:
I20260709 13:03:28.809561 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.809329 15324 rpcz_store.cc:276] 0709 13:03:27.742596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.777544 (+1034948us) service_pool.cc:224] Handling call
0709 13:03:28.797756 (+ 20212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.808750 (+ 10994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.808966 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.791214 18152 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.791735 17695 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:28.799853 17944 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:28.813474 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.814103 18155 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.814386 16029 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:28.816360 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2143) took 1077 ms. Trace:
I20260709 13:03:28.797994 15399 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:28.731618 18154 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.765111 18060 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.816975 15399 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:28.820737 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 46293.5us
I20260709 13:03:28.796047 18174 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:28.816831 15319 rpcz_store.cc:276] 0709 13:03:27.738954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.497110 (+758156us) service_pool.cc:224] Handling call
0709 13:03:28.497565 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.498084 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.498131 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.498791 (+   660us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.674542 (+175751us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:28.674590 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.674666 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:28.816100 (+141434us) raft_consensus.cc:1685] finished
0709 13:03:28.816121 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.816277 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8725,"thread_start_us":131094,"threads_started":1,"wal-append.queue_time_us":178927}
I20260709 13:03:28.819890 15399 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.825735 15248 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:28.828948 15319 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:28.830687 15319 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:28.839736 15324 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:03:28.840660 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2150) took 1029 ms. Trace:
I20260709 13:03:28.841239 15324 rpcz_store.cc:276] 0709 13:03:27.811766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.819423 (+1007657us) service_pool.cc:224] Handling call
0709 13:03:28.839454 (+ 20031us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:28.840304 (+   850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.840584 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:28.814927 18063 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:28.846030 15247 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:28.816815 17695 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:28.863116 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.863552 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.864575 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:28.813414 17944 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:03:28.838850 18166 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:03:28.797184 18094 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.889886 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.813448 17792 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.883320 18177 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:28.895133 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.883914 18154 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:28.886160 18172 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:03:28.887478 18140 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:28.878945 18171 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:03:28.895632 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.895956 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.865353 18063 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:28.808038 18162 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.822901 18152 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.866905 17695 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:28.873270 17944 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.869628 18150 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.870046 17909 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:28.913049 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 91601.6us
W20260709 13:03:28.913511 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49022.1us
I20260709 13:03:28.914717 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:28.938066 16026 raft_consensus.cc:2410] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:03:28.873111 18135 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.891131 18007 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:28.938731 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:28.942822 16027 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:03:28.943933 18054 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.945708 17965 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.947041 15241 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:28.947264 17792 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:28.925652 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.958078 18007 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.959056 18014 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:28.960590 18007 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:28.961985 18179 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:28.962133 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.924182 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2155) took 1060 ms. Trace:
I20260709 13:03:28.962970 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:28.909452 18177 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:28.965598 15396 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:28.963253 15319 rpcz_store.cc:276] 0709 13:03:27.863472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.832938 (+969466us) service_pool.cc:224] Handling call
0709 13:03:28.833297 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.834999 (+  1702us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:28.868597 (+ 33598us) log.cc:844] Serialized 14 byte log entry
0709 13:03:28.923347 (+ 54750us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:28.923479 (+   132us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:28.923570 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.923912 (+   342us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:28.924096 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10521,"prepare.queue_time_us":35686,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":178,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":10879,"spinlock_wait_cycles":1233152,"thread_start_us":53358,"threads_started":1}
I20260709 13:03:28.970870 15394 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:28.971231 18177 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:28.972903 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:28.973803 15393 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:03:28.974699 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:28.975291 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.976112 15248 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 3.
I20260709 13:03:28.976812 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:28.978562 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:28.980418 18175 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:28.981249 18175 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:28.982560 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.982507 18175 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.985417 18152 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:28.987640 18071 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.994973 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:28.996672 15396 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:28.998579 18060 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:29.000610 15397 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:29.001060 15397 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:29.001858 15397 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:28.939873 18150 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.003044 15397 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.004366 18150 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:28.966601 18174 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:29.006014 18174 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:29.006984 18174 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.008966 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:29.009657 16030 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:28.983417 15392 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:29.013887 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:29.014977 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:29.015527 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.015158 15319 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:29.015849 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:29.016475 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2159) took 1041 ms. Trace:
I20260709 13:03:29.016849 15319 rpcz_store.cc:276] 0709 13:03:27.975057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.968332 (+993275us) service_pool.cc:224] Handling call
0709 13:03:28.968696 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.016213 (+ 47517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.016416 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:29.017912 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:29.018013 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:29.018492 15319 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.019963 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:29.020591 16031 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:29.020654 15397 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:03:29.021221 15397 pending_rounds.cc:85] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 3
I20260709 13:03:29.019218 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:29.021574 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:29.022540 16024 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:29.022635 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:29.011909 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:29.023761 18177 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:29.024255 18177 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:29.024657 18177 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.025272 15289 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:29.026064 18026 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:29.026515 18026 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.026520 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:29.027567 16027 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.027848 18184 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:29.026865 18063 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.031402 18063 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:29.033335 18178 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:29.033895 18178 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.034276 18178 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:29.034436 17916 raft_consensus.cc:2764] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:29.034687 17980 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:29.035933 18054 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:29.036989 18184 consensus_queue.cc:1243] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:29.037737 18184 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:29.038137 18184 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:29.021644 15397 pending_rounds.cc:107] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:03:29.048799 15243 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:29.034484 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:29.051760 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:29.054694 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:29.048915 15397 raft_consensus.cc:2889] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:29.057729 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45897.9us
I20260709 13:03:29.067735 15319 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:29.007604 18162 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:29.065275 18045 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:29.035921 17980 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:03:29.061412 18034 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.004s
I20260709 13:03:29.026904 18026 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.054100 18007 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:29.084486 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:29.084787 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:29.003615 17944 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.087395 15325 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:29.065027 18173 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:29.077215 18185 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:03:29.092311 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:29.074893 18180 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:29.094360 15319 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:29.076548 18045 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:29.054247 17916 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:03:29.092964 15393 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:29.080520 17980 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:29.090086 18065 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.092720 18173 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.123588 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:29.130146 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:29.130856 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:29.095747 18180 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:29.159538 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 114233us
I20260709 13:03:29.138753 15319 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:29.138753 15392 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:29.140559 18173 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:29.140288 18131 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:03:29.141500 18145 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:29.141997 17771 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:29.145596 18078 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:29.146519 18017 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:29.148900 16027 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
W20260709 13:03:29.151722 18183 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:29.154592 18177 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.155166 17918 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:29.167577 18180 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:29.158609 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:29.093387 18176 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:03:29.128852 18162 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.096949 18060 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:03:29.077637 18184 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.096768 18059 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:03:29.173138 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:29.174817 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:29.187237 18078 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:29.194635 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.218340 17771 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.207341 18045 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.224803 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:29.323302 15319 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:29.167593 18065 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.157701 17911 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:29.233357 18177 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:29.234272 15397 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:29.235567 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1194) took 3585 ms. Trace:
I20260709 13:03:29.237094 18010 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:29.237414 18178 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.256637 17965 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:29.326210 18190 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.199s	user 0.000s	sys 0.009s
W20260709 13:03:29.243274 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 84746.5us
I20260709 13:03:29.347506 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:29.244417 17918 consensus_queue.cc:1243] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:29.324756 15393 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
W20260709 13:03:29.342851 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.342967 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:29.335451 15323 rpcz_store.cc:276] 0709 13:03:25.650063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.350826 (+700763us) service_pool.cc:224] Handling call
0709 13:03:26.351247 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.124049 (+772802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.235328 (+2111279us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54001e50d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:29.235507 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1735999360}
I20260709 13:03:29.328397 18145 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:29.356772 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 183412us
I20260709 13:03:29.357558 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:29.358120 15323 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:03:29.337868 16029 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:29.360786 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2160) took 1385 ms. Trace:
I20260709 13:03:29.246726 17988 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.363318 15323 rpcz_store.cc:276] 0709 13:03:27.975309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.357584 (+1382275us) service_pool.cc:224] Handling call
0709 13:03:29.357927 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:29.358613 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.360710 (+  2097us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:29.364939 18175 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:29.387355 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:29.367775 18187 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:03:29.321871 18162 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.378533 18154 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.380954 18078 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.343963 18017 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.338642 18010 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:29.398788 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:29.351593 18059 consensus_queue.cc:1243] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:29.391841 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:29.394348 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:29.396853 15319 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:29.360118 17918 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:29.397738 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:29.403646 15323 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:03:29.399744 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.399673 16024 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:29.361573 18131 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.350780 18177 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:03:29.351433 17916 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:03:29.335152 18191 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:03:29.361797 17965 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.403003 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2161) took 1414 ms. Trace:
I20260709 13:03:29.404680 15323 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:29.417498 15319 rpcz_store.cc:276] 0709 13:03:27.988863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.360560 (+1371697us) service_pool.cc:224] Handling call
0709 13:03:29.396619 (+ 36059us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:29.402684 (+  6065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.402942 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:29.417912 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2173) took 1222 ms. Trace:
I20260709 13:03:29.418270 15323 rpcz_store.cc:276] 0709 13:03:28.195248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.404231 (+1208983us) service_pool.cc:224] Handling call
0709 13:03:29.404518 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.417639 (+ 13121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.417855 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:29.390619 18175 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:29.386144 18145 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:29.415145 15392 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:29.386402 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:29.399142 18141 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:29.395606 17944 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:29.423216 15323 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:29.437381 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2175) took 1200 ms. Trace:
I20260709 13:03:29.437899 15323 rpcz_store.cc:276] 0709 13:03:28.236963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.418967 (+1182004us) service_pool.cc:224] Handling call
0709 13:03:29.419192 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.436571 (+ 17379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.437313 (+   742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:29.407955 17918 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.452895 16030 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:29.428287 18175 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:29.456552 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.402894 18154 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.437242 18078 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:29.406109 18017 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.415978 18071 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:03:29.411923 18150 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:03:29.442471 17918 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:29.411180 18131 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.516805 18131 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:29.401126 18195 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:03:29.519192 17988 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:29.429458 17965 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.522428 15247 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:29.523988 18197 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:29.524567 18197 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:29.527592 16024 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
W20260709 13:03:29.535815 15291 connection.cc:256] RPC call timeout handler was delayed by -1.1124433490000456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.253s for a response
I20260709 13:03:29.536813 18150 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.537001 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:29.538581 18071 raft_consensus.cc:2764] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:03:29.537597 18150 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.542904 18150 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:29.556995 17980 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.564378 15321 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 8. Ops: []
I20260709 13:03:29.499150 15316 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:29.531188 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1221) took 2343 ms. Trace:
I20260709 13:03:29.532954 17918 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.568961 15318 rpcz_store.cc:276] 0709 13:03:27.187646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.849356 (+661710us) service_pool.cc:224] Handling call
0709 13:03:29.530892 (+1681536us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b54001c66d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:29.531097 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3943680}
I20260709 13:03:29.443138 17916 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.584298 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:29.529873 17978 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:29.498088 16027 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:03:29.567555 17990 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.003s
I20260709 13:03:29.561921 18153 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.522054 17965 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:29.605705 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.609136 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:29.608007 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:29.615247 15316 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:29.606042 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:29.624826 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:29.597914 18026 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:29.596864 18049 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.858s	user 0.014s	sys 0.000s
W20260709 13:03:29.667578 18193 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:03:29.597065 17931 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:03:29.525650 18197 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:29.670537 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.602393 18156 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.090s	user 0.000s	sys 0.004s
W20260709 13:03:29.591831 17695 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.002s
I20260709 13:03:29.609680 18150 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:29.622686 17980 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:29.677292 18173 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
I20260709 13:03:29.663017 18071 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:29.591900 17771 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:29.592154 18178 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:29.590466 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 302) took 1326 ms. Trace:
W20260709 13:03:29.696830 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 72113.8us
I20260709 13:03:29.666105 18153 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.631651 17990 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.724987 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:29.743166 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:29.726775 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:29.730612 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 103685us
I20260709 13:03:29.607007 18145 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.735800 15316 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:29.607538 17916 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.715265 18199 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:29.747752 15396 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:29.753006 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:29.754424 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:29.755853 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:29.729873 18191 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.761252 18191 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.762476 17990 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:29.763659 18191 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:29.730997 18162 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:29.764389 18191 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:29.738119 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:29.764338 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:29.766462 15393 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:29.767568 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:29.738869 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:29.740520 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.769330 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:29.769793 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:29.770447 15316 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:29.771287 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1236) took 1130 ms. Trace:
I20260709 13:03:29.736968 15323 rpcz_store.cc:276] 0709 13:03:28.264212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.447461 (+1183249us) service_pool.cc:224] Handling call
0709 13:03:29.447846 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.448097 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:29.448138 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:29.448200 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:29.448239 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.448318 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:29.590364 (+142046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:29.771253 18150 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:29.772297 17863 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:03:29.772589 15323 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.772807 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:29.774468 18141 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:29.772850 17863 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:29.776625 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:29.777021 17863 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:29.779237 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:29.779915 15241 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:29.780534 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2149) took 2003 ms. Trace:
I20260709 13:03:29.780964 15321 rpcz_store.cc:276] 0709 13:03:27.777779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.789585 (+1011806us) service_pool.cc:224] Handling call
0709 13:03:29.564126 (+774541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.564965 (+   839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.780298 (+215333us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54001c66d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:29.780470 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1780174720}
I20260709 13:03:29.782567 15316 rpcz_store.cc:276] 0709 13:03:28.640876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.769701 (+1128825us) service_pool.cc:224] Handling call
0709 13:03:29.769977 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.770997 (+  1020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:29.771235 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:29.783519 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.771502 18182 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.781s	user 0.004s	sys 0.000s
I20260709 13:03:29.697201 17995 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:29.786515 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.790834 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:29.791605 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.785786 15321 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:29.787817 15390 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:29.793072 15396 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:29.788234 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:29.769321 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:29.782495 15323 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:29.741876 18197 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:29.832929 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 63690us
I20260709 13:03:29.782457 18048 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:29.844625 15321 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:29.739246 18174 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 13:03:29.723030 17695 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.778013 17863 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.834324 18150 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:29.922315 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.736886 18173 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.723340 18049 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:29.924010 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:29.841903 18048 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:29.941205 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:29.943547 15245 raft_consensus.cc:2368] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10.
I20260709 13:03:29.929701 18196 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.924113 17918 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:29.959403 15390 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:29.921092 17995 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:29.959405 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:29.977243 15391 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 5: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:29.932188 17931 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.960701 15248 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:29.940007 18199 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:29.851783 18191 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:03:29.979171 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:29.985875 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 137004us
I20260709 13:03:29.994192 17931 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:29.951357 17771 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:30.014109 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:30.020840 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.019644 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:30.027529 18215 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:30.027990 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.028712 15391 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:30.041893 18204 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:30.025437 17967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.034s	user 0.007s	sys 0.011s
I20260709 13:03:30.012660 18017 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:30.064234 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:30.030706 18154 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:30.052852 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 73759.4us
I20260709 13:03:30.033035 18215 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.016781 17771 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:29.977067 18196 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.071755 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:30.061434 18175 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 13:03:30.035841 18153 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:30.104498 18198 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:03:30.049270 17995 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:30.117467 17995 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.060943 18178 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:03:30.067868 17967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.074s	user 0.010s	sys 0.011s
I20260709 13:03:30.116556 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.115602 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:30.072234 18026 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.113399 17771 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.107779 18204 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:30.135821 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.228286 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.108399 18215 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:30.121618 17995 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:30.319039 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.137744 17931 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:30.121127 18178 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:30.322517 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.139253 18191 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:30.291147 18217 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:30.294765 18017 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.139822 17916 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.297137 18154 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:30.315002 18143 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 2.313s	user 0.008s	sys 0.010s
I20260709 13:03:30.119221 18175 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:30.336797 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:30.361048 15996 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.460s (SENT) [suppressed 10 similar messages]
I20260709 13:03:30.313125 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1182) took 1897 ms. Trace:
I20260709 13:03:30.344841 15241 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:30.293685 18204 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:30.353719 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 213640us
I20260709 13:03:30.336396 18153 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.329375 15391 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
W20260709 13:03:30.363637 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 169025us
I20260709 13:03:30.337949 18049 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.341349 17931 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.333124 18174 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:30.364233 15250 rpcz_store.cc:276] 0709 13:03:28.415611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.415729 (+   118us) service_pool.cc:224] Handling call
0709 13:03:28.416050 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:28.475928 (+ 59878us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:28.515021 (+ 39093us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.779148 (+1264127us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b18003f6a60. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:03:29.965006 (+185858us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:29.966424 (+  1418us) log.cc:844] Serialized 52 byte log entry
0709 13:03:29.966620 (+   196us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:30.311735 (+345115us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.312197 (+   462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.312636 (+   439us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.312810 (+   174us) raft_consensus.cc:1685] finished
0709 13:03:30.312831 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.313044 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6359,"prepare.queue_time_us":182534,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":8524,"raft.queue_time_us":25692,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":29371,"spinlock_wait_cycles":42472832,"thread_start_us":523479,"threads_started":2,"wal-append.queue_time_us":1441311}
I20260709 13:03:30.379248 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2262) took 1313 ms. Trace:
I20260709 13:03:30.342875 17695 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.382507 15318 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:30.382117 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.342727 18217 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:30.342201 18229 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:30.379830 15397 rpcz_store.cc:276] 0709 13:03:29.065861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.067030 (+  1169us) service_pool.cc:224] Handling call
0709 13:03:29.091604 (+ 24574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.335108 (+243504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.378917 (+1043809us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54002bc0d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:30.379166 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327601536}
I20260709 13:03:30.357878 18173 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.354664 18221 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:30.383940 16031 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:03:30.390065 15291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.024s	sys 0.055s
I20260709 13:03:30.352664 18017 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.383453 15391 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:30.346184 18191 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:30.392560 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 320913us
W20260709 13:03:30.392081 15291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.024s	sys 0.055s
W20260709 13:03:30.409567 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 621354us
I20260709 13:03:30.420326 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.360909 18154 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.385073 18229 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.421073 15397 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
W20260709 13:03:30.422999 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 62023.6us
I20260709 13:03:30.372495 18220 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:03:30.424763 16031 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:30.388659 17989 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.402801 17695 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:30.374003 18153 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.406183 18206 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.458333 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:30.460355 16024 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:30.414214 18173 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.382748 18174 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.481693 18017 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:30.428158 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:30.482534 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1240) took 1072 ms. Trace:
I20260709 13:03:30.482666 16029 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:30.483747 18174 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:30.485080 18191 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:30.483027 15323 rpcz_store.cc:276] 0709 13:03:29.410553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.798918 (+388365us) service_pool.cc:224] Handling call
0709 13:03:29.799345 (+   427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:29.949344 (+149999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:29.949392 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:29.949988 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:03:30.033476 (+ 83488us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:30.118371 (+ 84895us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.122118 (+  3747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.122200 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.482292 (+360092us) raft_consensus.cc:1685] finished
0709 13:03:30.482314 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.482469 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74231,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":6792,"raft.queue_time_us":77458,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":2388,"spinlock_wait_cycles":335055104,"thread_start_us":289879,"threads_started":3,"wal-append.queue_time_us":530012}
W20260709 13:03:30.487201 18180 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.231s	user 0.013s	sys 0.000s
I20260709 13:03:30.487666 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2174) took 2272 ms. Trace:
I20260709 13:03:30.488329 18204 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:30.489650 18227 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:30.490923 18237 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:30.491827 18237 consensus_queue.cc:1243] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:30.492631 18196 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:30.488098 15319 rpcz_store.cc:276] 0709 13:03:28.215532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.418345 (+1202813us) service_pool.cc:224] Handling call
0709 13:03:29.446548 (+ 28203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.663695 (+217147us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:29.946742 (+283047us) log.cc:844] Serialized 14 byte log entry
0709 13:03:29.992696 (+ 45954us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:29.992773 (+    77us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:29.992853 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.487426 (+494573us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540021a7d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:30.487480 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.487611 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":350111,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":4788,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":524546048,"thread_start_us":307925,"threads_started":2,"wal-append.queue_time_us":157435}
I20260709 13:03:30.470629 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1197) took 1082 ms. Trace:
I20260709 13:03:30.381824 17931 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.494992 15249 rpcz_store.cc:276] 0709 13:03:29.388588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.390324 (+  1736us) service_pool.cc:224] Handling call
0709 13:03:29.406368 (+ 16044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:29.593923 (+187555us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:29.926192 (+332269us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.296767 (+370575us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.322399 (+ 25632us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.322578 (+   179us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:30.322626 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.322702 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.470363 (+147661us) raft_consensus.cc:1685] finished
0709 13:03:30.470392 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.470557 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":474246,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1650,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":19993,"thread_start_us":817484,"threads_started":3,"wal-append.queue_time_us":440926}
I20260709 13:03:30.496306 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:30.496557 15319 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:30.496781 17931 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:30.498085 18049 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:30.500092 18049 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:30.428416 18229 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.374476 18178 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:30.502420 15245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 313) took 1571 ms (client timeout 1508 ms). Trace:
I20260709 13:03:30.502898 18178 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:30.503309 15245 rpcz_store.cc:269] 0709 13:03:28.930724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.957730 (+ 27006us) service_pool.cc:224] Handling call
0709 13:03:30.502109 (+1544379us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54003976d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:30.502312 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253123456}
I20260709 13:03:30.505419 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.506132 15390 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
W20260709 13:03:30.472357 18010 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 1.060s	user 0.006s	sys 0.006s
I20260709 13:03:30.507170 18217 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.508116 18154 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:30.474442 18173 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:30.474102 17980 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.738s	user 0.008s	sys 0.002s
I20260709 13:03:30.406860 18221 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.508997 18217 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.510260 18173 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:30.511324 18221 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.511878 17964 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:30.512341 17964 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:30.513669 18223 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.408s	user 0.002s	sys 0.000s
I20260709 13:03:30.479558 18232 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.514871 18232 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.516016 18048 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.517782 18232 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:30.518648 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.479849 18175 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.519320 15397 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:30.421103 18088 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.520761 18088 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.522030 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:30.522418 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.471903 18153 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:30.523300 18088 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.523875 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1199) took 1134 ms. Trace:
I20260709 13:03:30.487723 18180 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.524241 15247 rpcz_store.cc:276] 0709 13:03:29.389236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.390029 (+   793us) service_pool.cc:224] Handling call
0709 13:03:29.390347 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.522994 (+132647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.523629 (+1000635us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540001e854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:30.523800 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303300992}
W20260709 13:03:30.524991 15242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1186) took 2061 ms (client timeout 1814 ms). Trace:
W20260709 13:03:30.525509 15242 rpcz_store.cc:269] 0709 13:03:28.463753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.463869 (+   116us) service_pool.cc:224] Handling call
0709 13:03:30.524759 (+2060890us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b540023a5d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:30.524907 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39378688}
I20260709 13:03:30.526516 18180 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.527287 15396 raft_consensus.cc:2368] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5.
I20260709 13:03:30.507851 18010 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.527992 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.513243 17964 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.528041 15244 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:30.463354 17695 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.463627 18206 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.462075 17989 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.533264 15319 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:30.531869 15393 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:30.517493 18048 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:30.542220 17989 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:30.544198 17695 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.545241 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1235) took 1904 ms. Trace:
I20260709 13:03:30.545629 15318 rpcz_store.cc:276] 0709 13:03:28.640517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.763101 (+1122584us) service_pool.cc:224] Handling call
0709 13:03:29.763441 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.383185 (+619744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.545000 (+161815us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b5400374e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:30.545184 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422597376}
I20260709 13:03:30.546736 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:30.547349 15318 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:30.535420 16024 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:30.552141 17771 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:30.529830 18197 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.002s
I20260709 13:03:30.562916 15998 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:30.423830 15291 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:30.566349 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 142607us
I20260709 13:03:30.556015 17964 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:30.572690 15391 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:30.574985 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1223) took 3358 ms. Trace:
I20260709 13:03:30.529824 18010 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:30.578871 15390 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:30.582430 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:30.580785 15322 rpcz_store.cc:276] 0709 13:03:27.216918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.130997 (+914079us) service_pool.cc:224] Handling call
0709 13:03:28.131281 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.131503 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.131528 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.022153 (+1890625us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b2c0012b498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:30.027780 (+  5627us) log.cc:844] Serialized 26 byte log entry
0709 13:03:30.295913 (+268133us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:30.322250 (+ 26337us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.478901 (+156651us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:30.574595 (+ 95694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.574698 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.574775 (+    77us) raft_consensus.cc:1685] finished
0709 13:03:30.574789 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.574928 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35921,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":2739,"raft.queue_time_us":66003,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":13148,"spinlock_wait_cycles":73640576,"thread_start_us":519826,"threads_started":2,"wal-append.queue_time_us":340610}
I20260709 13:03:30.587575 15318 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:30.533655 18154 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:03:30.560127 18226 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:30.594839 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:30.640019 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.640194 18207 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:30.581442 18232 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:30.598712 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.658562 18232 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:30.658943 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.659029 18232 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:30.659992 18173 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:30.661077 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1203) took 1267 ms. Trace:
I20260709 13:03:30.661470 15241 rpcz_store.cc:276] 0709 13:03:29.393906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.780694 (+386788us) service_pool.cc:224] Handling call
0709 13:03:29.780978 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.365372 (+584394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.660833 (+295461us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54003980d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:30.661017 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296230144}
I20260709 13:03:30.663053 17771 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:30.663851 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.665190 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.665985 15249 raft_consensus.cc:2410] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:03:30.584143 18197 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.641461 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:30.578989 18217 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:30.562659 17995 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.642031 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.578805 18088 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:30.644694 15242 raft_consensus.cc:2410] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:30.571830 18153 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:30.677677 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:30.612126 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.646345 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:30.646754 15250 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:30.679128 15245 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:30.679658 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.579838 18034 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:30.680305 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.681387 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.666563 18197 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:30.607838 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.682157 15242 raft_consensus.cc:2410] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:03:30.684057 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.679972 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:30.684877 15245 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:30.594280 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 172804us
I20260709 13:03:30.650823 17695 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:30.686626 15325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2166) took 2695 ms (client timeout 1675 ms). Trace:
W20260709 13:03:30.687047 15325 rpcz_store.cc:269] 0709 13:03:27.991210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.070477 (+ 79267us) service_pool.cc:224] Handling call
0709 13:03:30.686454 (+2615977us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400083c54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:30.686560 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336284416}
W20260709 13:03:30.651461 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 75231us
I20260709 13:03:30.688159 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:30.648142 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.688776 16024 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:30.653040 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1200) took 1260 ms. Trace:
I20260709 13:03:30.680342 15250 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:30.689983 15316 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:30.690088 15248 rpcz_store.cc:276] 0709 13:03:29.393024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.394024 (+  1000us) service_pool.cc:224] Handling call
0709 13:03:30.652826 (+1258802us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54003971d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:30.652963 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283511168}
I20260709 13:03:30.690811 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.689448 15322 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:30.641794 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.669654 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:30.672129 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:30.579107 18215 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.698937 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:30.674669 15318 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:30.675752 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:30.700248 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.674255 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.700568 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.701262 15241 raft_consensus.cc:2410] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:03:30.591596 18216 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:30.583868 18221 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:03:30.696549 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.697095 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:30.707122 15325 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:30.705267 15996 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:30.692461 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:30.683796 17989 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:30.674067 18164 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.981s	user 0.008s	sys 0.008s
I20260709 13:03:30.701445 15318 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:30.726174 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 299) took 2767 ms. Trace:
I20260709 13:03:30.726841 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.690876 17695 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:30.700920 18205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.003s	sys 0.011s
I20260709 13:03:30.697839 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:30.707124 16031 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:30.711445 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.710675 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.683820 18153 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.584015 18180 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 13:03:30.731567 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.731997 15322 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:30.732679 15318 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:30.733021 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.713461 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:30.704321 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:30.696329 18226 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.730212 15996 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:30.686908 18034 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.734138 15322 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:30.734102 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.735152 15318 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:30.735392 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.696125 18207 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:30.736433 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:30.702834 18088 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:30.702431 17984 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:03:30.712250 18216 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:30.737102 18205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.003s	sys 0.013s
I20260709 13:03:30.741411 18231 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:30.738696 18226 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:30.741348 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.742596 15322 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:30.683604 18217 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.743788 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:30.744822 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:30.739627 18197 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:30.724983 18010 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:30.744585 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:30.796695 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52276.4us
I20260709 13:03:30.690745 18054 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 13:03:30.751761 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 47565.7us
I20260709 13:03:30.751778 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.739940 18153 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:30.753085 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.799350 15325 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:30.799461 15318 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:30.742502 18034 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.741994 18237 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:30.751462 18178 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.727658 18141 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:30.743139 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:30.706159 18200 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:03:30.736433 17695 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:30.730670 18065 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:30.710855 18063 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:03:30.767373 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.832144 15322 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:30.798843 18010 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:30.793406 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:30.837010 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 43725.9us
I20260709 13:03:30.837939 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:30.757117 18229 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.727813 18245 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:30.800415 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.839231 15325 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:30.801205 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.802253 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:30.802543 15215 leader_election.cc:400] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5.
I20260709 13:03:30.841303 15215 leader_election.cc:403] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:30.841164 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.842438 15318 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:30.844022 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:30.735271 15392 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:30.804836 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.845921 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.741322 18241 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:03:30.730105 17989 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:30.829778 18163 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 2.296s	user 0.006s	sys 0.004s
I20260709 13:03:30.761262 18242 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:30.814675 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.815446 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:30.818924 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.770592 18231 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:30.823844 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:30.825371 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.826717 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:30.796284 18243 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:30.833110 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:31.059986 15322 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:30.743482 18154 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:30.802951 18072 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:30.757169 17966 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:30.803748 16031 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.806298 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:30.846884 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:30.802735 18162 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:30.851888 18088 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:30.852298 15289 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:30.875998 18206 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:31.093506 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 241275us
I20260709 13:03:30.853633 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:31.096303 15325 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:31.097402 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:30.760821 17980 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:31.099337 17980 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:30.854601 15318 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:30.814495 17863 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:30.819823 18145 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:30.829470 17978 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.830569 18045 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:30.877039 15393 raft_consensus.cc:2410] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:30.877594 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:30.851429 18010 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:31.014385 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 275906us
I20260709 13:03:30.830348 18246 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:30.752341 18207 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.850513 18245 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.819720 18178 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:30.834872 16029 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:31.064705 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 249359us
I20260709 13:03:31.136230 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.109297 18065 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:31.069464 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:31.141563 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.108623 17931 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:31.142872 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.143888 15241 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:30.879055 18248 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:31.079202 18216 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:31.090764 15322 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:31.151163 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2270) took 1311 ms. Trace:
I20260709 13:03:31.151572 15391 rpcz_store.cc:276] 0709 13:03:29.839451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.405236 (+565785us) service_pool.cc:224] Handling call
0709 13:03:30.426184 (+ 20948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.580630 (+154446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.150916 (+570286us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001554d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:31.151096 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335846656}
I20260709 13:03:31.152103 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:31.103528 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:31.098124 15325 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:31.155267 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:31.068128 18154 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.074352 17995 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:31.072589 18072 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.101999 17980 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:31.053264 18242 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.060002 18243 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.079983 17966 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:31.092903 18088 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.094398 18199 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:31.110308 17984 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.862402 18195 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:31.185763 18072 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:31.108821 18150 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:31.146250 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:31.190348 18242 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:31.160140 16024 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:31.156087 15325 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:31.220379 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:31.170840 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1231) took 3874 ms. Trace:
I20260709 13:03:31.175168 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.109710 18162 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:31.132539 18246 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:31.205824 18217 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:31.221434 18246 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:31.223126 18162 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:31.221074 15320 rpcz_store.cc:276] 0709 13:03:27.296755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.317470 (+1020715us) service_pool.cc:224] Handling call
0709 13:03:28.317812 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:28.319489 (+  1677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:28.319537 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:28.320049 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:03:28.515779 (+195730us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:28.578330 (+ 62551us) log.cc:844] Serialized 14 byte log entry
0709 13:03:28.578825 (+   495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.578906 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:30.763675 (+2184769us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:31.154130 (+390455us) raft_consensus.cc:1685] finished
0709 13:03:31.170599 (+ 16469us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:31.170755 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":62601,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":1246,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":181,"spinlock_wait_cycles":50215168,"thread_start_us":219860,"threads_started":2,"wal-append.queue_time_us":193199}
I20260709 13:03:31.132784 18245 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:31.224537 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:31.227161 15320 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:31.191486 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:31.148193 17931 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.227936 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1246) took 1293 ms. Trace:
I20260709 13:03:31.228150 17931 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:31.228438 15320 rpcz_store.cc:276] 0709 13:03:29.934755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.225973 (+1291218us) service_pool.cc:224] Handling call
0709 13:03:31.226711 (+   738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.227612 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.227880 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:31.120186 17863 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:31.195031 18243 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:31.197921 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.170213 18154 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:31.133951 18045 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:31.126397 18145 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:31.130205 17978 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:31.136546 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 334170us
I20260709 13:03:31.217542 15245 raft_consensus.cc:2376] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6. Re-sending same reply.
I20260709 13:03:31.255806 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:31.147421 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:31.234266 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:31.256542 15398 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:31.257309 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:31.256090 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:31.209636 18250 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.410s	user 0.001s	sys 0.000s
I20260709 13:03:31.149294 18237 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:31.240221 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 48905.8us
I20260709 13:03:31.240476 15325 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:31.264642 18261 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:31.265940 15325 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:31.204485 18088 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:31.237957 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:31.270975 15325 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:31.219660 18034 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:31.258976 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.274885 15245 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:31.172379 18231 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:31.255118 18195 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:31.247128 18232 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.001s
I20260709 13:03:31.277472 15325 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:31.265260 18261 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:31.215989 18252 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:03:31.251817 16024 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:31.269883 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:31.275897 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.271636 18259 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:31.288311 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.267771 18063 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:31.230544 18150 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:31.288987 15245 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:31.269373 18217 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:31.277688 15242 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
W20260709 13:03:31.289887 18257 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:03:31.290612 18262 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:31.291344 18249 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.417s	user 0.001s	sys 0.000s
I20260709 13:03:31.267431 18226 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:31.295588 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:31.271957 17989 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:31.279844 15213 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:31.279727 15398 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:31.262357 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:31.306073 16031 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:31.308341 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:31.263376 18200 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:03:31.318629 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.292609 18063 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.319308 15245 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:31.324513 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.325966 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.327666 16030 raft_consensus.cc:2368] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5.
I20260709 13:03:31.350070 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:31.351161 16031 raft_consensus.cc:2368] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6.
W20260709 13:03:31.351467 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 71705.9us
I20260709 13:03:31.352478 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:31.356122 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:31.356887 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.274923 18260 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:31.376267 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:03:31.372905 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 526119us
W20260709 13:03:31.373085 15394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 287) took 2411 ms (client timeout 1652 ms). Trace:
I20260709 13:03:31.317941 17783 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.374728 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:31.397701 16031 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 5: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:03:31.373811 15996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.001s	sys 0.009s
I20260709 13:03:31.270457 18237 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:31.382074 15394 rpcz_store.cc:269] 0709 13:03:28.961708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.961884 (+   176us) service_pool.cc:224] Handling call
0709 13:03:31.372883 (+2410999us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b54002bdc54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:31.373008 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18478848}
I20260709 13:03:31.318292 18262 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:31.356343 18063 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:31.395598 15214 leader_election.cc:400] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5.
I20260709 13:03:31.288231 18232 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:31.400410 15996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.002s	sys 0.009s
I20260709 13:03:31.357769 18221 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:31.388563 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:31.425275 15248 raft_consensus.cc:2368] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10.
I20260709 13:03:31.378291 18065 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:31.319962 18217 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:31.426450 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.428689 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.383104 18259 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:31.397308 17783 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:31.429984 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 77604us
I20260709 13:03:31.419463 18222 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.417933 18195 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:31.278574 18264 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.161s
I20260709 13:03:31.435361 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.537146 18284 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:31.537071 15248 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:31.435932 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:31.350600 18178 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:31.430882 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 687120us
I20260709 13:03:31.539812 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.446686 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:31.421015 18262 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.547199 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:31.546185 16029 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:31.431670 15214 leader_election.cc:400] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6.
I20260709 13:03:31.548090 15214 leader_election.cc:403] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 13:03:31.549357 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 113531us
I20260709 13:03:31.550477 15213 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:31.552269 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 130069us
W20260709 13:03:31.456805 18251 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 13:03:31.461411 18253 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:31.593887 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:31.512275 18256 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.230s	user 0.000s	sys 0.002s
W20260709 13:03:31.598902 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51754.3us
I20260709 13:03:31.595126 18268 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:31.595867 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45449.9us
I20260709 13:03:31.540771 18261 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:31.434598 18221 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:31.604020 15289 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:31.461807 15132 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9e997bc5c2942178cde4c670df97100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 45ddec37d9e741a598bf32f6c9d7e0ee is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:03:31.616319 15132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 193219us
I20260709 13:03:31.591419 18278 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:31.599735 18200 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:31.630489 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:31.608014 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:31.532182 17984 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5.
I20260709 13:03:31.546370 17863 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:31.455700 18259 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:31.499346 18026 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:31.433645 18017 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:31.437634 17783 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.461594 18272 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:31.460875 17931 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:31.601145 18226 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:31.458931 18065 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:31.621930 18221 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:31.625864 18265 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.627127 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1193) took 3114 ms. Trace:
I20260709 13:03:31.461072 18245 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:31.493968 18283 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.295s
I20260709 13:03:31.626024 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:31.639200 18072 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:31.483669 18246 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:31.612828 18153 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.796s	user 0.011s	sys 0.001s
I20260709 13:03:31.554978 18222 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:31.603440 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:31.679368 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.953305 15243 rpcz_store.cc:276] 0709 13:03:28.512814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.513695 (+   881us) service_pool.cc:224] Handling call
0709 13:03:28.514018 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.049421 (+535403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.626861 (+2577440us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b5400315454. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:31.627066 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1229448960}
W20260709 13:03:31.944348 15246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.023s	sys 0.090s
W20260709 13:03:31.955504 15246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.023s	sys 0.091s
I20260709 13:03:31.995039 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:32.000837 16031 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
W20260709 13:03:31.944130 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 336175us
I20260709 13:03:32.002878 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:31.999990 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 396639us
I20260709 13:03:32.005775 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:32.001003 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:31.765276 18275 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:32.010334 18237 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:31.619746 18150 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.010658 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:31.765689 18271 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.629528 18278 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:31.713583 18255 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:31.917239 17964 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.333s	user 0.009s	sys 0.005s
I20260709 13:03:32.093354 15247 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:03:31.905833 18284 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:31.992933 18248 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:32.004504 18226 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:31.849313 18242 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.000s
I20260709 13:03:31.697928 17989 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.086323 18237 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.717720 18282 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:31.920135 18251 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:03:31.718374 18088 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:32.090124 15398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.009s	sys 0.010s
I20260709 13:03:32.097831 18150 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.090991 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:32.091500 15325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.008s	sys 0.010s
I20260709 13:03:32.157653 18150 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:32.158219 15325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.009s	sys 0.010s
I20260709 13:03:32.014189 15318 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:32.008283 17863 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:31.764950 18141 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:31.718629 18048 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:30.726585 15324 rpcz_store.cc:276] 0709 13:03:27.958911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.869049 (+910138us) service_pool.cc:224] Handling call
0709 13:03:28.890592 (+ 21543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.890827 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:30.509737 (+1618910us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b1800093160. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f366d5f23c7 00007f3669c049a7 00007f3669c140bf
0709 13:03:30.509883 (+   146us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.725840 (+215957us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:30.725892 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:30.725938 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.726014 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:30.726124 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36419,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":12135,"raft.queue_time_us":95,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8742,"spinlock_wait_cycles":8789248,"thread_start_us":227409,"threads_started":2}
W20260709 13:03:32.081807 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 79020.6us
I20260709 13:03:31.728124 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:32.082665 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 74827.4us
I20260709 13:03:31.706547 18217 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:31.765892 18034 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.123469 17989 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:31.794507 18260 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:32.189347 15396 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:32.190945 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:32.101285 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:31.964993 18279 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:03:32.087805 18278 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:32.097289 18063 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.005s
I20260709 13:03:31.709698 18243 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:31.652114 18154 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:32.080528 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.097116 18184 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:31.964957 18153 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:32.131704 15398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.009s	sys 0.010s
I20260709 13:03:31.964656 18017 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:32.130934 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 504973us
I20260709 13:03:32.028934 18272 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.134918 18041 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:32.135795 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1242) took 2508 ms. Trace:
I20260709 13:03:32.136209 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1917) took 3447 ms. Trace:
I20260709 13:03:32.227573 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:32.227788 15244 rpcz_store.cc:276] 0709 13:03:28.689287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.741738 (+ 52451us) service_pool.cc:224] Handling call
0709 13:03:30.527820 (+1786082us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.532590 (+  4770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.135988 (+1603398us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540023a5d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:32.136147 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4038922624}
I20260709 13:03:32.137529 18266 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:32.113479 18226 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:32.139809 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1244) took 2420 ms. Trace:
I20260709 13:03:32.116580 18284 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:32.148087 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:32.010474 18275 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.150424 18222 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:32.152722 18088 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:32.153497 15320 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:32.088001 18234 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:03:32.156627 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1205) took 1331 ms. Trace:
I20260709 13:03:32.100225 18246 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.009779 18026 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:32.160241 17695 consensus_meta.cc:287] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.324s	user 0.009s	sys 0.005s
I20260709 13:03:32.174489 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:32.177080 18049 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.011214 18264 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:32.188429 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:31.995024 18265 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.205746 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:32.308970 15391 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:32.309753 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.192421 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:32.310442 15396 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:32.310760 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 219844us
I20260709 13:03:32.171131 18048 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:32.311986 15243 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:32.312553 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1219) took 1200 ms. Trace:
I20260709 13:03:32.169247 18072 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.181277 18196 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:03:32.175289 17984 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.215124 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:32.174955 17863 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:32.176905 18141 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.129472 18237 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.216780 15395 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:32.099076 18271 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.222838 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:32.191074 18289 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.226534 15323 rpcz_store.cc:276] 0709 13:03:29.627463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.487535 (+860072us) service_pool.cc:224] Handling call
0709 13:03:30.487933 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:30.534900 (+ 46967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.534932 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:30.583882 (+ 48950us) log.cc:844] Serialized 52 byte log entry
0709 13:03:30.851949 (+268067us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:30.861809 (+  9860us) log.cc:844] Serialized 14 byte log entry
0709 13:03:30.863369 (+  1560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.863475 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.135538 (+1272063us) raft_consensus.cc:1685] finished
0709 13:03:32.135558 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.135724 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51711,"prepare.queue_time_us":8598,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":44624,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":16614,"thread_start_us":189406,"threads_started":1,"wal-append.queue_time_us":380454}
I20260709 13:03:32.325881 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:32.119681 18242 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.236007 15319 rpcz_store.cc:276] 0709 13:03:29.719919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.497384 (+777465us) service_pool.cc:224] Handling call
0709 13:03:30.497725 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.536146 (+ 38421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.139429 (+1603283us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b5400084154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:32.139701 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80348928}
I20260709 13:03:32.096458 18255 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:32.240387 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.241804 16032 raft_consensus.cc:2368] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6.
I20260709 13:03:32.189338 17960 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:03:32.243216 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:32.244241 16033 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 426) took 1513 ms (client timeout 1832 ms). Trace:
W20260709 13:03:32.333849 16033 rpcz_store.cc:269] 0709 13:03:30.731235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.731392 (+   157us) service_pool.cc:224] Handling call
0709 13:03:32.147848 (+1416456us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:32.244167 (+ 96319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7045504}
I20260709 13:03:32.186524 18034 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.219233 18176 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:32.224793 18017 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:32.275633 15242 rpcz_store.cc:276] 0709 13:03:30.824885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.825056 (+   171us) service_pool.cc:224] Handling call
0709 13:03:32.156362 (+1331306us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54001a77d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:32.156535 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":921636736}
I20260709 13:03:32.212971 18063 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.290474 15317 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:32.238385 18078 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:32.308044 17695 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.235999 18240 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.189813 18293 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:03:32.303972 18272 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:32.242165 18282 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:32.307091 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 423) took 1602 ms. Trace:
I20260709 13:03:32.266847 18245 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.267045 17931 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:32.312914 15243 rpcz_store.cc:276] 0709 13:03:31.112620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.010406 (+897786us) service_pool.cc:224] Handling call
0709 13:03:32.312494 (+302088us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:32.282285 18266 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.366643 15245 raft_consensus.cc:2368] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9.
I20260709 13:03:32.321450 17984 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.314493 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:32.277307 18294 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.317746 15392 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:32.306156 18264 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:32.323625 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:32.342886 18078 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.311558 18041 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:32.326385 15323 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:32.385079 15397 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:32.386281 15397 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:32.386591 15397 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:32.387259 15397 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.388168 15397 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:32.390340 18292 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:03:32.340243 18048 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.391745 18048 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:32.326818 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:32.312788 18268 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:32.318907 16028 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:32.419600 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 624) took 1609 ms. Trace:
I20260709 13:03:32.420310 16028 rpcz_store.cc:276] 0709 13:03:30.809665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.233703 (+1424038us) service_pool.cc:224] Handling call
0709 13:03:32.306799 (+ 73096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.419088 (+112289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.419498 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:32.421964 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.343566 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:32.308414 18049 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.349110 15396 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:32.365757 16033 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:32.362941 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1207) took 1536 ms. Trace:
I20260709 13:03:32.314433 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:32.373126 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:32.373454 15249 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:32.337213 18176 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:32.342465 18139 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.377642 15391 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:32.442761 15319 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 3: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:32.408839 18041 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:32.402125 18078 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:32.340822 18150 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.360858 16026 rpcz_store.cc:276] 0709 13:03:30.704735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.712519 (+  7784us) service_pool.cc:224] Handling call
0709 13:03:31.231874 (+519355us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:31.232077 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.239006 (+  6929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.239040 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.241778 (+  2738us) log.cc:844] Serialized 26 byte log entry
0709 13:03:31.372609 (+130831us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:31.372651 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.372721 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.292156 (+919435us) raft_consensus.cc:1685] finished
0709 13:03:32.292176 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.307022 (+ 14846us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6523,"raft.queue_time_us":25261,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3123,"spinlock_wait_cycles":10788608,"thread_start_us":130526,"threads_started":1,"wal-append.queue_time_us":271303}
I20260709 13:03:32.382469 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:32.382872 15395 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:03:32.324414 18284 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.398509 15398 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:32.410737 18275 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:32.354437 17989 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:32.412916 15323 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:32.358577 18240 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.355829 18231 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:32.422600 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.435338 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 625) took 1625 ms. Trace:
W20260709 13:03:32.435421 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 121073us
I20260709 13:03:32.437403 15396 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:32.468705 16033 rpcz_store.cc:276] 0709 13:03:30.809904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.358418 (+1548514us) service_pool.cc:224] Handling call
0709 13:03:32.361703 (+  3285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.434993 (+ 73290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.435276 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:32.469867 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:32.470917 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:32.438488 15397 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:32.395670 18264 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:32.449445 15392 raft_consensus.cc:2410] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:03:32.339768 18289 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:32.434154 18262 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.837s	user 0.010s	sys 0.002s
I20260709 13:03:32.471664 15397 pending_rounds.cc:85] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 3
I20260709 13:03:32.483251 15397 pending_rounds.cc:107] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:32.483536 15397 raft_consensus.cc:2889] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:32.418156 18153 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.485028 15397 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 13:03:32.420334 18026 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:32.445477 18041 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.443699 18154 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.446022 18245 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:32.308156 18260 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:32.493059 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 74188.5us
I20260709 13:03:32.468164 18243 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:32.487037 18291 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.209s	user 0.001s	sys 0.001s
I20260709 13:03:32.482551 18235 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.408973 17863 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.448881 18139 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.377264 18266 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.484961 18191 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.488853 18199 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:32.408166 18278 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.490892 16028 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:32.486580 18272 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:32.396493 18294 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.450652 18268 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:32.509858 18303 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:03:32.510051 18237 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.482882 18282 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.510650 18041 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.480353 18231 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:32.502599 18297 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.183s	user 0.001s	sys 0.001s
W20260709 13:03:32.505096 18010 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 1.359s	user 0.012s	sys 0.003s
W20260709 13:03:32.517789 18295 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 13:03:32.515391 18194 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 3.066s	user 0.009s	sys 0.000s
W20260709 13:03:32.516534 18299 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:03:32.484248 18262 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.504578 18235 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.515234 18272 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:32.511693 18191 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.525308 18255 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.535085 18265 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:32.536705 18231 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.531107 18272 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:32.530802 18242 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:32.542258 18294 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.542316 18289 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.543046 18271 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.545238 18278 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:32.338197 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:32.576995 15242 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:32.438776 15246 rpcz_store.cc:276] 0709 13:03:30.826631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.827163 (+   532us) service_pool.cc:224] Handling call
0709 13:03:30.827544 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.157248 (+329704us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:31.272424 (+115176us) log.cc:844] Serialized 14 byte log entry
0709 13:03:31.956042 (+683618us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:32.002986 (+ 46944us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.003130 (+   144us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:32.003175 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.003240 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.362709 (+359469us) raft_consensus.cc:1685] finished
0709 13:03:32.362729 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.362877 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13730,"prepare.queue_time_us":207053,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":40501,"raft.run_cpu_time_us":8788,"raft.run_wall_time_us":226233,"thread_start_us":1063540,"threads_started":3,"wal-append.queue_time_us":838227}
I20260709 13:03:32.579315 15244 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 4.
I20260709 13:03:32.580107 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:32.581517 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:32.583956 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1221) took 1441 ms. Trace:
I20260709 13:03:32.584439 15243 rpcz_store.cc:276] 0709 13:03:31.142564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.580915 (+1438351us) service_pool.cc:224] Handling call
0709 13:03:32.583873 (+  2958us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:32.478685 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:32.584386 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:32.588989 15246 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:32.588789 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2188) took 1915 ms. Trace:
I20260709 13:03:32.490468 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:32.524458 18063 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.592185 15319 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:32.524621 18141 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.609375 18199 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:32.592336 16026 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:32.614485 18199 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:32.616146 18231 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:32.626518 18010 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.632048 18262 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:32.633900 18010 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:32.598078 17695 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.594926 18049 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.639503 17984 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.519876 18034 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:32.643597 18255 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:32.644778 18255 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.626485 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:32.652351 16033 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:32.653896 18271 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.665203 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:32.666553 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:32.667956 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:32.668501 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:32.670835 18191 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:32.670935 18294 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:32.590204 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 111476us
I20260709 13:03:32.670061 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:32.678687 18266 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.680986 18226 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.682437 16028 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:32.685149 16028 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:03:32.687645 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.680821 18078 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.589406 15325 rpcz_store.cc:276] 0709 13:03:30.672684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.389166 (+716482us) service_pool.cc:224] Handling call
0709 13:03:31.389432 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:31.389640 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:31.489255 (+ 99615us) log.cc:844] Serialized 14 byte log entry
0709 13:03:32.587709 (+1098454us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:32.587873 (+   164us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:32.588029 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.588175 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.588499 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20688,"prepare.queue_time_us":244823,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":150087,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":4463,"thread_start_us":1174512,"threads_started":3,"wal-append.queue_time_us":732386}
I20260709 13:03:32.691833 15363 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:32.694873 18268 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:32.696193 15245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1215) took 1623 ms (client timeout 2123 ms). Trace:
W20260709 13:03:32.696743 15245 rpcz_store.cc:269] 0709 13:03:31.072846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.325679 (+252833us) service_pool.cc:224] Handling call
0709 13:03:32.695666 (+1369987us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001397d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:32.695975 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2375399168}
I20260709 13:03:29.947079 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:32.698730 18271 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.682578 16031 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:32.712958 16031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 622) took 1914 ms. Trace:
I20260709 13:03:32.711953 15245 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:32.734815 16031 rpcz_store.cc:276] 0709 13:03:30.798991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.029075 (+1230084us) service_pool.cc:224] Handling call
0709 13:03:32.030993 (+  1918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.711205 (+680212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.712566 (+  1361us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b540066eed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:32.712836 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497162624}
W20260709 13:03:32.711733 15318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2207) took 1921 ms (client timeout 2397 ms). Trace:
I20260709 13:03:32.710067 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2185) took 3697 ms. Trace:
I20260709 13:03:32.716339 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2187) took 2043 ms. Trace:
I20260709 13:03:32.747484 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1220) took 1614 ms. Trace:
I20260709 13:03:32.748060 15245 rpcz_store.cc:276] 0709 13:03:31.125944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.697837 (+1571893us) service_pool.cc:224] Handling call
0709 13:03:32.705541 (+  7704us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.736524 (+ 30983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.736969 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:32.742367 15318 rpcz_store.cc:269] 0709 13:03:30.790267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.103171 (+312904us) service_pool.cc:224] Handling call
0709 13:03:32.711123 (+1607952us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54001c5cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:32.711507 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1977486592}
W20260709 13:03:32.716653 17783 consensus_meta.cc:287] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.713s	user 0.008s	sys 0.015s
I20260709 13:03:32.703831 18311 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:32.744081 15322 rpcz_store.cc:276] 0709 13:03:30.672395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.150888 (+478493us) service_pool.cc:224] Handling call
0709 13:03:32.715795 (+1564907us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540016dd54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:32.716138 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3050846592}
I20260709 13:03:32.742707 15316 rpcz_store.cc:276] 0709 13:03:29.012098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.786933 (+774835us) service_pool.cc:224] Handling call
0709 13:03:29.841798 (+ 54865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.690474 (+848676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.709162 (+2018688us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54000fb9d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:32.709732 (+   570us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949875072}
I20260709 13:03:32.665948 18231 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.736702 18034 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.710881 18177 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:32.759277 18235 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:32.761953 18240 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:32.763962 15399 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:32.767643 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:32.751616 18271 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:32.775346 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46650.5us
I20260709 13:03:32.779021 15319 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:32.785707 18231 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:32.786154 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 80664.9us
I20260709 13:03:32.789546 18177 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:32.784144 18034 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.796934 18034 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:32.801185 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.805055 18139 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.806732 18255 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:32.811637 18184 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.013s
I20260709 13:03:32.814805 18226 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:32.817322 18197 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.824954 18180 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:03:32.828467 18233 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 2.368s	user 0.009s	sys 0.000s
I20260709 13:03:32.757094 17783 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.855043 18180 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:32.861703 18174 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:32.862128 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.861809 18197 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:32.863159 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:32.865908 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.039s
W20260709 13:03:32.869722 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.008s	sys 0.039s
I20260709 13:03:32.869860 15322 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:32.870446 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1222) took 1719 ms. Trace:
I20260709 13:03:32.870995 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:32.871778 15322 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
W20260709 13:03:32.872819 18254 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.703s	user 0.003s	sys 0.000s
I20260709 13:03:32.870841 15245 rpcz_store.cc:276] 0709 13:03:31.151432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.771540 (+1620108us) service_pool.cc:224] Handling call
0709 13:03:32.869621 (+ 98081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.870027 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:32.870051 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:32.870111 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:32.870152 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.870211 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.870369 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:32.872887 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:32.866114 18174 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.897272 15394 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:32.879803 17783 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:32.879908 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 433) took 1254 ms. Trace:
I20260709 13:03:32.880642 15390 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:32.881884 18180 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:32.890434 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:32.892805 17978 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.894838 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1942) took 2248 ms. Trace:
I20260709 13:03:32.895996 15322 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:32.893815 18176 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.067121 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2189) took 2367 ms. Trace:
I20260709 13:03:32.898763 16026 rpcz_store.cc:276] 0709 13:03:31.625618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.448726 (+823108us) service_pool.cc:224] Handling call
0709 13:03:32.483280 (+ 34554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.622846 (+139566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.879595 (+256749us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54004740d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:32.879821 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249113472}
I20260709 13:03:32.950330 15399 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:32.975281 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 300) took 1011 ms. Trace:
I20260709 13:03:32.981308 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:32.973131 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.160668 15325 rpcz_store.cc:276] 0709 13:03:30.672972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.691966 (+2018994us) service_pool.cc:224] Handling call
0709 13:03:32.692562 (+   596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.693246 (+   684us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:32.758462 (+ 65216us) log.cc:844] Serialized 14 byte log entry
0709 13:03:32.958038 (+199576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:32.958116 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:33.039890 (+ 81774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.040000 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.040190 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3481,"prepare.queue_time_us":162847,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":3602,"raft.queue_time_us":8970,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":1513,"thread_start_us":186841,"threads_started":2}
W20260709 13:03:33.164934 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.970970 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1238) took 3607 ms. Trace:
W20260709 13:03:33.093364 18264 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.605s	user 0.002s	sys 0.015s
I20260709 13:03:33.163271 15390 rpcz_store.cc:276] 0709 13:03:31.964253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.011286 (+ 47033us) service_pool.cc:224] Handling call
0709 13:03:32.011709 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.957520 (+945811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.974845 (+ 17325us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b540034ba54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:32.975146 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997512960}
I20260709 13:03:32.971791 16025 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:33.167016 15321 rpcz_store.cc:276] 0709 13:03:29.363001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.793494 (+430493us) service_pool.cc:224] Handling call
0709 13:03:29.794714 (+  1220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:29.847431 (+ 52717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.970398 (+3122967us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54003e35d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:32.970761 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114322816}
W20260709 13:03:33.113435 18200 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.475s	user 0.019s	sys 0.004s
W20260709 13:03:32.971750 18017 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.010s
I20260709 13:03:33.173985 15395 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:32.969548 16024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 424) took 2256 ms (client timeout 1655 ms). Trace:
I20260709 13:03:33.166131 18173 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.179143 18180 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.178804 18173 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:33.184104 15397 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:33.176249 18264 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.184466 17966 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.187939 18264 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:33.188665 17966 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:33.177450 16024 rpcz_store.cc:269] 0709 13:03:30.712880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.713624 (+   744us) service_pool.cc:224] Handling call
0709 13:03:32.969100 (+2255476us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540043b2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:32.969295 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":970993536}
W20260709 13:03:33.166330 18221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.014s	sys 0.001s
W20260709 13:03:33.190886 18221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.015s	sys 0.001s
I20260709 13:03:33.191748 18232 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:33.196870 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.192111 18017 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.191764 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.193005 18207 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:32.986020 18199 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.154457 18197 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:33.174978 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 284) took 4373 ms. Trace:
I20260709 13:03:33.193185 18054 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.203500 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.200593 15395 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:33.200702 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:33.202023 15399 rpcz_store.cc:276] 0709 13:03:28.797506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.797656 (+   150us) service_pool.cc:224] Handling call
0709 13:03:28.797884 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:30.527586 (+1729702us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b1800326d00. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669c35646 00007f3669b6f58e 00007f3669bf0f9e 00007f3669bf27de 00007f3669bfcb49 00007f3669bfd416 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4
0709 13:03:32.763276 (+2235690us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b5800652dd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b560aa 00007f3669bd8447 00007f3669bf0fe7 00007f3669bf27de 00007f3669bfcb49 00007f3669bfd416 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4
0709 13:03:33.162460 (+399184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.170342 (+  7882us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128701568}
I20260709 13:03:33.201510 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1951) took 2024 ms. Trace:
I20260709 13:03:33.206781 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.154211 15250 rpcz_store.cc:276] 0709 13:03:30.645945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.691789 (+ 45844us) service_pool.cc:224] Handling call
0709 13:03:30.692176 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:30.702885 (+ 10709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:30.702919 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:30.725348 (+ 22429us) log.cc:844] Serialized 26 byte log entry
0709 13:03:31.163049 (+437701us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:31.163110 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:31.163224 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.875064 (+1711840us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18001479a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:32.884482 (+  9418us) raft_consensus.cc:1685] finished
0709 13:03:32.884512 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.894578 (+ 10066us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10197,"raft.queue_time_us":17799,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":11639,"spinlock_wait_cycles":23487360,"thread_start_us":390172,"threads_started":1,"wal-append.queue_time_us":420965}
I20260709 13:03:32.993661 18272 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.209828 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:33.213444 15246 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:33.215163 15245 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:33.216096 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:33.218322 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.219365 15390 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:33.196084 18200 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6.
I20260709 13:03:33.206972 15393 rpcz_store.cc:276] 0709 13:03:31.146687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.146839 (+   152us) service_pool.cc:224] Handling call
0709 13:03:31.147200 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:32.792175 (+1644975us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b18002e9600. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f3669bf2060 00007f3669bf2bfb 00007f3669bfd64b
0709 13:03:32.792483 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:32.792514 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:32.793262 (+   748us) log.cc:844] Serialized 26 byte log entry
0709 13:03:32.865165 (+ 71903us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:32.865225 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.868075 (+  2850us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:33.018527 (+150452us) raft_consensus.cc:1685] finished
0709 13:03:33.018547 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.170456 (+151909us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29322,"raft.queue_time_us":40018,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10435,"spinlock_wait_cycles":5947264,"thread_start_us":119598,"threads_started":2,"wal-append.queue_time_us":104073}
I20260709 13:03:33.208688 18176 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:33.225934 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:33.231427 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.232729 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.235071 15325 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:03:33.229247 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.237103 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.238613 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:33.240085 15322 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:33.244025 15318 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:33.245497 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.255775 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.256426 15318 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:33.260133 15397 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:33.263226 18265 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:33.268469 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.269954 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.263859 18265 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:33.271838 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:33.272954 16027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 420) took 2892 ms (client timeout 2942 ms). Trace:
W20260709 13:03:33.273661 16030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 627) took 2456 ms (client timeout 3221 ms). Trace:
W20260709 13:03:33.273415 16027 rpcz_store.cc:269] 0709 13:03:30.380186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.382477 (+  2291us) service_pool.cc:224] Handling call
0709 13:03:33.271516 (+2889039us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:33.272862 (+  1346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8395520}
I20260709 13:03:33.273416 18265 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:33.277423 18265 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:33.234247 18054 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:33.281512 15241 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:33.282209 18200 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:33.283057 15241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1217) took 2177 ms (client timeout 1973 ms). Trace:
W20260709 13:03:33.283463 15241 rpcz_store.cc:269] 0709 13:03:31.106049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.144829 (+ 38780us) service_pool.cc:224] Handling call
0709 13:03:33.282775 (+2137946us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b540010bb54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:33.282956 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4737642752}
I20260709 13:03:33.284214 18054 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:33.284687 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.285053 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:33.286278 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:33.287132 18264 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.287372 15291 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2213) took 2052 ms. Trace:
I20260709 13:03:33.286446 17978 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:33.287879 15291 rpcz_store.cc:276] 0709 13:03:31.235208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.287269 (+2052061us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:33.287776 18264 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:33.288720 15291 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:39714 dropped due to backpressure: service queue is full with 50 items
I20260709 13:03:33.286123 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.290584 15399 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:03:33.267093 15395 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
W20260709 13:03:33.274345 16030 rpcz_store.cc:269] 0709 13:03:30.817306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.375965 (+558659us) service_pool.cc:224] Handling call
0709 13:03:33.273282 (+1897317us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54001801d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:33.273488 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963339136}
I20260709 13:03:33.287519 18215 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:33.292910 18229 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:33.293720 15241 raft_consensus.cc:2410] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:03:33.301461 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.302870 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.304272 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:33.304678 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.306923 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.312076 18200 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:33.315786 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.280645 17966 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:03:33.314829 15245 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:33.329133 15322 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:33.331655 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.333634 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:33.336167 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 50137.8us
I20260709 13:03:33.340966 18078 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:33.345412 15241 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
W20260709 13:03:33.348031 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:33.349377 15247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1931) took 2707 ms (client timeout 1724 ms). Trace:
W20260709 13:03:33.349859 15247 rpcz_store.cc:269] 0709 13:03:30.641062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.641200 (+   138us) service_pool.cc:224] Handling call
0709 13:03:33.331120 (+2689920us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000ada54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:33.348403 (+ 17283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3279430016}
I20260709 13:03:33.351248 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.352541 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.353231 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1247) took 3233 ms. Trace:
I20260709 13:03:33.353807 15320 rpcz_store.cc:276] 0709 13:03:30.119908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.229394 (+1109486us) service_pool.cc:224] Handling call
0709 13:03:31.229730 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:32.268310 (+1038580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.352580 (+1084270us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b54001e64d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:33.353015 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2123729792}
I20260709 13:03:33.359192 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.360059 15248 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:33.359678 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 317) took 2098 ms. Trace:
I20260709 13:03:33.362648 15247 rpcz_store.cc:276] 0709 13:03:31.256860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.353539 (+2096679us) service_pool.cc:224] Handling call
0709 13:03:33.353942 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.354222 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.354587 (+   365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:33.354662 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:33.354699 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.354752 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.354870 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.347627 18017 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:33.361599 18059 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:03:33.373435 18059 consensus_queue.cc:1243] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:33.289001 15291 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:39714 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1257)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2233)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2223)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2224)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2225)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2227)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 326)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 329)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2234)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2231)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 330)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1254)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1272)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2190)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2191)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2192)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2193)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2194)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2201)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2202)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2204)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2209)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2212)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2214)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2218)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2219)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2221)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1255)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1256)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1262)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1267)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1275)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2232)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 319)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 321)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 323)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 328)
I20260709 13:03:33.363596 18272 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:33.387593 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.379988 18264 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:33.397948 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:33.398850 15392 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:33.402740 18282 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.403471 18282 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.403985 15241 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:33.405798 15241 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:33.405874 18282 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:33.406268 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 298) took 1861 ms. Trace:
I20260709 13:03:33.408898 15394 rpcz_store.cc:276] 0709 13:03:31.545158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.545339 (+   181us) service_pool.cc:224] Handling call
0709 13:03:31.605011 (+ 59672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.897716 (+1292705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.405844 (+508128us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001955d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:33.406159 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2970412800}
I20260709 13:03:33.415822 15399 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:33.415262 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:33.427836 18045 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:33.430832 18173 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:33.433435 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.441792 15243 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:33.446368 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:33.445149 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49581.6us
I20260709 13:03:33.447465 15318 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:33.450562 15320 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:33.449607 15241 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.455438 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.456146 15318 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:33.461064 15392 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:33.453028 18045 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:33.470587 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.472841 15320 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:33.474339 15325 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:33.470798 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:33.463502 15241 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:33.464457 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.469493 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:33.478456 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.482285 18145 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:33.483230 15365 connection.cc:256] RPC call timeout handler was delayed by -1.0014852960000553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2546s for a response
I20260709 13:03:33.484866 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:33.485759 15395 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:33.486392 18222 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:03:33.487042 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.488377 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.485008 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 620) took 2693 ms. Trace:
I20260709 13:03:33.492956 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.489467 16025 rpcz_store.cc:276] 0709 13:03:30.792028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.796052 (+  4024us) service_pool.cc:224] Handling call
0709 13:03:32.971275 (+2175223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.199252 (+227977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.484752 (+285500us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b540043b2d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:33.484925 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4971624832}
I20260709 13:03:33.484867 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.494724 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.495463 15325 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:33.501273 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:33.499306 18282 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:33.479470 18045 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:33.476518 18180 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:03:33.516816 15398 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:33.497630 18272 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:33.520807 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:33.521661 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:33.521797 16032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 621) took 2729 ms (client timeout 1671 ms). Trace:
I20260709 13:03:33.522936 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.523120 18199 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:33.523190 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:33.532996 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:33.534614 15395 raft_consensus.cc:2410] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:33.534790 15393 pending_rounds.cc:85] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 2
I20260709 13:03:33.525604 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:33.527010 15249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1937) took 2883 ms (client timeout 1877 ms). Trace:
W20260709 13:03:33.529708 16032 rpcz_store.cc:269] 0709 13:03:30.792440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.835187 (+ 42747us) service_pool.cc:224] Handling call
0709 13:03:33.512707 (+2677520us) spinlock_profiling.cc:243] Waited 967 ms on lock 0x7b54004759d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:33.521596 (+  8889us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2223732992}
W20260709 13:03:33.535653 15249 rpcz_store.cc:269] 0709 13:03:30.642946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.675468 (+ 32522us) service_pool.cc:224] Handling call
0709 13:03:33.526579 (+2851111us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54001a86d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:33.526802 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3841067904}
I20260709 13:03:33.536330 15245 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:33.536513 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.527813 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.537794 15245 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:33.531016 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.532218 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:33.538362 15323 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:33.538920 18174 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:33.539147 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 1947) took 1492 ms. Trace:
I20260709 13:03:33.535393 15393 pending_rounds.cc:107] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 7.3
I20260709 13:03:33.547058 15396 raft_consensus.cc:2410] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:33.540043 15321 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:33.540238 15242 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:33.550287 17978 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.543794 15320 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:33.547231 15244 rpcz_store.cc:276] 0709 13:03:32.046622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.229204 (+182582us) service_pool.cc:224] Handling call
0709 13:03:33.538963 (+1309759us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54001a81d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:33.539090 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563528448}
I20260709 13:03:33.530449 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.494061 18145 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:33.548115 15393 raft_consensus.cc:2889] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:33.553319 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1948) took 1497 ms. Trace:
I20260709 13:03:33.555696 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:33.554414 15245 rpcz_store.cc:276] 0709 13:03:32.046931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.537131 (+1490200us) service_pool.cc:224] Handling call
0709 13:03:33.537465 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.544026 (+  6561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.544170 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.560333 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.563500 16031 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:33.565807 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:33.566155 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 96789.3us
I20260709 13:03:33.565847 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.567600 15323 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:33.571413 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:33.572078 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 186792us
I20260709 13:03:33.563166 18145 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:33.573573 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2140) took 7707 ms. Trace:
I20260709 13:03:33.574009 15317 rpcz_store.cc:276] 0709 13:03:25.863965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.975512 (+2111547us) service_pool.cc:224] Handling call
0709 13:03:27.975800 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:32.340186 (+4364386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.559497 (+1219311us) spinlock_profiling.cc:243] Waited 4.31 s on lock 0x7b54004047d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:33.571041 (+ 11544us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9921893760}
I20260709 13:03:33.575256 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.575418 18145 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:33.575866 15317 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:33.565237 17966 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:03:33.577134 17966 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:33.577557 17966 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:33.569252 15318 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:33.580474 15320 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:33.582526 15321 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:33.589036 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 151402us
I20260709 13:03:33.591087 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.594478 15320 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:33.598655 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:33.609189 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.616526 15396 raft_consensus.cc:2410] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:33.619767 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:33.620955 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.622277 18180 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:33.622728 18180 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:33.623116 18180 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:33.625317 16031 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
W20260709 13:03:33.618182 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 86820.4us
W20260709 13:03:33.640374 15148 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 134) took 26847 ms (client timeout 15000 ms). Trace:
I20260709 13:03:33.641518 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.642729 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:33.644706 15248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1209) took 2817 ms (client timeout 3259 ms). Trace:
W20260709 13:03:33.659368 15248 rpcz_store.cc:269] 0709 13:03:30.827155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.593611 (+766456us) service_pool.cc:224] Handling call
0709 13:03:33.644459 (+2050848us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54003971d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:33.644636 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3774863232}
I20260709 13:03:33.645536 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 322) took 2387 ms. Trace:
I20260709 13:03:33.660270 15247 rpcz_store.cc:276] 0709 13:03:31.259366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.369373 (+2110007us) service_pool.cc:224] Handling call
0709 13:03:33.379041 (+  9668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.578518 (+199477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.578560 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:33.578618 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:33.578696 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.645250 (+ 66554us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400139cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:33.645298 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.645456 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458107648}
I20260709 13:03:33.645963 15321 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:33.663328 15322 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:33.651854 15320 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
W20260709 13:03:33.654736 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.665808 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.662563 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2217) took 1482 ms. Trace:
W20260709 13:03:33.663548 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 75499.7us
I20260709 13:03:33.672915 15317 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:03:33.673277 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.675062 15325 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:33.676437 15241 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:03:33.677009 15241 pending_rounds.cc:85] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 4
I20260709 13:03:33.671258 15319 rpcz_store.cc:276] 0709 13:03:32.173160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.667495 (+494335us) service_pool.cc:224] Handling call
0709 13:03:33.655662 (+988167us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400375354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:33.655814 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253728128}
I20260709 13:03:33.676437 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:33.677330 15241 pending_rounds.cc:107] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:03:33.680770 15241 raft_consensus.cc:2889] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:33.680871 15317 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:33.697458 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:33.698539 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55954.3us
I20260709 13:03:33.701426 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.702283 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:33.703094 15318 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:33.600489 18045 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:33.712280 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.712954 15322 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:33.712374 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1228) took 2409 ms. Trace:
I20260709 13:03:33.714442 15241 rpcz_store.cc:276] 0709 13:03:31.303117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.403353 (+2100236us) service_pool.cc:224] Handling call
0709 13:03:33.403757 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.712028 (+308271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.712297 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.718735 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.719949 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:33.720341 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.722662 15321 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:33.704002 15316 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:33.724390 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1259) took 1003 ms. Trace:
I20260709 13:03:33.724838 15316 rpcz_store.cc:276] 0709 13:03:32.720894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.641219 (+920325us) service_pool.cc:224] Handling call
0709 13:03:33.724319 (+ 83100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.727290 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:33.728845 15247 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:03:33.727483 15394 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:33.729315 15247 pending_rounds.cc:85] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 7
I20260709 13:03:33.730008 15248 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:33.735472 15247 pending_rounds.cc:107] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:03:33.737627 15247 raft_consensus.cc:2889] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:33.738595 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 144427us
I20260709 13:03:33.739529 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1229) took 2181 ms. Trace:
I20260709 13:03:33.742580 15318 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:33.735419 15325 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:33.745980 15317 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:33.751029 15319 raft_consensus.cc:2410] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:33.751782 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1226) took 2449 ms. Trace:
I20260709 13:03:33.753211 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.752203 15250 rpcz_store.cc:276] 0709 13:03:31.302528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.370209 (+2067681us) service_pool.cc:224] Handling call
0709 13:03:33.389942 (+ 19733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.407269 (+ 17327us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:33.585136 (+177867us) log.cc:844] Serialized 14 byte log entry
0709 13:03:33.749892 (+164756us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:33.749956 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:33.750012 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.751604 (+  1592us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.751725 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":182968,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":5341,"raft.queue_time_us":10343,"thread_start_us":306415,"threads_started":2}
I20260709 13:03:33.754703 15325 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:33.755460 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2194) took 3081 ms. Trace:
I20260709 13:03:33.755807 15325 rpcz_store.cc:276] 0709 13:03:30.674161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.743939 (+3069778us) service_pool.cc:224] Handling call
0709 13:03:33.754517 (+ 10578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.755185 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.755379 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.757398 15325 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:33.646014 17966 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:33.758939 15321 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:03:33.759104 17966 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:33.759461 18197 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:33.759675 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2192) took 3086 ms. Trace:
I20260709 13:03:33.759902 18197 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:33.760260 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.760099 15321 rpcz_store.cc:276] 0709 13:03:30.673701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.733385 (+3059684us) service_pool.cc:224] Handling call
0709 13:03:33.758619 (+ 25234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.759393 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.759590 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.761583 15321 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:33.763345 15996 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:33.763607 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.764436 15316 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: [6.7-9.9]
I20260709 13:03:33.760428 18197 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:33.765123 18328 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:03:33.765455 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2193) took 3091 ms. Trace:
I20260709 13:03:33.766409 18260 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:33.766857 15317 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:03:33.767038 18260 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:33.767565 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 315) took 3069 ms. Trace:
I20260709 13:03:33.764478 18014 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:33.768203 18260 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.769075 18014 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:33.764593 15318 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:33.770171 18014 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:33.772202 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2204) took 3030 ms. Trace:
I20260709 13:03:33.772569 15318 rpcz_store.cc:276] 0709 13:03:30.741974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.771219 (+3029245us) service_pool.cc:224] Handling call
0709 13:03:33.771605 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.771876 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.771900 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:33.771940 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:33.771966 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.772017 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.772123 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.767983 15317 rpcz_store.cc:276] 0709 13:03:30.698133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.747294 (+3049161us) service_pool.cc:224] Handling call
0709 13:03:33.766606 (+ 19312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.767262 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.767487 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.777729 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:33.775692 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 110655us
I20260709 13:03:33.780277 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.774559 17978 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:03:33.778623 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.776614 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:33.738420 18326 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:03:33.786528 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1254) took 1068 ms. Trace:
I20260709 13:03:33.783447 15318 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:03:33.777087 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.787029 15319 rpcz_store.cc:276] 0709 13:03:32.718735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.680011 (+961276us) service_pool.cc:224] Handling call
0709 13:03:33.786459 (+106448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.787766 15322 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:03:33.788146 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2205) took 3045 ms. Trace:
I20260709 13:03:33.764453 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:33.789207 15394 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:33.790175 15398 raft_consensus.cc:2368] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:33.790540 15318 rpcz_store.cc:276] 0709 13:03:30.742273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.773509 (+3031236us) service_pool.cc:224] Handling call
0709 13:03:33.773977 (+   468us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:33.787785 (+ 13808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.788074 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.789705 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:33.794869 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2191) took 3115 ms. Trace:
I20260709 13:03:33.795315 15322 rpcz_store.cc:276] 0709 13:03:30.673463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.722510 (+3049047us) service_pool.cc:224] Handling call
0709 13:03:33.785976 (+ 63466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.788200 (+  2224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.788352 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.796162 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:33.795539 15323 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:33.765839 15316 rpcz_store.cc:276] 0709 13:03:30.673931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.725667 (+3051736us) service_pool.cc:224] Handling call
0709 13:03:33.764157 (+ 38490us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:33.765183 (+  1026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.765406 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.762214 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2202) took 3022 ms. Trace:
I20260709 13:03:33.802623 15321 rpcz_store.cc:276] 0709 13:03:30.739840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.761005 (+3021165us) service_pool.cc:224] Handling call
0709 13:03:33.761406 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.761968 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.762165 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.758018 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2201) took 3033 ms. Trace:
I20260709 13:03:33.803721 15319 raft_consensus.cc:2368] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8.
I20260709 13:03:33.803622 15325 rpcz_store.cc:276] 0709 13:03:30.724198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.756588 (+3032390us) service_pool.cc:224] Handling call
0709 13:03:33.757006 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.757760 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.757941 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:33.809514 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45120.3us
I20260709 13:03:33.811463 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.816994 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:33.849385 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:33.748726 18222 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:33.851318 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65645.9us
I20260709 13:03:33.861471 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1210) took 2978 ms. Trace:
I20260709 13:03:33.862056 15246 rpcz_store.cc:276] 0709 13:03:30.828840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.611671 (+1782831us) service_pool.cc:224] Handling call
0709 13:03:32.612131 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.217812 (+605681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.806939 (+589127us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54004493d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:33.807180 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381258496}
I20260709 13:03:33.871860 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:33.877020 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 85062.8us
I20260709 13:03:33.878391 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.799084 18017 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:03:33.870712 18229 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:33.882094 18017 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:33.882678 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.882876 18017 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.883363 18017 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:33.883531 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1211) took 3049 ms. Trace:
I20260709 13:03:33.883699 15397 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:33.884112 15318 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:33.884725 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2221) took 1551 ms. Trace:
I20260709 13:03:33.883957 15243 rpcz_store.cc:276] 0709 13:03:30.833840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.641532 (+1807692us) service_pool.cc:224] Handling call
0709 13:03:32.720052 (+ 78520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.442309 (+722257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.883276 (+440967us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54000ad554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:33.883466 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655854848}
I20260709 13:03:33.885092 15318 rpcz_store.cc:276] 0709 13:03:32.333636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.883438 (+1549802us) service_pool.cc:224] Handling call
0709 13:03:33.883823 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.884471 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.884653 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.890642 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:33.891860 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.892628 15395 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:33.893939 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:33.894133 15999 connection.cc:256] RPC call timeout handler was delayed by -1.7990955550000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
I20260709 13:03:33.895794 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:33.896816 15999 connection.cc:256] RPC call timeout handler was delayed by -1.5902955550000115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 13:03:33.897258 15999 connection.cc:256] RPC call timeout handler was delayed by -1.4903955549999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
I20260709 13:03:33.904903 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:33.907068 18215 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:33.909150 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.740176 15249 rpcz_store.cc:276] 0709 13:03:31.553767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.536571 (+1982804us) service_pool.cc:224] Handling call
0709 13:03:33.536927 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.537193 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:33.593362 (+ 56169us) log.cc:844] Serialized 14 byte log entry
0709 13:03:33.734327 (+140965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:33.734413 (+    86us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:33.734481 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.734594 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:33.734743 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6144,"prepare.queue_time_us":90741,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":11855,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":6996,"thread_start_us":153776,"threads_started":2}
W20260709 13:03:33.911185 15999 connection.cc:256] RPC call timeout handler was delayed by -1.3895955550000281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
I20260709 13:03:33.912709 15317 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:33.907116 18014 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:33.893738 18017 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.921334 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2209) took 3122 ms. Trace:
I20260709 13:03:33.921805 15317 rpcz_store.cc:276] 0709 13:03:30.791012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.780909 (+2989897us) service_pool.cc:224] Handling call
0709 13:03:33.875340 (+ 94431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.913263 (+ 37923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.913529 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.918082 15316 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:33.924716 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2218) took 1751 ms. Trace:
I20260709 13:03:33.925269 15316 rpcz_store.cc:276] 0709 13:03:32.173407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.822863 (+1649456us) service_pool.cc:224] Handling call
0709 13:03:33.917649 (+ 94786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.924359 (+  6710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.924650 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.920843 15392 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:33.935305 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:33.940167 15317 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:33.942327 15316 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:33.943434 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1262) took 1221 ms. Trace:
I20260709 13:03:33.944132 15316 rpcz_store.cc:276] 0709 13:03:32.721989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.930883 (+1208894us) service_pool.cc:224] Handling call
0709 13:03:33.941820 (+ 10937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.943040 (+  1220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.943356 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:33.945644 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 146147us
W20260709 13:03:33.946034 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 82390.9us
I20260709 13:03:33.903704 18200 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:03:33.947499 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1261) took 1225 ms. Trace:
I20260709 13:03:33.953086 18145 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:33.953729 18145 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.931478 18174 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:33.954195 18145 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:33.959626 18174 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.965497 18174 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:33.960398 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.971436 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.957764 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:33.960789 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:33.959982 18264 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:33.972865 15245 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:33.972937 18264 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:33.973968 18264 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.975791 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:33.949776 15317 rpcz_store.cc:276] 0709 13:03:32.721648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.930182 (+1208534us) service_pool.cc:224] Handling call
0709 13:03:33.939983 (+  9801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.940754 (+   771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.947408 (+  6654us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:33.664031 15148 rpcz_store.cc:269] 0709 13:03:06.792726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.792990 (+   264us) service_pool.cc:224] Handling call
0709 13:03:08.365155 (+1572165us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b64090 00007f3669c02f3a 00007f366f9b91cc 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc 00007f366df77392 00007f3667f3548c 00007f3667f348c6
0709 13:03:33.640098 (+25274943us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:23.414043 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:23.419450 (+  5407us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:23.419505 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:03:23.419522 (+    17us) tablet.cc:662] Decoding operations
0709 13:03:23.420715 (+  1193us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:23.420802 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:23.420837 (+    35us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:03:23.422080 (+  1243us) tablet.cc:701] Row locks acquired
0709 13:03:23.422139 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:03:23.449724 (+ 27585us) write_op.cc:270] Start()
0709 13:03:23.467954 (+ 18230us) write_op.cc:276] Timestamp: P: 1783602203443725 usec, L: 0
0709 13:03:23.470278 (+  2324us) op_driver.cc:348] REPLICATION: starting
0709 13:03:23.572017 (+101739us) log.cc:844] Serialized 4392 byte log entry
0709 13:03:24.656705 (+1084688us) op_driver.cc:464] REPLICATION: finished
0709 13:03:24.899529 (+242824us) write_op.cc:301] APPLY: starting
0709 13:03:24.914369 (+ 14840us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:24.979480 (+ 65111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:24.979624 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:24.981181 (+  1557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:24.981565 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:03:24.981615 (+    50us) write_op.cc:312] APPLY: finished
0709 13:03:24.982038 (+   423us) log.cc:844] Serialized 83 byte log entry
0709 13:03:24.987244 (+  5206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:24.992936 (+  5692us) write_op.cc:454] Released schema lock
0709 13:03:25.005225 (+ 12289us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:25.081243 (+ 76018us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:25.083983 (+  2740us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10209142,"reported_tablets":21,"spinlock_wait_cycles":54616320,"child_traces":[["op",{"apply.queue_time_us":172222,"apply.run_cpu_time_us":4501,"apply.run_wall_time_us":185348,"num_ops":11,"prepare.queue_time_us":321807,"prepare.run_cpu_time_us":48664,"prepare.run_wall_time_us":336560,"raft.queue_time_us":229441,"raft.run_cpu_time_us":22242,"raft.run_wall_time_us":144777,"replication_time_us":1107636,"thread_start_us":285138,"threads_started":4,"wal-append.queue_time_us":202084,"wal-append.run_cpu_time_us":17750,"wal-append.run_wall_time_us":2218533}]]}
I20260709 13:03:34.005056 15316 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:03:34.010214 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 69082.1us
I20260709 13:03:34.006444 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1267) took 1136 ms. Trace:
I20260709 13:03:34.015200 15316 rpcz_store.cc:276] 0709 13:03:32.870456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.950423 (+1079967us) service_pool.cc:224] Handling call
0709 13:03:33.951024 (+   601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:34.006006 (+ 54982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.006363 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:34.021514 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:34.023212 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 88863.5us
I20260709 13:03:34.025080 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:34.026674 15322 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:03:34.032404 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2212) took 3239 ms. Trace:
I20260709 13:03:34.032776 15322 rpcz_store.cc:276] 0709 13:03:30.793046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.823891 (+3030845us) service_pool.cc:224] Handling call
0709 13:03:33.933651 (+109760us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.032104 (+ 98453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.032346 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:33.904488 18222 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:33.929991 18197 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:34.051864 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:34.053072 15245 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:34.052726 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:34.031813 18176 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.003s
I20260709 13:03:34.063390 15322 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:34.064538 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:34.066538 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:34.066933 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:34.073933 15247 raft_consensus.cc:2410] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:34.067735 15249 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:03:34.066577 15324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 318) took 2524 ms (client timeout 2172 ms). Trace:
I20260709 13:03:34.069046 15365 leader_election.cc:400] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9.
I20260709 13:03:34.076547 15365 leader_election.cc:403] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:34.075769 15324 rpcz_store.cc:269] 0709 13:03:31.541759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.169759 (+628000us) service_pool.cc:224] Handling call
0709 13:03:34.050363 (+1880604us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54001c57d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:34.066387 (+ 16024us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528192768}
W20260709 13:03:34.080826 18318 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.088s	user 0.004s	sys 0.009s
I20260709 13:03:34.081604 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:34.082756 15394 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:34.085496 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:34.087847 18180 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:34.090521 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:34.090920 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:34.092070 15397 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:34.093976 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:34.094977 15398 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:34.098249 18197 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:34.099392 18272 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:34.099581 15321 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:03:34.100015 18272 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:34.100567 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2219) took 1926 ms. Trace:
I20260709 13:03:34.101099 15321 rpcz_store.cc:276] 0709 13:03:32.173628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.873465 (+1699837us) service_pool.cc:224] Handling call
0709 13:03:34.098965 (+225500us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:34.099231 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.100205 (+   974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.100493 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4861312}
I20260709 13:03:34.102802 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:34.105175 15390 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:34.092092 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:34.091240 15395 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
W20260709 13:03:34.109252 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 74127.8us
I20260709 13:03:34.078337 15243 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:34.057188 18054 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:03:34.069067 18340 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:03:34.133028 18173 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:34.133798 15324 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:34.134466 18017 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:34.136812 15325 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:03:34.137712 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1256) took 1418 ms. Trace:
I20260709 13:03:34.138175 15325 rpcz_store.cc:276] 0709 13:03:32.719639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.891196 (+1171557us) service_pool.cc:224] Handling call
0709 13:03:34.136244 (+245048us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:34.136490 (+   246us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:34.137371 (+   881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.137645 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14439680}
I20260709 13:03:34.100596 18272 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:34.160197 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.187815 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1965) took 1181 ms. Trace:
I20260709 13:03:34.130286 18197 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9.
I20260709 13:03:34.198606 15317 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:34.199564 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1275) took 1318 ms. Trace:
I20260709 13:03:34.199971 15317 rpcz_store.cc:276] 0709 13:03:32.881023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.034365 (+1153342us) service_pool.cc:224] Handling call
0709 13:03:34.198053 (+163688us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:34.198359 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:34.199211 (+   852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.199489 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23520512}
I20260709 13:03:34.207237 17967 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:34.197835 17966 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:03:34.203327 18180 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:34.208958 17966 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:34.209467 17966 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:34.209967 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 319) took 1038 ms. Trace:
I20260709 13:03:34.210525 15321 rpcz_store.cc:276] 0709 13:03:33.171582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.115014 (+943432us) service_pool.cc:224] Handling call
0709 13:03:34.163547 (+ 48533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:34.209502 (+ 45955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.209537 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:34.209606 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:34.209660 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.209730 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.209884 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:34.211323 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 1956) took 1397 ms. Trace:
W20260709 13:03:34.218962 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 150129us
I20260709 13:03:34.211776 15244 rpcz_store.cc:276] 0709 13:03:32.813759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.561415 (+747656us) service_pool.cc:224] Handling call
0709 13:03:33.571301 (+  9886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.619739 (+ 48438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.619789 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.654598 (+ 34809us) log.cc:844] Serialized 26 byte log entry
0709 13:03:33.928507 (+273909us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:33.928556 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:33.928618 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.211105 (+282487us) raft_consensus.cc:1685] finished
0709 13:03:34.211124 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.211263 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5630,"raft.queue_time_us":11723,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":2836,"thread_start_us":206264,"threads_started":1,"wal-append.queue_time_us":500707}
I20260709 13:03:34.190902 18229 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:34.217521 18014 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:34.222494 17966 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:34.223694 18347 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.269s	user 0.001s	sys 0.003s
I20260709 13:03:34.224062 17966 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.222985 18014 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:34.231629 18222 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:34.203197 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:34.236505 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 165242us
W20260709 13:03:34.239658 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 148881us
W20260709 13:03:34.243515 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.240694 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:34.253773 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 436878us
I20260709 13:03:34.229946 18017 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
W20260709 13:03:34.265480 18337 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.306s	user 0.001s	sys 0.001s
I20260709 13:03:34.233161 18174 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:34.254608 18059 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:34.282586 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 215784us
W20260709 13:03:34.281673 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 251329us
I20260709 13:03:34.321864 15392 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:34.322705 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:34.320773 16027 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:03:34.330422 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 234185us
I20260709 13:03:34.293021 17978 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:34.333994 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:34.321044 18173 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:34.288054 18145 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:34.330868 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.027s
W20260709 13:03:34.347622 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.000s	sys 0.027s
W20260709 13:03:34.348474 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 567965us
I20260709 13:03:34.350452 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:34.190330 15242 rpcz_store.cc:276] 0709 13:03:32.972250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.578760 (+606510us) service_pool.cc:224] Handling call
0709 13:03:33.579107 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:33.579448 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:33.790712 (+211264us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.153170 (+362458us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:34.153246 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:34.153317 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.153414 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.153591 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85337,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":371,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":19377,"thread_start_us":460181,"threads_started":2}
I20260709 13:03:34.336956 17978 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:34.380764 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 237032us
I20260709 13:03:34.381690 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:34.343596 18173 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:34.382846 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58747.3us
I20260709 13:03:34.340098 18260 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:34.349149 18176 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:34.406067 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 62217.6us
I20260709 13:03:34.346463 18349 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.340469 18054 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:34.417659 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:34.422304 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:34.424402 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 93661.4us
I20260709 13:03:34.387270 18173 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:34.432673 18354 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:34.446621 18354 consensus_queue.cc:1243] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:34.424001 17967 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:34.450659 17967 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.451057 17967 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:34.454704 15999 leader_election.cc:400] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10.
I20260709 13:03:34.457132 15999 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:34.433221 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:34.433614 18145 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:34.435004 18357 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:34.435534 18361 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:34.436836 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66600.5us
I20260709 13:03:34.471895 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:34.437230 18265 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.437373 18176 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:34.453658 18272 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:34.437740 18364 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:34.438277 17863 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 13:03:34.438829 18367 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:34.439299 18054 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:34.440724 18174 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:34.441851 18355 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:03:34.385334 18045 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:34.419675 18360 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:34.449151 15147 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 4 to 5, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 5 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.340627 18229 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:34.478775 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 63352.5us
I20260709 13:03:34.909621 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:34.910656 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:34.911903 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:34.386560 18220 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 13:03:34.499917 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:34.913149 16032 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:34.914206 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:34.914939 16032 raft_consensus.cc:2368] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6.
I20260709 13:03:34.915712 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:34.916785 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:34.917490 16032 raft_consensus.cc:2368] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5.
I20260709 13:03:34.474912 18176 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:34.918489 18176 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.507272 18354 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:34.472400 18349 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:34.496189 18265 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:34.924463 18265 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:34.526115 18367 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:34.924854 16028 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:34.925665 18367 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:34.610807 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 142262us
I20260709 13:03:34.619869 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:34.932017 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:34.932569 18354 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:34.933293 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:34.933197 18354 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:34.934016 16033 raft_consensus.cc:2368] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:34.522248 18145 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:03:34.934883 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:34.614143 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:34.935853 16025 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:34.936118 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:34.936561 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:34.622700 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:34.924463 18349 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:34.938347 16030 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:34.938795 18370 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:34.939242 18370 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:34.939581 18370 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:34.939610 16030 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:34.940908 16030 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:34.474067 17978 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:34.942189 16030 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:34.602123 18360 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:34.943377 18360 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:34.944734 16030 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:34.945492 15147 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 3 to 4, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 4 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.612353 18363 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:34.946635 18220 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:34.946939 18363 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:34.947135 18220 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:34.947448 18363 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:34.947635 18220 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:34.650482 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 65039.2us
I20260709 13:03:34.638548 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:34.606256 18045 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:34.649655 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:34.952579 16024 raft_consensus.cc:2368] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:34.953735 18045 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:34.635996 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:34.954059 18394 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:34.664508 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:34.694510 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 120958us
W20260709 13:03:34.665714 18284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.030s	sys 0.033s
I20260709 13:03:34.712678 18272 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:34.955670 18265 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:34.713217 18371 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:34.956096 15998 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:34.956581 18371 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:34.956993 18349 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:34.958055 18349 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:34.958453 18349 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.958796 18349 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.959431 18371 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:34.716878 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:34.730646 18359 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:03:34.960521 18229 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:34.960968 18229 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:34.955672 18284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.030s	sys 0.034s
W20260709 13:03:34.742530 18353 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:03:34.956058 18272 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:03:34.962074 18229 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:34.747224 18373 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:03:34.756532 18173 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:34.965858 18173 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:34.956115 18265 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:34.966614 18173 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:34.967126 18265 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:34.747174 17967 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:34.968580 18265 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:34.969600 15323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.013s	sys 0.010s
W20260709 13:03:34.969987 15323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.013s	sys 0.010s
I20260709 13:03:34.970274 17967 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:34.766657 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.970836 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2214) took 3735 ms. Trace:
W20260709 13:03:34.971789 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.744184 18260 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:34.784622 18264 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:34.973034 18260 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:34.801577 15291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.009s	sys 0.017s
W20260709 13:03:34.976050 15291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.010s	sys 0.018s
W20260709 13:03:34.976495 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 720285us
I20260709 13:03:34.826633 18014 raft_consensus.cc:3055] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:34.977537 18014 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:34.978591 18014 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:34.979673 18014 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.980479 18349 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:34.838418 18344 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.503s	user 0.000s	sys 0.004s
W20260709 13:03:34.853505 18366 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.239s	user 0.000s	sys 0.002s
I20260709 13:03:34.984688 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2190) took 4311 ms. Trace:
I20260709 13:03:34.985091 15320 rpcz_store.cc:276] 0709 13:03:30.673222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.713420 (+3040198us) service_pool.cc:224] Handling call
0709 13:03:33.735409 (+ 21989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.750324 (+ 14915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.750369 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.754700 (+  4331us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.146559 (+391859us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:34.428561 (+282002us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.460138 (+ 31577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.460348 (+   210us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.837697 (+377349us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:34.984368 (+146671us) raft_consensus.cc:1685] finished
0709 13:03:34.984470 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.984628 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31238,"prepare.queue_time_us":467097,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":184552,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":49630,"spinlock_wait_cycles":22378752,"thread_start_us":622400,"threads_started":2,"wal-append.queue_time_us":524652}
I20260709 13:03:34.986668 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2317) took 1504 ms. Trace:
I20260709 13:03:34.987869 18367 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:34.987118 15399 rpcz_store.cc:276] 0709 13:03:33.482768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.128606 (+645838us) service_pool.cc:224] Handling call
0709 13:03:34.129061 (+   455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.135016 (+  5955us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:34.135049 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.135571 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.334138 (+198567us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:34.334182 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.334284 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.852655 (+518371us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:34.986328 (+133673us) raft_consensus.cc:1685] finished
0709 13:03:34.986351 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.986597 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1778,"raft.queue_time_us":3050,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":31928,"spinlock_wait_cycles":4308352,"thread_start_us":198132,"threads_started":1,"wal-append.queue_time_us":360269}
I20260709 13:03:34.989481 18282 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:34.991042 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:34.993021 18393 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:34.993927 18393 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:34.995101 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:34.996094 15246 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:34.996250 18393 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:34.997339 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:34.999428 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:35.001792 15243 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:03:34.993041 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:35.005733 18392 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:35.007027 18364 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:35.007418 18364 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:35.008823 18364 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:35.012794 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:34.991154 15290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.010s	sys 0.023s
I20260709 13:03:34.876459 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 324) took 1611 ms. Trace:
I20260709 13:03:35.014487 15322 rpcz_store.cc:276] 0709 13:03:33.264855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.128397 (+863542us) service_pool.cc:224] Handling call
0709 13:03:34.192674 (+ 64277us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:34.510578 (+317904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.510629 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:34.857589 (+346960us) log.cc:844] Serialized 52 byte log entry
0709 13:03:34.876013 (+ 18424us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:34.876061 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.876146 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.876203 (+    57us) raft_consensus.cc:1685] finished
0709 13:03:34.876214 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.876366 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":201620,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":153,"thread_start_us":289555,"threads_started":2,"wal-append.queue_time_us":13357}
W20260709 13:03:34.885916 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.892093 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 322) took 1673 ms. Trace:
W20260709 13:03:35.014087 15290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.010s	sys 0.023s
W20260709 13:03:34.901513 15318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.015s	sys 0.006s
I20260709 13:03:34.928707 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:03:35.017179 15318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.015s	sys 0.006s
I20260709 13:03:34.935351 15289 leader_election.cc:400] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:35.017519 15289 leader_election.cc:403] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:35.017656 15242 raft_consensus.cc:2368] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
W20260709 13:03:35.018113 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 83016us
I20260709 13:03:35.019166 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:34.936838 16033 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:34.946305 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:34.938552 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:34.954664 18394 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:34.506969 18357 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:34.609369 18174 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.955191 17863 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:34.736654 17966 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.004s
I20260709 13:03:34.688278 18351 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.231s
I20260709 13:03:34.963656 18229 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:34.886978 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 468013us
I20260709 13:03:35.024926 18054 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:35.025054 18367 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:35.020222 16032 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
W20260709 13:03:35.016987 15214 leader_election.cc:336] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Timed out: RequestConsensusVote RPC to 127.13.206.196:38543 timed out after 1.671s (SENT)
I20260709 13:03:35.016160 15319 rpcz_store.cc:276] 0709 13:03:33.218409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.129803 (+911394us) service_pool.cc:224] Handling call
0709 13:03:34.145405 (+ 15602us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:34.383959 (+238554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.384006 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:34.476608 (+ 92602us) log.cc:844] Serialized 52 byte log entry
0709 13:03:34.890698 (+414090us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:34.891082 (+   384us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.891473 (+   391us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.891679 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.891764 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.891829 (+    65us) raft_consensus.cc:1685] finished
0709 13:03:34.891844 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.892021 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1802,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":263691,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":225,"thread_start_us":575166,"threads_started":2,"wal-append.queue_time_us":226760}
I20260709 13:03:34.971264 15323 rpcz_store.cc:276] 0709 13:03:31.235506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.813493 (+2577987us) service_pool.cc:224] Handling call
0709 13:03:34.118580 (+305087us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:34.118851 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.296923 (+178072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.296961 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.297494 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.970360 (+672866us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:34.970400 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.970468 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:34.970521 (+    53us) raft_consensus.cc:1685] finished
0709 13:03:34.970532 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:34.970760 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":302085,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"spinlock_wait_cycles":20803968,"thread_start_us":817615,"threads_started":2,"wal-append.queue_time_us":396361}
I20260709 13:03:35.034691 16025 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:03:35.037876 15391 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:35.037876 15392 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:35.010152 18364 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:35.043454 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.007s	sys 0.021s
W20260709 13:03:35.060144 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.007s	sys 0.022s
W20260709 13:03:35.060617 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 669284us
I20260709 13:03:35.061153 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:35.064002 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:35.064749 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:35.064766 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 126286us
I20260709 13:03:35.060173 15399 pending_rounds.cc:85] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 4
I20260709 13:03:35.068694 15399 pending_rounds.cc:107] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:03:35.068967 15399 raft_consensus.cc:2889] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:35.047940 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 96806.3us
I20260709 13:03:35.038983 18394 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:35.042863 18222 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.059697 18351 consensus_queue.cc:1243] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:35.040633 17863 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:35.044727 15147 catalog_manager.cc:5697] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:35.054425 18176 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.054781 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:35.041206 18272 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:35.052934 18174 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:35.096236 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 57201.4us
I20260709 13:03:35.097471 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:35.100179 15291 leader_election.cc:400] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:35.100577 15291 leader_election.cc:403] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:03:35.063673 18371 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:03:35.063526 18282 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:03:35.085587 18413 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:35.086583 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:35.104943 18346 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:35.108947 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54261.7us
I20260709 13:03:35.109972 15213 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:35.076854 17967 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:35.116051 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:35.118608 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 132388us
W20260709 13:03:35.119666 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.120136 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.083387 17863 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:35.132682 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 107194us
I20260709 13:03:35.133823 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:03:35.127825 18405 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:03:35.119402 18284 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:35.138002 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:35.125046 18371 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:35.106086 18346 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:03:35.082304 18410 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:03:35.138861 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:35.128180 18272 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:35.160010 15147 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 3 to 6, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 6 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.164876 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1255) took 2445 ms. Trace:
I20260709 13:03:35.168810 15147 catalog_manager.cc:5697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 2 to 4, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 4 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.165514 15318 rpcz_store.cc:276] 0709 13:03:32.719251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.886003 (+1166752us) service_pool.cc:224] Handling call
0709 13:03:33.898576 (+ 12573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.927398 (+ 28822us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:34.296466 (+369068us) log.cc:844] Serialized 14 byte log entry
0709 13:03:35.017591 (+721125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:35.018129 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.018315 (+   186us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:35.018347 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.018412 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.164584 (+146172us) raft_consensus.cc:1685] finished
0709 13:03:35.164612 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.164816 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29864,"prepare.queue_time_us":540773,"prepare.run_cpu_time_us":7245,"prepare.run_wall_time_us":19928,"raft.queue_time_us":11969,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":10204,"thread_start_us":1064507,"threads_started":2,"wal-append.queue_time_us":360850}
I20260709 13:03:35.129065 18222 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.149287 18360 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:35.175081 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 59114us
I20260709 13:03:35.150391 18284 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:35.174583 15147 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 3 to 4, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 4 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.178424 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:35.193539 18354 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:35.194537 18386 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:35.195101 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:35.198501 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 98519.7us
I20260709 13:03:35.198779 15317 raft_consensus.cc:2376] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7. Re-sending same reply.
I20260709 13:03:35.195393 18406 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:03:35.199499 18176 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:35.199887 18406 consensus_queue.cc:1243] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:03:35.195463 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 75261.3us
I20260709 13:03:35.200366 18360 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:35.197728 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:35.200773 18360 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:35.200767 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:35.208206 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:35.209787 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 73896.2us
I20260709 13:03:35.175716 18388 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:35.219964 18358 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:35.220283 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:35.220654 18358 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:35.221637 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:35.221760 18386 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:35.222308 15247 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:35.222481 18406 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:35.222828 18386 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:35.225734 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.201773 18360 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.226208 15147 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 3, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:35.227065 18360 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:35.228551 15147 catalog_manager.cc:5697] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 2 to 3, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:35.230278 18173 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:35.176913 17967 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:03:35.231452 18349 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:35.213450 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:35.233381 15242 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:35.233747 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:35.207024 18272 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:35.234609 15246 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.238068 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:35.238782 15249 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.239374 18222 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:35.180495 18370 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.242700 18370 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:35.243495 17978 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:35.243774 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:35.244621 16031 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:35.219120 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:35.173852 18045 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:03:35.210640 18200 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.220014 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:35.247400 18045 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:35.248085 18045 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:35.226897 18176 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:35.248164 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:35.248492 18045 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:35.247155 18200 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.249424 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:35.250803 18384 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:35.168748 18059 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:03:35.252751 18145 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:35.252929 18222 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.253551 18145 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:35.255280 18200 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:35.255038 18145 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.253682 18222 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.196274 18264 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:35.256655 18264 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:35.257992 18222 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:35.255632 18220 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:35.259001 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:35.259678 15392 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:35.260250 18220 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:35.260462 15395 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:35.181878 18284 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:35.262956 18017 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:35.263435 16025 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:35.263562 18017 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.252449 18357 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:35.221661 18358 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.263428 15147 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 3, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.260802 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:35.215166 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:35.270359 15241 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:35.270542 16029 raft_consensus.cc:2410] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:35.252018 15250 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:35.245934 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:35.250980 18174 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:35.248842 18176 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:35.257642 18264 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:35.253587 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:35.274257 15244 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:35.280541 15246 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:35.276142 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:35.290472 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 44594.8us
I20260709 13:03:35.282541 15147 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 3, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:35.289065 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:35.253036 18059 consensus_queue.cc:1243] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:35.301380 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:35.303323 15390 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 3.
I20260709 13:03:35.304615 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:35.251447 18384 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:35.249502 18045 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:35.318323 18384 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.279991 18176 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:35.287704 17978 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:35.307508 18174 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:35.320355 17863 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.323650 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:35.326159 15247 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:35.311558 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:35.327507 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 78155.6us
I20260709 13:03:35.345733 15249 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:35.289490 17967 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:35.346982 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:35.328625 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:35.350353 15365 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:35.347944 15241 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:35.353590 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:35.356526 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:35.354646 18272 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:03:35.364897 17863 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:35.367280 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:35.345734 18346 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.368525 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:35.346323 18174 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:35.354789 18220 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:35.395248 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:35.344108 17966 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:03:35.395499 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 314190us
W20260709 13:03:35.387874 15999 leader_election.cc:336] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.508s (SENT)
I20260709 13:03:35.356105 18370 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:35.399777 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 266248us
W20260709 13:03:35.402370 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55465.5us
I20260709 13:03:35.365610 18173 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:35.394914 18174 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:35.368352 18357 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.369282 17978 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:35.369552 18017 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:35.353157 18059 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:03:35.398214 18220 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:35.411675 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 354392us
I20260709 13:03:35.356211 18222 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:03:35.399405 17967 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:35.406495 17863 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:35.437922 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:35.440723 15398 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:35.441642 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.413148 18370 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:35.443308 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:35.446653 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.395675 18346 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:35.455920 15392 pending_rounds.cc:85] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 6
I20260709 13:03:35.458992 15392 pending_rounds.cc:107] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:03:35.459522 15392 raft_consensus.cc:2889] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:35.437141 18220 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:35.437271 18173 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:35.464001 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 76168.8us
I20260709 13:03:35.425586 18357 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.475069 18173 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.475629 18284 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.480363 18394 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.435015 18363 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.465814 17863 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:35.406502 18176 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:35.464793 15999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.561s (SENT) [suppressed 28 similar messages]
I20260709 13:03:35.491966 15398 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:35.455940 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:35.458707 18260 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:35.501382 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.502121 18059 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:35.463371 17967 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:35.523188 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.478133 18284 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:35.528148 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:35.495695 18357 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:35.487582 17978 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:03:35.531002 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 118164us
W20260709 13:03:35.524384 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 59531.7us
I20260709 13:03:35.534035 15244 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:35.536262 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54131.2us
I20260709 13:03:35.547508 15213 leader_election.cc:400] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8.
I20260709 13:03:35.547889 15213 leader_election.cc:403] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:35.548550 15999 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.609s (SENT)
I20260709 13:03:35.529551 18176 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:35.552752 15245 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:35.555028 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 99168.7us
I20260709 13:03:35.529583 18260 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:35.555393 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.555353 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:35.555649 15999 leader_election.cc:336] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.652s (SENT)
I20260709 13:03:35.538344 18393 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:35.561002 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:35.503203 17863 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:35.560791 15996 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:35.565315 17967 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.555346 18370 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.062006 18176 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:36.062813 18176 consensus_queue.cc:1243] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:35.562646 18394 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:35.571278 18260 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:35.580566 18419 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:35.628644 18384 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:36.068395 18384 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:35.675846 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 121421us
I20260709 13:03:36.070341 18260 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:35.768760 15316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.327s	user 0.030s	sys 0.016s
W20260709 13:03:36.072047 15316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.630s	user 0.030s	sys 0.017s
I20260709 13:03:36.073503 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:35.783269 15321 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:36.075090 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 333) took 1044 ms. Trace:
I20260709 13:03:36.075521 15321 rpcz_store.cc:276] 0709 13:03:35.030521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.782485 (+751964us) service_pool.cc:224] Handling call
0709 13:03:35.782883 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.074773 (+291890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.075025 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:35.784992 18045 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:35.793146 18433 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.179s	user 0.002s	sys 0.000s
I20260709 13:03:35.811964 18386 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:35.811945 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 256647us
I20260709 13:03:36.085278 18145 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:35.579957 18358 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:36.087071 18145 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:35.846176 18371 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.000s
I20260709 13:03:36.090611 18371 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:35.863147 18174 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.093745 18174 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:35.875305 18424 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:36.096511 18424 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:36.097477 18424 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.898478 18054 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.098753 18054 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.101135 18054 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:35.577760 18265 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.333s
I20260709 13:03:36.102061 18265 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:36.102460 18265 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:36.103289 18265 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.104430 18265 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:36.105371 15145 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 4, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 4 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.106971 18424 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:35.922127 18440 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
I20260709 13:03:36.113704 15248 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:36.119880 18054 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:36.120771 16028 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:36.120589 18054 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:35.931630 18200 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:36.123430 18054 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:36.123587 18200 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:36.124593 18200 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:36.125806 18200 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:35.935735 18350 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.414s	user 0.002s	sys 0.003s
W20260709 13:03:35.939046 18427 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.354s	user 0.002s	sys 0.000s
W20260709 13:03:35.939046 18431 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.354s	user 0.002s	sys 0.000s
W20260709 13:03:35.944188 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 388210us
I20260709 13:03:36.129369 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 309) took 1104 ms. Trace:
I20260709 13:03:36.129751 15399 rpcz_store.cc:276] 0709 13:03:35.025207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.040081 (+ 14874us) service_pool.cc:224] Handling call
0709 13:03:35.059977 (+ 19896us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:35.283618 (+223641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.283667 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:35.287659 (+  3992us) log.cc:844] Serialized 52 byte log entry
0709 13:03:35.438038 (+150379us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:35.438090 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.438575 (+   485us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.938392 (+499817us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:36.129047 (+190655us) raft_consensus.cc:1685] finished
0709 13:03:36.129074 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.129308 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":890,"raft.queue_time_us":24712,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":20316,"spinlock_wait_cycles":14165376,"thread_start_us":291858,"threads_started":2,"wal-append.queue_time_us":206046}
W20260709 13:03:35.949892 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.134764 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48630.1us
W20260709 13:03:36.135108 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.928323 18346 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:35.980825 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.136140 15320 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.980176 15323 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:36.138211 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:36.138888 15323 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:36.138398 18145 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:36.139814 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.140293 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:36.140931 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.141487 15323 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.982659 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:36.142652 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1276) took 1126 ms. Trace:
I20260709 13:03:36.142966 15322 rpcz_store.cc:276] 0709 13:03:35.016753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.982329 (+965576us) service_pool.cc:224] Handling call
0709 13:03:36.142597 (+160268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:36.143939 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.144440 15322 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:35.983668 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.145310 15317 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:35.986979 15324 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:35.988281 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:36.146574 15319 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:36.147485 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.147992 15319 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:35.989378 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:36.149243 15318 raft_consensus.cc:2410] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:03:36.150063 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.150594 15318 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:35.994280 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.151443 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:36.153023 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:36.153434 15998 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:36.153725 15395 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:36.008389 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.014073 18272 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:36.205039 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:36.205477 18272 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.032344 18363 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:36.019049 18445 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.378s	user 0.002s	sys 0.002s
I20260709 13:03:36.036551 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:36.045480 18365 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.432s	user 0.005s	sys 0.007s
W20260709 13:03:36.207442 18365 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.594s	user 0.005s	sys 0.008s
I20260709 13:03:36.046295 18220 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.046291 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.207631 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:36.207556 15399 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:36.208539 15398 raft_consensus.cc:2410] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:03:36.049634 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 488985us
I20260709 13:03:36.202160 16028 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:36.213528 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.050206 18014 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:36.050724 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.215340 18220 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:36.221660 15396 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:36.223038 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:36.223675 15396 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:36.060204 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.059944 18437 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:36.227275 18358 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8.
I20260709 13:03:36.228041 18437 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:36.064605 18414 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:36.230480 18414 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:36.231356 18414 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.232583 18414 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:36.241477 18437 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:36.247761 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 112247us
I20260709 13:03:36.248397 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.250962 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.251595 15245 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:36.253052 15241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:03:36.253911 15241 raft_consensus.cc:606] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:36.254906 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.255616 15250 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:36.255957 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.256870 15241 raft_consensus.cc:2410] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:36.257896 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.258740 15244 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:36.260109 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.262517 17967 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:36.263343 17967 consensus_queue.cc:1243] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:36.263815 17967 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.264247 17967 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.266404 18145 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:36.266851 18145 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:36.267665 18145 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:36.268127 15320 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:36.269050 18145 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:36.269348 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.263363 18272 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:36.109781 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.164928 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:36.271293 15324 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 3.
I20260709 13:03:36.271507 15244 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:36.271790 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:36.272188 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.272754 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.273001 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.273164 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.273660 15324 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:36.274344 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:36.010895 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.195811 18421 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:36.275081 17967 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:36.275259 15250 raft_consensus.cc:2410] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:36.276787 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.277412 15320 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:36.278417 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.201324 15391 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:36.198494 15393 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:36.283239 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:36.283564 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:36.283937 15391 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:36.201756 18419 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:36.202667 18410 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.285444 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:36.205916 15392 raft_consensus.cc:2410] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:03:36.035323 15246 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:36.204025 15395 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:36.287114 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.287740 15246 raft_consensus.cc:2376] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8. Re-sending same reply.
I20260709 13:03:36.287896 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:36.288650 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.289141 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:36.289691 15395 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:36.277933 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.290859 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:36.290997 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.279345 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.292157 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.292757 15249 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:36.293052 15247 raft_consensus.cc:2410] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:36.294744 15247 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:36.296578 15394 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:36.155380 18422 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:36.285328 18410 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:36.299885 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.300786 18410 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:36.227494 15363 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:36.303138 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 75752.4us
I20260709 13:03:36.293956 15249 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:36.289811 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.298050 15394 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:36.310098 18363 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:36.276818 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.312597 15394 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:36.314394 15394 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:36.315716 15394 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:36.317886 15394 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:36.270401 15241 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:36.348572 15243 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:36.352396 15241 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:36.362799 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:36.363724 15248 raft_consensus.cc:2368] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8.
I20260709 13:03:36.366670 15391 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:36.368076 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:36.368470 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:36.369400 15391 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:36.370559 15392 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:36.372980 15245 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:36.380829 18054 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:36.107952 15145 catalog_manager.cc:5697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:36.385345 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.385972 15399 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:36.386592 18358 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:36.426560 15243 raft_consensus.cc:2368] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6.
W20260709 13:03:36.428335 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.428733 15396 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
W20260709 13:03:36.430667 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.386680 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.442812 15323 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:36.444213 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:36.445796 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:36.447320 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:36.386658 15319 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:03:36.387756 15317 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:36.450459 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:36.388796 15318 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:36.452842 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.453155 15250 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:03:36.453796 15318 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:36.389665 15322 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:36.393342 17967 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:36.394491 18386 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:36.397214 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 383645us
I20260709 13:03:36.399071 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:36.399490 18260 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:36.401403 17978 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:36.402882 18059 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:36.403412 18200 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:36.493407 18458 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:36.494040 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:36.411684 15391 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:36.494606 18458 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:36.413455 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:36.495150 18458 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:36.470106 15320 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
W20260709 13:03:36.495761 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 82430.4us
I20260709 13:03:36.404068 18384 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.497056 15320 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:36.475488 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:36.479269 15324 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:36.481529 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.499243 15325 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:36.418577 18346 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:03:36.491659 18260 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:36.492348 17978 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:36.493844 18059 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:36.494724 18054 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.495309 18264 raft_consensus.cc:993] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:03:36.477048 15321 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:36.477924 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:36.591069 15319 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:36.478655 15395 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:36.485538 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:36.426529 18358 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:36.502765 15324 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:36.480314 18017 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:03:36.503139 15322 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
W20260709 13:03:36.544782 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 266037us
I20260709 13:03:36.483357 18272 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.538580 18197 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:36.549589 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 55612.6us
I20260709 13:03:36.497457 18428 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:36.482743 18363 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.490367 18045 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:36.559127 17966 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:36.562397 18435 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:36.494971 18200 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:36.498652 18414 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.571077 15244 raft_consensus.cc:2410] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:36.573732 18475 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:36.577097 18014 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:36.579326 18421 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.501863 18384 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:36.640604 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.628690 15319 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:36.579880 15318 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:36.502025 17967 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.594218 15324 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:36.490818 15290 connection.cc:256] RPC call timeout handler was delayed by -1.8404099990000304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
I20260709 13:03:36.502000 18361 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:36.538992 18174 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:36.547672 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.542902 18360 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:36.603096 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.543076 18260 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:36.546684 17978 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:36.594571 18358 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:36.601603 18145 raft_consensus.cc:1081] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
W20260709 13:03:36.703192 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 217728us
I20260709 13:03:36.613015 18428 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.612563 18355 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:03:36.602066 18054 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:36.874504 15290 connection.cc:256] RPC call timeout handler was delayed by -1.8080099989999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 13:03:36.830514 16031 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:03:36.876197 15290 connection.cc:256] RPC call timeout handler was delayed by -1.7963099989999591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
W20260709 13:03:36.876722 15290 connection.cc:256] RPC call timeout handler was delayed by -1.6235099990000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
I20260709 13:03:36.877272 15318 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:36.877363 15290 connection.cc:256] RPC call timeout handler was delayed by -1.6091099989999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
I20260709 13:03:36.875962 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:36.877929 15290 connection.cc:256] RPC call timeout handler was delayed by -1.590209998999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
I20260709 13:03:36.947109 15365 leader_election.cc:400] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8.
I20260709 13:03:36.734167 15325 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:36.951196 15365 leader_election.cc:403] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:03:36.951231 15290 connection.cc:256] RPC call timeout handler was delayed by -1.5263099989999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:03:36.952375 15290 connection.cc:256] RPC call timeout handler was delayed by -1.5011099990000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
I20260709 13:03:36.952553 15325 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:36.952838 15290 connection.cc:256] RPC call timeout handler was delayed by -1.2977099989999488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 13:03:36.950804 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.953274 15290 connection.cc:256] RPC call timeout handler was delayed by -1.2500099989999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
I20260709 13:03:36.882820 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 323) took 3652 ms. Trace:
W20260709 13:03:36.953821 15290 connection.cc:256] RPC call timeout handler was delayed by -1.2482099989999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 13:03:36.954334 15290 connection.cc:256] RPC call timeout handler was delayed by -1.2050099990000263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 13:03:36.955402 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:36.963809 16032 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:36.964974 18498 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.965538 18481 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.965590 18498 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:36.966328 18481 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:36.968089 18458 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.969389 18458 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:36.626961 17966 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:36.737499 18421 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:36.973768 17966 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.671262 18200 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:36.974934 17966 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:36.975534 18200 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.976783 18200 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:36.839704 18469 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:03:36.958915 15324 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:36.978942 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:36.959568 18260 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.979766 16028 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:36.980324 18260 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:36.927984 18361 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.615815 18272 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:36.839507 18446 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:03:36.664973 18419 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:36.961946 17967 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:36.986385 15145 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.988236 15145 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.989670 17967 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:36.745374 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 484116us
I20260709 13:03:36.963212 18499 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.960439 18174 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:36.838956 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08002a4640 after lost signal to thread 14142
I20260709 13:03:36.990965 18014 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:36.993551 18466 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:03:36.983042 18419 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.005345 18272 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:36.958969 18360 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.627564 18363 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:37.007601 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 82421.9us
I20260709 13:03:36.887624 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:37.034307 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08002b8ca0 after lost signal to thread 15182
I20260709 13:03:37.050155 15321 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:37.024287 18220 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8.
W20260709 13:03:36.995154 18472 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:03:37.054868 18265 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:36.669703 18475 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:37.061663 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 106347us
I20260709 13:03:37.121034 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:37.062332 18476 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:37.062774 18367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.006s	sys 0.009s
I20260709 13:03:37.062878 15145 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 2 to 4, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 4 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:37.077521 18496 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:36.733505 18435 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:37.140745 18435 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:36.625167 18197 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:37.073997 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.144961 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.147449 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.149394 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:37.073885 15325 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:03:37.074343 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:37.085829 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08002aaa00 after lost signal to thread 15274
I20260709 13:03:37.154124 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1291) took 1101 ms. Trace:
I20260709 13:03:37.154649 15323 rpcz_store.cc:276] 0709 13:03:36.052262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.491578 (+439316us) service_pool.cc:224] Handling call
0709 13:03:37.154046 (+662468us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:37.155031 15346 debug-util.cc:398] Leaking SignalData structure 0x7b080030a480 after lost signal to thread 15349
W20260709 13:03:37.156651 15346 debug-util.cc:398] Leaking SignalData structure 0x7b0800397be0 after lost signal to thread 15423
W20260709 13:03:37.086867 15147 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49186 (request call id 215) took 25797 ms (client timeout 15000 ms). Trace:
I20260709 13:03:37.090341 15398 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:37.090620 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:37.023795 18361 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:36.954066 15316 rpcz_store.cc:276] 0709 13:03:33.234479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.132043 (+897564us) service_pool.cc:224] Handling call
0709 13:03:34.176525 (+ 44482us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:34.414799 (+238274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.414874 (+    75us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:34.440515 (+ 25641us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b2c0012b498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:34.441238 (+   723us) log.cc:844] Serialized 78 byte log entry
0709 13:03:36.072482 (+1631244us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:36.072798 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:03:36.882417 (+809619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.882495 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.882536 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:36.882611 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.882753 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3085,"prepare.queue_time_us":22390,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":316465,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":44625,"spinlock_wait_cycles":11972352,"thread_start_us":2635416,"threads_started":4,"wal-append.queue_time_us":875122,"wal-append.run_cpu_time_us":4267,"wal-append.run_wall_time_us":1336104}
I20260709 13:03:37.093855 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:37.095822 15394 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:36.928431 18428 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:37.100085 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.164713 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.165180 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.047559 18371 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:36.887931 18284 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.185s
I20260709 13:03:36.674209 18414 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:36.886471 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 389696us
I20260709 13:03:37.133054 15145 catalog_manager.cc:5697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
W20260709 13:03:37.160151 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66440.4us
W20260709 13:03:37.161077 15346 debug-util.cc:398] Leaking SignalData structure 0x7b0800313f40 after lost signal to thread 16057
W20260709 13:03:37.184094 15346 debug-util.cc:398] Leaking SignalData structure 0x7b08003a85c0 after lost signal to thread 16058
I20260709 13:03:37.137262 18220 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.096205 18498 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:37.136982 18367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.006s	sys 0.009s
I20260709 13:03:37.189414 15316 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:37.162002 15323 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:03:37.198031 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 310502us
W20260709 13:03:37.199049 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49749.4us
W20260709 13:03:37.180709 18176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.018s	sys 0.044s
I20260709 13:03:37.176733 18272 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:37.203442 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 82562.3us
I20260709 13:03:37.226871 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:37.197270 15318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:03:37.046681 18499 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.204667 18346 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:37.206143 15291 leader_election.cc:400] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6.
I20260709 13:03:37.207847 15145 catalog_manager.cc:5697] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 2 to 3, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:37.229936 15291 leader_election.cc:403] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:37.212862 18059 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:37.157507 15147 rpcz_store.cc:269] 0709 13:03:11.273995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.276412 (+  2417us) service_pool.cc:224] Handling call
0709 13:03:37.070635 (+25794223us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:35.594443 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:35.633444 (+ 39001us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:35.633507 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:03:35.633526 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:35.634800 (+  1274us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:35.634895 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:35.634941 (+    46us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:03:35.636025 (+  1084us) tablet.cc:701] Row locks acquired
0709 13:03:35.636075 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:03:35.636265 (+   190us) write_op.cc:270] Start()
0709 13:03:35.636421 (+   156us) write_op.cc:276] Timestamp: P: 1783602215636183 usec, L: 0
0709 13:03:35.636448 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:03:35.637804 (+  1356us) log.cc:844] Serialized 4098 byte log entry
0709 13:03:35.648566 (+ 10762us) op_driver.cc:464] REPLICATION: finished
0709 13:03:35.651226 (+  2660us) write_op.cc:301] APPLY: starting
0709 13:03:35.651340 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:35.651629 (+   289us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:35.651800 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:35.653396 (+  1596us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:35.653821 (+   425us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:03:35.653865 (+    44us) write_op.cc:312] APPLY: finished
0709 13:03:35.654675 (+   810us) log.cc:844] Serialized 77 byte log entry
0709 13:03:35.654943 (+   268us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:35.655100 (+   157us) write_op.cc:454] Released schema lock
0709 13:03:35.655175 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:35.658337 (+  3162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:35.658378 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":381669,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":2342,"apply.run_cpu_time_us":3954,"apply.run_wall_time_us":7056,"num_ops":10,"prepare.queue_time_us":259400,"prepare.run_cpu_time_us":6666,"prepare.run_wall_time_us":51635,"raft.queue_time_us":3409,"raft.run_cpu_time_us":2246,"raft.run_wall_time_us":2653,"replication_time_us":11923,"thread_start_us":136254,"threads_started":4,"wal-append.queue_time_us":1728,"wal-append.run_cpu_time_us":6655,"wal-append.run_wall_time_us":1023903}]]}
I20260709 13:03:37.219334 18145 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:37.219933 18490 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:37.204013 18414 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:37.225456 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:37.175784 18371 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:37.235041 15145 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:37.229838 18176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.019s	sys 0.044s
I20260709 13:03:37.253780 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:37.252547 15250 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:37.255060 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:37.256395 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2324) took 1039 ms. Trace:
I20260709 13:03:37.257232 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:37.257603 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.258069 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.255041 15320 raft_consensus.cc:2410] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:03:37.259881 15325 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: [6.3-8.4]
I20260709 13:03:37.152179 18476 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:37.302868 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45517.5us
I20260709 13:03:37.256947 15397 rpcz_store.cc:276] 0709 13:03:36.216924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.218970 (+  2046us) service_pool.cc:224] Handling call
0709 13:03:36.219370 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.219820 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.219848 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.220339 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:03:36.595435 (+375096us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:36.595493 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.595601 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.256163 (+660562us) raft_consensus.cc:1685] finished
0709 13:03:37.256184 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.256323 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":99,"thread_start_us":374658,"threads_started":1,"wal-append.queue_time_us":406306}
I20260709 13:03:37.241554 18260 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:37.244164 18272 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:37.327385 15245 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:03:37.263466 18406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.022s	sys 0.045s
I20260709 13:03:37.228567 18220 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:37.330260 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:37.330631 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:37.256240 18357 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 5. Current term is 6.
I20260709 13:03:37.352504 15396 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:37.261057 18367 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:37.335084 18406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.023s	sys 0.045s
I20260709 13:03:37.342947 15392 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:37.343061 15391 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:37.371901 15391 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:37.373104 15391 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:37.351137 15399 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 4: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:37.300992 18282 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.361186 15397 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:37.345222 15242 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:37.321686 18346 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:37.378988 15391 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:37.338786 17967 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:37.384908 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:37.393232 15396 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:03:37.332618 18490 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:37.392576 18282 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:37.396494 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.351591 18200 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:37.405400 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:37.385501 17863 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.408987 15241 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:03:37.393080 18470 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:37.415673 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:37.370514 15392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:03:37.420922 15392 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:37.421373 15392 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:37.342511 18260 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.343837 18471 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:03:37.463315 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2323) took 1246 ms. Trace:
I20260709 13:03:37.407428 18059 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:37.339278 18441 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:03:37.462896 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:37.409327 18200 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:03:37.452016 18045 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.025s	sys 0.035s
I20260709 13:03:37.496735 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:37.404594 18054 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:37.449818 18482 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:37.452104 18272 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:37.513031 15318 raft_consensus.cc:606] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:37.527040 15318 raft_consensus.cc:614] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:37.484481 15390 rpcz_store.cc:276] 0709 13:03:36.216657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.218325 (+  1668us) service_pool.cc:224] Handling call
0709 13:03:36.218671 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.234638 (+ 15967us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:36.551481 (+316843us) log.cc:844] Serialized 14 byte log entry
0709 13:03:37.035394 (+483913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:37.035458 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:37.035499 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.463015 (+427516us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b54001545d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:37.463070 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.463244 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":341164,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":389,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":2774,"spinlock_wait_cycles":35802368,"thread_start_us":681640,"threads_started":2,"wal-append.queue_time_us":636706}
I20260709 13:03:37.303594 18475 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.381312 18371 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:37.453291 18360 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:37.512838 18045 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.026s	sys 0.036s
I20260709 13:03:37.501840 18059 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.417588 17863 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:37.538779 15392 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:37.557157 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 292855us
I20260709 13:03:37.513191 18200 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:37.484342 18458 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:03:37.528700 18482 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:37.599599 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 344577us
I20260709 13:03:37.602566 18371 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:37.608004 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.435946 18361 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.611035 15392 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:37.615304 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:37.636675 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 379501us
I20260709 13:03:37.637568 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:37.512880 18498 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:03:37.616998 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:37.510911 18406 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:03:37.507028 18424 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:03:37.514966 18264 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:03:37.546779 18174 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:37.559171 18045 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:37.601713 18458 consensus_queue.cc:1243] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:03:37.634902 18491 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:03:37.590152 18059 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:37.639148 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 243151us
W20260709 13:03:37.642668 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.545051 18477 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:03:37.592306 18363 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:37.643636 18504 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:37.687817 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 339) took 1307 ms. Trace:
I20260709 13:03:37.689469 18282 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:37.689296 18045 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:37.688982 15323 rpcz_store.cc:276] 0709 13:03:36.380268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.225892 (+845624us) service_pool.cc:224] Handling call
0709 13:03:37.236512 (+ 10620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.236798 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:37.558176 (+321378us) log.cc:844] Serialized 14 byte log entry
0709 13:03:37.687044 (+128868us) log.cc:844] Serialized 14 byte log entry
0709 13:03:37.687347 (+   303us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:37.687411 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:37.687471 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.687569 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.687739 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1788,"prepare.queue_time_us":324125,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":2005,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":5150592,"thread_start_us":422884,"threads_started":2}
I20260709 13:03:37.692307 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:37.693159 15323 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
W20260709 13:03:37.693373 18501 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:03:37.694690 18521 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:03:37.695917 18521 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:37.696350 18145 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:37.697232 18145 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:37.697916 18521 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.618680 18490 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:37.698694 18497 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:03:37.663523 17967 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:37.694644 15323 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:37.703775 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2258) took 1114 ms. Trace:
I20260709 13:03:37.705466 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2244) took 1350 ms. Trace:
I20260709 13:03:37.706167 15322 rpcz_store.cc:276] 0709 13:03:36.355466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.597737 (+242271us) service_pool.cc:224] Handling call
0709 13:03:36.624909 (+ 27172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.745286 (+120377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.745337 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.814929 (+ 69592us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.176718 (+361789us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:37.643803 (+467085us) log.cc:844] Serialized 14 byte log entry
0709 13:03:37.674106 (+ 30303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.674215 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.705194 (+ 30979us) raft_consensus.cc:1685] finished
0709 13:03:37.705221 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.705394 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159105,"prepare.queue_time_us":381375,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":318722,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":22798,"thread_start_us":676603,"threads_started":2,"wal-append.queue_time_us":559844}
I20260709 13:03:37.709704 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2259) took 1097 ms. Trace:
I20260709 13:03:37.665485 18410 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:37.667336 18512 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:37.716593 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 79106.2us
I20260709 13:03:37.677944 18499 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:37.705997 15323 rpcz_store.cc:276] 0709 13:03:36.589347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.694021 (+1104674us) service_pool.cc:224] Handling call
0709 13:03:37.694391 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.703448 (+  9057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.703710 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:37.687218 18220 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:37.755218 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 70689.6us
I20260709 13:03:37.710146 15322 rpcz_store.cc:276] 0709 13:03:36.612199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.708641 (+1096442us) service_pool.cc:224] Handling call
0709 13:03:37.709039 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.709274 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.709314 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:37.709375 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:37.709420 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.709495 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.709635 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:37.757761 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.758131 15392 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:37.757614 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:37.760797 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:37.761478 15392 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:37.717445 18504 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:37.769840 18504 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.769886 15322 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:37.771947 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:37.782081 15322 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:37.750530 18476 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:37.784590 15322 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:03:37.789793 18508 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:03:37.790258 18492 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260709 13:03:37.795102 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.795724 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.775592 18260 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:37.802673 15322 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:37.804921 15215 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:37.777881 18520 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:37.758862 18410 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.807930 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:37.704826 18482 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.809383 15322 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:03:37.802314 18502 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:03:37.811431 18513 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:37.812280 18260 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:37.813344 18410 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:37.813649 17966 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.838s	user 0.009s	sys 0.001s
I20260709 13:03:37.816483 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1297) took 1762 ms. Trace:
I20260709 13:03:37.715205 18521 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.840610 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:37.857563 15244 raft_consensus.cc:2410] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:03:37.847034 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 74193.4us
I20260709 13:03:37.852388 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:37.853838 15317 rpcz_store.cc:276] 0709 13:03:36.053889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.496789 (+442900us) service_pool.cc:224] Handling call
0709 13:03:37.085319 (+588530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:37.186950 (+101631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.186984 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:37.202579 (+ 15595us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.512079 (+309500us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:37.512133 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.513398 (+  1265us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.816239 (+302841us) raft_consensus.cc:1685] finished
0709 13:03:37.816265 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.816416 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73026,"raft.queue_time_us":103105,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":308976,"threads_started":1,"wal-append.queue_time_us":500670}
W20260709 13:03:37.861800 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57827.2us
I20260709 13:03:37.869818 15249 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:37.848402 18260 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.788177 17967 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:37.851660 17863 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:37.851117 18525 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:03:37.883261 18358 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.853s	user 0.003s	sys 0.009s
I20260709 13:03:37.897706 18358 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:37.897938 18490 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:37.899945 18490 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:37.900792 18428 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.002s
I20260709 13:03:37.901115 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2242) took 1640 ms. Trace:
I20260709 13:03:37.901245 18428 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:37.901644 18490 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:37.901665 15321 rpcz_store.cc:276] 0709 13:03:36.260859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.589703 (+328844us) service_pool.cc:224] Handling call
0709 13:03:36.590084 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.095058 (+504974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.900880 (+805822us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54002193d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:37.901053 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056857344}
I20260709 13:03:37.903277 15248 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:37.903055 18531 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:37.903713 18458 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:37.905776 18513 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:37.875391 18510 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:37.876084 18361 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:37.914593 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:37.876475 18482 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:37.886307 18260 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:37.948973 15249 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:37.899973 18358 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:37.819463 18520 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.914716 18476 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:37.956435 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 43911.8us
I20260709 13:03:37.957798 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:37.958599 18527 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:03:37.959316 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:37.959784 18509 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:03:37.961100 18494 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:37.961498 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2250) took 1604 ms. Trace:
I20260709 13:03:37.962450 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:37.961910 15319 rpcz_store.cc:276] 0709 13:03:36.357086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.683120 (+326034us) service_pool.cc:224] Handling call
0709 13:03:36.683474 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:37.012738 (+329264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.012788 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:37.035394 (+ 22606us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.532321 (+496927us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:37.532381 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.532482 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.961268 (+428786us) raft_consensus.cc:1685] finished
0709 13:03:37.961289 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.961434 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140306,"raft.queue_time_us":287775,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":22768,"spinlock_wait_cycles":5504,"thread_start_us":431006,"threads_started":1,"wal-append.queue_time_us":692090}
W20260709 13:03:37.958802 18523 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:03:37.965471 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 76949.7us
I20260709 13:03:37.969316 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:37.964725 18361 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:37.956400 18515 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:37.961918 18494 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:37.915990 18525 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.943606 18513 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.980696 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:37.981849 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:37.983325 15319 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:03:37.979849 18494 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:37.987653 18494 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:37.987100 18521 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.003537 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2260) took 1337 ms. Trace:
I20260709 13:03:37.967672 18476 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:37.977154 18358 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:03:37.995149 18054 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:38.009908 18361 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:37.987165 18059 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.031080 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2257) took 1487 ms. Trace:
I20260709 13:03:38.031795 18513 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.032837 18059 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.033516 18017 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:38.033766 15242 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:38.033959 18017 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:38.010408 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.013618 18531 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:38.014197 18536 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.016130 18520 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:38.017154 18519 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:03:38.031599 15325 rpcz_store.cc:276] 0709 13:03:36.543549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.328500 (+784951us) service_pool.cc:224] Handling call
0709 13:03:37.360812 (+ 32312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.404400 (+ 43588us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.404431 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:37.404473 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:37.404500 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.030821 (+626321us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b54002edbd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:38.030865 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.031006 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99760896}
I20260709 13:03:38.042953 18494 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.034873 18017 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.055148 18017 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:38.040944 18361 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:38.040943 18437 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:38.059762 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.061997 18494 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.064370 18525 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:38.051513 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.067582 18428 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.041013 18531 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.070395 18531 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.050355 18536 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:38.035632 18535 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:03:38.071955 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:38.059544 18437 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:38.080030 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 69711.2us
I20260709 13:03:38.081033 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:38.081214 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.092305 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.093344 15321 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:38.095643 18410 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:38.095975 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.093954 18536 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:38.131261 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 50328.3us
I20260709 13:03:38.132932 15290 leader_election.cc:400] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:38.134182 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.073522 18200 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.105487 18357 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:38.088400 18272 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:38.133186 18494 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:38.114070 18477 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:38.079193 18419 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:03:38.161227 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.100179 18355 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:03:38.163995 18282 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:38.169489 15245 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:38.156534 18265 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:38.173725 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:38.172617 18489 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:38.175135 18265 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.162626 18272 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.201506 18272 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:38.203728 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58726 (request call id 18) took 1168 ms. Trace:
I20260709 13:03:38.204200 15318 rpcz_store.cc:276] 0709 13:03:37.055058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.120379 (+ 65321us) service_pool.cc:224] Handling call
0709 13:03:38.203477 (+1083098us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b54002ed6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf4853 00007f366ebc260a 00007f36681487d4 00007f3668148762 00007f3668148691 00007f366814860c 00007f36681478c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:38.203617 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654877056}
I20260709 13:03:38.205576 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.210500 18475 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:38.164821 18357 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:38.214285 18357 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:38.224987 18537 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:03:38.229818 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56231.1us
W20260709 13:03:38.180730 15362 leader_election.cc:336] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.656s (SENT)
I20260709 13:03:38.230679 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:38.230993 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.238597 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.240288 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:38.236443 18424 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:03:38.242602 18528 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.290s	user 0.004s	sys 0.000s
I20260709 13:03:38.248274 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.274686 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.277974 16031 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:38.280030 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.228678 17863 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:03:38.277868 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.287102 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.293855 16032 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:38.302161 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:38.293860 16033 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:38.244480 18489 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:38.241367 17967 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.236584 18361 raft_consensus.cc:2764] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:03:38.303323 18541 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:03:38.310250 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 214317us
I20260709 13:03:38.325289 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:38.326630 18406 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:38.327181 18406 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.327692 18406 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:38.313843 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 133409us
I20260709 13:03:38.248641 18487 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:38.306469 18424 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.244726 18282 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:38.231622 18145 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.318471 15290 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:38.335362 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:38.306850 18494 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:38.314572 15363 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:38.337919 15363 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:38.336519 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.336757 15325 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:38.322758 18355 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:38.323791 18220 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:38.324740 18476 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:38.345932 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.348074 15322 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:38.353094 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.331157 18487 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:38.341553 18272 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:38.340072 18486 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:38.344072 18371 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:38.324033 17967 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:38.392130 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.381942 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.350028 18361 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:38.337245 18424 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.390239 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.395567 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.398461 18476 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:38.388096 18371 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.399721 18371 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:38.400322 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1278) took 1017 ms. Trace:
I20260709 13:03:38.365821 18494 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:38.354409 18510 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:38.399371 18476 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:03:38.402127 18421 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.424978 17967 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.394685 18361 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.425946 18361 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.347700 18355 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.427263 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2000) took 1178 ms. Trace:
I20260709 13:03:38.427809 15248 rpcz_store.cc:276] 0709 13:03:37.249136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.251539 (+  2403us) service_pool.cc:224] Handling call
0709 13:03:37.251832 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.908334 (+656502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.426941 (+518607us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54003985d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:38.427182 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497758976}
I20260709 13:03:38.428498 18355 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.430673 18424 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:38.394757 18489 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:38.393162 18265 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.389701 18488 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:38.434912 18488 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.435334 18488 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:38.435616 18265 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.377213 18437 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.377588 18260 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.437561 18384 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.343154 18546 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:38.438886 18546 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.004076 15323 rpcz_store.cc:276] 0709 13:03:36.666454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.766154 (+1099700us) service_pool.cc:224] Handling call
0709 13:03:37.768768 (+  2614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.768955 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:37.780525 (+ 11570us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.003079 (+222554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.003138 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:38.003194 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.003283 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.003462 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3261,"prepare.queue_time_us":11364,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1491,"raft.queue_time_us":781,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":90,"thread_start_us":222218,"threads_started":1}
I20260709 13:03:38.439297 18546 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:38.378746 17978 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.376850 18272 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.440084 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:38.440399 18272 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.440912 16031 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 5: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:38.397950 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.357468 18487 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:38.399787 18482 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:38.400722 15242 rpcz_store.cc:276] 0709 13:03:37.383405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.383555 (+   150us) service_pool.cc:224] Handling call
0709 13:03:38.400112 (+1016557us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540001e354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:38.400265 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442642176}
I20260709 13:03:38.342983 18145 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.404335 18545 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:38.405869 18551 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:03:38.406045 18471 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:03:38.408103 18534 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:03:38.410401 18200 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.412730 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1276) took 1086 ms. Trace:
W20260709 13:03:38.443972 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.445477 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.458056 15243 rpcz_store.cc:276] 0709 13:03:37.325912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.326018 (+   106us) service_pool.cc:224] Handling call
0709 13:03:37.344346 (+ 18328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.521298 (+176952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.521345 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:37.521406 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:37.521453 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.412353 (+890900us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54003971d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:38.412421 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.412648 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406343936}
W20260709 13:03:38.449378 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 96407.5us
W20260709 13:03:38.399902 18544 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:38.440120 17978 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:38.439301 18260 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.463544 15317 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:03:38.462131 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 64264.4us
I20260709 13:03:38.451160 18471 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:38.467533 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:38.451289 18384 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.473075 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.453686 18045 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.477135 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.480551 15394 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:38.397106 18486 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.467866 18392 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:38.487963 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:38.453377 18499 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:03:38.463922 18494 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:03:38.451112 18489 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:03:38.470381 18510 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:03:38.472723 18476 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:03:38.470810 18496 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:03:38.476553 18384 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.487435 18555 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:38.482203 18045 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:38.529691 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 58649.9us
I20260709 13:03:38.536257 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.537148 15317 raft_consensus.cc:2368] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8.
I20260709 13:03:38.541941 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.542913 15399 raft_consensus.cc:2410] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:38.543998 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.544490 16029 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:38.548429 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.549288 15317 raft_consensus.cc:2376] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6. Re-sending same reply.
I20260709 13:03:38.551378 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.551815 15394 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:38.552381 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.551856 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.552974 16031 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:38.553679 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.553803 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.554533 15317 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:38.521225 18265 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:38.539067 18392 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.557550 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.560065 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.557725 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.560791 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.575145 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.577025 15321 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:38.577484 16030 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:38.577657 15319 raft_consensus.cc:2376] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8. Re-sending same reply.
I20260709 13:03:38.579836 15394 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:38.583009 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:38.583957 16030 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:38.586191 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.588174 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.546571 18422 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:38.507602 18471 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:38.603436 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.602571 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.579401 18265 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.608305 18556 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:38.608443 18559 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.085s	user 0.001s	sys 0.001s
I20260709 13:03:38.615761 15393 pending_rounds.cc:85] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 3
I20260709 13:03:38.616281 15393 pending_rounds.cc:107] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:38.616614 15393 raft_consensus.cc:2889] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.607023 16026 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:38.619642 18406 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.622550 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.622926 18384 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.623335 15319 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:38.624446 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.625377 18272 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.561290 18371 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.622026 18406 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.628870 18488 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.629773 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.583067 18481 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.591162 18145 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.633402 18197 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:38.636389 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:38.664142 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:38.664503 16025 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:38.664149 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.638068 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.636893 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.664345 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.638641 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:38.653609 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.661172 15323 raft_consensus.cc:2376] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9. Re-sending same reply.
I20260709 13:03:38.665905 15396 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:38.666286 15391 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:38.631595 18441 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.657617 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.670982 15320 raft_consensus.cc:2376] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6. Re-sending same reply.
I20260709 13:03:38.671087 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.666185 16031 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:38.664909 15390 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:38.672600 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.673071 15317 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:03:38.673252 15323 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:38.675184 15321 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:38.625468 18556 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.584755 18392 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.633950 18546 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.690320 16025 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:38.691573 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:38.693285 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.664331 18471 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.614733 18422 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.698648 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:38.699290 15394 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:38.699453 16029 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:38.683964 16027 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:03:38.700362 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:38.670627 18563 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.701836 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:38.714677 16030 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:38.722810 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.723726 15320 raft_consensus.cc:2376] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10. Re-sending same reply.
I20260709 13:03:38.725216 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:38.726589 16031 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:38.715996 18554 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:03:38.729753 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:38.727353 16024 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:38.670514 18477 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:38.693218 18512 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:38.728063 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.686782 18481 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:38.702900 16027 pending_rounds.cc:85] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 8
I20260709 13:03:38.701668 18486 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:38.684832 18441 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.742964 18487 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.743438 18488 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.745278 18487 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.745862 18441 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.747133 18422 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.738090 16027 pending_rounds.cc:107] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:03:38.753952 18392 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:38.754168 16027 raft_consensus.cc:2889] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.755146 18361 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.756501 18371 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.735890 18045 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.756781 15319 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:38.758905 18556 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.721679 18563 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:38.760823 15394 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:38.761777 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.762568 15394 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:38.752709 18272 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.751910 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.769553 15320 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
W20260709 13:03:38.775214 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 45544.7us
I20260709 13:03:38.778740 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.778786 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:38.781598 15399 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:38.781798 16031 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:38.782784 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:38.793169 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.794128 15320 raft_consensus.cc:2376] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8. Re-sending same reply.
I20260709 13:03:38.798897 15394 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: [6.5-9.6]
I20260709 13:03:38.780140 18515 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:38.800863 18546 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:38.802695 15394 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:03:38.828656 18568 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:03:38.830385 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 336) took 2451 ms. Trace:
I20260709 13:03:38.830813 15324 rpcz_store.cc:276] 0709 13:03:36.379421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.979112 (+599691us) service_pool.cc:224] Handling call
0709 13:03:36.979458 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:37.156666 (+177208us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:37.513678 (+357012us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.539329 (+1025651us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b1800394300. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:03:38.689860 (+150531us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:38.690638 (+   778us) log.cc:844] Serialized 52 byte log entry
0709 13:03:38.690819 (+   181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:38.690879 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.690987 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.830029 (+139042us) raft_consensus.cc:1685] finished
0709 13:03:38.830126 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.830319 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":201261,"prepare.queue_time_us":362384,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3958,"raft.queue_time_us":190984,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":24929,"spinlock_wait_cycles":15677184,"thread_start_us":445665,"threads_started":2,"wal-append.queue_time_us":1196388}
I20260709 13:03:38.832510 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.832880 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.833400 15325 raft_consensus.cc:2410] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:38.834004 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.834124 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.860267 15324 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:38.861402 15390 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:38.837852 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.841198 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:38.862784 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.864158 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.864853 15321 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:38.866168 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.867981 16031 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:38.869354 15325 raft_consensus.cc:2410] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:03:38.869737 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:38.872134 16031 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.877774 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.878249 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:38.878922 15396 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:38.883697 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.890664 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.891381 15325 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:38.892272 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.895504 15321 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:38.896643 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.897828 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.898921 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:38.899624 15321 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:38.900635 15324 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:38.845597 18495 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.901985 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.905956 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.913110 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.914114 15325 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:38.915376 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.916802 15325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:03:38.835618 18563 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:38.924928 16031 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:38.926589 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.927561 15320 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:38.930927 15363 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:38.932500 15321 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:38.870723 18504 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:38.934629 15321 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:38.885084 18045 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.941057 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.938493 18488 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:38.954552 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:38.923571 18495 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:39.031570 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.940096 18504 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.944929 18045 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:38.969758 18488 raft_consensus.cc:697] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:39.113503 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.025545 18546 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.392015 18017 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:39.392917 18017 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.459205 18441 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:39.486997 18441 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:39.524032 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.453661 18197 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.554836 15319 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:39.490398 18284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.036s	sys 0.030s
I20260709 13:03:39.278874 18546 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.552676 18197 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.623916 15320 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:39.580017 18284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.036s	sys 0.030s
I20260709 13:03:39.652375 18045 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.616398 18495 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.673856 15320 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:39.685979 15320 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:39.681211 18017 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:39.685504 18488 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.706712 18264 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:03:39.709596 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 145198us
I20260709 13:03:39.705293 15320 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:03:39.709605 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:39.704854 18543 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.397s	user 0.011s	sys 0.010s
I20260709 13:03:39.704144 18471 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.715898 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:39.718254 15320 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:03:39.718538 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:39.710397 18264 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:39.707247 18441 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.730273 18384 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:03:39.732995 18358 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:39.733273 18384 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:39.733744 18358 consensus_queue.cc:1243] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:39.733881 18384 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:39.720350 18017 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:39.734655 18017 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.735061 18017 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:39.731144 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:39.726327 18495 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:39.740897 18437 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:39.741564 18437 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:39.740861 18264 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.742803 18264 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:39.742620 18437 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.744262 18437 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:39.744635 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:39.745390 15324 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:39.746197 18197 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:39.747161 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:39.747867 15324 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:39.736405 15320 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 4.
I20260709 13:03:39.714706 18471 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.753755 18282 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.755393 18282 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.754477 15325 raft_consensus.cc:606] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:39.758473 15325 raft_consensus.cc:614] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:39.761183 18579 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:03:39.762676 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 347) took 1420 ms. Trace:
I20260709 13:03:39.740372 18495 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.763283 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 1994) took 1094 ms. Trace:
I20260709 13:03:39.763188 15318 rpcz_store.cc:276] 0709 13:03:38.342656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.347601 (+  4945us) service_pool.cc:224] Handling call
0709 13:03:38.348094 (+   493us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:03:38.473072 (+124978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.473103 (+    31us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:03:38.485046 (+ 11943us) log.cc:844] Serialized 104 byte log entry
0709 13:03:38.509476 (+ 24430us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:38.516299 (+  6823us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.519895 (+  3596us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.603855 (+ 83960us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.604746 (+   891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.604823 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.756393 (+1151570us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b18003ebea0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:39.762326 (+  5933us) raft_consensus.cc:1685] finished
0709 13:03:39.762359 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.762591 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25457,"prepare.queue_time_us":39840,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":127,"raft.queue_time_us":246216,"raft.run_cpu_time_us":519,"raft.run_wall_time_us":23504,"spinlock_wait_cycles":32126208,"thread_start_us":208130,"threads_started":3,"wal-append.queue_time_us":52959}
I20260709 13:03:39.763895 15399 rpcz_store.cc:276] 0709 13:03:38.668712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.789639 (+120927us) service_pool.cc:224] Handling call
0709 13:03:38.790088 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:38.790646 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.790685 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:38.796767 (+  6082us) log.cc:844] Serialized 52 byte log entry
0709 13:03:39.096040 (+299273us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:39.252309 (+156269us) log.cc:844] Serialized 14 byte log entry
0709 13:03:39.252738 (+   429us) log.cc:844] Serialized 14 byte log entry
0709 13:03:39.252941 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.253039 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.763036 (+509997us) raft_consensus.cc:1685] finished
0709 13:03:39.763056 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.763223 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28644,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":1511,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":6770,"thread_start_us":257135,"threads_started":1,"wal-append.queue_time_us":845727}
I20260709 13:03:39.763844 18495 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:39.777082 18054 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:39.783867 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2256) took 3284 ms. Trace:
W20260709 13:03:39.785723 15214 connection.cc:256] RPC call timeout handler was delayed by -1.2679936880000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
I20260709 13:03:39.777794 18054 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.790918 18504 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:39.791507 18560 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.215s	user 0.012s	sys 0.017s
I20260709 13:03:39.793141 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 477) took 1354 ms. Trace:
I20260709 13:03:39.794121 18510 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:39.794591 18510 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:39.794903 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 648) took 1244 ms. Trace:
I20260709 13:03:39.795605 18510 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.797996 18520 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.798556 18520 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.799959 18471 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.800546 18520 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.784469 15316 rpcz_store.cc:276] 0709 13:03:36.499255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.241305 (+742050us) service_pool.cc:224] Handling call
0709 13:03:37.262957 (+ 21652us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:37.309680 (+ 46723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.309713 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:37.310320 (+   607us) log.cc:844] Serialized 52 byte log entry
0709 13:03:38.057459 (+747139us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b180005ecc0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:03:38.106890 (+ 49431us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:38.166180 (+ 59290us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.170767 (+  4587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.170843 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.788960 (+618117us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b180005ecc0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d522 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:39.636096 (+847136us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:39.776521 (+140425us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b180005ecc0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d522 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:39.783548 (+  7027us) raft_consensus.cc:1685] finished
0709 13:03:39.783581 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.783778 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9289,"prepare.queue_time_us":67983,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":85353,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":6331,"spinlock_wait_cycles":237905152,"thread_start_us":49204,"threads_started":1,"wal-append.queue_time_us":851661}
I20260709 13:03:39.802800 15316 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:39.802927 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:39.804244 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:39.795320 16029 rpcz_store.cc:276] 0709 13:03:38.550546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.550679 (+   133us) service_pool.cc:224] Handling call
0709 13:03:39.794650 (+1243971us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400389d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:39.794829 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278046592}
I20260709 13:03:39.793635 16032 rpcz_store.cc:276] 0709 13:03:38.438532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.439155 (+   623us) service_pool.cc:224] Handling call
0709 13:03:38.439521 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:38.446470 (+  6949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.446518 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:38.451108 (+  4590us) log.cc:844] Serialized 52 byte log entry
0709 13:03:38.492620 (+ 41512us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:38.492665 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.492738 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.790850 (+1298112us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:39.792654 (+  1804us) raft_consensus.cc:1685] finished
0709 13:03:39.792700 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.793025 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6444,"raft.queue_time_us":9049,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3180,"spinlock_wait_cycles":26044160,"thread_start_us":16494,"threads_started":1,"wal-append.queue_time_us":45761}
I20260709 13:03:39.739483 18441 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:03:39.817893 18045 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.818545 18045 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:39.819859 15362 connection.cc:256] RPC call timeout handler was delayed by -1.3293727699999636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
W20260709 13:03:39.820444 15362 connection.cc:256] RPC call timeout handler was delayed by -1.322337186000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
I20260709 13:03:39.820667 18045 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:39.808092 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.831548 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:39.826200 18054 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:39.821909 18045 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.831807 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:39.766083 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:39.832912 18357 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:39.833297 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:39.833968 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.833793 18371 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:39.857822 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:39.858565 15395 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:39.858443 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:39.835285 18504 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:39.860683 15242 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:39.835433 18520 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:39.833773 18556 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:03:39.794516 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:39.836956 18546 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.835623 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:39.841827 15249 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:39.829233 18282 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.835307 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:39.887598 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:39.820878 15362 connection.cc:256] RPC call timeout handler was delayed by -1.2107371859999603s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:03:39.888273 15362 connection.cc:256] RPC call timeout handler was delayed by -1.2055990740000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 13:03:39.888634 15362 connection.cc:256] RPC call timeout handler was delayed by -1.1517424249999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:03:39.888906 15362 connection.cc:256] RPC call timeout handler was delayed by -1.1427347819999341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 13:03:39.889349 15362 connection.cc:256] RPC call timeout handler was delayed by -1.0908727700000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2481s for a response
W20260709 13:03:39.889956 15362 connection.cc:256] RPC call timeout handler was delayed by -1.0378057269999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:03:39.890533 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:39.891062 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 647) took 1348 ms. Trace:
I20260709 13:03:39.890928 18495 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.843416 15250 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:39.891482 16024 rpcz_store.cc:276] 0709 13:03:38.542741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.542881 (+   140us) service_pool.cc:224] Handling call
0709 13:03:38.556610 (+ 13729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.730589 (+173979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.890843 (+1160254us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540067dc54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:39.891006 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377835264}
I20260709 13:03:39.892067 16033 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:39.892460 16033 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:39.893258 16033 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.861354 18371 consensus_queue.cc:1243] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:39.874931 18504 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.894204 18054 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.900218 18054 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.852409 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:39.859421 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:39.902112 15244 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:39.899052 18504 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.903304 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:39.903689 18272 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:39.903983 18504 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.904295 18272 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.904426 18504 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.904942 18495 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.905627 18495 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.906396 18220 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.906829 18357 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.906980 18220 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.907384 18357 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.908355 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58726 (request call id 19) took 1293 ms. Trace:
I20260709 13:03:39.908751 15325 rpcz_store.cc:276] 0709 13:03:38.614521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.916591 (+302070us) service_pool.cc:224] Handling call
0709 13:03:39.908142 (+991551us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54001e69d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf4853 00007f366ebc260a 00007f36681487d4 00007f3668148762 00007f3668148691 00007f366814860c 00007f36681478c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:39.908262 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914850560}
I20260709 13:03:39.909256 18220 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:39.909739 18357 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:39.875751 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:39.876356 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:39.910918 18498 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:39.911372 15324 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:03:39.911455 18498 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.879853 16032 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:39.912354 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:39.879632 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:39.912992 18441 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.886526 18520 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.913658 18498 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:39.913611 18441 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.914419 18264 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:39.912931 15324 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:39.914827 18264 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:39.889840 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:39.915396 18264 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:39.915958 18441 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:39.860391 18045 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.859347 15391 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 10 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:03:39.924775 15395 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:39.906090 18495 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.911880 18546 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:39.861728 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:39.928346 15318 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:03:39.859364 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:39.909866 18220 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.899179 16033 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:39.910063 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:39.931766 15325 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:03:39.935292 15318 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:39.919358 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:39.863821 15245 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:39.936983 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:39.855377 18587 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:39.917348 18520 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.899590 18017 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:39.936218 15244 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:39.943321 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:39.931507 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:39.944244 16029 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:03:39.945399 15362 leader_election.cc:400] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8.
I20260709 13:03:39.899431 18571 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:39.937872 16027 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:39.932466 18197 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:03:39.945529 15363 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:39.947319 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:39.947719 15318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:03:39.948510 15318 raft_consensus.cc:606] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:39.949005 15318 raft_consensus.cc:614] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:39.947096 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:39.950325 15325 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:39.949471 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:39.961097 15324 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:39.969761 15291 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:39.980464 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:39.982753 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:39.984543 18282 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:39.952760 18357 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:39.990933 18357 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.991405 18357 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:39.991199 18282 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:39.992329 18282 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:39.993741 18282 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:39.995421 18512 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:39.996127 18512 consensus_queue.cc:1243] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:39.941895 18220 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:39.996519 15318 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:58726
I20260709 13:03:39.997192 15318 raft_consensus.cc:606] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:39.997535 15318 raft_consensus.cc:614] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:39.998371 15392 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:39.941663 18272 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:39.924862 18498 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:03:39.939649 18504 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:40.007269 15392 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
W20260709 13:03:40.020758 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.949788 18570 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:39.947384 18571 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:39.952093 18054 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:39.949841 18572 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:39.994107 18282 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:40.066624 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.065713 18272 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:40.071599 18282 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:40.071866 18437 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:40.076020 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:40.085060 15244 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:03:40.085445 15244 pending_rounds.cc:85] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 6
I20260709 13:03:40.085692 15244 pending_rounds.cc:107] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:03:40.085948 15244 raft_consensus.cc:2889] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.086403 18571 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.087186 18495 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:40.086108 18386 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.087960 18386 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:40.088238 18384 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.089395 18384 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:40.090142 18386 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:40.091522 18587 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:40.096567 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:40.102555 15250 raft_consensus.cc:2410] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:40.094311 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:40.095896 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:40.103982 15245 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:40.096707 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:40.105768 15249 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:40.098661 15248 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:03:40.106875 15248 pending_rounds.cc:85] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 5
I20260709 13:03:40.107189 15248 pending_rounds.cc:107] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:03:40.107478 15248 raft_consensus.cc:2889] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.071142 18572 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.082033 18272 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:40.084414 18197 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:40.129261 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:40.135933 15244 raft_consensus.cc:2376] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10. Re-sending same reply.
I20260709 13:03:40.083894 18220 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:40.126171 18587 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:40.144836 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:40.149258 15244 raft_consensus.cc:2368] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 6. Current term is 7.
W20260709 13:03:40.129196 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 397114us
I20260709 13:03:40.128546 18437 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:40.164244 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:40.165818 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:40.166510 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:40.167160 15399 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:03:40.168376 15398 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:40.169015 15249 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:03:40.169870 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:40.172467 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:40.172654 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:40.173483 15394 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:40.166512 15391 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:03:40.134195 18272 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:40.141716 18197 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:40.181397 18197 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:40.182322 18594 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:03:40.183792 18594 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:40.175558 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:40.187314 15243 raft_consensus.cc:2368] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8.
I20260709 13:03:40.175475 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:40.189885 15244 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 5.
I20260709 13:03:40.190351 15394 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:03:40.190850 15394 pending_rounds.cc:85] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 4
I20260709 13:03:40.191141 15394 pending_rounds.cc:107] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:03:40.191463 15394 raft_consensus.cc:2889] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.195159 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:40.190097 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:40.203372 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:40.205323 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:40.206192 15244 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:40.205781 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:40.214897 15391 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:40.215778 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:40.217065 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:40.217921 15395 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
W20260709 13:03:40.225109 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 275687us
I20260709 13:03:40.226521 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:40.234172 15398 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:40.245661 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:40.197474 18546 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:40.269975 18487 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.258540 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.271238 15322 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:40.259593 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.271848 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:40.260296 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.203699 18358 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:40.207597 18496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.697s	user 0.047s	sys 0.040s
W20260709 13:03:40.296532 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 50972us
I20260709 13:03:40.298978 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:40.262552 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.204190 18045 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:40.303402 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.267023 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:40.272756 15324 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:40.306680 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.278832 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.308097 15321 raft_consensus.cc:2410] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:03:40.278834 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 447320us
I20260709 13:03:40.206736 18386 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:40.315101 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:40.253626 18592 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:40.315771 15321 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:40.305394 15394 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:40.284591 16033 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260709 13:03:40.288194 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 452930us
I20260709 13:03:40.318089 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:40.209961 18017 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:40.262121 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57719.4us
I20260709 13:03:40.288604 15213 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:40.263520 18594 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:03:40.319698 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:40.253422 18220 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:40.323694 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:40.320302 15318 raft_consensus.cc:2376] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8. Re-sending same reply.
I20260709 13:03:40.318920 16033 pending_rounds.cc:85] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 7
I20260709 13:03:40.300313 18487 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.322158 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.334715 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.334857 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:40.268239 18471 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:40.328758 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.315584 18197 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:40.333076 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:40.327780 16033 pending_rounds.cc:107] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:03:40.363417 16033 raft_consensus.cc:2889] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.285627 18358 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:40.321058 18592 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.343967 15321 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
W20260709 13:03:40.344283 15290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.014s	sys 0.014s
W20260709 13:03:40.369297 15290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.014s	sys 0.014s
W20260709 13:03:40.347576 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.304482 18496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.786s	user 0.047s	sys 0.040s
I20260709 13:03:40.359242 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:40.374608 15318 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:40.314626 18386 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.364651 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:40.380955 15324 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:40.393148 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:40.393960 15321 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 4: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:40.395277 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.395931 15321 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:40.396978 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:40.398411 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.389648 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:40.400610 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 455095us
I20260709 13:03:40.401873 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 476) took 2030 ms. Trace:
I20260709 13:03:40.406069 18557 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:40.423506 18557 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:40.424741 18487 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:40.368957 18471 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:40.381068 18358 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:40.427796 18471 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:40.315241 18437 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.430773 18520 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:40.431246 18520 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:40.431622 18520 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:40.431924 18264 consensus_meta.cc:287] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.000s
I20260709 13:03:40.432359 18264 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:40.356456 18017 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:40.407997 16028 rpcz_store.cc:276] 0709 13:03:38.371565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.371830 (+   265us) service_pool.cc:224] Handling call
0709 13:03:38.372149 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.434435 (+ 62286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.434464 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.434503 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:38.434536 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.401550 (+1967014us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b5400550ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:40.401611 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.401798 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142786944}
I20260709 13:03:40.368080 18441 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:40.439425 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:40.368755 18197 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:40.387234 18488 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:40.445815 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.386176 18592 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.452394 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:40.400238 18498 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:40.391424 18386 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:40.460449 16033 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:40.380231 18220 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:40.465838 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:40.468101 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:40.471199 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:40.478681 18565 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:40.479527 18588 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:03:40.479364 18565 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.481469 18565 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:40.436403 18017 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:40.481530 18265 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:40.487038 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 479) took 1825 ms. Trace:
I20260709 13:03:40.459791 18197 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:40.492226 15291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.017s	sys 0.034s
I20260709 13:03:40.490960 16026 rpcz_store.cc:276] 0709 13:03:38.661541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.732120 (+ 70579us) service_pool.cc:224] Handling call
0709 13:03:39.800364 (+1068244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.800603 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.800638 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.800728 (+    90us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:39.800771 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.800849 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.486773 (+685924us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400389d50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:40.486962 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2455836928}
I20260709 13:03:40.482137 18565 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:40.495600 18606 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:40.451861 18441 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.496212 18606 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:40.496259 18441 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:40.497287 18606 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:40.459309 18604 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:40.482784 18593 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:03:40.510082 18572 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:40.510950 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2283) took 1689 ms. Trace:
I20260709 13:03:40.511359 15319 rpcz_store.cc:276] 0709 13:03:38.821282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.556169 (+734887us) service_pool.cc:224] Handling call
0709 13:03:39.628129 (+ 71960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.650385 (+ 22256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.650418 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:39.665000 (+ 14582us) log.cc:844] Serialized 26 byte log entry
0709 13:03:39.849470 (+184470us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:39.849523 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.849605 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:40.510720 (+661115us) raft_consensus.cc:1685] finished
0709 13:03:40.510746 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.510889 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137940,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":167617,"threads_started":1,"wal-append.queue_time_us":399649}
I20260709 13:03:40.513100 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:40.460047 18504 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:40.494565 15318 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
W20260709 13:03:40.503149 15291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.018s	sys 0.034s
I20260709 13:03:40.506892 18604 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:40.507942 18591 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:40.509188 18441 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.518718 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.463537 18498 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:40.521755 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:40.557423 15318 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:40.487208 18017 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:40.542025 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 554848us
W20260709 13:03:40.548058 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.486366 18487 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:40.551863 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 317817us
W20260709 13:03:40.552604 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 223183us
I20260709 13:03:40.553565 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:40.519536 18264 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:40.560985 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 303811us
W20260709 13:03:40.579968 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.565059 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 276517us
I20260709 13:03:40.526117 18565 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.566169 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2298) took 1614 ms. Trace:
I20260709 13:03:40.603152 15317 rpcz_store.cc:276] 0709 13:03:38.952325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.820430 (+868105us) service_pool.cc:224] Handling call
0709 13:03:39.820749 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.820963 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:40.227373 (+406410us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.565600 (+338227us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.565813 (+   213us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.565863 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:40.565916 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.565987 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.566111 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28074,"prepare.queue_time_us":603621,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":75,"raft.queue_time_us":28418,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8014,"spinlock_wait_cycles":30243328,"thread_start_us":715529,"threads_started":2,"wal-append.queue_time_us":356189}
W20260709 13:03:40.602017 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 212426us
I20260709 13:03:40.520895 18504 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:40.608016 15317 pending_rounds.cc:85] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 2
I20260709 13:03:40.609650 15317 pending_rounds.cc:107] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:03:40.568559 18592 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.520040 18054 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:40.569666 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:40.559876 18498 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:40.631915 18592 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:40.610723 18504 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:40.588487 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:40.593668 18384 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.002s
W20260709 13:03:40.636198 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66630.2us
I20260709 13:03:40.643438 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:40.644132 15245 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:40.645090 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:40.658510 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 50367.1us
I20260709 13:03:40.659405 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:40.584059 18282 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.665403 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:40.666198 15242 raft_consensus.cc:2368] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:40.661154 18496 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:40.592048 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 257288us
I20260709 13:03:40.674299 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:40.595098 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:40.675253 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 80228.6us
I20260709 13:03:40.596531 15392 pending_rounds.cc:85] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 3
I20260709 13:03:40.599007 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:40.677349 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:40.678043 15325 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:40.676093 15392 pending_rounds.cc:107] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:40.678874 15392 raft_consensus.cc:2889] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.676474 15394 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
W20260709 13:03:40.555588 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 232423us
I20260709 13:03:40.601472 15397 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:40.535970 18489 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.697708 18489 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.555783 18591 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.699733 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:40.701342 15394 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:40.701678 18591 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:40.701581 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:40.613200 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:40.702874 15393 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:40.702953 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:40.610572 18565 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.699695 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2297) took 1756 ms. Trace:
I20260709 13:03:40.705543 18565 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:40.615643 18510 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:40.618710 18557 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:40.624286 18604 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:40.704483 15316 rpcz_store.cc:276] 0709 13:03:38.943112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.803715 (+860603us) service_pool.cc:224] Handling call
0709 13:03:39.804043 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.804279 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:40.210925 (+406646us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.605857 (+394932us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.698334 (+ 92477us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.698490 (+   156us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:40.698729 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.698992 (+   263us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.699441 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91605,"prepare.queue_time_us":622006,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":100379,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":6597,"thread_start_us":796298,"threads_started":2,"wal-append.queue_time_us":390036}
W20260709 13:03:40.625512 18357 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.634s	user 0.012s	sys 0.000s
I20260709 13:03:40.626840 18494 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:40.583256 18563 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:03:40.642788 18054 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:40.695923 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:40.675925 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:40.600479 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:40.696103 18488 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:40.700006 18489 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:40.741231 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45390us
I20260709 13:03:40.611735 15317 raft_consensus.cc:2889] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:40.572182 15999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.711s (SENT) [suppressed 29 similar messages]
W20260709 13:03:40.718113 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 58850.6us
I20260709 13:03:40.743017 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:40.674731 18496 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:40.661291 18272 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:40.737075 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 61225.2us
W20260709 13:03:40.724822 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60377.3us
I20260709 13:03:40.675872 18220 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:40.723714 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:40.678408 18600 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:40.741969 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:40.744333 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 172163us
I20260709 13:03:40.661803 18587 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.668342 18495 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:03:40.737972 18604 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:40.739112 18584 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:40.776644 18386 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.777446 18197 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.715896 18437 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:40.758415 18600 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.770064 18489 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:40.771373 16026 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:40.771472 18264 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:40.772740 18619 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:03:40.725294 18361 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:40.740898 18546 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:40.739356 18594 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:40.755506 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.716965 18370 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:40.794632 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45608us
I20260709 13:03:40.720243 18494 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:40.780048 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.837692 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.863343 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:40.863036 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 121143us
I20260709 13:03:40.873646 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:40.877290 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:40.864626 15999 leader_election.cc:336] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.066s (SENT)
W20260709 13:03:40.779294 18629 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:40.842739 18608 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:40.882723 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:40.880941 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 118321us
I20260709 13:03:40.881111 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:40.879016 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 136092us
I20260709 13:03:40.869989 18546 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.753371 18572 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:40.751616 18496 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:40.874929 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:40.799372 18441 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:40.918502 15397 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:40.735064 18357 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:40.861536 18600 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:40.925601 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 50817.8us
W20260709 13:03:40.918699 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 167838us
W20260709 13:03:40.919243 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54659.3us
I20260709 13:03:40.927666 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:40.928282 15999 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.082s (SENT)
I20260709 13:03:40.920270 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:40.920320 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:40.880350 18045 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:40.888336 18437 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:40.862264 18594 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:40.933497 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:40.929189 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:03:40.933907 15999 leader_election.cc:336] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.175s (SENT)
I20260709 13:03:40.907090 18546 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:40.907353 18572 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.862103 18489 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.898659 18622 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:40.929416 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.929214 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:40.887914 18265 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:40.914135 18264 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:40.939747 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:40.937055 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 336555us
I20260709 13:03:40.925294 18495 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:40.927870 18370 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:40.942795 18572 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:40.930671 18045 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.053212 18045 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:40.938772 18612 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:40.982296 15322 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:03:40.985141 18622 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.058868 18272 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:41.060196 18197 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:40.928150 18220 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.062397 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:41.063138 16025 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:41.060245 18622 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:41.011811 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 82737.2us
I20260709 13:03:41.065798 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:41.065625 18437 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.066987 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:41.068086 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:41.068912 18370 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:41.069028 18197 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:41.069633 18197 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:41.070035 16025 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:03:41.070333 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:41.070574 18197 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.071597 18610 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:41.072877 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:40.859722 18488 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:40.880051 18590 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:03:40.921521 18017 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:41.046896 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 126744us
I20260709 13:03:41.012004 18386 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:40.926640 18054 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.929150 18608 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:41.069171 18504 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.071524 15363 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:40.937355 18594 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:40.980219 18520 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.000s
I20260709 13:03:40.935448 18494 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:40.933717 18592 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:03:40.990403 18489 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:40.983714 18566 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:41.078985 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:41.051378 18357 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:41.101498 18520 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.076514 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:41.021610 18631 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:41.082819 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 149435us
I20260709 13:03:41.010260 18361 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:41.121500 18636 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 13:03:41.073962 18616 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
I20260709 13:03:41.040473 18264 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.122802 18264 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:41.123260 18642 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:41.042913 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 113847us
W20260709 13:03:41.135123 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 56204.9us
I20260709 13:03:41.075559 18610 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:41.096552 18265 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:03:41.121134 18361 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.084821 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:41.141155 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 56402us
I20260709 13:03:41.101539 18645 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:41.097607 18622 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:41.073977 18358 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.000s
I20260709 13:03:41.126252 18590 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:41.126878 18045 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.127532 18386 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:41.130510 18626 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 13:03:41.131472 18264 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.118676 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:41.138852 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.201083 15250 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 4.
I20260709 13:03:41.139722 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:41.142119 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:41.084345 18495 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:41.109477 18635 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:03:41.108202 18637 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.361s	user 0.002s	sys 0.000s
I20260709 13:03:41.165969 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.101552 18625 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:41.167640 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.198490 18589 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:41.173012 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.110858 18520 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:41.196604 18357 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:41.178150 15247 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:41.174499 18587 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:41.109967 18608 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.248466 18623 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:41.111328 18504 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:41.097836 18272 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:03:41.204054 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.256748 18220 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:41.281793 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:41.125476 18017 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:41.107457 18566 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:41.239701 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 97682.8us
I20260709 13:03:41.150467 18610 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:41.242684 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 124070us
I20260709 13:03:41.316229 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:41.244740 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 310906us
W20260709 13:03:41.317481 15999 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.176s (SENT)
W20260709 13:03:41.142625 18628 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.393s	user 0.001s	sys 0.001s
I20260709 13:03:41.117195 18599 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:41.199800 18630 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:41.198083 18361 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:41.172612 18358 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.271615 15241 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:41.279390 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.108733 18498 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.250375 18590 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:41.203521 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84539.5us
I20260709 13:03:41.305406 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:41.396498 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 79046.4us
W20260709 13:03:41.387001 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 70867.1us
I20260709 13:03:41.402698 18590 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.387989 15247 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:41.405575 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:41.261775 18635 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:41.261457 18589 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:41.143222 18494 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:41.266944 18625 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:41.281961 18642 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:41.270793 18357 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.420199 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.421000 15243 raft_consensus.cc:2393] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:41.326951 18610 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:41.397217 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.406817 15246 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:41.387428 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:41.411403 15247 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:41.412278 15999 leader_election.cc:336] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.502s (SENT)
I20260709 13:03:41.414901 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.314796 18587 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:41.407321 18265 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:41.415499 18648 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:41.429432 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.403890 18630 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.414795 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.374307 18652 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:41.446378 15241 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 4.
I20260709 13:03:41.416179 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:41.429603 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.427551 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.443514 15242 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:41.447739 15250 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 9: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:41.429824 18642 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.453789 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:41.435760 18649 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 13:03:41.436391 18654 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:41.522532 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.534770 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:41.634065 15250 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.589583 18489 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.634277 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.452150 18656 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:03:41.579392 18594 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.425199 18660 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:41.583209 18358 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:41.583704 18645 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:41.443471 18587 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.522588 18265 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:41.586171 15242 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:41.435117 18655 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:41.427460 18665 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:41.618326 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.630023 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 213905us
I20260709 13:03:41.448828 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:41.682934 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 234156us
I20260709 13:03:41.685600 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:41.687011 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:41.688139 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:41.688899 15325 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:41.428066 18622 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:03:41.637625 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:41.436702 18590 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:41.699029 15316 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:41.658838 18045 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:41.646389 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 221720us
I20260709 13:03:41.703286 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:41.704906 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:41.430456 18566 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:41.455713 18648 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:41.697527 18546 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.001s
I20260709 13:03:41.679330 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:41.720947 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 168037us
I20260709 13:03:41.357856 18495 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.692834 15324 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:03:41.659858 18510 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.954s	user 0.011s	sys 0.000s
I20260709 13:03:41.723588 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:41.724233 15324 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:41.700281 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:41.454308 18630 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:41.652304 18652 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:41.688195 18600 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.752s	user 0.011s	sys 0.001s
I20260709 13:03:41.709034 15325 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:41.713400 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.727520 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.727944 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:41.728295 15242 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:41.728525 15316 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:03:41.666553 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.717535 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:41.729964 15320 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:41.730322 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.695837 18650 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:41.731488 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.735213 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.736599 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:41.737244 15324 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.727514 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:41.738441 15321 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:41.738480 15325 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:41.707448 18651 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:41.714689 18358 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:41.746814 15242 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:41.747292 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.740603 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:41.750378 18437 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:41.750689 18659 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:03:41.430804 18635 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.782151 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:41.782856 15320 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:41.762118 15246 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:41.749189 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.791646 18358 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:41.791896 18357 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:41.740414 18603 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.031s	sys 0.015s
I20260709 13:03:41.692626 18665 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.799616 15324 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:41.800690 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:41.801435 15324 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:41.781961 18649 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:41.639135 18589 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.664361 18660 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.740427 18555 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.739501 18668 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:41.795089 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:41.806134 15325 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:41.746624 18265 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:03:41.802923 18498 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:41.662667 18625 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.729427 18546 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:41.797268 18603 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.032s	sys 0.016s
I20260709 13:03:41.828104 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:41.773876 15250 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5.
I20260709 13:03:41.739169 18600 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:41.853137 15242 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:41.854691 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:41.855847 15325 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 9: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:41.828316 18668 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.807096 18488 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:03:41.851634 18197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.050s	sys 0.056s
I20260709 13:03:41.877768 15320 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:41.897277 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2322) took 1609 ms. Trace:
W20260709 13:03:41.889513 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 148996us
I20260709 13:03:41.873624 18589 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:41.907840 15365 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:41.897753 15317 rpcz_store.cc:276] 0709 13:03:40.288074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.605562 (+317488us) service_pool.cc:224] Handling call
0709 13:03:40.607712 (+  2150us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:40.793295 (+185583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.793343 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:40.800615 (+  7272us) log.cc:844] Serialized 78 byte log entry
0709 13:03:41.101113 (+300498us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:41.127647 (+ 26534us) log.cc:844] Serialized 14 byte log entry
0709 13:03:41.129581 (+  1934us) log.cc:844] Serialized 14 byte log entry
0709 13:03:41.136752 (+  7171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.137008 (+   256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.897033 (+760025us) raft_consensus.cc:1685] finished
0709 13:03:41.897052 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.897212 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18120,"prepare.queue_time_us":25578,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":25087,"raft.run_cpu_time_us":480,"raft.run_wall_time_us":31410,"thread_start_us":175422,"threads_started":1,"wal-append.queue_time_us":293834}
I20260709 13:03:41.913345 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:41.905901 15324 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:41.916649 15325 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:41.917758 15317 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:03:41.890753 18197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.050s	sys 0.056s
I20260709 13:03:41.922047 15317 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:41.828588 18555 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.926980 18587 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:41.843305 18652 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.815346 18648 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.929262 18546 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:41.929890 18594 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:41.888279 18668 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:41.824744 18358 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.939896 15316 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:41.911235 18489 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:41.956156 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:41.936054 18370 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:41.959525 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:41.960834 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2311) took 1701 ms. Trace:
I20260709 13:03:41.961824 15322 rpcz_store.cc:276] 0709 13:03:40.259166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.356680 (+ 97514us) service_pool.cc:224] Handling call
0709 13:03:40.357014 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.054616 (+697602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.960654 (+906038us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b5400375354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:41.960792 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341017472}
I20260709 13:03:41.955466 18659 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:41.958122 18437 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:41.975425 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:41.963505 18679 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:03:41.981848 18494 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.000s
I20260709 13:03:41.985785 18630 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:41.987818 18610 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.548s	user 0.005s	sys 0.003s
I20260709 13:03:41.988291 18610 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:41.990711 18630 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:41.997922 18610 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:41.999643 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:42.000227 18670 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:03:42.007439 18675 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:03:42.007953 18604 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:42.008304 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:42.008486 18604 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:41.975939 18489 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.040304 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.045269 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2299) took 3087 ms. Trace:
I20260709 13:03:42.052815 15317 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:42.061043 18282 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:42.080147 18680 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:03:42.081693 18630 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:42.046047 18054 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:42.082767 18054 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.084774 18660 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:42.046794 18600 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:42.082154 18630 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:42.067046 15323 rpcz_store.cc:276] 0709 13:03:38.957567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.916552 (+958985us) service_pool.cc:224] Handling call
0709 13:03:39.916891 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.917109 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:40.316204 (+399095us) log.cc:844] Serialized 14 byte log entry
0709 13:03:42.005948 (+1689744us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b18002ffa40. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f366d5f23c7 00007f3669c049a7 00007f3669c140bf
0709 13:03:42.006169 (+   221us) log.cc:844] Serialized 14 byte log entry
0709 13:03:42.044933 (+ 38764us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:42.044984 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:42.045033 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.045097 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.045213 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112925,"prepare.queue_time_us":519216,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":71606,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":4083,"spinlock_wait_cycles":11315328,"thread_start_us":751083,"threads_started":4,"wal-append.queue_time_us":469537,"wal-append.run_cpu_time_us":1158,"wal-append.run_wall_time_us":1027333}
I20260709 13:03:42.046125 18677 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:42.039558 18684 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:03:42.088342 18571 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:42.097700 18496 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.170s	user 0.007s	sys 0.007s
I20260709 13:03:42.046279 18489 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.138259 15395 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:42.114501 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:42.136195 15391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2390) took 1892 ms (client timeout 1514 ms). Trace:
I20260709 13:03:42.147790 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.114899 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.145893 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:42.146320 15391 rpcz_store.cc:269] 0709 13:03:40.243596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.135979 (+1892383us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:42.136125 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:42.151096 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:42.152247 18676 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:03:42.150619 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.153787 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1290) took 1015 ms. Trace:
I20260709 13:03:42.155052 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.154183 15249 rpcz_store.cc:276] 0709 13:03:41.137895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.138663 (+   768us) service_pool.cc:224] Handling call
0709 13:03:41.138963 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.318817 (+179854us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:41.662932 (+344115us) log.cc:844] Serialized 14 byte log entry
0709 13:03:41.869413 (+206481us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.869915 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:03:41.870038 (+   123us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:41.870071 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.870138 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.153560 (+283422us) raft_consensus.cc:1685] finished
0709 13:03:42.153580 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.153727 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20730,"prepare.queue_time_us":477944,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":5945,"raft.queue_time_us":131803,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":25103,"thread_start_us":633406,"threads_started":3,"wal-append.queue_time_us":273531}
I20260709 13:03:42.105116 18282 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:42.144538 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.157377 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.158159 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.161358 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.136437 18665 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:42.161954 15395 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:42.143844 15393 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:42.165395 15323 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:42.166491 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.167114 15396 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:42.167759 15393 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:42.170186 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:42.173285 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:42.173516 18687 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:03:42.142609 18496 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.157289 18630 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:42.172165 18572 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.093s	user 0.013s	sys 0.000s
I20260709 13:03:42.201176 15396 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:42.174055 18570 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:42.202129 15399 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:42.210467 18570 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:42.214543 18570 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.216015 18570 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.218986 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.220060 18572 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.221309 15398 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:42.222425 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.223145 18489 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:42.223713 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.225646 18496 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:42.226351 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.227628 18648 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:42.228492 18594 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:42.231451 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:42.232831 18515 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.232390 18594 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:42.233387 18648 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:42.237640 18665 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.238219 18665 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.240389 18665 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:42.241211 18054 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:42.243855 16025 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:42.246414 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:42.247495 18594 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:42.250711 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:42.251557 15324 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:42.252552 18677 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:42.233705 18515 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.253727 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:42.255319 18594 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:42.255648 18515 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:42.256036 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:42.256376 18677 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:42.206393 18681 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.157s	user 0.001s	sys 0.002s
I20260709 13:03:42.258992 18594 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.163867 18282 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.260684 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.265216 18608 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:42.276172 18608 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:42.276608 18608 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:42.276782 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.265655 18688 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:42.266939 18615 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.641s	user 0.004s	sys 0.000s
I20260709 13:03:42.267912 18572 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:42.268975 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.284199 15396 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:42.262028 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.287362 15398 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:42.288105 15247 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:42.288540 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.289436 15398 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:42.289729 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.290360 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.290892 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.291558 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.293008 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:42.271374 18673 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 13:03:42.267913 18610 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:42.275264 18437 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:42.264742 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:42.278035 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.277458 18282 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:42.293258 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.270208 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:42.296873 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.297549 15395 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:42.295218 15398 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:42.298794 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:42.294773 18610 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:42.308319 18610 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.259577 18594 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.300218 18652 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:42.319314 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 359) took 2152 ms. Trace:
I20260709 13:03:42.319880 15248 rpcz_store.cc:276] 0709 13:03:40.166702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.166843 (+   141us) service_pool.cc:224] Handling call
0709 13:03:40.167112 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.167442 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.167470 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:40.167908 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:03:40.524370 (+356462us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:40.524424 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.524521 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.266362 (+1741841us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:42.316917 (+ 50555us) raft_consensus.cc:1685] finished
0709 13:03:42.316949 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.319244 (+  2295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2162,"raft.queue_time_us":660,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":21086,"spinlock_wait_cycles":23619456,"thread_start_us":329255,"threads_started":1,"wal-append.queue_time_us":393376}
I20260709 13:03:42.301585 18384 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:03:42.316877 18652 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.311192 18045 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:03:42.322124 18610 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:42.312525 18437 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:03:42.324776 18635 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:42.331441 18515 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.337098 18652 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.369551 18677 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:42.372814 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 97722.2us
I20260709 13:03:42.332893 18668 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:42.376274 18557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.463s	user 0.015s	sys 0.031s
W20260709 13:03:42.382658 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 83966.7us
I20260709 13:03:42.373150 18515 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.390648 18608 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.391963 15393 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:42.389142 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:42.382920 18557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.484s	user 0.015s	sys 0.031s
I20260709 13:03:42.406596 18635 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:42.407011 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:42.410095 18635 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:42.410455 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2001) took 1814 ms. Trace:
I20260709 13:03:42.397153 18694 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:03:42.411309 18635 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:42.412089 18635 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:42.410979 15392 rpcz_store.cc:276] 0709 13:03:40.595843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.595979 (+   136us) service_pool.cc:224] Handling call
0709 13:03:40.596329 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:40.725739 (+129410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.725774 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:40.738147 (+ 12373us) log.cc:844] Serialized 52 byte log entry
0709 13:03:40.908627 (+170480us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:40.931951 (+ 23324us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.939549 (+  7598us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.981801 (+ 42252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.981914 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.407645 (+1425731us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b18004693c0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:42.410191 (+  2546us) raft_consensus.cc:1685] finished
0709 13:03:42.410214 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.410385 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35850,"prepare.queue_time_us":126897,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":49154,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":8400,"spinlock_wait_cycles":99513472,"thread_start_us":170100,"threads_started":1,"wal-append.queue_time_us":307501}
I20260709 13:03:42.413929 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.413735 18635 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.414705 15392 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:42.414752 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 1.66141e+06us
I20260709 13:03:42.415014 18635 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:42.415661 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.416340 15392 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:42.417693 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:42.423427 15392 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:42.424795 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.426635 15392 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:42.415609 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:42.429620 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2005) took 1733 ms. Trace:
I20260709 13:03:42.429600 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:42.433956 15291 leader_election.cc:400] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
I20260709 13:03:42.436862 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:42.416920 18694 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:03:42.442408 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:42.443045 15318 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:42.441089 15324 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:42.446586 18609 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.447255 18609 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:42.447706 18691 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:42.450218 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:42.451265 18495 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:42.451438 18604 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.454186 18604 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:42.430895 15397 rpcz_store.cc:276] 0709 13:03:40.697803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.702686 (+  4883us) service_pool.cc:224] Handling call
0709 13:03:42.429451 (+1726765us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002b5f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:42.429559 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449215744}
I20260709 13:03:42.455281 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:42.456195 15397 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:42.458026 15397 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:42.456611 15291 leader_election.cc:403] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:42.441466 18661 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:42.456275 18441 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:42.428812 18677 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:42.464294 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.464948 15248 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:42.466009 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.468022 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.468504 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:42.471882 15249 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:42.472582 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:42.473208 15318 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:42.472636 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:42.462075 18594 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:42.474653 18668 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:42.469295 18604 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 4. Current term is 5.
W20260709 13:03:42.462158 18606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.842s	user 0.009s	sys 0.004s
I20260709 13:03:42.475853 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:42.476320 18606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.856s	user 0.009s	sys 0.004s
I20260709 13:03:42.476611 15241 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:42.477649 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.438441 18563 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:42.439049 18696 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:03:42.478979 18571 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.479496 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:42.480026 18441 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:42.480273 15244 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:42.480703 18608 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:42.479570 18571 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.481091 18441 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.482734 18571 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:42.483580 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.483987 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.485133 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.487959 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.492193 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:42.480082 18515 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:42.500308 15318 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:42.510893 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:42.494346 15397 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:42.489073 18661 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:42.496347 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:42.515972 15241 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:42.517290 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.518324 15397 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:42.519519 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.491721 18265 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:42.464619 18659 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:03:42.493263 18563 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.537364 15291 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:42.493659 18604 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:42.536193 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:42.539378 15320 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:42.540494 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:42.541731 18604 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.543421 18563 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.544174 18604 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:42.545750 18563 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:42.537117 15397 raft_consensus.cc:2410] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:42.497771 18571 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.550539 18571 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.550427 18661 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.552870 18571 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:42.537283 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.534461 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:42.554971 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.555183 15241 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:42.555294 15316 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:42.556075 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.557380 15322 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:42.555054 15244 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:42.573282 15316 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:03:42.538722 18557 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:42.582813 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.592747 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:42.598817 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:42.609486 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 158998us
I20260709 13:03:42.610595 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:42.616084 15322 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:03:42.595719 18557 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.620019 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:42.623018 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.624229 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.622905 15397 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:42.600577 18688 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:42.627264 18495 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:42.632000 15213 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:42.595089 18571 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:03:42.625356 18557 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:42.625777 18606 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:42.629733 18494 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:42.630908 18688 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:42.657204 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 208932us
I20260709 13:03:42.660363 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:42.635090 18650 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:42.627923 18668 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:03:42.648506 18563 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:42.670483 15320 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:42.670938 16025 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:42.707304 15324 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:03:42.660686 18561 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.724005 18700 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:03:42.723685 18561 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:42.725772 18701 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:03:42.726478 18495 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.662410 18494 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:42.708602 18054 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.731066 18702 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:03:42.667872 18652 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.752130 18650 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:42.736469 18677 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:42.738550 18054 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.736176 18688 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.779102 18688 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:42.780066 18652 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:42.782752 18570 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:42.783205 18570 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:42.743142 18661 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:03:42.774389 18606 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:42.804702 18606 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.753912 18650 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:42.859232 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.867722 15242 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:42.867202 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.870020 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.871526 15248 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:42.873139 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.874493 15249 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 6: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:42.878341 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:42.878767 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.879118 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:42.879433 16024 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:42.880089 16030 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.881150 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:42.881836 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.882252 16028 raft_consensus.cc:2368] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5.
I20260709 13:03:42.882790 16027 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:03:42.883713 16029 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:03:42.881160 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.889801 15249 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:03:42.890385 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:42.878346 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.870281 15244 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:42.883724 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:42.784046 18054 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:42.896534 16028 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:42.897289 18054 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.898109 18054 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.895130 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.895183 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:42.931339 16030 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:42.940670 16033 raft_consensus.cc:2410] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:42.940687 18054 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:42.948544 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:42.784030 18570 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.768756 18494 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.959029 15324 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:03:42.959576 18725 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:42.960280 18677 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.961071 18725 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:42.961149 18677 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:42.966684 18677 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:42.961653 18725 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:42.975495 16028 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:42.983227 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.983894 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.984275 16030 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:42.986773 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.987521 18197 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:42.988037 18197 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:42.988243 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.988292 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.989445 16025 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:42.989801 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.989336 18197 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.991734 18197 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.992522 18725 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:42.990547 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:42.990732 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:42.995078 15390 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:43.003300 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:43.004259 16030 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:43.005465 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:43.007440 16025 raft_consensus.cc:2410] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:43.008526 18563 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:43.024276 18725 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:43.024567 18563 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:43.570067 18695 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:43.571281 18695 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:43.574568 18695 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:43.993502 18695 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:43.994632 18695 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:43.997628 18695 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:44.046752 15179 debug-util.cc:398] Leaking SignalData structure 0x7b0800277ca0 after lost signal to thread 14142
I20260709 13:03:44.189144 18743 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.193527 18743 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.194512 18695 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.195938 18695 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.196492 18743 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.198490 18695 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.199615 18371 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:44.200165 18371 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:44.201395 18371 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.203919 18371 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:44.235965 15998 connection.cc:256] RPC call timeout handler was delayed by -2.8399207740000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 13:03:44.238668 15998 connection.cc:256] RPC call timeout handler was delayed by -2.3908207739999625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260709 13:03:44.239210 15998 connection.cc:256] RPC call timeout handler was delayed by -1.9551574009999513s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 13:03:44.239617 15998 connection.cc:256] RPC call timeout handler was delayed by -1.30591482300008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
W20260709 13:03:44.244014 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.244889 15290 connection.cc:256] RPC call timeout handler was delayed by -1.1814968149999459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2842s for a response
I20260709 13:03:44.249066 18371 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.250593 18494 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.251307 18494 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.249924 18371 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.253005 18694 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.253943 18694 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.255203 18371 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.256546 18694 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:44.256924 18494 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:44.257323 15241 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.609s	user 0.003s	sys 0.015s
W20260709 13:03:44.257820 15241 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.610s	user 0.004s	sys 0.016s
I20260709 13:03:44.259451 18371 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.260674 18494 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.261495 18494 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.263918 18494 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.264011 18488 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:44.264482 18488 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:44.264571 18494 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.265327 18494 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.260232 18371 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.269549 18371 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.271759 18494 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.272738 18725 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.273166 18745 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.273543 18725 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.273793 18745 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.275972 18725 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:44.276027 18745 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.276707 18725 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.277431 18725 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.278569 18679 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.279107 18264 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:44.279260 18679 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.281711 18679 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:44.282394 18694 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.283099 18694 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.285465 18694 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:44.286134 18679 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.286978 18679 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.289428 18679 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:44.291185 18725 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:44.265863 18488 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.296609 18488 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.301745 15324 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:44.303311 18648 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:44.303861 18648 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:44.305202 18648 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.308828 18648 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:44.315209 16029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.287s	user 0.013s	sys 0.004s
W20260709 13:03:44.315914 16029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.288s	user 0.013s	sys 0.004s
I20260709 13:03:44.317016 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 570) took 1441 ms. Trace:
W20260709 13:03:44.318392 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 78078.2us
I20260709 13:03:44.321585 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:44.317565 16029 rpcz_store.cc:276] 0709 13:03:42.876104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.884848 (+  8744us) service_pool.cc:224] Handling call
0709 13:03:42.885289 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.952676 (+ 67387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.952720 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:43.027575 (+ 74855us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.316447 (+1288872us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:44.316509 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.316615 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.316678 (+    63us) raft_consensus.cc:1685] finished
0709 13:03:44.316696 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.316891 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68308,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":1616,"thread_start_us":1345822,"threads_started":2,"wal-append.queue_time_us":27221,"wal-append.run_cpu_time_us":2762,"wal-append.run_wall_time_us":1084708}
I20260709 13:03:44.329823 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:44.343250 18747 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:44.344568 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.364125 18496 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:44.365368 18555 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:44.367223 15214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.718s	user 0.012s	sys 0.008s
W20260709 13:03:44.367671 15214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.718s	user 0.012s	sys 0.008s
I20260709 13:03:44.369242 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:44.371066 15289 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:44.371516 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.372756 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.373093 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.373876 18571 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:44.375389 18571 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:44.375856 18571 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.376281 18571 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.378427 18488 raft_consensus.cc:476] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:03:44.379709 18679 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.380376 18679 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.382436 18694 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:44.383517 18694 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.386505 18571 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.387413 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:44.388157 15324 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:44.390257 18571 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:44.397128 18749 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.401119 18498 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:44.401603 18498 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:44.402860 18498 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.404115 18498 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:44.406474 16024 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 1.526s	user 0.014s	sys 0.019s
I20260709 13:03:44.406901 16024 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:44.407501 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 669) took 1533 ms. Trace:
I20260709 13:03:44.332299 18494 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.355402 18748 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:03:44.407836 16024 rpcz_store.cc:276] 0709 13:03:42.873817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.877522 (+  3705us) service_pool.cc:224] Handling call
0709 13:03:44.407404 (+1529882us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8448}
I20260709 13:03:44.408916 18494 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.409446 18748 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:44.409925 18748 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:44.413156 18679 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:44.398006 18749 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.411478 18748 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.411831 18494 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.360306 18609 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:44.468614 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49246us
I20260709 13:03:44.470075 18748 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:44.471586 16031 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:44.455391 18494 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:44.386134 18694 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:44.473340 18494 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.477558 18494 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:44.478282 18494 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.481904 18749 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.484417 18494 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.487612 18494 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.490041 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:44.492122 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:44.492920 15324 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:44.494560 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:44.495388 15324 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:44.496817 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:44.497480 15324 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:44.498952 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:44.499809 15324 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
W20260709 13:03:44.499012 18557 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.846s	user 0.023s	sys 0.014s
I20260709 13:03:44.500962 18557 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.503376 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:44.511243 18606 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.563s	user 0.029s	sys 0.037s
I20260709 13:03:44.518317 15324 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
W20260709 13:03:44.518754 18606 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.571s	user 0.029s	sys 0.038s
I20260709 13:03:44.516028 18557 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:44.522066 15390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2396) took 2385 ms (client timeout 1578 ms). Trace:
W20260709 13:03:44.522606 15390 rpcz_store.cc:269] 0709 13:03:42.136629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.138492 (+  1863us) service_pool.cc:224] Handling call
0709 13:03:44.521674 (+2383182us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54000280d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:44.521926 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937591040}
W20260709 13:03:44.524412 18563 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.499s	user 0.018s	sys 0.004s
I20260709 13:03:44.524765 15392 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:44.524897 18563 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.527714 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2013) took 2274 ms. Trace:
I20260709 13:03:44.543422 15392 rpcz_store.cc:276] 0709 13:03:42.253474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.427782 (+174308us) service_pool.cc:224] Handling call
0709 13:03:44.524378 (+2096596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.525350 (+   972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.527446 (+  2096us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54000280d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:44.527612 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4820820736}
I20260709 13:03:44.544013 18563 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:44.545473 18265 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.546200 18265 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.556658 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:44.557715 18563 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:44.558185 18563 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.558586 18563 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:44.558917 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:44.562047 15999 leader_election.cc:336] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.703s (SENT)
I20260709 13:03:44.562685 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:44.563529 18748 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:44.564972 15999 leader_election.cc:336] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.711s (SENT)
I20260709 13:03:44.565565 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:44.566850 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1304) took 2981 ms. Trace:
I20260709 13:03:44.567301 15247 rpcz_store.cc:276] 0709 13:03:41.585047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.590588 (+  5541us) service_pool.cc:224] Handling call
0709 13:03:41.644138 (+ 53550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.288602 (+644464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.565080 (+2276478us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b540025bcd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:44.566650 (+  1570us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480333184}
I20260709 13:03:44.574738 18745 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:44.574982 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:44.575940 15324 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:44.575592 18745 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.577165 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:44.577913 15320 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:44.578893 18748 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:44.579499 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:44.579563 18748 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.582348 18745 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:44.583503 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.583984 15996 connection.cc:256] RPC call timeout handler was delayed by -1.4123003840001047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 13:03:44.584331 15996 connection.cc:256] RPC call timeout handler was delayed by -1.1029649539999582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
I20260709 13:03:44.586483 18748 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.588496 18749 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:44.590097 18589 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:44.590605 18589 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:44.591972 18589 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.592823 18563 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.595615 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:44.597424 18745 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:44.598053 18745 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:44.599658 18748 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:44.599212 18745 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.607913 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2409) took 2393 ms. Trace:
W20260709 13:03:44.615410 15322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 366) took 2105 ms (client timeout 2028 ms). Trace:
W20260709 13:03:44.615983 15322 rpcz_store.cc:269] 0709 13:03:42.509667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.510549 (+   882us) service_pool.cc:224] Handling call
0709 13:03:44.614970 (+2104421us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b54002ed1d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:44.615167 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104859392}
W20260709 13:03:44.618854 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.967s	user 0.014s	sys 0.007s
W20260709 13:03:44.615728 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 50842.3us
W20260709 13:03:44.619398 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.968s	user 0.015s	sys 0.008s
W20260709 13:03:44.619699 15999 connection.cc:256] RPC call timeout handler was delayed by -1.2837358660000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
W20260709 13:03:44.619856 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 1.96973e+06us
W20260709 13:03:44.620126 15999 connection.cc:256] RPC call timeout handler was delayed by -1.2585358659999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 13:03:44.620527 15999 connection.cc:256] RPC call timeout handler was delayed by -1.2516145270000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
W20260709 13:03:44.621232 15999 connection.cc:256] RPC call timeout handler was delayed by -1.1454145270000708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
I20260709 13:03:44.621345 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:44.621631 15999 connection.cc:256] RPC call timeout handler was delayed by -1.1265145270000403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:03:44.621994 15999 connection.cc:256] RPC call timeout handler was delayed by -1.1079005379999671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:03:44.622304 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.623142 15395 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:44.623332 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.623885 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:44.624248 15397 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:44.624948 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:44.625409 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.625938 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.626688 15398 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:44.627584 18608 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:44.628408 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:44.625437 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.629577 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:44.629705 15396 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:44.629874 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:44.625564 16028 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:44.631220 16030 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:03:44.631809 15179 debug-util.cc:398] Leaking SignalData structure 0x7b08001e1fc0 after lost signal to thread 15182
I20260709 13:03:44.632296 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:44.633353 16030 raft_consensus.cc:2410] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:44.628587 18608 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:44.612108 18561 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:44.634486 18608 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.613579 15393 rpcz_store.cc:276] 0709 13:03:42.214026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.278901 (+ 64875us) service_pool.cc:224] Handling call
0709 13:03:42.300703 (+ 21802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.392372 (+ 91669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.607399 (+2215027us) spinlock_profiling.cc:243] Waited 91 ms on lock 0x7b54003d90d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:44.607734 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209403264}
I20260709 13:03:44.635043 18608 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:44.635743 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:44.638634 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:44.639379 16025 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.640619 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:44.641304 16030 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:44.626612 15392 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:03:44.642373 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:44.643215 16026 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:03:44.643697 16026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 582) took 1655 ms (client timeout 1740 ms). Trace:
W20260709 13:03:44.644039 16026 rpcz_store.cc:269] 0709 13:03:42.988035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.989504 (+  1469us) service_pool.cc:224] Handling call
0709 13:03:44.643624 (+1654120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.647981 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:44.649173 18696 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:44.649621 18696 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.650009 18696 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:44.626720 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.655568 15391 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:44.645816 16026 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:44.632236 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:44.658728 16033 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:44.661319 16024 raft_consensus.cc:2410] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:44.663710 16024 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:44.674259 16028 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:44.685075 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 363) took 2180 ms. Trace:
I20260709 13:03:44.690153 15323 rpcz_store.cc:276] 0709 13:03:42.504758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.504938 (+   180us) service_pool.cc:224] Handling call
0709 13:03:42.507535 (+  2597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.544919 (+ 37384us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:42.545148 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 13:03:42.720271 (+175123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:42.720353 (+    82us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:42.720417 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.161272 (+1440855us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b18003dba00. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:44.681689 (+520417us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b18003dba00. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240
0709 13:03:44.683193 (+  1504us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b18003dba00. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419
0709 13:03:44.684513 (+  1320us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b5400078354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:44.684559 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.684848 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9077,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":114,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":542863616,"thread_start_us":174701,"threads_started":1,"wal-append.queue_time_us":229434}
W20260709 13:03:44.677173 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.677611 15321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1335) took 4284 ms (client timeout 1799 ms). Trace:
W20260709 13:03:44.750523 15321 rpcz_store.cc:269] 0709 13:03:40.393500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.397987 (+  4487us) service_pool.cc:224] Handling call
0709 13:03:44.677205 (+4279218us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400374954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:44.677381 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3079230208}
W20260709 13:03:44.751058 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 146044us
I20260709 13:03:44.678661 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.752074 15392 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:44.753432 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.686728 15399 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.687305 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:44.688119 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:44.689549 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.754199 15392 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:44.759502 15391 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:44.760226 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:44.674356 18572 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:44.761067 18572 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:44.758742 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 71548.2us
I20260709 13:03:44.696616 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1346) took 2999 ms. Trace:
W20260709 13:03:44.700886 18657 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 2.815s	user 0.010s	sys 0.016s
I20260709 13:03:44.702710 18608 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.701917 18696 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.676388 18563 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:44.716142 18384 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:44.717379 18661 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:44.717870 15214 connection.cc:256] RPC call timeout handler was delayed by -1.2178891959999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
I20260709 13:03:44.717988 18723 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:44.781694 15214 connection.cc:256] RPC call timeout handler was delayed by -1.1845891960000472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 13:03:44.783246 15214 connection.cc:256] RPC call timeout handler was delayed by -1.1521891959999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1734s for a response
I20260709 13:03:44.718468 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 374) took 1842 ms. Trace:
I20260709 13:03:44.718708 16031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 572) took 1765 ms. Trace:
I20260709 13:03:44.721215 18668 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.722571 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:44.722807 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 102065us
I20260709 13:03:44.723640 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.723860 15247 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:44.724745 15249 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:44.721853 18284 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.722803 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2051) took 2098 ms. Trace:
I20260709 13:03:44.731451 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.721810 18706 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:44.733863 15246 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:44.738718 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2321) took 4457 ms. Trace:
I20260709 13:03:44.758867 18630 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.744731 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:44.745738 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.746788 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 670) took 1872 ms. Trace:
W20260709 13:03:44.801306 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.801889 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.748149 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:44.760347 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.761283 15392 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:44.698889 16032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.699s	user 0.030s	sys 0.042s
I20260709 13:03:44.692770 15289 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:44.763651 15325 rpcz_store.cc:276] 0709 13:03:41.696831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.867636 (+170805us) service_pool.cc:224] Handling call
0709 13:03:41.916411 (+ 48775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.917254 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.696219 (+2778965us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b54001e5fd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:44.696432 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111396608}
I20260709 13:03:44.764734 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:44.773953 16025 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
W20260709 13:03:44.778508 18197 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.786s	user 0.014s	sys 0.019s
I20260709 13:03:44.784085 16031 rpcz_store.cc:276] 0709 13:03:42.957572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.959294 (+  1722us) service_pool.cc:224] Handling call
0709 13:03:44.469398 (+1510104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.473819 (+  4421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.718458 (+244639us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400632c50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:44.718620 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3340130688}
I20260709 13:03:44.781370 18384 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:44.805977 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:44.807730 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.793737 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:44.742884 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.798688 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:44.804435 16032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.807s	user 0.031s	sys 0.043s
I20260709 13:03:44.780200 18592 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:44.799177 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 111209us
I20260709 13:03:44.805087 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:44.810055 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.810344 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:44.810997 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.832629 15245 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.791591 15241 rpcz_store.cc:276] 0709 13:03:42.624846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.624988 (+   142us) service_pool.cc:224] Handling call
0709 13:03:42.633340 (+  8352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.633554 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:44.294598 (+1661044us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.722305 (+427707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.722383 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:44.722458 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.722568 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.722752 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":395755,"prepare.queue_time_us":92952,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":395955,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":133,"thread_start_us":1641194,"threads_started":2,"wal-append.queue_time_us":31730}
I20260709 13:03:44.811223 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.811550 18706 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.812096 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.812304 18717 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:44.812693 18704 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.791002 18668 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.813275 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.812779 18384 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.813755 18017 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:44.814311 18370 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:44.814903 18723 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.815094 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.795841 15319 rpcz_store.cc:276] 0709 13:03:40.281746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.589755 (+308009us) service_pool.cc:224] Handling call
0709 13:03:40.590132 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:42.236456 (+1646324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.236519 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:42.237279 (+   760us) log.cc:844] Serialized 52 byte log entry
0709 13:03:42.332159 (+ 94880us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:42.363018 (+ 30859us) log.cc:844] Serialized 14 byte log entry
0709 13:03:42.371291 (+  8273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.853688 (+482397us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b18002cc140. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419
0709 13:03:44.738043 (+1884355us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54001e5ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:44.738098 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.738195 (+    97us) raft_consensus.cc:1685] finished
0709 13:03:44.738206 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.738489 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28179,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":12997,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":3693,"spinlock_wait_cycles":3788075008,"thread_start_us":94268,"threads_started":1,"wal-append.queue_time_us":144704,"wal-append.run_cpu_time_us":2405,"wal-append.run_wall_time_us":1029138}
I20260709 13:03:44.810891 18284 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.819263 18496 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:44.820799 18282 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:44.821655 18561 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:03:44.822880 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 78408.1us
I20260709 13:03:44.823479 18612 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:03:44.849401 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.828119 18608 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:44.810390 15214 leader_election.cc:400] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5.
I20260709 13:03:44.874708 15214 leader_election.cc:403] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:44.829367 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.869102 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.875056 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.829878 18661 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.789746 18572 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.876223 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.877198 18572 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:44.831228 15179 debug-util.cc:398] Leaking SignalData structure 0x7b08001499c0 after lost signal to thread 15202
W20260709 13:03:44.878692 15179 debug-util.cc:398] Leaking SignalData structure 0x7b08001c23e0 after lost signal to thread 15274
W20260709 13:03:44.879033 15179 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca4a0 after lost signal to thread 15275
W20260709 13:03:44.880167 15179 debug-util.cc:398] Leaking SignalData structure 0x7b08001a3e40 after lost signal to thread 15349
W20260709 13:03:44.880476 15179 debug-util.cc:398] Leaking SignalData structure 0x7b08002abcc0 after lost signal to thread 15350
I20260709 13:03:44.876255 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:44.881636 15179 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3020 after lost signal to thread 15423
I20260709 13:03:44.783967 15248 rpcz_store.cc:276] 0709 13:03:42.876338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.893397 (+ 17059us) service_pool.cc:224] Handling call
0709 13:03:42.893915 (+   518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.427344 (+1533429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.427379 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.427994 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.469455 (+ 41461us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:44.498175 (+ 28720us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.718074 (+219899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.718154 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.718193 (+    39us) raft_consensus.cc:1685] finished
0709 13:03:44.718204 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.718385 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1679097,"prepare.queue_time_us":47389,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":1718586,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":208,"thread_start_us":68488,"threads_started":2,"wal-append.queue_time_us":44220}
I20260709 13:03:44.791355 18747 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.884506 18747 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.816264 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.838219 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:44.801168 16027 rpcz_store.cc:276] 0709 13:03:42.874356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.883590 (+  9234us) service_pool.cc:224] Handling call
0709 13:03:42.884072 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.884829 (+   757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.884858 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.885852 (+   994us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.981691 (+ 95839us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:42.981728 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.981812 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.746546 (+1764734us) raft_consensus.cc:1685] finished
0709 13:03:44.746571 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.746728 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29469,"raft.run_cpu_time_us":570,"raft.run_wall_time_us":29100,"thread_start_us":74438,"threads_started":1,"wal-append.queue_time_us":157565,"wal-append.run_cpu_time_us":2597,"wal-append.run_wall_time_us":1008942}
I20260709 13:03:44.849872 15390 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.846982 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:44.851002 18384 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:44.894737 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 59662.7us
I20260709 13:03:44.851186 18703 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:44.851611 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.848910 18471 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:44.852501 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:44.846119 18704 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:44.854537 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.907811 15396 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:44.908509 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 170480us
W20260709 13:03:44.909025 15215 connection.cc:256] RPC call timeout handler was delayed by -1.6298382549999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
I20260709 13:03:44.909106 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.854689 18284 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.854413 18017 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.913014 18017 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.855166 18612 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.913887 18612 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:44.857120 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.857808 18696 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:44.858266 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 165630us
I20260709 13:03:44.919673 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:44.920511 15289 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:44.850492 18265 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:44.922103 18282 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:44.922585 18282 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:44.922977 18282 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:44.923651 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.923971 18265 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:44.859539 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.925446 15391 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:44.925793 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.859849 15244 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:44.927515 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.860378 18723 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.843091 18370 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.861392 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.859568 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.862393 18570 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:44.866314 18678 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:44.866588 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:44.867409 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.869065 18706 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:44.870944 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.872156 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.873760 18589 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:44.874070 18668 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:44.877264 18661 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:44.878576 18717 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:44.837623 15399 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
W20260709 13:03:44.889256 15179 debug-util.cc:398] Leaking SignalData structure 0x7b080038f940 after lost signal to thread 16057
W20260709 13:03:44.950155 15179 debug-util.cc:398] Leaking SignalData structure 0x7b08001b6ee0 after lost signal to thread 16058
I20260709 13:03:44.845275 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 666) took 1972 ms. Trace:
I20260709 13:03:44.886906 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:44.897851 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.898195 15245 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
W20260709 13:03:44.898598 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 88434.7us
I20260709 13:03:43.289742 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:44.902030 15241 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:44.832342 18592 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:44.924943 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:44.933961 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.920529 15393 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:44.939662 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 98938.4us
I20260709 13:03:44.945699 15397 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:44.906935 18471 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.901556 18703 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:44.939214 18608 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:44.960330 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.959486 15392 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:44.942648 18370 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:44.968250 15396 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:44.980019 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:44.981274 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 141865us
I20260709 13:03:44.981479 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:44.956081 18748 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:03:44.988046 15399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2407) took 2774 ms (client timeout 1840 ms). Trace:
I20260709 13:03:44.956633 18717 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:44.988605 15399 rpcz_store.cc:269] 0709 13:03:42.213344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.226058 (+ 12714us) service_pool.cc:224] Handling call
0709 13:03:44.961687 (+2735629us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b54003d86d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:44.987951 (+ 26264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5656541568}
I20260709 13:03:44.959179 18696 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.970482 18703 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:44.950585 16032 rpcz_store.cc:276] 0709 13:03:42.872421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.895886 (+ 23465us) service_pool.cc:224] Handling call
0709 13:03:42.896507 (+   621us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.955737 (+ 59230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.955778 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.982320 (+ 26542us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.808972 (+1826652us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:44.817465 (+  8493us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.844930 (+ 27465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.845005 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.845053 (+    48us) raft_consensus.cc:1685] finished
0709 13:03:44.845066 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.845212 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7432,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":80,"raft.queue_time_us":60598,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":3264,"thread_start_us":1891162,"threads_started":3,"wal-append.queue_time_us":166370,"wal-append.run_cpu_time_us":2321,"wal-append.run_wall_time_us":1002342}
I20260709 13:03:44.995879 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.964159 18471 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:44.995719 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.987444 15249 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:44.997202 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:44.966751 18725 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.966979 18608 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:45.002929 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.004716 15393 raft_consensus.cc:2410] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:03:44.974313 18265 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:45.008563 18610 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:45.008754 18265 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.009250 18610 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.010401 18725 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.011241 18265 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:45.012692 18725 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:45.013506 15397 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:45.014129 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:45.014614 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.015671 15291 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:45.015911 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.016610 15291 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:45.017230 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.018100 15391 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:45.018982 18592 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:45.020191 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.025235 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:45.028591 15999 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.103s (SENT)
W20260709 13:03:45.025547 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 182252us
I20260709 13:03:45.019027 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.031761 15243 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:45.039731 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:45.045007 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:44.993908 18496 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:45.020015 18358 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 4. Current term is 5.
I20260709 13:03:45.022796 18696 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.025290 18471 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.027841 18608 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:45.059921 15323 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:45.059990 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.075152 15397 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:45.041512 18592 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:45.060091 15391 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.076344 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.042569 18563 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:45.052115 18371 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:45.059695 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:45.055970 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:45.065990 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 84710.2us
I20260709 13:03:45.084432 15319 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:45.053164 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:45.083037 15392 raft_consensus.cc:2410] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:03:45.079200 18471 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:45.059391 18604 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:45.095328 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.021984 18282 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:45.096498 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 142940us
W20260709 13:03:45.099851 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 60234.5us
I20260709 13:03:45.057032 18747 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:45.068526 18696 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:45.105140 16026 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:45.105866 15321 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 9: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:45.084240 18563 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.080031 18748 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:45.108702 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.120230 15323 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:45.059909 18384 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:03:45.134599 15317 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:45.135962 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:45.137295 18495 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:45.139201 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:45.143029 18704 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:45.144749 15322 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:45.125694 15319 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:03:45.059382 15148 catalog_manager.cc:5697] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:45.137979 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:45.153316 15396 raft_consensus.cc:2410] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:45.158067 18361 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:45.158655 18361 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:45.159337 18361 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:45.159772 18441 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:03:45.161312 18761 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:03:45.152429 18747 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:45.162119 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:45.163034 15321 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:45.167959 18282 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:45.171005 18748 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.172304 18587 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:45.173064 18587 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:45.176540 15320 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:45.108492 18371 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:45.158490 18612 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.129338 18563 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:45.173180 18495 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:45.204854 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:45.206605 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:45.207381 15319 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.208184 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.209043 15399 raft_consensus.cc:2410] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:45.132261 18717 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.223373 15392 raft_consensus.cc:2368] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8.
I20260709 13:03:45.230163 18717 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:45.231758 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:45.232687 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 94837.8us
I20260709 13:03:45.235543 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.240829 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.245095 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:45.275220 15322 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:45.184919 18471 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:03:45.286322 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.286803 18678 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.195734 18747 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:03:45.292887 15398 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:03:45.294631 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:45.295761 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.302853 15399 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:45.300058 15396 raft_consensus.cc:2376] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8. Re-sending same reply.
I20260709 13:03:45.244290 18755 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:45.309270 18678 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.320475 18678 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:45.321444 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 321102us
W20260709 13:03:45.322278 15999 leader_election.cc:336] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.134s (SENT)
I20260709 13:03:45.322652 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:45.323689 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.323933 15999 leader_election.cc:336] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.287s (SENT)
I20260709 13:03:45.324358 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:45.324714 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.322644 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.328159 15399 raft_consensus.cc:2368] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:03:45.331921 15322 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:45.325986 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.335001 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.335625 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.335870 15399 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:45.186388 18587 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.339908 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.340715 15399 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:45.341024 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:45.341676 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.341763 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:45.342370 18771 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:45.343475 18745 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:45.343933 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:45.344612 15318 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:45.343502 15323 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:45.237174 18496 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:03:45.347054 15241 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:45.338716 15392 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 9: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:45.344641 15324 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:03:45.346299 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46758.8us
I20260709 13:03:45.335554 18747 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:45.357260 18765 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:45.357755 18765 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:45.355043 18371 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.371920 18769 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:45.372608 18769 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.377327 15390 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:45.377120 18370 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.378455 15395 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:45.379122 18769 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:45.369510 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:45.383219 16033 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.369773 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:45.368527 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:45.343935 18745 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:45.391096 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.394344 15322 raft_consensus.cc:2393] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:45.395772 15391 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:45.400040 15390 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:45.396076 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:45.407651 15399 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:45.395579 18572 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.002s
I20260709 13:03:45.396908 18745 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.414588 15391 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:45.416409 18612 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:45.419543 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:45.409991 18630 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.002s
I20260709 13:03:45.420555 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:45.449710 15241 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:45.421308 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:45.426879 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:45.427520 18045 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:45.430029 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.450862 15243 raft_consensus.cc:2410] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:03:45.395812 18361 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.433538 18384 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:45.435210 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 191198us
W20260709 13:03:45.439091 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.420434 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:45.451917 15396 raft_consensus.cc:2410] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:45.465366 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:45.467190 15392 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:45.469836 18361 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:45.471570 18045 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:45.471972 18471 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.472813 15319 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:45.479552 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:45.481346 15321 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:45.484530 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.483680 15399 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:45.457993 18384 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:45.477778 18589 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
I20260709 13:03:45.491170 15394 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:45.500382 16029 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:45.503736 18755 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:45.504377 18755 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.426054 18604 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:03:45.486693 18769 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:45.516278 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 151555us
I20260709 13:03:45.517143 15291 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:45.513724 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 133822us
W20260709 13:03:45.519081 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.522400 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:45.495116 18370 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:45.523121 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:45.506575 18488 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.526199 15316 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:45.528016 15392 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:45.472585 18045 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.529132 16033 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
W20260709 13:03:45.550042 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.565435 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.568596 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:45.571204 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 48170.7us
I20260709 13:03:45.573010 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:45.578816 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 86585us
I20260709 13:03:45.607862 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.613456 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:45.614564 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:45.569358 18604 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:45.617914 18604 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:45.619093 18604 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.620750 18604 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:45.622668 18610 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:45.624177 18726 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:45.641959 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:45.609071 15392 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:45.655896 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.656988 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:45.661496 15392 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:45.662863 15392 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:45.599049 18361 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:45.529433 18488 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.667425 15390 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:45.671072 15392 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:45.674996 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:45.664956 18703 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.002s
W20260709 13:03:45.679091 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 162022us
I20260709 13:03:45.664460 18726 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:45.683110 15392 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:45.689677 15390 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:03:45.694772 15392 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:45.692458 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:45.691079 15390 pending_rounds.cc:85] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 2
W20260709 13:03:45.701023 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 59237.5us
I20260709 13:03:45.601444 18384 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.703452 15324 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:45.704766 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 131858us
I20260709 13:03:45.703989 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:45.683288 18371 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:45.679674 18777 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:45.698935 18361 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:45.699246 15390 pending_rounds.cc:107] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:03:45.720822 15390 raft_consensus.cc:2889] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:45.713295 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.698851 18749 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:45.706882 18608 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.613s	user 0.005s	sys 0.007s
I20260709 13:03:45.690459 18703 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:45.735617 18766 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.434s	user 0.008s	sys 0.005s
I20260709 13:03:45.735193 15148 catalog_manager.cc:5697] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 3 to 6, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 6 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:45.751619 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:45.737507 15145 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49174 (request call id 239) took 32771 ms (client timeout 15000 ms). Trace:
I20260709 13:03:45.741178 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:45.743309 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.752465 15391 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:45.722903 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 66001.2us
I20260709 13:03:45.706372 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:45.749446 18361 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:45.757870 15148 catalog_manager.cc:5697] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:45.759807 15148 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:45.754936 18777 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:45.762969 18777 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.763427 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.764287 15392 raft_consensus.cc:2376] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8. Re-sending same reply.
I20260709 13:03:45.765700 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.823767 15391 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:45.823911 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 117683us
I20260709 13:03:45.761705 15148 catalog_manager.cc:5697] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 4 to 7, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 7 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:45.754158 18608 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.755641 18770 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:03:45.795481 18384 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:45.762977 15390 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:45.823280 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:45.824501 15392 raft_consensus.cc:2410] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:03:45.825013 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.758172 18361 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.825390 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:45.826092 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.826941 15393 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:45.823289 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 68961us
I20260709 13:03:45.846956 15390 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:45.851205 15325 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:45.833609 18783 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:45.853991 18783 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:45.854422 18783 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:45.855059 18765 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:45.856570 18765 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:45.858954 18358 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:45.859323 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2041) took 1184 ms. Trace:
I20260709 13:03:45.847760 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:45.860414 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 142422us
I20260709 13:03:45.860736 15391 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:45.859781 15395 rpcz_store.cc:276] 0709 13:03:44.675186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.791839 (+116653us) service_pool.cc:224] Handling call
0709 13:03:45.859080 (+1067241us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54001da954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:45.859222 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156257536}
I20260709 13:03:45.864641 15397 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 9. Ops: []
I20260709 13:03:45.868795 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:45.870476 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.860534 18284 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:03:45.873808 15322 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:45.873910 15316 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:45.874572 18358 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:45.875003 18358 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:45.875641 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 84366.5us
I20260709 13:03:45.875880 18358 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.859344 18661 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:45.877095 18661 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:45.877242 18358 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:45.877444 18371 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:45.874619 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2052) took 1194 ms. Trace:
W20260709 13:03:45.878551 15394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2392) took 3764 ms (client timeout 1556 ms). Trace:
I20260709 13:03:45.868229 18612 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.864305 18610 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.864125 18370 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.880404 15390 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.878146 18661 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.879158 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:45.878459 15323 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:45.871886 15324 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:45.879624 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:45.898058 15391 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:45.899025 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:45.876526 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.879072 15394 rpcz_store.cc:269] 0709 13:03:42.114200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.115008 (+   808us) service_pool.cc:224] Handling call
0709 13:03:45.878347 (+3763339us) spinlock_profiling.cc:243] Waited 3.33 s on lock 0x7b5400271354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:45.878483 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7654589696}
I20260709 13:03:45.878988 15398 rpcz_store.cc:276] 0709 13:03:44.680260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.812970 (+132710us) service_pool.cc:224] Handling call
0709 13:03:45.874453 (+1061483us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001d9554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:45.874569 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032743168}
I20260709 13:03:45.830432 18648 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:45.884399 15321 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:45.885041 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:45.872787 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:45.887748 15399 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:03:45.903378 15399 pending_rounds.cc:85] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 3
I20260709 13:03:45.903731 15399 pending_rounds.cc:107] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:03:45.904019 15399 raft_consensus.cc:2889] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.887516 18630 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.889894 18265 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.912560 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 502) took 1275 ms. Trace:
I20260709 13:03:45.913204 16026 rpcz_store.cc:276] 0709 13:03:44.637304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.657579 (+ 20275us) service_pool.cc:224] Handling call
0709 13:03:44.658011 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.123065 (+465054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.912208 (+789143us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400474d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:45.912478 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027799936}
I20260709 13:03:45.889555 18610 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:45.970160 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 63095.9us
I20260709 13:03:45.889449 15148 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 4 to 5, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 5 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:45.890321 18572 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.890924 15396 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:45.890758 18370 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:45.892584 18563 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.000s
I20260709 13:03:45.893680 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:45.894686 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:45.977000 16027 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:45.899485 15390 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:45.977916 15394 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 5. Current term is 7. Ops: []
I20260709 13:03:45.899762 15391 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:45.909001 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:45.756909 18749 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:45.920358 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.886912 18770 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:45.969300 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:45.983177 16024 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
W20260709 13:03:45.908681 15998 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.671s (SENT) [suppressed 52 similar messages]
I20260709 13:03:45.980104 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:45.988788 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 119211us
I20260709 13:03:45.906203 18787 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:45.993985 15398 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:45.990214 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:45.997713 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88829.3us
I20260709 13:03:45.969713 18496 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:45.969527 18726 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:45.998850 15395 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:45.976588 18265 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.016654 18624 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:45.991669 18572 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:45.992892 18284 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:46.018821 15394 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:03:46.017930 15148 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 4 to 5, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 5 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:45.896070 18612 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:45.752475 15145 rpcz_store.cc:269] 0709 13:03:12.966242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.970970 (+  4728us) service_pool.cc:224] Handling call
0709 13:03:45.737198 (+32766228us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:37.778072 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:37.918690 (+140618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:37.942654 (+ 23964us) write_op.cc:435] Acquired schema lock
0709 13:03:37.943414 (+   760us) tablet.cc:662] Decoding operations
0709 13:03:38.033445 (+ 90031us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:38.033499 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:38.033533 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:03:38.034213 (+   680us) tablet.cc:701] Row locks acquired
0709 13:03:38.034269 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:03:38.034422 (+   153us) write_op.cc:270] Start()
0709 13:03:38.034552 (+   130us) write_op.cc:276] Timestamp: P: 1783602218034377 usec, L: 0
0709 13:03:38.034573 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:38.103063 (+ 68490us) log.cc:844] Serialized 3267 byte log entry
0709 13:03:38.529345 (+426282us) op_driver.cc:464] REPLICATION: finished
0709 13:03:38.740363 (+211018us) write_op.cc:301] APPLY: starting
0709 13:03:38.749447 (+  9084us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:38.766713 (+ 17266us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:38.787254 (+ 20541us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:38.836541 (+ 49287us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:38.836751 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:03:38.836801 (+    50us) write_op.cc:312] APPLY: finished
0709 13:03:38.837073 (+   272us) log.cc:844] Serialized 65 byte log entry
0709 13:03:38.837252 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:38.837375 (+   123us) write_op.cc:454] Released schema lock
0709 13:03:38.837418 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:38.837804 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:38.837831 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1255000,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":194156,"apply.run_cpu_time_us":4203,"apply.run_wall_time_us":102702,"num_ops":8,"prepare.queue_time_us":392637,"prepare.run_cpu_time_us":60520,"prepare.run_wall_time_us":559958,"raft.queue_time_us":108777,"raft.run_cpu_time_us":25198,"raft.run_wall_time_us":187435,"replication_time_us":475733,"thread_start_us":535694,"threads_started":4,"wal-append.queue_time_us":274133,"wal-append.run_cpu_time_us":17738,"wal-append.run_wall_time_us":1451096}]]}
I20260709 13:03:46.030984 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:46.014269 18648 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:45.981741 18017 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:03:46.020190 18496 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:46.035104 15148 catalog_manager.cc:5697] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 5 to 8, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 8 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.024448 18726 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:46.021211 18703 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:45.990296 18563 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:46.026909 18604 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:45.981732 18630 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.068790 15392 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:03:46.070955 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.084695 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.032835 18668 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:46.091427 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:46.031361 18624 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:46.087849 18785 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:46.050076 18496 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:46.093775 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 54208.4us
I20260709 13:03:46.098585 15391 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:03:46.080485 15148 catalog_manager.cc:5697] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 3 to 5, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 5 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:46.042935 18017 consensus_queue.cc:1243] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:46.093428 15390 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:03:46.099591 15390 pending_rounds.cc:85] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 4
I20260709 13:03:46.101657 15320 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 9: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:46.082880 18282 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:46.099109 15391 pending_rounds.cc:85] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 9
I20260709 13:03:46.105716 15391 pending_rounds.cc:107] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:03:46.086585 18703 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.106087 15391 raft_consensus.cc:2889] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:46.109338 18265 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:46.106716 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:46.109892 18747 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:46.111208 18624 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.112273 18630 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:46.113540 15319 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:46.102212 15148 catalog_manager.cc:5697] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 4 to 5, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 5 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:46.116701 18488 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:46.116964 15148 catalog_manager.cc:5697] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:46.110342 15394 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:46.122092 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 584) took 1495 ms. Trace:
I20260709 13:03:46.122555 16029 rpcz_store.cc:276] 0709 13:03:44.626593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.626727 (+   134us) service_pool.cc:224] Handling call
0709 13:03:44.627064 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.500764 (+873700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.121892 (+621128us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b540065e354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:46.122035 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007560576}
I20260709 13:03:46.126675 18648 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.129077 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:46.116925 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.131179 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.041852 18284 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:46.131664 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.136842 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.137327 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.105207 15390 pending_rounds.cc:107] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 9.5
W20260709 13:03:46.100032 18471 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.006s
W20260709 13:03:46.133289 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 113602us
I20260709 13:03:46.143882 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:46.134789 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 120308us
I20260709 13:03:46.139736 15390 raft_consensus.cc:2889] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:46.100263 18785 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:46.106127 18755 consensus_meta.cc:287] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.000s
I20260709 13:03:46.118804 15148 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 5 to 6, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 6 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:46.131999 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 223336us
I20260709 13:03:46.046700 18783 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:46.132308 18745 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.007s
W20260709 13:03:46.151654 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 255667us
I20260709 13:03:46.094512 18589 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:03:46.105650 18282 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:46.156116 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:46.131986 18608 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:46.150218 18471 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:46.150709 18785 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:46.160529 18371 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:46.093245 18749 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:46.210870 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 62871us
I20260709 13:03:46.212977 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:46.196668 18282 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:46.139170 18703 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:46.189088 18769 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:46.206841 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 102076us
I20260709 13:03:46.218729 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:46.218729 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 125380us
I20260709 13:03:46.220050 15148 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 5 to 6, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 6 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:46.129789 18496 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:46.225201 16027 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:46.228144 16026 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
W20260709 13:03:46.230741 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 85546.3us
I20260709 13:03:46.229444 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:46.232163 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.160408 18755 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.163908 18745 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.237607 15213 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:46.222105 18589 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:46.240316 15998 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:46.254853 18045 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:46.259506 15148 catalog_manager.cc:5697] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 3 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:46.261377 15148 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 6 to 9, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 9 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.261907 18648 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:03:46.263182 15148 catalog_manager.cc:5697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 1 to 3, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:03:46.275296 15148 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:46.226212 18668 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:46.224413 18794 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:03:46.268802 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 112792us
I20260709 13:03:46.269879 16027 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:46.279551 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:46.241379 18370 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:46.283247 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:46.283981 16026 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:46.244782 18589 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:46.198158 18726 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:46.289705 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2417) took 1243 ms. Trace:
I20260709 13:03:46.283763 18803 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:03:46.293104 18765 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:46.258805 18610 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:46.234185 18769 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.290247 15397 rpcz_store.cc:276] 0709 13:03:45.054909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.086008 (+ 31099us) service_pool.cc:224] Handling call
0709 13:03:45.131942 (+ 45934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.880287 (+748345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.285246 (+404959us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54003d81d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:46.285431 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1684432128}
I20260709 13:03:46.257476 18045 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:03:46.304557 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 82637.2us
W20260709 13:03:46.305486 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.281193 18572 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:46.286669 18612 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:46.316243 15241 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:46.318989 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:46.319717 16033 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:46.319922 15249 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:46.298553 18779 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:46.326538 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48743.8us
I20260709 13:03:46.298465 18563 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:46.295859 18813 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:46.331360 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:46.338912 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59462.9us
I20260709 13:03:46.301997 18624 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:03:46.375581 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 135340us
I20260709 13:03:46.417186 15998 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:46.437893 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.416205 18807 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:03:46.458388 15998 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:46.332904 18813 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.459757 18808 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:46.466687 18589 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.466861 18813 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:46.498394 18793 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:03:46.467207 18783 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:46.467837 18284 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:46.555769 18796 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:46.560011 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.571760 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.661028 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.661468 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.661758 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.588068 18795 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.361s	user 0.004s	sys 0.005s
I20260709 13:03:46.588523 18745 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:46.589124 18803 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:46.324499 18806 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.151s
I20260709 13:03:46.590780 18703 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:46.662645 18803 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:03:46.591361 18384 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.742s	user 0.012s	sys 0.004s
W20260709 13:03:46.592284 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 252642us
I20260709 13:03:46.663290 18745 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:46.664338 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:46.596398 18371 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:46.596858 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 265638us
I20260709 13:03:46.668666 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:46.343446 18668 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.601727 18787 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.674763 18787 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:46.603379 18798 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:46.605197 18765 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:46.607030 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:46.641314 18808 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.608850 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.702014 15244 raft_consensus.cc:2410] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:46.610055 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.610776 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.610702 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.611768 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:46.417532 18794 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:03:46.703640 15245 raft_consensus.cc:2376] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5. Re-sending same reply.
I20260709 13:03:46.591099 15249 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
W20260709 13:03:46.671378 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 336040us
I20260709 13:03:46.608495 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.655202 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:46.706352 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 51264.2us
I20260709 13:03:46.710698 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:46.711985 15247 raft_consensus.cc:2368] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7.
I20260709 13:03:46.663308 18803 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:46.713569 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:46.720396 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:46.714560 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:46.714846 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:46.714560 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:46.732012 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.732479 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.732808 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:46.733616 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:46.712754 18783 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:46.737680 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:46.700409 18755 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:46.739660 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:46.710177 18808 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:46.785647 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:46.719064 18371 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.787019 15245 raft_consensus.cc:2376] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 5. Re-sending same reply.
I20260709 13:03:46.788285 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.790647 16024 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:03:46.794610 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.795341 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.795956 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 59565.4us
I20260709 13:03:46.670104 18796 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:46.800848 18785 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:03:46.738772 18361 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:46.813664 15244 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:46.812294 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 107095us
I20260709 13:03:46.814996 15215 leader_election.cc:400] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8.
I20260709 13:03:46.814790 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.668666 18816 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:03:46.720974 18592 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:03:46.721172 18284 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 13:03:46.829361 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.806028 15243 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:03:46.831487 18830 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:46.833454 18769 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:46.834921 18755 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.809875 18371 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.836072 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 351) took 1074 ms. Trace:
I20260709 13:03:46.803541 18794 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:46.841267 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.866436 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:46.824554 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 93459us
W20260709 13:03:46.826388 18282 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.000s
I20260709 13:03:46.859993 15395 rpcz_store.cc:276] 0709 13:03:45.762122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.870162 (+108040us) service_pool.cc:224] Handling call
0709 13:03:46.835882 (+965720us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54001d9f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:46.836005 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287888640}
I20260709 13:03:46.863334 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:46.873548 15247 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:46.875862 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:46.876956 15325 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:46.881057 15317 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:46.809738 18831 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 13:03:46.816943 18785 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:46.887097 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:46.888942 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.894809 15316 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 6: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:46.828637 18779 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 13:03:46.913834 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84539.7us
I20260709 13:03:46.914443 15247 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:46.878870 18745 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:46.918921 15324 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: [8.6-10.7]
I20260709 13:03:46.929338 15215 leader_election.cc:400] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:03:46.869756 18755 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.871783 18282 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:46.916328 18778 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:46.932928 18358 consensus_meta.cc:287] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.055s	user 0.005s	sys 0.010s
I20260709 13:03:46.971009 15248 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:46.947860 18824 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:46.948884 18827 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:03:46.952409 18796 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:46.956004 18785 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:46.957787 18755 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:47.001956 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84414.2us
I20260709 13:03:47.003168 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:46.981022 18824 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.008199 18824 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:46.982409 18811 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.193s
I20260709 13:03:46.959576 18282 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.017067 18769 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.017781 18769 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.020110 18769 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:46.962904 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 94623.9us
I20260709 13:03:46.936439 18745 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:46.968000 18787 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:46.974210 15242 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:46.976698 15397 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:03:47.034796 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:46.873469 18798 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:03:46.921478 18806 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:03:46.937156 18802 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:03:47.045806 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:47.046437 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:46.980389 15247 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:47.048775 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:46.993130 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.028717 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.036368 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.047349 16025 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
W20260709 13:03:47.069965 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.070930 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.084676 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.086766 16026 raft_consensus.cc:2410] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:03:47.087613 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84566.2us
I20260709 13:03:47.091645 18796 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:47.092257 18796 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.092074 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:47.094200 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.094460 18282 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:47.095031 18282 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:47.095259 18816 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:47.095470 18282 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:47.095893 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:47.096994 18361 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:47.097383 18361 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:47.097465 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:47.097790 18361 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:47.098677 18788 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:47.099246 18788 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:47.099403 18796 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:47.099735 18788 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:47.101980 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.112931 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:47.119880 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2352) took 1771 ms. Trace:
I20260709 13:03:47.086184 18779 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:47.155108 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.125098 15320 rpcz_store.cc:276] 0709 13:03:45.339715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.345497 (+  5782us) service_pool.cc:224] Handling call
0709 13:03:47.111359 (+1765862us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b5400218ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:47.111537 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633226368}
I20260709 13:03:47.119372 18284 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:03:47.122507 18624 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:47.165220 18788 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.165779 18624 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:47.166221 18624 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:47.166646 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 54619.5us
I20260709 13:03:47.111003 18785 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:47.178344 15393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2063) took 2208 ms (client timeout 2842 ms). Trace:
I20260709 13:03:47.116808 18371 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:47.181325 15393 rpcz_store.cc:269] 0709 13:03:44.969383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.055357 (+ 85974us) service_pool.cc:224] Handling call
0709 13:03:47.177982 (+2122625us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54002b5f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:47.178212 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660897536}
I20260709 13:03:47.178524 15398 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:47.178929 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.186312 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.186827 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 357) took 1157 ms. Trace:
I20260709 13:03:47.187256 15398 rpcz_store.cc:276] 0709 13:03:46.029338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.033267 (+  3929us) service_pool.cc:224] Handling call
0709 13:03:47.178191 (+1144924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.185323 (+  7132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.186621 (+  1298us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002b5f50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:47.186769 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2601192320}
I20260709 13:03:47.187654 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:47.189702 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.193853 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 105550us
I20260709 13:03:47.166000 18803 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:47.233088 18839 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:03:47.254377 18794 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:47.191308 18820 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:47.256585 18745 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.258584 18788 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.181113 18561 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:47.265058 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:47.191478 18783 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:47.266832 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 348) took 1505 ms. Trace:
W20260709 13:03:47.268904 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.191533 18777 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:47.183434 18785 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.277709 15215 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.265524 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:47.191377 18371 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:47.274623 15390 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:03:47.300426 15390 pending_rounds.cc:85] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 8
I20260709 13:03:47.300794 15390 pending_rounds.cc:107] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:03:47.301115 15390 raft_consensus.cc:2889] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:47.290432 18836 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
I20260709 13:03:47.299000 16025 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:47.286113 15392 rpcz_store.cc:276] 0709 13:03:45.761335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.872530 (+111195us) service_pool.cc:224] Handling call
0709 13:03:47.266547 (+1394017us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54001d9554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:47.266747 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379692928}
I20260709 13:03:47.283601 18820 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:47.285708 18802 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:47.313524 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.320327 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:47.326395 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 80401.9us
I20260709 13:03:47.265096 18808 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:47.328550 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.328877 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.318508 18820 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:47.318186 18802 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:47.334424 15318 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:03:47.352636 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.341349 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:47.320966 18811 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:47.289726 18561 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:47.334470 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 146884us
I20260709 13:03:47.328315 18806 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.346287 18589 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:47.355082 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.325493 18592 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:47.380410 18831 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.390730 18282 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.351341 18787 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.399173 15318 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:47.355229 18802 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:47.400399 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:47.356542 18788 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:47.405517 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:47.409049 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.359475 18745 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:47.410845 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 215915us
I20260709 13:03:47.412900 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:47.413398 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.414505 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:47.415107 18845 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:03:47.416647 18778 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:47.416867 18282 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.417522 18745 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.420015 18745 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:47.379863 18806 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.421046 18624 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.422777 18806 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:47.423143 15324 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:47.423517 18361 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:47.425750 18844 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:03:47.426972 18847 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:03:47.427428 15249 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:47.390156 18587 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:47.429929 16027 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:47.428681 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.425824 18361 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:47.433910 15322 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:47.392377 18785 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.392436 18803 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:47.444929 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.446142 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.411314 18788 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.446830 15249 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
I20260709 13:03:47.428418 18561 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:47.443555 15324 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
W20260709 13:03:47.447860 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92849.5us
I20260709 13:03:47.394842 18592 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.451086 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.454619 15322 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:47.449843 18798 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:47.458812 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.459565 18594 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:47.460117 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.461604 15249 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:47.462990 15249 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:47.465269 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.392258 18831 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.476203 18592 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:47.476733 18645 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:47.480216 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.484068 15324 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:47.486959 18838 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:03:47.495888 18808 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.503019 15323 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:47.505968 18645 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.450810 18788 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:47.509891 18624 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:47.512305 18796 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:47.512930 18796 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.513378 18796 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:47.514745 18645 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:47.515805 18813 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.835s	user 0.006s	sys 0.005s
W20260709 13:03:47.518671 18804 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.176s	user 0.014s	sys 0.020s
I20260709 13:03:47.525620 18813 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.551770 18831 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:47.553009 18813 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.554520 15243 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 8. Ops: []
I20260709 13:03:47.557052 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.560742 18358 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:47.561264 18358 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:47.567133 18788 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:47.568243 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 112873us
W20260709 13:03:47.569059 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 118053us
I20260709 13:03:47.597735 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.569368 18787 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:47.570782 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.575980 16033 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:47.599642 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:47.576511 16024 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:03:47.600566 16028 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:47.579376 16027 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:03:47.600445 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.579425 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:47.601979 16025 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 6: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:47.580914 18796 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:47.583176 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.592875 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 187479us
I20260709 13:03:47.594775 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.607761 15245 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:47.609532 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.614943 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:47.614876 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:47.625279 15365 connection.cc:256] RPC call timeout handler was delayed by -1.2352970379999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
I20260709 13:03:47.619108 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.607110 18282 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:47.606426 18561 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:47.637893 18561 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.602727 18589 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.639546 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:47.640151 18561 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:47.640244 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:47.602751 18361 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:47.640974 16033 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:47.634496 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.641850 15321 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:03:47.642088 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.644039 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.644622 15325 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:47.628582 15365 connection.cc:256] RPC call timeout handler was delayed by -1.2181970379999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:03:47.647315 15365 connection.cc:256] RPC call timeout handler was delayed by -1.2055970379999508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
I20260709 13:03:47.649138 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:47.652307 15365 connection.cc:256] RPC call timeout handler was delayed by -1.1047970380000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1937s for a response
I20260709 13:03:47.638705 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.639345 18589 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.655745 16028 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
W20260709 13:03:47.654256 15365 connection.cc:256] RPC call timeout handler was delayed by -1.0975970380000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
I20260709 13:03:47.655655 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:47.657114 15365 connection.cc:256] RPC call timeout handler was delayed by -1.0840970379999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 13:03:47.658321 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.659436 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.660246 15365 connection.cc:256] RPC call timeout handler was delayed by -1.0651970379999511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:03:47.661290 15365 connection.cc:256] RPC call timeout handler was delayed by -1.041797038000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 13:03:47.662709 15365 connection.cc:256] RPC call timeout handler was delayed by -1.0165970379999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
I20260709 13:03:47.646852 18794 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:47.545948 18802 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.653633 15323 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:47.673185 18796 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:47.596390 18358 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.675280 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:47.689872 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 231372us
I20260709 13:03:47.677505 18661 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:47.678552 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.679431 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.702984 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.642798 18587 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:47.684898 15365 connection.cc:256] RPC call timeout handler was delayed by -1.0129970379999804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 13:03:47.685122 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 62358.8us
I20260709 13:03:47.705392 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:47.709282 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:47.684646 15291 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:47.693454 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.698251 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88769.3us
I20260709 13:03:47.680786 18726 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:47.680389 18856 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.683068 18384 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.711840 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:47.681865 18361 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:47.717206 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 113368us
I20260709 13:03:47.717401 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:47.721590 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:47.721793 15245 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:47.707267 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:47.724119 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.689016 18778 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.730731 16033 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:47.732652 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:47.735828 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.728094 18017 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:47.741819 15244 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:47.767854 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1339) took 1151 ms. Trace:
I20260709 13:03:47.742569 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.768559 16030 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:47.743676 18796 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.788801 18796 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.789659 15319 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:47.790680 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.791047 18796 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:47.768226 15244 rpcz_store.cc:276] 0709 13:03:46.616501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.899758 (+283257us) service_pool.cc:224] Handling call
0709 13:03:46.928983 (+ 29225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.741506 (+812523us) spinlock_profiling.cc:243] Waited 78.3 ms on lock 0x7b5400226620. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfc1c0 00007f3669bfd231 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c
0709 13:03:47.767500 (+ 25994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.767783 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180031872}
I20260709 13:03:47.791759 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.792445 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.792831 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.793079 15244 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:47.700942 18820 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.795828 18820 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.702670 18813 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:03:47.704545 18859 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:03:47.747433 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:47.798620 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.799526 15322 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:03:47.800422 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.801102 15322 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 9: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:47.801890 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.715476 18831 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:03:47.748939 18788 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:47.719084 18624 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:47.726842 18384 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.722442 18561 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:47.816571 18561 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:47.726675 18856 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.820562 18856 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:47.714742 18645 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:03:47.817811 18561 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.752259 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.825450 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.756587 18802 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:47.729197 18358 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:47.727176 18496 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.758687 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1329) took 1147 ms. Trace:
I20260709 13:03:47.831069 15248 rpcz_store.cc:276] 0709 13:03:46.610906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.683704 (+ 72798us) service_pool.cc:224] Handling call
0709 13:03:47.758437 (+1074733us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400316354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:47.758602 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":596478208}
I20260709 13:03:47.758978 18778 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.836526 18778 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.759158 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:47.839934 15247 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:47.759788 18668 raft_consensus.cc:2764] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:03:47.760682 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.761521 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.761986 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 362) took 1607 ms. Trace:
I20260709 13:03:47.846450 15390 rpcz_store.cc:276] 0709 13:03:46.155111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.155251 (+   140us) service_pool.cc:224] Handling call
0709 13:03:47.267468 (+1112217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.319100 (+ 51632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.761790 (+442690us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001d9550. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:47.761931 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2557063936}
I20260709 13:03:47.762555 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 366) took 1051 ms. Trace:
I20260709 13:03:47.848140 15391 rpcz_store.cc:276] 0709 13:03:46.711088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.719197 (+  8109us) service_pool.cc:224] Handling call
0709 13:03:47.036075 (+316878us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.036449 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.036477 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.036967 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:03:47.179707 (+142740us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:47.179746 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.179819 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:47.429064 (+249245us) raft_consensus.cc:1685] finished
0709 13:03:47.429084 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.762307 (+333223us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540034b7d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:47.762497 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5362,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":9873,"spinlock_wait_cycles":727893248,"thread_start_us":92232,"threads_started":1,"wal-append.queue_time_us":250603}
I20260709 13:03:47.762647 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:47.851166 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88588.7us
I20260709 13:03:47.763350 18798 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:47.763536 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.855140 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.856848 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.764621 15316 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:47.811995 18825 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:47.859428 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.860668 15316 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:03:47.765854 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.861996 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.862478 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.862866 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.786690 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:47.787282 18017 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.787665 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.865468 16026 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:47.788192 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.866559 15242 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:47.796162 18361 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:47.716176 18592 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:47.802186 18824 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.786677 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.869108 18824 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.787005 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.871229 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.794044 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.804301 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:47.793927 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.804816 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2084) took 1500 ms. Trace:
I20260709 13:03:47.874902 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.809528 15325 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:47.815516 15322 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:47.862627 18815 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:47.872407 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.803975 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:47.865466 18017 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:47.873574 15246 rpcz_store.cc:276] 0709 13:03:46.304136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.304313 (+   177us) service_pool.cc:224] Handling call
0709 13:03:46.309693 (+  5380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:46.309944 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:46.323759 (+ 13815us) log.cc:844] Serialized 14 byte log entry
0709 13:03:47.572132 (+1248373us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b1800345100. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:03:47.804478 (+232346us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:47.804531 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:47.804572 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.804652 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.804764 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13736,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":3438,"raft.queue_time_us":7741,"spinlock_wait_cycles":5867776,"thread_start_us":232146,"threads_started":1}
W20260709 13:03:47.913722 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 109814us
I20260709 13:03:47.914453 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:47.894615 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.894744 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:47.915442 15319 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:47.915618 15392 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:47.895665 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:47.896518 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:47.897428 18803 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.887712 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:47.899899 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.901271 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.876400 15320 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:47.877048 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:47.920177 15390 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:47.876334 15323 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:47.921348 15317 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:47.921721 15395 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:47.880981 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:47.877207 15245 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:47.889935 15318 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:47.903286 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.905810 15241 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:47.906738 18661 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:47.907761 18361 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:47.907579 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:47.908811 18645 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:47.909406 18798 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:47.907604 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1344) took 1192 ms. Trace:
I20260709 13:03:47.954514 15249 rpcz_store.cc:276] 0709 13:03:46.715628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.463636 (+748008us) service_pool.cc:224] Handling call
0709 13:03:47.463953 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.464320 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.464365 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.466742 (+  2377us) log.cc:844] Serialized 26 byte log entry
0709 13:03:47.599072 (+132330us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:47.815314 (+216242us) log.cc:844] Serialized 14 byte log entry
0709 13:03:47.907284 (+ 91970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.907369 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:47.907412 (+    43us) raft_consensus.cc:1685] finished
0709 13:03:47.907424 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.907548 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91598,"prepare.queue_time_us":151346,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":93133,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":13039,"thread_start_us":300797,"threads_started":2,"wal-append.queue_time_us":169336}
I20260709 13:03:47.910503 18745 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:47.910511 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:47.929805 18661 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:47.958613 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:47.959059 18361 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:47.959523 18361 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:47.959240 18661 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:47.960744 18661 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:47.960454 18361 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:47.961598 18589 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:47.961808 18361 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:47.928625 15322 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:47.930155 15363 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:47.966534 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.958676 15244 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:47.967451 15325 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:03:47.933604 15398 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:47.937146 15397 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:47.968816 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.939512 16026 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:47.943724 15250 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:47.962347 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:47.963274 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 55776.6us
I20260709 13:03:47.972572 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:47.912019 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:47.959295 15317 raft_consensus.cc:2376] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8. Re-sending same reply.
I20260709 13:03:47.964280 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:47.976902 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 253085us
I20260709 13:03:47.981772 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1321) took 1373 ms. Trace:
I20260709 13:03:47.982250 15241 rpcz_store.cc:276] 0709 13:03:46.608099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.608225 (+   126us) service_pool.cc:224] Handling call
0709 13:03:47.981556 (+1373331us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540011a3d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:47.981705 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2759028608}
I20260709 13:03:47.985167 15324 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:47.971865 15316 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:03:47.814976 18811 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 13:03:47.811720 18853 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:03:47.932953 18856 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.942371 18796 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:48.020349 15391 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:03:47.912120 18770 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:03:47.942960 18645 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:47.922987 18808 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
W20260709 13:03:48.027271 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 258518us
I20260709 13:03:48.031639 15245 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:48.034967 15319 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
W20260709 13:03:48.036417 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.004361 18860 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:03:47.976562 18788 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:48.046175 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:48.003378 18496 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:47.934358 18803 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.053956 15318 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:48.060834 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:48.050391 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:48.026666 18796 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.063449 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:48.069443 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:48.054415 18496 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:48.074374 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 318650us
I20260709 13:03:48.067273 18831 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:48.067660 18796 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.079121 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:48.076853 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 165164us
I20260709 13:03:48.055133 18868 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:48.037528 18856 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.073609 18778 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.093770 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1352) took 1184 ms. Trace:
I20260709 13:03:48.091566 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:48.110683 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47281.7us
I20260709 13:03:48.111984 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:48.081266 18496 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:48.069134 18668 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:03:48.080787 18358 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:48.125147 15393 raft_consensus.cc:2410] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:48.121659 15322 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:48.089850 15998 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:48.084508 18831 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:48.140715 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 50867.4us
W20260709 13:03:48.137699 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 207611us
I20260709 13:03:48.094272 15248 rpcz_store.cc:276] 0709 13:03:46.909314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.832559 (+923245us) service_pool.cc:224] Handling call
0709 13:03:47.832987 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.833255 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:47.833666 (+   411us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.093409 (+259743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.093471 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:48.093520 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.093590 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.093714 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6622,"prepare.queue_time_us":3848,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"thread_start_us":252537,"threads_started":1}
I20260709 13:03:48.096976 18859 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:03:48.152410 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 83088.7us
W20260709 13:03:48.137749 18282 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.002s
I20260709 13:03:48.153556 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:48.148304 15998 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:48.141505 18831 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.081856 18798 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.116074 18853 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:03:48.164840 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:48.170043 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 74337.1us
I20260709 13:03:48.148854 18808 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:48.174897 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:48.133648 18778 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.185822 18886 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.140597 18802 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:03:48.189810 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:48.157935 18282 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:48.155651 18879 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:48.092514 18645 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.174352 18384 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:48.174749 18589 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:48.178303 18808 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:48.260964 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.209929 18868 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:48.263120 18868 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.267133 18869 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:48.271533 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:48.272264 15318 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:48.273584 15318 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:48.276544 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 117461us
I20260709 13:03:48.267726 18869 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:48.275271 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 83727.4us
I20260709 13:03:48.159513 18859 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.215888 18808 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.193558 18811 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:03:48.335144 15318 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:48.276129 18645 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:48.276057 18384 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:48.342847 18880 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:48.349176 18875 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:03:48.196012 18886 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.273373 18853 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:03:48.273583 18879 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.301790 18869 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.291093 18881 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.373121 15398 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:03:48.375097 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 96477.5us
I20260709 13:03:48.339783 18803 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:48.350658 18384 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:48.367123 18862 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:03:48.347394 18778 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:48.423142 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.435292 18876 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.436151 18879 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:48.435971 18876 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.436720 18879 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.437208 18879 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:48.439036 18874 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:03:48.413849 18868 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:03:48.439321 18887 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:48.446532 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.449617 18856 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:48.450258 18873 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.304s	user 0.001s	sys 0.000s
I20260709 13:03:48.451048 15394 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:48.451321 18856 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:48.451753 18856 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:48.452723 18384 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:48.451505 18017 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.003s
I20260709 13:03:48.456012 18796 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.458374 18796 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:48.439590 18668 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:03:48.455466 18017 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.459416 18886 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:48.460096 18890 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:03:48.461073 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 523) took 1053 ms. Trace:
I20260709 13:03:48.461210 18017 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:48.461467 16029 rpcz_store.cc:276] 0709 13:03:47.407842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.408034 (+   192us) service_pool.cc:224] Handling call
0709 13:03:47.591894 (+183860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.592118 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:47.607027 (+ 14909us) log.cc:844] Serialized 14 byte log entry
0709 13:03:47.758143 (+151116us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b18003f6b80. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:47.983449 (+225306us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.015914 (+ 32465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.015999 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:48.016069 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.016170 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.460897 (+444727us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54001801d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:48.461014 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111161,"prepare.queue_time_us":36235,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":12011,"raft.queue_time_us":65799,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":10563,"spinlock_wait_cycles":442896768,"thread_start_us":375801,"threads_started":2,"wal-append.queue_time_us":299671}
I20260709 13:03:48.464746 15316 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:48.465994 15390 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:03:48.467216 15392 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:48.402506 18561 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:03:48.421051 18870 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:03:48.466403 15390 pending_rounds.cc:85] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 5
I20260709 13:03:48.471693 15390 pending_rounds.cc:107] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:03:48.472000 15390 raft_consensus.cc:2889] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:48.453925 18384 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:48.472465 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.375761 18888 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:03:48.438483 18803 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:03:48.475422 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:48.478457 15399 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:48.478991 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:48.473675 15393 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:48.481351 15392 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:03:48.482141 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.486774 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 75684.8us
I20260709 13:03:48.457939 18808 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:48.489960 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 115629us
I20260709 13:03:48.494441 15392 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:48.495424 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:48.496209 16029 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.498517 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:48.479820 18778 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:48.473655 18589 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:48.502969 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 344582us
W20260709 13:03:48.487056 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 208169us
I20260709 13:03:48.503276 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:48.364686 18880 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.452636 18856 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.477065 18661 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:03:48.473275 18561 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.479656 18884 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.085s
W20260709 13:03:48.500130 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 335400us
I20260709 13:03:48.574750 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:48.562999 15390 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 13:03:48.574734 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:48.575402 15399 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:48.614202 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:48.509318 15392 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:48.615628 16028 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.615814 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:48.616508 15390 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:48.611349 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:48.617461 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:48.618147 15243 raft_consensus.cc:2410] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:48.620005 15392 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:03:48.608520 16031 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:48.587076 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 94295.2us
I20260709 13:03:48.571921 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:48.581149 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.592056 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:48.624894 15393 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.504168 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:48.608939 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.613166 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:48.626875 15399 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:48.627226 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53008.5us
I20260709 13:03:48.628818 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:48.566620 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:48.568293 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:48.572428 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:48.631315 15246 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:03:48.573380 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:48.586648 18361 consensus_meta.cc:287] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.000s
I20260709 13:03:48.581699 18879 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:48.652560 18880 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:48.653582 18358 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:03:48.633447 18778 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.654059 18358 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:48.654512 18894 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:48.654781 18661 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:48.655822 18661 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:48.565080 18496 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.657006 15325 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:48.645251 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:48.657516 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:48.658027 16032 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:48.611263 18887 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:48.644352 18561 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:48.658821 15395 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:48.661001 18859 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:48.661589 18859 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:48.661939 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:03:48.577844 18891 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:03:48.663514 18645 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:48.663873 18592 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:48.664403 18592 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:48.665189 18592 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.582612 18889 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.667385 18889 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:48.668080 18865 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.761s	user 0.003s	sys 0.003s
I20260709 13:03:48.669582 15242 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:48.669786 18889 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:48.654886 18358 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:48.655987 18894 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:48.656901 18661 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:48.567736 18813 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:03:48.670055 18863 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.872s	user 0.001s	sys 0.004s
I20260709 13:03:48.586086 18881 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:48.557678 18895 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.613145 18803 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:03:48.671161 15399 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:48.671737 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:48.674134 16028 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:48.637305 15249 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:48.698060 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:48.632539 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:48.692216 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:48.692286 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 74935.3us
I20260709 13:03:48.699266 16031 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:48.699532 15392 raft_consensus.cc:2393] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:48.676208 16029 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:48.677700 15244 raft_consensus.cc:2410] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:03:48.691756 18592 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:48.678289 15245 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:48.693596 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:48.499891 18876 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:48.709384 16032 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:48.699928 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:48.664000 18645 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:48.663466 18496 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:48.611711 18811 consensus_queue.cc:1243] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:48.689625 18856 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.655858 18778 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:48.713351 15397 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.014s	sys 0.007s
W20260709 13:03:48.715813 15397 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.014s	sys 0.007s
I20260709 13:03:48.675292 18859 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:48.692121 18808 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:48.717473 15398 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:48.718168 15246 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:03:48.702276 18901 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:48.693642 18813 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:48.506402 18831 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:48.725418 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53755us
I20260709 13:03:48.739662 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:03:48.740892 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 117711us
I20260709 13:03:48.743971 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:48.717139 18897 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:48.733026 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.727025 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:48.719007 18859 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:48.654220 18869 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.718868 18887 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:48.718940 18624 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:03:48.695055 18890 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:03:48.728415 18889 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:03:48.756230 15241 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:48.722750 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:48.730504 18880 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:03:48.762831 18796 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:48.770038 15399 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:48.755599 18668 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:03:48.754869 18901 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:48.777927 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 392) took 1013 ms. Trace:
I20260709 13:03:48.777779 18796 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:48.780007 18825 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:48.780584 18825 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:48.780985 18796 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.738634 18589 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:48.791184 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68527.7us
W20260709 13:03:48.804878 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53261.5us
I20260709 13:03:48.782895 18898 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:48.771895 18853 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:48.809732 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:48.810793 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 119424us
I20260709 13:03:48.775544 18890 consensus_queue.cc:1243] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:48.815920 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:48.819187 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:48.758420 18897 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:48.820768 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.827135 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:48.828668 15247 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:48.831094 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.831732 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.813421 18883 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:48.834514 18899 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:03:48.834687 18883 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.817181 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:48.814210 18853 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.839185 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:48.842445 16032 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:48.827849 18890 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.833630 18885 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:48.828270 18496 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:48.837857 18883 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:48.860738 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:48.845824 18898 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:48.863884 15393 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:48.867272 16029 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:48.843214 18853 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:48.852200 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 396) took 1064 ms. Trace:
I20260709 13:03:48.870900 15322 rpcz_store.cc:276] 0709 13:03:47.787535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.464374 (+676839us) service_pool.cc:224] Handling call
0709 13:03:48.464677 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.464884 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:48.715080 (+250196us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.845782 (+130702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.845906 (+   124us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:48.846051 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.848933 (+  2882us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.851944 (+  3011us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":296220,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2126,"raft.queue_time_us":122,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9196,"thread_start_us":380014,"threads_started":2,"wal-append.queue_time_us":146945}
I20260709 13:03:48.874163 18893 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:48.874646 18893 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:48.875458 18776 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:48.875917 18776 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:48.875699 18893 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:48.877557 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 63537.8us
I20260709 13:03:48.846768 18887 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:48.878787 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 139213us
I20260709 13:03:48.818758 18859 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.864571 18869 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:48.876967 18776 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:48.883438 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:48.884183 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:48.889519 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48731.5us
I20260709 13:03:48.893666 18913 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:48.898455 18915 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:48.938311 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.878595 18901 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.871243 18885 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:48.905251 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 388) took 1189 ms. Trace:
I20260709 13:03:48.941411 15323 rpcz_store.cc:276] 0709 13:03:47.715864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.716036 (+   172us) service_pool.cc:224] Handling call
0709 13:03:47.732208 (+ 16172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.931446 (+199238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.904964 (+973518us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54001c70d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:48.905154 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324015360}
I20260709 13:03:48.906478 18831 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:48.911329 18776 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:48.893698 18900 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:48.915544 18770 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:48.869769 18496 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.925336 18778 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:48.927647 18897 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:48.931742 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:48.935369 15213 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:48.936188 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:48.952971 15398 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:48.953430 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:48.954679 18808 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:48.956251 18808 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:48.957465 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:48.958534 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.940140 18913 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:48.967741 15398 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
W20260709 13:03:48.969787 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 91230.5us
I20260709 13:03:48.973542 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:48.922063 18825 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.956657 18808 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:48.980281 18864 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:48.981379 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:48.982074 15320 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:48.983063 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:48.983249 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:48.983696 15396 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.977105 15365 leader_election.cc:400] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7.
I20260709 13:03:48.967886 18913 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:49.006345 18923 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:49.006973 18923 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:49.007922 18923 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.012295 18890 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:49.013398 18885 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:49.014643 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44075us
I20260709 13:03:49.015565 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.016949 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.003264 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:49.004257 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:49.002753 18922 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:49.026528 15323 raft_consensus.cc:2368] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7.
I20260709 13:03:49.022485 15320 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.984535 18808 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:48.967463 18778 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.030030 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 393) took 1243 ms. Trace:
I20260709 13:03:49.032074 15325 rpcz_store.cc:276] 0709 13:03:47.786673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.345109 (+558436us) service_pool.cc:224] Handling call
0709 13:03:48.345477 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.657459 (+311982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.029717 (+372258us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400078354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:49.029951 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":715969408}
I20260709 13:03:49.000385 18587 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.029546 18384 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.005s
I20260709 13:03:49.039569 16031 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:49.040207 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:49.027555 18868 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:49.048233 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.043011 15395 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:49.031642 18900 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:03:49.076081 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.032115 18922 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:48.969811 18883 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.046195 18928 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.082265 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53651.4us
I20260709 13:03:49.083575 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.086751 18922 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:48.778546 15318 rpcz_store.cc:276] 0709 13:03:47.764208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.344947 (+580739us) service_pool.cc:224] Handling call
0709 13:03:48.360252 (+ 15305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.360500 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:48.473988 (+113488us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.777091 (+303103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.777167 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:48.777229 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.777313 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.777852 (+   539us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":372370,"prepare.run_cpu_time_us":1012,"prepare.run_wall_time_us":7159,"raft.queue_time_us":114,"thread_start_us":413152,"threads_started":2}
I20260709 13:03:49.102928 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2092) took 1515 ms. Trace:
I20260709 13:03:49.106029 15247 rpcz_store.cc:276] 0709 13:03:47.587631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.842206 (+254575us) service_pool.cc:224] Handling call
0709 13:03:47.882828 (+ 40622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.829071 (+946243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.102659 (+273588us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b540010b154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:49.102859 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174766848}
I20260709 13:03:49.041303 18587 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.089973 18868 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:49.131421 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:49.160969 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.133533 18914 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:03:49.183600 15320 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:49.133946 18923 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:49.135212 18592 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.204511 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.139441 18831 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.103682 18881 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:03:49.165977 18384 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.271327 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.093952 18898 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:03:49.174283 18824 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.213395 18868 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:49.092896 18928 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.279727 18496 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:49.343619 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 237533us
I20260709 13:03:49.318923 18361 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.346155 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.349436 15365 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.351779 18864 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:49.352978 18911 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
W20260709 13:03:49.354926 18926 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:03:49.363715 18830 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:49.364231 18830 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:49.365228 18830 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.366640 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 376) took 1279 ms. Trace:
I20260709 13:03:49.367043 15391 rpcz_store.cc:276] 0709 13:03:48.087228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.091771 (+  4543us) service_pool.cc:224] Handling call
0709 13:03:48.092124 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.465183 (+373059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.465218 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.471023 (+  5805us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.789744 (+318721us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:48.841487 (+ 51743us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.845474 (+  3987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.845557 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:49.366407 (+520850us) raft_consensus.cc:1685] finished
0709 13:03:49.366429 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.366578 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13378,"prepare.queue_time_us":47085,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":288098,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":32080,"spinlock_wait_cycles":5681536,"thread_start_us":628260,"threads_started":3,"wal-append.queue_time_us":536867}
I20260709 13:03:49.368620 16031 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:49.369165 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:49.369829 15391 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:49.370378 18895 raft_consensus.cc:3055] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:49.370775 18895 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:49.371778 18928 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.371743 18895 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.373217 18726 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:49.373616 18726 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:49.374428 18726 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.382721 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.381863 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.331866 18825 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.273226 18592 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.261885 18923 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.316042 18831 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.391233 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.427784 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.428555 18831 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.406818 18778 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.409389 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.429711 18869 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:49.429924 15242 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:49.410573 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:49.393253 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.431772 15245 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:49.433032 18913 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.343410 18868 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:49.434978 18868 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.435501 18923 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:49.400490 18496 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:03:49.437613 18496 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:49.424081 18604 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:03:49.424934 18894 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:03:49.425374 18934 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.003s
I20260709 13:03:49.425648 18898 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:49.426401 18883 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:49.426470 18592 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.428684 15249 raft_consensus.cc:2410] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:03:49.429124 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.438388 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:49.438977 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:49.423689 18587 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.323472 18384 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:49.421964 18853 consensus_meta.cc:287] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.539s	user 0.014s	sys 0.000s
W20260709 13:03:49.441663 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.376395 18361 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:49.466444 18939 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:03:49.442746 15322 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:49.444203 15396 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:49.491896 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:49.465327 15247 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:49.513571 15396 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:03:49.513891 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 137506us
I20260709 13:03:49.465776 18894 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:49.477496 18913 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:49.473802 15246 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:49.480209 15244 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:49.514971 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:49.481037 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.441555 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:49.526549 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 85083.3us
I20260709 13:03:49.527344 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:49.528465 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:49.489450 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60376us
W20260709 13:03:49.466271 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.545827 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.548758 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:49.549654 15396 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:49.465454 18496 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.553962 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:49.467581 18808 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.556345 15247 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:49.565804 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:49.566565 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:49.566726 15319 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:49.569758 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:49.570031 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:49.511533 18853 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.570531 15317 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:49.570741 15316 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:49.571074 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:49.571753 15319 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:49.572767 15213 leader_election.cc:400] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7.
I20260709 13:03:49.548058 18770 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:49.554621 18589 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:49.553785 18802 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:49.554360 18815 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:49.553372 18765 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:49.573215 15213 leader_election.cc:403] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:03:49.576831 15396 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:49.577237 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:49.577373 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:49.582469 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:49.582511 15325 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:49.583163 15325 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:49.554561 18946 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:49.583750 15316 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:49.584447 15322 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:49.563863 18913 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.586454 15396 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:49.586773 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:49.588682 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:49.603062 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.590083 15323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.024s	sys 0.022s
W20260709 13:03:49.581027 18871 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.007s	sys 0.011s
I20260709 13:03:49.605803 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.608978 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:49.609123 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.589923 15325 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.585227 18769 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:49.615557 18864 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:49.586615 18831 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7.
I20260709 13:03:49.610520 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:49.620294 15325 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:49.602283 18881 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:49.610986 18916 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:49.627525 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:49.612932 18796 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:49.585098 18802 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:49.608515 18871 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.007s	sys 0.012s
W20260709 13:03:49.634296 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 267057us
I20260709 13:03:49.639061 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:49.572865 18894 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.612592 18946 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:49.618409 18898 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:49.601915 18913 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.630142 18806 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:49.638863 18796 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.652366 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:49.625556 18769 raft_consensus.cc:697] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:49.632254 18931 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
W20260709 13:03:49.755045 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.707264 18808 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.719091 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:49.711879 18496 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:49.723219 18776 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.002s
W20260709 13:03:49.639529 18872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.275s	user 0.011s	sys 0.012s
W20260709 13:03:49.754357 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.719435 18802 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.718465 18946 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.724056 18913 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:49.641386 18604 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.783907 18604 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.763449 18798 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:49.679153 18361 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:49.695245 18384 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.683506 18894 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:49.761498 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 109211us
I20260709 13:03:49.647382 18928 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:49.763621 15250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1336) took 3090 ms (client timeout 1811 ms). Trace:
W20260709 13:03:49.765854 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 211944us
W20260709 13:03:49.763095 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 151843us
I20260709 13:03:49.667042 18918 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:49.769399 15325 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:49.760066 18796 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:49.771250 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:49.647010 18916 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:49.780467 18953 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:03:49.673096 18806 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.806700 15247 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:49.792797 18893 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:49.848796 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.796567 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2107) took 1100 ms. Trace:
W20260709 13:03:49.773672 18872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.013s	sys 0.018s
I20260709 13:03:49.803012 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:49.803392 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:49.854786 16031 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:03:49.795181 15362 leader_election.cc:336] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.804s (SENT)
I20260709 13:03:49.856050 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.802583 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:49.798797 15250 rpcz_store.cc:269] 0709 13:03:46.615461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.716840 (+101379us) service_pool.cc:224] Handling call
0709 13:03:49.697510 (+2980670us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540011b2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:49.705830 (+  8320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2621036288}
I20260709 13:03:49.813006 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:49.858043 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.774114 18889 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:49.858932 16030 raft_consensus.cc:2368] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7.
I20260709 13:03:49.859841 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.860798 15247 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:03:49.861380 15244 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:49.851397 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.863240 15242 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:49.787143 18954 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:03:49.802362 18936 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.378s	user 0.002s	sys 0.000s
I20260709 13:03:49.779167 18853 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:49.836146 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.787673 18798 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:49.842067 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.801268 18745 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.786191 18604 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:49.807216 18587 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:03:49.798566 18928 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.804714 18918 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.797598 18805 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:49.807593 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:49.820420 18878 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:03:49.862978 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:49.821569 15246 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:49.862084 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:49.867754 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72601.5us
W20260709 13:03:49.885121 15362 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.157s (SENT)
I20260709 13:03:49.885671 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:49.871538 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:49.874203 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:49.878676 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 74183.5us
I20260709 13:03:49.849943 15241 rpcz_store.cc:276] 0709 13:03:48.696574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.696691 (+   117us) service_pool.cc:224] Handling call
0709 13:03:48.696994 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.765592 (+ 68598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.796292 (+1030700us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b540023a5d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:49.796501 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135663872}
I20260709 13:03:49.878691 15249 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:49.883616 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:49.889596 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2473) took 1326 ms. Trace:
I20260709 13:03:49.865428 18950 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.890205 15390 rpcz_store.cc:276] 0709 13:03:48.562758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.617091 (+ 54333us) service_pool.cc:224] Handling call
0709 13:03:49.436028 (+818937us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:03:49.436272 (+   244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.436635 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.436667 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.437111 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.522593 (+ 85482us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:49.522640 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.522716 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:49.878193 (+355477us) raft_consensus.cc:1685] finished
0709 13:03:49.878215 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.889529 (+ 11314us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1551,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":20285,"spinlock_wait_cycles":25985792,"thread_start_us":85106,"threads_started":1,"wal-append.queue_time_us":201521}
I20260709 13:03:49.892336 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:49.892961 15390 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:49.890661 15362 leader_election.cc:336] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.829s (SENT)
I20260709 13:03:49.894200 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:49.788305 18813 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.872323 18798 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:49.904954 15249 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:03:49.909170 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:49.881234 18928 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:49.877838 18745 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.880780 18805 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:49.864529 18776 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:03:49.880398 18918 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:49.916101 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2475) took 1287 ms. Trace:
I20260709 13:03:49.872833 18806 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:49.914915 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60845.9us
I20260709 13:03:49.897270 18887 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:49.900246 18808 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:49.921428 18882 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.592s	user 0.005s	sys 0.000s
W20260709 13:03:49.969149 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.928624 18820 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:49.971135 18820 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:49.972119 18820 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.973500 18820 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:49.938594 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:49.915594 18589 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:49.974732 18589 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:49.975682 18589 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.977087 18778 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:49.977531 18778 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.977885 18778 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:49.916137 18361 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:49.978307 18907 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:49.978935 18907 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:49.978863 18361 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.980238 18907 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.981310 18361 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:49.981496 18907 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:49.982419 18946 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:49.983119 18960 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:49.899497 18916 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.986907 15248 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:49.989343 18898 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:49.993144 18928 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.946074 18957 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:49.919682 15394 rpcz_store.cc:276] 0709 13:03:48.628376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.878354 (+249978us) service_pool.cc:224] Handling call
0709 13:03:48.888336 (+  9982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.890880 (+  2544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.890916 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.941303 (+ 50387us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.092188 (+150885us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:49.128398 (+ 36210us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.128652 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.128728 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:49.915864 (+787136us) raft_consensus.cc:1685] finished
0709 13:03:49.915894 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.916038 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1380,"prepare.queue_time_us":6377,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":3197,"raft.queue_time_us":301,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":13871,"spinlock_wait_cycles":6528,"thread_start_us":131292,"threads_started":1,"wal-append.queue_time_us":188968}
I20260709 13:03:49.921581 18959 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:03:50.036206 18959 consensus_queue.cc:1243] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 7.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:03:49.954449 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.950764 18878 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:49.959481 18930 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.536s	user 0.002s	sys 0.000s
I20260709 13:03:49.960278 18805 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.896227 18769 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:49.966718 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:49.970667 18932 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.547s	user 0.003s	sys 0.000s
W20260709 13:03:50.053620 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 87015.3us
I20260709 13:03:50.054349 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:50.054605 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:49.993427 18778 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:49.943673 15390 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:50.010489 18745 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:50.020283 18968 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:49.907640 18950 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:50.024509 18808 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:50.026870 18284 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:50.027498 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:50.028522 18900 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:50.035135 18747 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:50.050628 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.106380 15394 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:50.052331 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:50.046983 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 154218us
I20260709 13:03:50.107728 15325 raft_consensus.cc:2376] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7. Re-sending same reply.
I20260709 13:03:50.053108 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.055488 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.056084 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:50.001929 18796 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:50.094563 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.046149 18957 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:50.096942 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.098001 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:50.096969 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.100241 15322 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:50.100471 15248 raft_consensus.cc:2410] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:03:50.046963 18878 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:50.052405 18496 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.097726 18889 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.210690 15321 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 9: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:50.205777 15324 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:50.212050 15323 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:50.213126 15318 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:03:50.214368 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 158967us
I20260709 13:03:50.095144 18815 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:50.094348 18776 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:50.206544 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 149992us
I20260709 13:03:50.097518 18893 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.205437 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.101109 18805 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:50.104568 18900 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:03:50.222041 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 105149us
I20260709 13:03:50.104975 18284 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:50.099191 18770 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.117s
W20260709 13:03:50.217630 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 240973us
I20260709 13:03:50.229041 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:50.230340 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:50.221661 18815 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.243772 15395 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:50.319826 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.216564 18889 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:50.254555 18959 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:50.212183 18496 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:50.103724 18968 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:50.329797 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.332499 18946 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:50.287384 18815 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:50.254164 18951 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:50.225652 18893 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:50.339986 15318 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:50.321372 18886 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:50.356031 15316 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:03:50.356066 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 69598.8us
I20260709 13:03:50.362735 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:50.366551 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:50.368088 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:50.293073 18885 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:03:50.332294 18971 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.293612 18878 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:50.346539 18951 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:50.346810 18959 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:50.288853 18808 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:50.385497 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:50.391324 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.344370 18806 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:50.402099 15321 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:50.357163 18881 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:03:50.337859 18284 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:50.408046 18984 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:03:50.349058 18900 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:50.464486 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2485) took 1416 ms. Trace:
I20260709 13:03:50.350975 18957 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:50.459896 18284 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:50.456880 18983 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:03:50.464946 15394 rpcz_store.cc:276] 0709 13:03:49.047999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.107358 (+1059359us) service_pool.cc:224] Handling call
0709 13:03:50.207667 (+100309us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:50.214317 (+  6650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.214347 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:50.224169 (+  9822us) log.cc:844] Serialized 78 byte log entry
0709 13:03:50.306403 (+ 82234us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:50.306855 (+   452us) log.cc:844] Serialized 14 byte log entry
0709 13:03:50.307104 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.307213 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.464189 (+156976us) raft_consensus.cc:1685] finished
0709 13:03:50.464219 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.464414 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1143,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":7215,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":7948,"spinlock_wait_cycles":36608,"thread_start_us":14745,"threads_started":1,"wal-append.queue_time_us":98100}
I20260709 13:03:50.466827 18830 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:50.467283 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:50.467872 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2474) took 1839 ms. Trace:
I20260709 13:03:50.467926 15394 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:50.393093 18951 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.468334 15392 rpcz_store.cc:276] 0709 13:03:48.628130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.713370 (+ 85240us) service_pool.cc:224] Handling call
0709 13:03:48.714794 (+  1424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.752111 (+ 37317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.752142 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.755451 (+  3309us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.291619 (+1536168us) spinlock_profiling.cc:243] Waited 889 us on lock 0x7b180042b620. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:03:50.310957 (+ 19338us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:50.311398 (+   441us) log.cc:844] Serialized 14 byte log entry
0709 13:03:50.311640 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.311729 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.467560 (+155831us) raft_consensus.cc:1685] finished
0709 13:03:50.467664 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.467812 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36817,"prepare.queue_time_us":994,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":37855,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":8538,"spinlock_wait_cycles":2045824,"thread_start_us":19070,"threads_started":1,"wal-append.queue_time_us":1567690}
I20260709 13:03:50.491065 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 377) took 2403 ms. Trace:
I20260709 13:03:50.489871 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:50.499032 15392 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:50.499600 18747 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.500138 18747 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:50.396481 18589 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:03:50.491660 15397 rpcz_store.cc:276] 0709 13:03:48.087595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.088058 (+   463us) service_pool.cc:224] Handling call
0709 13:03:48.088426 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.169270 (+ 80844us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:48.718670 (+549400us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.814438 (+ 95768us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.826352 (+ 11914us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.826564 (+   212us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:48.841183 (+ 14619us) log.cc:844] Serialized 14 byte log entry
0709 13:03:48.845776 (+  4593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.845849 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.462490 (+1616641us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b1800347440. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:50.490727 (+ 28237us) raft_consensus.cc:1685] finished
0709 13:03:50.490768 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.490985 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93987,"prepare.queue_time_us":629247,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":1781,"raft.queue_time_us":256927,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":30667,"spinlock_wait_cycles":14135680,"thread_start_us":672373,"threads_started":3,"wal-append.queue_time_us":129598}
I20260709 13:03:50.510125 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.470482 18969 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:50.397956 18971 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:50.523674 18968 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:50.504154 18778 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:50.547521 18979 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:03:50.548453 18967 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:03:50.549839 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2482) took 1609 ms. Trace:
I20260709 13:03:50.519084 18796 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:50.550280 15396 rpcz_store.cc:276] 0709 13:03:48.940625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.618828 (+678203us) service_pool.cc:224] Handling call
0709 13:03:49.619195 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.762497 (+143302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.762543 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.767619 (+  5076us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.095966 (+328347us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:50.096018 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.096108 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.549605 (+453497us) raft_consensus.cc:1685] finished
0709 13:03:50.549626 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.549773 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47124,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":5465,"spinlock_wait_cycles":4480,"thread_start_us":391466,"threads_started":2,"wal-append.queue_time_us":422421}
W20260709 13:03:50.535902 18975 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:03:50.559695 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:50.561049 18942 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.139s	user 0.004s	sys 0.000s
W20260709 13:03:50.561334 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.561455 18776 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:50.560369 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:50.564816 18747 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:50.565805 18950 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:50.516762 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.579852 15392 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
W20260709 13:03:50.555187 18973 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:03:50.565621 18928 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:50.526214 18971 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:50.585739 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.590400 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.586181 18796 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:50.594928 15396 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:50.595912 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:50.597008 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:50.527559 18959 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:50.598930 16033 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:03:50.600752 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:50.592398 18980 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:50.593758 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:50.586824 18776 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:50.603015 15397 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:50.603785 18940 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.180s	user 0.000s	sys 0.003s
I20260709 13:03:50.604506 18776 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:50.594861 18796 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.616348 15245 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:50.616894 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:50.616159 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:50.617761 15241 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:50.621800 15246 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:50.611291 18796 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:50.591038 18976 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.627796 15392 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
W20260709 13:03:50.612553 18918 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 13:03:50.632671 15394 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:50.634508 15396 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:50.606176 18496 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:50.637483 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.644877 15396 raft_consensus.cc:2410] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:50.646060 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:50.623561 18889 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:50.606707 18893 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:50.642795 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:50.651304 15244 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:50.643070 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.652536 15392 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:50.641534 15397 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:50.653357 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.654157 15320 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:50.654515 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:50.636646 18798 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.720s	user 0.012s	sys 0.000s
I20260709 13:03:50.587580 18815 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:50.655536 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.659888 15323 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:50.655972 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:50.657820 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 72235.2us
I20260709 13:03:50.661172 18815 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:50.662112 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:50.662410 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.662726 15318 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:50.663704 15322 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:50.663939 15392 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:50.658456 18990 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:50.624025 18971 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.665805 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:50.668932 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.670796 15394 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:50.669164 15322 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:50.676680 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:50.677148 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:50.677670 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:50.678530 15323 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 9: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:50.679375 16033 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:50.683104 15318 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
W20260709 13:03:50.695108 15398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2480) took 1757 ms (client timeout 1663 ms). Trace:
W20260709 13:03:50.695621 15398 rpcz_store.cc:269] 0709 13:03:48.937408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.953546 (+ 16138us) service_pool.cc:224] Handling call
0709 13:03:50.694925 (+1741379us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b540026ff54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:50.695038 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21582208}
W20260709 13:03:50.696748 18941 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.276s	user 0.000s	sys 0.004s
I20260709 13:03:50.696853 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.698179 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:50.706274 15362 leader_election.cc:336] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.876s (SENT)
I20260709 13:03:50.706940 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:50.711867 18987 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:03:50.642449 18976 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:50.717847 18952 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.952s	user 0.007s	sys 0.005s
I20260709 13:03:50.718730 16029 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:50.718853 18976 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:50.719564 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2479) took 1786 ms. Trace:
I20260709 13:03:50.694985 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.722107 15393 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:50.727941 15392 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:50.728374 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.651937 18989 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:50.719965 15391 rpcz_store.cc:276] 0709 13:03:48.932815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.388182 (+455367us) service_pool.cc:224] Handling call
0709 13:03:49.388503 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.392027 (+  3524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.392060 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.400066 (+  8006us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.582002 (+181936us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:49.601775 (+ 19773us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.602020 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.602104 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.717132 (+1115028us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:50.719280 (+  2148us) raft_consensus.cc:1685] finished
0709 13:03:50.719380 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.719509 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3153,"prepare.queue_time_us":20394,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":2668,"raft.queue_time_us":6754,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4482,"spinlock_wait_cycles":22167168,"thread_start_us":145603,"threads_started":1,"wal-append.queue_time_us":243520}
I20260709 13:03:50.633924 18881 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:03:50.730605 15398 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:50.728477 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:50.737226 15395 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:50.732115 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.733489 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.738062 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:50.669492 18806 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:50.752839 15397 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:50.756796 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:50.757552 15397 raft_consensus.cc:2376] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10. Re-sending same reply.
I20260709 13:03:50.744635 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.752468 15244 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:03:50.763808 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:50.645548 18918 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:50.766156 15394 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:50.767073 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2486) took 1691 ms. Trace:
I20260709 13:03:50.767491 15394 rpcz_store.cc:276] 0709 13:03:49.075783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.745439 (+1669656us) service_pool.cc:224] Handling call
0709 13:03:50.765830 (+ 20391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.766768 (+   938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.767010 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:50.776547 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.668188 18798 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:50.773017 15397 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:50.788502 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 387) took 1425 ms. Trace:
I20260709 13:03:50.788956 15397 rpcz_store.cc:276] 0709 13:03:49.362995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.772421 (+1409426us) service_pool.cc:224] Handling call
0709 13:03:50.772794 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:50.787784 (+ 14990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.788014 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:50.790429 15397 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:50.791105 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2490) took 1406 ms. Trace:
I20260709 13:03:50.791500 15397 rpcz_store.cc:276] 0709 13:03:49.384644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.789928 (+1405284us) service_pool.cc:224] Handling call
0709 13:03:50.790220 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:50.790880 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.791052 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:50.754375 18883 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:50.758076 18776 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:50.728188 18971 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:50.797919 15396 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:51.195261 18668 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:50.834240 18974 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.503s	user 0.000s	sys 0.003s
W20260709 13:03:50.842912 18963 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:03:50.740428 18982 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:03:51.139086 18769 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:50.848546 15317 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:51.195502 18624 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.206818 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 386) took 2126 ms. Trace:
I20260709 13:03:51.271833 15392 rpcz_store.cc:276] 0709 13:03:49.080377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.746195 (+1665818us) service_pool.cc:224] Handling call
0709 13:03:50.746631 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:50.746989 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:03:50.770351 (+ 23362us) log.cc:844] Serialized 14 byte log entry
0709 13:03:51.205881 (+435530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:51.205971 (+    90us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:51.206107 (+   136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.206363 (+   256us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.206678 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23712,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":5176,"raft.queue_time_us":298590,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":20007,"thread_start_us":148452,"threads_started":1}
I20260709 13:03:51.273955 15392 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:51.274627 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2067) took 1165 ms. Trace:
I20260709 13:03:51.274942 15392 rpcz_store.cc:276] 0709 13:03:50.108731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.273418 (+1164687us) service_pool.cc:224] Handling call
0709 13:03:51.273740 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:51.274377 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.274571 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:51.276087 15392 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:51.208034 15250 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:50.740154 18989 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:51.209964 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:51.278709 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 68831.6us
I20260709 13:03:51.193213 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2483) took 2252 ms. Trace:
I20260709 13:03:51.280180 15390 rpcz_store.cc:276] 0709 13:03:48.941122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.098054 (+1156932us) service_pool.cc:224] Handling call
0709 13:03:50.098525 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.099029 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:50.216223 (+117194us) log.cc:844] Serialized 14 byte log entry
0709 13:03:50.572703 (+356480us) log.cc:844] Serialized 14 byte log entry
0709 13:03:50.624198 (+ 51495us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:50.633358 (+  9160us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.633612 (+   254us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:50.633665 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.633751 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.192933 (+559182us) raft_consensus.cc:1685] finished
0709 13:03:51.192957 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.193141 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51601,"prepare.queue_time_us":118983,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":134942,"raft.run_cpu_time_us":480,"raft.run_wall_time_us":51956,"thread_start_us":325318,"threads_started":2,"wal-append.queue_time_us":236412}
W20260709 13:03:51.212486 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:51.282877 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:51.283262 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:51.215533 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.026106 18990 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.218820 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:51.284478 16027 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:51.217531 15394 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:51.249588 18907 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.267s	user 0.015s	sys 0.008s
I20260709 13:03:51.285699 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2488) took 1901 ms. Trace:
I20260709 13:03:51.230852 18880 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:51.221179 15215 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.805s (SENT) [suppressed 41 similar messages]
I20260709 13:03:51.286650 15390 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:51.227243 15398 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:51.287297 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2069) took 1177 ms. Trace:
I20260709 13:03:51.287547 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2499) took 1264 ms. Trace:
I20260709 13:03:51.288107 15398 rpcz_store.cc:276] 0709 13:03:50.023520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.801396 (+777876us) service_pool.cc:224] Handling call
0709 13:03:51.226921 (+425525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.287258 (+ 60337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.287488 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:51.194159 15397 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:51.289525 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2494) took 1745 ms. Trace:
I20260709 13:03:51.289903 15397 rpcz_store.cc:276] 0709 13:03:49.543989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.797859 (+1253870us) service_pool.cc:224] Handling call
0709 13:03:51.193333 (+395474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:51.289220 (+ 95887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.289467 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:51.229905 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2066) took 1121 ms. Trace:
I20260709 13:03:51.291235 15396 rpcz_store.cc:276] 0709 13:03:50.108495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.656519 (+548024us) service_pool.cc:224] Handling call
0709 13:03:51.229839 (+573320us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:51.251543 15395 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.508s	user 0.016s	sys 0.004s
I20260709 13:03:51.292428 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2068) took 1167 ms. Trace:
I20260709 13:03:51.292744 15395 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:51.292992 15392 rpcz_store.cc:276] 0709 13:03:50.109098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.275657 (+1166559us) service_pool.cc:224] Handling call
0709 13:03:51.275929 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.276464 (+   535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.276636 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:51.267304 15246 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:51.216840 18959 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.235579 18887 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:51.250735 18668 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:51.307905 15395 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:51.356117 15324 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:51.250177 18883 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.286128 15394 rpcz_store.cc:276] 0709 13:03:49.384039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.780443 (+1396404us) service_pool.cc:224] Handling call
0709 13:03:51.217245 (+436802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.285442 (+ 68197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.285648 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:51.360530 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2116) took 1515 ms. Trace:
I20260709 13:03:51.355831 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 406) took 1424 ms. Trace:
I20260709 13:03:51.423128 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2086) took 1155 ms. Trace:
I20260709 13:03:51.379956 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:51.385213 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.343159 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1415) took 1293 ms. Trace:
I20260709 13:03:51.369148 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2118) took 1001 ms. Trace:
I20260709 13:03:51.378927 15318 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:51.334502 16032 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:51.301898 15396 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:51.398463 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:51.352246 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.399848 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:51.399392 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:51.294812 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 94557.8us
I20260709 13:03:51.287684 15390 rpcz_store.cc:276] 0709 13:03:50.109416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.281982 (+1172566us) service_pool.cc:224] Handling call
0709 13:03:51.282299 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.287030 (+  4731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.287240 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:51.346927 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:51.348536 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:51.432057 15250 rpcz_store.cc:276] 0709 13:03:49.844852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.857687 (+ 12835us) service_pool.cc:224] Handling call
0709 13:03:51.360268 (+1502581us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b540001e854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:51.360456 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174080768}
W20260709 13:03:51.438271 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.472929 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:51.359032 18830 consensus_meta.cc:287] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.892s	user 0.011s	sys 0.005s
I20260709 13:03:51.874296 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:51.365504 18796 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.730s	user 0.011s	sys 0.000s
I20260709 13:03:51.400910 18982 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.886456 15395 rpcz_store.cc:276] 0709 13:03:50.268298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.302788 (+1034490us) service_pool.cc:224] Handling call
0709 13:03:51.303094 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.422842 (+119748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.423071 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:51.344295 18805 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.091s	user 0.005s	sys 0.011s
I20260709 13:03:51.921020 15391 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:51.883421 15319 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:51.881412 15363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.005s	sys 0.005s
W20260709 13:03:51.949400 15363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.007s	sys 0.006s
I20260709 13:03:51.938541 18745 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.299419 18880 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:51.883900 15322 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:03:51.307982 15399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 384) took 2617 ms (client timeout 1820 ms). Trace:
W20260709 13:03:51.932405 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.930446 15393 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:51.330809 18948 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.570s	user 0.004s	sys 0.000s
W20260709 13:03:51.367522 18951 consensus_meta.cc:287] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.859s	user 0.013s	sys 0.000s
I20260709 13:03:51.881430 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2082) took 1630 ms. Trace:
I20260709 13:03:51.339394 18604 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.625s
I20260709 13:03:51.979979 18745 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:51.992250 16032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 697) took 2187 ms (client timeout 1810 ms). Trace:
I20260709 13:03:51.355554 18645 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:51.992717 16032 rpcz_store.cc:269] 0709 13:03:49.800592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.802194 (+  1602us) service_pool.cc:224] Handling call
0709 13:03:51.987898 (+2185704us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540065e354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:51.988070 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3397602560}
I20260709 13:03:51.993251 18645 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:51.990135 18951 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:51.996402 18951 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:51.456812 18883 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:51.444403 18959 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:51.921018 15320 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:52.003185 15397 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:51.879164 15316 rpcz_store.cc:276] 0709 13:03:50.049446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.051981 (+  2535us) service_pool.cc:224] Handling call
0709 13:03:51.342899 (+1290918us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002ed1d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:51.343090 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347491712}
W20260709 13:03:51.888630 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.342455 18361 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:03:51.580828 15365 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.535s (SENT)
I20260709 13:03:52.014629 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:51.935201 16028 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.004s	sys 0.009s
I20260709 13:03:51.921979 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:51.377089 18726 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:52.018080 16028 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.004s	sys 0.009s
I20260709 13:03:52.018385 15390 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:51.354709 18900 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:52.020807 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:51.937318 15364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.004s	sys 0.008s
I20260709 13:03:51.432417 15249 rpcz_store.cc:276] 0709 13:03:49.931198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.931534 (+   336us) service_pool.cc:224] Handling call
0709 13:03:49.982676 (+ 51142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.020196 (+ 37520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.020244 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:50.020859 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.192291 (+171432us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:50.192355 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.192467 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.833606 (+641139us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:51.355549 (+521943us) raft_consensus.cc:1685] finished
0709 13:03:51.355571 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.355770 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37015,"raft.queue_time_us":38550,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":3994,"spinlock_wait_cycles":6591744,"thread_start_us":170888,"threads_started":1,"wal-append.queue_time_us":303961}
I20260709 13:03:51.922492 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:51.411334 18887 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:51.299239 18778 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:51.315876 18859 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:51.368160 18765 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.421775 18358 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.875406 18815 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:51.316974 18918 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:51.361400 18960 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:51.348289 18587 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:51.922469 15325 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:51.934545 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:52.037159 15395 raft_consensus.cc:2376] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9. Re-sending same reply.
I20260709 13:03:52.037724 15320 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:52.038148 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:51.938499 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:51.356925 18901 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.920922 15248 rpcz_store.cc:276] 0709 13:03:50.367846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.367997 (+   151us) service_pool.cc:224] Handling call
0709 13:03:50.390555 (+ 22558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.393596 (+  3041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.393633 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:50.404657 (+ 11024us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.627061 (+222404us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:50.627100 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.627165 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.368921 (+741756us) raft_consensus.cc:1685] finished
0709 13:03:51.368944 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.369087 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46395,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":16027,"thread_start_us":131295,"threads_started":1,"wal-append.queue_time_us":292654}
I20260709 13:03:51.286396 18624 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:51.454679 18945 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.027908 18778 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:51.975325 15318 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:51.356874 18995 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.298446 18990 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:51.354125 18971 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:51.933153 15317 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:51.283016 18769 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:51.636435 19003 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 13:03:51.980044 15399 rpcz_store.cc:269] 0709 13:03:48.690629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.697715 (+  7086us) service_pool.cc:224] Handling call
0709 13:03:51.307745 (+2610030us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54003291d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:51.307912 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162893696}
I20260709 13:03:51.987140 15396 rpcz_store.cc:276] 0709 13:03:50.251140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.301304 (+1050164us) service_pool.cc:224] Handling call
0709 13:03:51.301685 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.881120 (+579435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.881370 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:51.947443 19008 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:51.318306 18999 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:51.359674 18798 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:51.898082 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:03:52.096570 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 198617us
I20260709 13:03:52.097203 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:51.363147 18989 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:52.001739 15393 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:51.939503 18982 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.011117 15319 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:52.106498 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.024161 15394 raft_consensus.cc:2376] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10. Re-sending same reply.
I20260709 13:03:52.107780 15393 raft_consensus.cc:2410] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:03:52.024680 15364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.005s	sys 0.008s
I20260709 13:03:52.076954 18778 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:52.035878 15291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.000s	sys 0.024s
I20260709 13:03:51.771674 18976 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.030998 18765 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.039245 15391 raft_consensus.cc:2376] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9. Re-sending same reply.
I20260709 13:03:52.038930 15395 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:52.028083 18776 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:52.060014 15999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.008s	sys 0.042s
W20260709 13:03:52.075691 15290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.008s	sys 0.028s
W20260709 13:03:52.125304 15999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.008s	sys 0.042s
W20260709 13:03:52.125411 15290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.008s	sys 0.028s
W20260709 13:03:52.088639 15215 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.025s	sys 0.036s
W20260709 13:03:52.126847 15215 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.026s	sys 0.036s
W20260709 13:03:52.127161 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 906022us
W20260709 13:03:52.127558 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.127830 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.128320 15325 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
W20260709 13:03:52.128580 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.129122 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.033541 18668 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:52.097894 15399 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:03:52.081964 18945 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.131093 15249 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:52.132354 18765 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.132697 18945 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.038915 18815 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.102610 19008 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.135016 19008 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:52.135424 18815 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.080601 18901 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.040439 18928 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:03:52.138379 18976 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.032193 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:52.139410 15390 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:52.139871 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 622) took 1463 ms. Trace:
I20260709 13:03:52.140479 18976 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:52.138002 18901 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:51.939224 18796 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.143236 18878 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:52.144071 18796 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:52.117785 15291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.000s	sys 0.024s
W20260709 13:03:52.119495 15214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.073s	sys 0.057s
W20260709 13:03:52.144876 15214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.073s	sys 0.057s
W20260709 13:03:52.144791 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 865020us
I20260709 13:03:52.145565 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:52.147858 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2081) took 1911 ms. Trace:
I20260709 13:03:52.148274 15397 rpcz_store.cc:276] 0709 13:03:50.236738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.290689 (+1053951us) service_pool.cc:224] Handling call
0709 13:03:51.290990 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.003646 (+712656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.147597 (+143951us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54001d9a54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:52.147794 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1637440768}
I20260709 13:03:52.148941 15398 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8. Ops: []
W20260709 13:03:52.109400 16033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.011s	sys 0.022s
W20260709 13:03:52.149470 16033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.012s	sys 0.023s
I20260709 13:03:52.037539 18361 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:52.150552 18971 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:52.140244 16029 rpcz_store.cc:276] 0709 13:03:50.676301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.676412 (+   111us) service_pool.cc:224] Handling call
0709 13:03:52.139697 (+1463285us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b54003e26d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:52.139812 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94839552}
I20260709 13:03:52.138646 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.152242 18951 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:52.154860 18880 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:52.157061 15215 connection.cc:256] RPC call timeout handler was delayed by -1.368427128999997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
I20260709 13:03:52.157585 18594 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.090617 18887 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.158459 15248 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:52.158221 18594 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.158903 18887 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:52.042065 18960 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.160043 15249 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:52.035458 18358 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:52.157511 15215 connection.cc:256] RPC call timeout handler was delayed by -1.3224980600000436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:03:52.163389 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.167958 15394 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:52.165778 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2071) took 2055 ms. Trace:
I20260709 13:03:52.168879 15398 rpcz_store.cc:276] 0709 13:03:50.109942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.289006 (+1179064us) service_pool.cc:224] Handling call
0709 13:03:51.316929 (+ 27923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.149350 (+832421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.150130 (+   780us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54003cc154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:52.165691 (+ 15561us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1912990592}
I20260709 13:03:52.123334 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.170251 15396 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
W20260709 13:03:52.171096 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.172410 15289 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:52.173020 15390 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:03:52.173924 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.174736 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.175228 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.175726 15215 connection.cc:256] RPC call timeout handler was delayed by -1.0529130299998997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 13:03:52.176417 15215 connection.cc:256] RPC call timeout handler was delayed by -1.0339780179999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19340000000000002s for a response
I20260709 13:03:52.178037 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:52.161944 18960 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:52.189487 18745 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.190106 15247 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:52.197348 15250 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:52.042440 18587 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.089448 18995 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.166447 18776 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:52.206660 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:52.215616 15248 raft_consensus.cc:2410] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:52.207612 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.216584 15243 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:03:52.111668 18989 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:52.162170 18959 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:52.164520 19006 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.157409 18990 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.204521 18384 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.224587 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:52.260834 15249 raft_consensus.cc:2368] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9.
I20260709 13:03:52.236529 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:52.262001 15250 raft_consensus.cc:2368] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11.
I20260709 13:03:52.203135 19017 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.202311 18798 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.193838 18945 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.201635 18901 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:52.223732 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.212796 18726 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.151293 18361 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.211966 18928 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:52.242126 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.224123 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.212790 18765 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.194465 19008 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:52.283126 18769 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.285166 18587 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.277359 18726 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.223351 18745 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:03:52.287106 18951 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:52.278867 18945 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:52.279819 18999 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:52.304311 18765 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.247010 18989 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.315948 15317 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:52.273466 18384 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.308513 18813 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:52.300765 18928 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:52.345214 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.323741 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:52.348083 15246 raft_consensus.cc:2410] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:03:52.308051 18361 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:52.340487 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.278146 19017 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.314028 18951 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.274161 19006 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.349536 15244 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 9: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:52.276643 18798 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.332999 18358 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:52.354525 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 402) took 1704 ms. Trace:
I20260709 13:03:52.358564 18384 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.359512 18765 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.310606 19008 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.348528 18928 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.382632 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:52.385591 15244 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:52.362851 15321 rpcz_store.cc:276] 0709 13:03:50.652100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.652263 (+   163us) service_pool.cc:224] Handling call
0709 13:03:50.655679 (+  3416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:50.659682 (+  4003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.659727 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:50.660336 (+   609us) log.cc:844] Serialized 52 byte log entry
0709 13:03:50.774120 (+113784us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:50.786507 (+ 12387us) log.cc:844] Serialized 14 byte log entry
0709 13:03:50.788321 (+  1814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.788404 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:52.354283 (+1565879us) raft_consensus.cc:1685] finished
0709 13:03:52.354305 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:52.354449 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4720,"prepare.queue_time_us":12328,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":34,"raft.queue_time_us":6360,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":6291,"thread_start_us":113228,"threads_started":1,"wal-append.queue_time_us":211804}
I20260709 13:03:52.353014 18951 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:52.391685 18945 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:52.392518 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.403949 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:52.405146 15246 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:52.413285 18726 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:52.434746 15246 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:03:52.402065 18982 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.402384 18624 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.458619 15244 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:03:52.461159 15244 pending_rounds.cc:85] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 7
I20260709 13:03:52.461508 15244 pending_rounds.cc:107] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:03:52.461819 15244 raft_consensus.cc:2889] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:52.475847 18883 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:52.484368 15392 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:03:52.484911 15392 pending_rounds.cc:85] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 2
I20260709 13:03:52.485169 15392 pending_rounds.cc:107] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:03:52.485446 15392 raft_consensus.cc:2889] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:52.443378 19008 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:52.489830 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:52.490936 15246 raft_consensus.cc:2368] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9.
W20260709 13:03:52.493360 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.494609 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:52.495042 15244 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:03:52.499001 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:52.502779 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:52.506984 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:52.510540 15247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2117) took 2658 ms (client timeout 3056 ms). Trace:
W20260709 13:03:52.511158 15247 rpcz_store.cc:269] 0709 13:03:49.852567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.861758 (+  9191us) service_pool.cc:224] Handling call
0709 13:03:52.510286 (+2648528us) spinlock_profiling.cc:243] Waited 2.31 s on lock 0x7b540025b7d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:52.510459 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5302164864}
I20260709 13:03:52.512075 16031 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:52.513607 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 704) took 1301 ms. Trace:
I20260709 13:03:52.517755 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:52.519245 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.519634 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:52.519971 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:52.520334 15397 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:52.520555 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.021s	sys 0.034s
W20260709 13:03:52.520970 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.022s	sys 0.035s
I20260709 13:03:52.520810 16031 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
W20260709 13:03:52.521461 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 503811us
I20260709 13:03:52.522982 15363 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:52.514115 16028 rpcz_store.cc:276] 0709 13:03:51.211744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.211864 (+   120us) service_pool.cc:224] Handling call
0709 13:03:51.212149 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.212361 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:52.019503 (+807142us) log.cc:844] Serialized 14 byte log entry
0709 13:03:52.506548 (+487045us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:52.506603 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:52.513242 (+  6639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.513351 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:52.513541 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":122588,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":85,"thread_start_us":1238933,"threads_started":2}
I20260709 13:03:52.525053 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:52.525278 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.527340 15244 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:52.527400 15395 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:52.524560 18883 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:52.524106 15247 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:03:52.528975 15247 pending_rounds.cc:85] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 6
I20260709 13:03:52.528652 18883 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.529232 15247 pending_rounds.cc:107] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:03:52.529490 15247 raft_consensus.cc:2889] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:52.530807 18883 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:52.531404 18883 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:52.532904 18883 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.533387 15395 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:52.534807 19017 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:52.539106 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:52.539568 19017 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:52.504570 18995 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:52.540390 19017 consensus_queue.cc:1243] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:03:52.540548 18995 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:52.540972 19017 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:52.541098 18995 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.541476 19017 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:52.541606 18995 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:52.542665 19017 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.543823 18765 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.545733 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.546005 18765 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.522505 18960 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.547112 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.546993 18960 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.547672 19017 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:52.548759 19006 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:52.549233 18960 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:52.545310 18883 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:52.516686 18880 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:52.555325 18880 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.555678 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2094) took 2242 ms. Trace:
I20260709 13:03:52.556169 15392 rpcz_store.cc:276] 0709 13:03:50.313847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.308087 (+994240us) service_pool.cc:224] Handling call
0709 13:03:51.308469 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.485959 (+1177490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.555431 (+ 69472us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540009bad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:52.555620 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2703107968}
W20260709 13:03:52.556777 18859 consensus_meta.cc:287] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.001s
W20260709 13:03:52.557504 18998 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.317s	user 0.007s	sys 0.007s
I20260709 13:03:52.557731 18880 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:52.559262 15214 leader_election.cc:400] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 6 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7.
I20260709 13:03:52.559470 15246 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:52.526065 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:52.560164 15214 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:52.561056 18859 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:52.561810 18859 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:52.539991 15394 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:52.563987 16028 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:52.564285 15390 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:03:52.564524 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:52.565315 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.565449 15247 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.566370 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:52.567375 15246 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:52.568488 15248 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:03:52.571334 18798 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.571992 18945 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.572516 18945 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.574313 18811 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.575088 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:52.574967 18811 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.575656 15249 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:52.576766 18726 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:52.577201 18778 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.578390 16024 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:52.578503 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.579108 15250 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:52.579608 18778 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.574432 18624 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.555620 15244 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:52.581290 15397 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:52.586045 15397 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:03:52.581807 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 455540us
I20260709 13:03:52.587700 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:52.588609 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.589546 15249 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
I20260709 13:03:52.589742 15397 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:52.593734 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:52.594022 15392 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:52.533609 18776 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.597236 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:52.599418 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:52.603524 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:52.608628 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.609346 15398 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:52.610947 15396 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:52.612144 15247 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:03:52.612676 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 1.03184e+06us
I20260709 13:03:52.610684 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:52.608755 18798 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:52.614880 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:52.618595 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 440655us
I20260709 13:03:52.616593 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:52.619537 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.620234 16032 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:52.620533 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:52.615053 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:52.596483 18957 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:52.621495 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:52.620143 15396 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:52.629992 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.630358 15998 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:52.631318 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.631971 15244 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:52.632030 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:52.632891 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.633352 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.633739 15248 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:52.592720 18890 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:52.634440 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.635643 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.621011 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:52.636054 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:52.636765 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.636240 15243 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:52.633955 15247 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:52.604887 18726 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:52.640107 15393 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:52.640123 15249 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:52.604652 18982 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.638840 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:52.613531 18990 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.642302 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.647553 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.647981 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:52.596776 18624 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.618398 18668 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:52.648586 15393 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:52.644102 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.640939 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.621905 18871 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:52.602533 18384 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:03:52.644629 15395 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.657009 18776 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.658319 18905 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.658927 18905 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.643576 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.666709 15396 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:52.667474 18358 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:52.667716 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:52.668087 18358 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:52.668982 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.669018 18358 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.647755 15998 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:52.654162 18918 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:52.670743 18918 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:52.671729 18769 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:52.645923 18815 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:52.604656 18868 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:03:52.673336 18815 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:52.641410 19006 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:52.674461 19009 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:52.674292 18815 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.675172 19009 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:52.675570 19009 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:52.675937 19009 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:52.676025 18624 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.651048 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:52.678153 15325 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.678828 18928 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.637719 18745 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:52.640429 18726 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.651427 19007 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:03:52.647186 15398 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 6.
I20260709 13:03:52.622795 18945 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.613448 19015 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:52.652386 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.693884 15321 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:52.621857 18645 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:52.704216 18645 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:52.704909 15365 leader_election.cc:336] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.576s (SENT)
I20260709 13:03:52.705397 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:52.705139 18645 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.684427 18745 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.706881 18745 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:52.707877 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.708693 15244 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:52.709954 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.670787 18776 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:52.710544 15244 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:52.684660 18995 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.711228 18384 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:52.711781 18384 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.712546 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.713017 18995 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:52.684592 18871 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:52.714378 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.714996 15245 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:03:52.715137 18871 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.719506 15245 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:52.654420 18990 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.719856 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.720530 15316 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:52.721524 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.722394 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.722769 15393 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:03:52.723685 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:52.686400 15394 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:52.732460 15393 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:52.617092 18859 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.734618 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.714010 18384 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.688766 15325 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
W20260709 13:03:52.652935 18971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.013s	sys 0.037s
I20260709 13:03:52.694139 15396 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:52.695413 15318 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:52.686285 18726 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.689424 18668 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:52.698957 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:52.699909 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:52.819456 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 119649us
I20260709 13:03:52.821553 16028 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:52.700798 16025 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:52.703116 18951 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.706719 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.693305 19015 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:52.833469 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.644268 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:52.651253 18982 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.626538 18798 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.736725 15320 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:52.688436 15395 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:52.815233 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.815920 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:52.813894 18971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.013s	sys 0.037s
I20260709 13:03:52.819693 18928 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:52.821972 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:52.844576 15319 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:52.826821 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.710832 18776 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.818806 15398 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:52.735827 18990 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:52.641834 19011 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:03:52.742267 18624 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.838663 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:52.841534 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:52.846339 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 141459us
I20260709 13:03:52.879603 15325 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:52.847237 15316 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:52.837088 18878 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:52.817906 18995 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:52.874326 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 618) took 2480 ms. Trace:
I20260709 13:03:52.818121 18976 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:52.671736 18918 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.880843 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.915918 15320 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:52.845271 15324 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:03:52.885176 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:52.834410 19006 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:52.824000 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.924304 15318 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:52.921614 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:52.892552 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 271617us
W20260709 13:03:52.893688 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 277170us
W20260709 13:03:52.904120 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.836244 18798 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:52.837350 19015 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:52.909572 16026 rpcz_store.cc:276] 0709 13:03:50.360386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.360559 (+   173us) service_pool.cc:224] Handling call
0709 13:03:51.988063 (+1627504us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.988334 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:51.988365 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:51.988410 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:51.988446 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.988519 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:52.840625 (+852106us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b540065e350. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:52.840721 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3740355456}
I20260709 13:03:52.914678 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.918026 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.874015 18776 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.918143 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:52.932145 15321 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:52.932551 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:52.933495 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.920224 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:52.929044 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:52.920387 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.839416 18971 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:52.878192 18361 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.525s	user 0.000s	sys 0.011s
I20260709 13:03:52.922498 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:52.927636 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:52.939620 15241 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:52.845242 19029 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:52.951313 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:52.952152 15244 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:52.909832 18878 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.877921 18384 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.076s
W20260709 13:03:52.976761 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 94749.6us
I20260709 13:03:52.980070 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:52.954823 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:52.940622 19012 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:52.984979 19012 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.985417 19012 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:52.982985 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.990988 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.993508 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 48811.1us
I20260709 13:03:53.008438 18995 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:53.015597 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:53.017947 18995 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:53.020797 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:53.022811 18995 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:52.955876 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 139905us
I20260709 13:03:53.025332 15365 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:53.027572 18995 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:53.030766 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:53.032747 18995 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:53.035175 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:53.035820 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 213855us
I20260709 13:03:53.037164 18995 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:53.039256 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:53.041116 18995 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:52.950367 18945 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:52.950112 18928 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:53.010135 19012 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:52.886953 18624 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:52.959540 19007 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:53.051056 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 118559us
I20260709 13:03:52.967072 18878 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.941864 19006 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.042420 19028 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:52.930022 18976 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.050145 18945 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:53.100601 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47346.1us
I20260709 13:03:53.126585 15365 leader_election.cc:400] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9.
I20260709 13:03:53.127007 15365 leader_election.cc:403] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:03:53.097913 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 66054.1us
I20260709 13:03:53.096652 19007 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:52.954829 18668 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.155934 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:52.982388 19033 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 13:03:53.112914 19028 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.058564 19029 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:03:53.052637 19026 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:53.077040 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.132368 18945 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.155122 19007 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:53.115846 18886 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:03:53.180687 19030 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
I20260709 13:03:53.181542 19012 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.135550 18928 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:03:53.185799 19045 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.186610 18811 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.187335 18976 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:53.168670 19028 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:53.190476 18869 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:53.166280 18995 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
W20260709 13:03:53.197942 19027 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.288s	user 0.000s	sys 0.000s
W20260709 13:03:53.198849 19032 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:03:53.197615 18878 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.200340 18989 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:53.185860 18951 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:53.147977 19019 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9.
W20260709 13:03:53.177640 19009 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.000s
W20260709 13:03:53.182256 19021 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.350s	user 0.001s	sys 0.001s
I20260709 13:03:53.165396 18868 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:03:53.122349 18971 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.162508 19024 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:03:53.201962 18982 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:53.212940 18869 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.227259 18869 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:53.230628 18957 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:53.231024 19006 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:53.231503 18957 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.233408 18878 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.235364 18869 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.237576 18869 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:53.211369 19045 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.240386 19045 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:53.224583 18989 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:53.242164 18989 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:53.242740 19015 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.250643 19007 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.250918 18989 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.251847 19028 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.252234 18989 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.252812 19015 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:53.253050 19007 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.221019 19009 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:53.113322 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 133307us
I20260709 13:03:53.296712 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:53.121683 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.097615 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:53.090160 15244 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
W20260709 13:03:53.302153 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 374422us
I20260709 13:03:53.310978 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:53.312031 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:53.305528 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 207919us
I20260709 13:03:53.312521 15244 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:53.299502 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:53.316797 15241 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:53.315590 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 702) took 2105 ms. Trace:
I20260709 13:03:53.316955 18624 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:53.322546 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:53.322978 15291 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:53.323715 18624 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:53.324523 18624 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.324992 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 626) took 1194 ms. Trace:
I20260709 13:03:53.325201 18624 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:53.313848 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:53.321187 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:53.332494 15996 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:53.333339 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:53.196480 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 701) took 1987 ms. Trace:
I20260709 13:03:53.325632 16029 rpcz_store.cc:276] 0709 13:03:52.170029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.190284 (+ 20255us) service_pool.cc:224] Handling call
0709 13:03:52.190722 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.208888 (+ 18166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.208938 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:52.219162 (+ 10224us) log.cc:844] Serialized 26 byte log entry
0709 13:03:52.605876 (+386714us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:52.605915 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.605984 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:53.324197 (+718213us) raft_consensus.cc:1685] finished
0709 13:03:53.324256 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.324693 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4956,"raft.queue_time_us":18477,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":10141,"thread_start_us":330060,"threads_started":1,"wal-append.queue_time_us":486583}
I20260709 13:03:53.342985 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:53.348124 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:53.385102 18813 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.322117 16033 rpcz_store.cc:276] 0709 13:03:51.210349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.210498 (+   149us) service_pool.cc:224] Handling call
0709 13:03:51.260121 (+ 49623us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.149866 (+889745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.149898 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:52.150451 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:03:52.587704 (+437253us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:52.587755 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.587822 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:53.314913 (+727091us) raft_consensus.cc:1685] finished
0709 13:03:53.314976 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.315278 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107472,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":1326097,"threads_started":2,"wal-append.queue_time_us":663137}
I20260709 13:03:53.388028 19007 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:53.388612 19007 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.389079 19007 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:53.398597 18982 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:53.399272 18982 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:53.399937 18982 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:53.400691 19009 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.401639 18951 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:53.404528 18890 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.405426 18890 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.407590 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:53.408537 18890 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:53.387455 18813 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.418011 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:53.420205 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 264217us
I20260709 13:03:53.420929 19054 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:53.421494 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:53.422049 18813 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.422938 19044 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:53.427754 18951 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:53.422068 18726 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.590s	user 0.005s	sys 0.016s
I20260709 13:03:53.432103 19006 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:53.432621 18726 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:53.433506 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 85708.5us
I20260709 13:03:53.434810 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:53.437007 15242 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:53.436902 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:53.439466 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:53.441123 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:53.441563 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 98872.1us
I20260709 13:03:53.442281 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:53.448410 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:53.334756 16030 rpcz_store.cc:276] 0709 13:03:51.208960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.209120 (+   160us) service_pool.cc:224] Handling call
0709 13:03:51.209442 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.107122 (+897680us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:52.107398 (+   276us) log.cc:844] Serialized 14 byte log entry
0709 13:03:52.507400 (+400002us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:52.507474 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:52.507537 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.195461 (+687924us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b180049fa20. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419
0709 13:03:53.196126 (+   665us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b540067edd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:53.196174 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.196390 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":82279,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":108,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":11611,"spinlock_wait_cycles":2077376768,"thread_start_us":399299,"threads_started":1,"wal-append.queue_time_us":546567}
W20260709 13:03:53.452442 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68771.3us
I20260709 13:03:53.399164 19033 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:53.446076 18778 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:53.452921 19062 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:53.455680 19062 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.455739 18778 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:53.456225 19062 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:53.458845 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:53.463764 18770 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:53.445437 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.453433 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:53.457337 18778 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.454947 19033 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.429981 18951 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.473398 15323 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:03:53.453950 18745 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.010s
W20260709 13:03:53.501358 18776 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.015s
I20260709 13:03:53.502081 18776 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.431784 19028 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.504758 19063 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:53.505573 18776 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:53.497749 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 436615us
W20260709 13:03:53.509042 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55804.4us
I20260709 13:03:53.493801 19033 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:53.518872 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.523124 18645 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:53.523648 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:53.524325 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:53.527468 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:53.523787 18645 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.508478 18745 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:53.535236 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 98537.7us
I20260709 13:03:53.516034 18770 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:53.539304 16032 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:53.541467 18765 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:53.542325 18726 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:53.542523 15321 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:53.543745 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:53.544504 15318 raft_consensus.cc:2376] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9. Re-sending same reply.
W20260709 13:03:53.545187 18798 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.597s	user 0.014s	sys 0.003s
I20260709 13:03:53.498483 19009 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:03:53.531958 18645 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.520838 18361 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:53.545753 18798 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.555007 18770 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.575795 19069 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:53.575639 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:53.577531 18745 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.579890 18798 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:53.585366 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 146159us
W20260709 13:03:53.594789 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58627.7us
I20260709 13:03:53.595060 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 392) took 1076 ms. Trace:
I20260709 13:03:53.652530 15390 rpcz_store.cc:276] 0709 13:03:52.518861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.518995 (+   134us) service_pool.cc:224] Handling call
0709 13:03:53.594626 (+1075631us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b5400154fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:53.594819 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102092160}
I20260709 13:03:53.575731 15245 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:53.597000 18982 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.599325 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:53.553233 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:53.644966 18624 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.658337 16030 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 9: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:53.658603 18895 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:53.659188 19058 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:53.661793 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:53.662283 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:53.663081 15318 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:53.663756 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:53.664682 15325 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:03:53.664970 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:53.665287 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:53.666080 15398 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:53.666503 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:53.668594 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:53.669404 18776 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:03:53.670418 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:53.671125 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.672057 18776 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:53.672406 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:53.673398 15393 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:53.672564 18776 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:53.674456 18776 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.641336 19069 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:53.676316 18770 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:53.676231 19069 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.678814 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:53.679662 15399 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:53.681638 18982 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.681963 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 406) took 1034 ms. Trace:
I20260709 13:03:53.682446 15319 rpcz_store.cc:276] 0709 13:03:52.647037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.647295 (+   258us) service_pool.cc:224] Handling call
0709 13:03:53.681515 (+1034220us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54001c70d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:53.681739 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451321216}
I20260709 13:03:53.684310 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:53.686578 18859 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:53.686347 18957 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.688301 15318 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
W20260709 13:03:53.658355 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 50998.3us
I20260709 13:03:53.689046 18957 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:53.695636 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:53.698078 18361 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:53.698267 15323 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:53.702754 16032 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:53.678107 19069 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:53.711443 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:53.713784 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:53.713924 18898 raft_consensus.cc:2764] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:03:53.716517 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:53.717533 18959 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:53.719152 18989 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:53.719434 15250 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:53.719751 18989 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.720324 18989 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:53.721122 19062 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.722800 15397 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:03:53.726914 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56820.1us
I20260709 13:03:53.729223 15398 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
W20260709 13:03:53.729722 18945 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.003s
I20260709 13:03:53.730259 18945 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.718030 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:53.693567 18776 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.733745 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:53.738058 15247 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:53.740291 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 217666us
I20260709 13:03:53.740737 15399 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:53.733527 18361 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:53.757658 18945 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.765053 19017 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:53.765625 18594 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.765887 19062 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.767789 18859 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:53.770583 18901 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:53.771113 18901 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.771519 18901 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:53.771427 18604 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:53.772552 18604 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:53.772915 18604 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:53.774381 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.775023 15390 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:53.776508 18905 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.779145 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2440) took 1150 ms. Trace:
I20260709 13:03:53.780311 18358 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:53.780824 18358 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.781167 18358 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:53.746981 19009 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:03:53.787417 19009 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:53.787879 19009 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:53.788942 19009 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.791632 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:53.774060 18604 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.793579 18604 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.767254 15144 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:53.794052 18361 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.798792 19044 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:53.800714 19044 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:53.801046 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:53.802724 18624 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.803567 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:53.791445 18989 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.789706 19020 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:03:53.815497 15250 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:53.816834 19026 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:53.818756 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:53.817056 15144 catalog_manager.cc:5697] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 3, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 3 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.819836 18745 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:53.749184 18951 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:03:53.820580 18745 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:53.821159 18745 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.820879 18645 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.821327 15213 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:53.823453 18645 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.824291 18645 raft_consensus.cc:2764] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:03:53.826071 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 68625.5us
I20260709 13:03:53.827850 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:53.827193 15144 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.829473 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:53.830062 15144 catalog_manager.cc:5697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.826141 19012 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:53.836148 19012 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:53.837054 19012 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.838421 18885 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.839200 15998 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:53.839038 18885 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.839689 18770 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:53.840298 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:53.841631 18770 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:53.841972 18878 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:53.842550 18878 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:53.842787 18770 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:53.843732 18878 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.845439 18989 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:53.847095 15391 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:53.849406 18885 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:53.850153 19033 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.779672 15317 rpcz_store.cc:276] 0709 13:03:52.628452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.628599 (+   147us) service_pool.cc:224] Handling call
0709 13:03:52.628922 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.882387 (+253465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.882435 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:52.886255 (+  3820us) log.cc:844] Serialized 26 byte log entry
0709 13:03:53.138980 (+252725us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:53.139022 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.778317 (+639295us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001c57d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:53.778417 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:53.778513 (+    96us) raft_consensus.cc:1685] finished
0709 13:03:53.778525 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.778906 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25948,"raft.queue_time_us":6221,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":21066,"spinlock_wait_cycles":494108416,"thread_start_us":181284,"threads_started":1,"wal-append.queue_time_us":324631}
W20260709 13:03:53.859000 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 44286.9us
I20260709 13:03:53.843832 18770 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.821045 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:53.857690 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 396) took 1328 ms. Trace:
I20260709 13:03:53.857762 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:53.858165 18971 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:53.832199 15144 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 5 to 7, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 7 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.869776 15390 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:53.862474 15391 rpcz_store.cc:276] 0709 13:03:52.526094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.530438 (+  4344us) service_pool.cc:224] Handling call
0709 13:03:52.530747 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.847490 (+1316743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.851335 (+  3845us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540034ba54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:53.854567 (+  3232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025979776}
I20260709 13:03:53.854799 18776 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:53.853478 19009 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:53.821398 18951 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:53.896061 18587 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:53.896916 18990 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.884071 18745 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:53.898435 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:53.878403 18971 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.897722 18990 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.880298 19054 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:53.907836 19012 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:53.909327 18971 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:53.938278 15144 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.939235 19033 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.940205 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 412) took 1035 ms. Trace:
I20260709 13:03:53.940532 15144 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 3 to 4, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 4 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.942507 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:53.912238 18951 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:53.954401 15148 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 236) took 18211 ms (client timeout 15000 ms). Trace:
I20260709 13:03:53.955137 18951 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.943447 15144 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 2 to 3, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 3 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:53.957827 18895 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.907387 18885 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 13:03:53.958560 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 137632us
I20260709 13:03:53.958506 18895 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.959501 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:53.960772 18895 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:53.961018 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:53.962026 19069 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:53.962337 18778 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:53.962757 19054 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:53.963028 18778 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:53.963899 19069 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:53.964135 18778 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.964993 19069 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:53.968427 18769 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:53.940661 15396 rpcz_store.cc:276] 0709 13:03:52.824154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.837249 (+ 13095us) service_pool.cc:224] Handling call
0709 13:03:52.837592 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.839315 (+  1723us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.839359 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:52.878489 (+ 39130us) log.cc:844] Serialized 26 byte log entry
0709 13:03:53.601886 (+723397us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b180042b320. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:03:53.760944 (+159058us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:53.761013 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.813043 (+ 52030us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:53.851433 (+ 38390us) raft_consensus.cc:1685] finished
0709 13:03:53.851454 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.859575 (+  8121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1260,"raft.queue_time_us":3273,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":32673,"spinlock_wait_cycles":19808128,"thread_start_us":134472,"threads_started":1,"wal-append.queue_time_us":937130}
I20260709 13:03:53.957187 15144 catalog_manager.cc:5697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 2 to 3, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 3 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:03:53.915622 18989 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.991873 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 176690us
I20260709 13:03:53.998723 15320 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:03:53.992726 19007 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.600s	user 0.013s	sys 0.006s
I20260709 13:03:53.987259 18745 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:53.987625 18769 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:54.021883 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.026921 18989 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.030516 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.030599 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.031100 15247 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:54.031512 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.032251 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:54.032681 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 204174us
I20260709 13:03:54.033558 19022 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.033681 19063 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.026180 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:53.970686 18358 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.034734 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:54.012657 18898 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:54.050104 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:54.047107 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:54.056324 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:54.078106 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:54.078123 19063 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.079643 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.080801 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:54.083431 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.050146 15144 catalog_manager.cc:5697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 4, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 4 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:54.105871 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.083966 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:54.070204 19022 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:54.108639 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84462.5us
I20260709 13:03:54.095288 18990 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:54.079219 18881 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.049183 18885 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.098817 15243 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:03:54.099350 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:54.099601 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.100500 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.101388 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:54.102134 15242 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:54.102252 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:54.104296 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 69623.3us
I20260709 13:03:54.019426 19007 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:54.082832 18769 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:54.141091 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:54.108500 15320 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:54.015184 18765 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:03:54.112427 15322 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:54.118541 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.103392 18358 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:54.155675 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:54.157300 15248 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:54.116559 19022 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:54.161093 16033 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:03:54.164875 15241 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:54.111379 18895 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:03:54.145818 19017 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:54.163316 15249 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
W20260709 13:03:53.954900 15148 rpcz_store.cc:269] 0709 13:03:35.742815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.743008 (+   193us) service_pool.cc:224] Handling call
0709 13:03:53.954097 (+18211089us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:46.969095 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:46.969967 (+   872us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:46.970024 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:03:46.970048 (+    24us) tablet.cc:662] Decoding operations
0709 13:03:47.007886 (+ 37838us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:47.007967 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:47.007995 (+    28us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:03:47.009556 (+  1561us) tablet.cc:701] Row locks acquired
0709 13:03:47.009604 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:03:47.009797 (+   193us) write_op.cc:270] Start()
0709 13:03:47.009965 (+   168us) write_op.cc:276] Timestamp: P: 1783602227009731 usec, L: 0
0709 13:03:47.009984 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:03:47.265986 (+256002us) log.cc:844] Serialized 6820 byte log entry
0709 13:03:47.802793 (+536807us) op_driver.cc:464] REPLICATION: finished
0709 13:03:48.151163 (+348370us) write_op.cc:301] APPLY: starting
0709 13:03:48.165624 (+ 14461us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:48.323026 (+157402us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:48.349553 (+ 26527us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:48.587998 (+238445us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:48.588470 (+   472us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:03:48.588530 (+    60us) write_op.cc:312] APPLY: finished
0709 13:03:48.589033 (+   503us) log.cc:844] Serialized 119 byte log entry
0709 13:03:48.589252 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:48.589438 (+   186us) write_op.cc:454] Released schema lock
0709 13:03:48.589519 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:48.589948 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:48.589982 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":986819,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":310100,"apply.run_cpu_time_us":6993,"apply.run_wall_time_us":456415,"num_ops":17,"prepare.queue_time_us":375438,"prepare.run_cpu_time_us":54655,"prepare.run_wall_time_us":420034,"raft.queue_time_us":324399,"raft.run_cpu_time_us":13647,"raft.run_wall_time_us":263554,"replication_time_us":792631,"thread_start_us":564047,"threads_started":4,"wal-append.queue_time_us":179676,"wal-append.run_cpu_time_us":33471,"wal-append.run_wall_time_us":2194417}]]}
I20260709 13:03:54.170446 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:54.137872 19034 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:03:54.168627 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 260041us
I20260709 13:03:54.190886 15319 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:54.191028 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:54.158532 19054 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:54.192811 15320 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:54.195560 15245 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:54.194087 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:54.201010 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 98938.5us
I20260709 13:03:54.154479 18945 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:03:54.203099 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 155496us
I20260709 13:03:54.164191 18951 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:03:54.204530 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49653.5us
W20260709 13:03:54.207842 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 181826us
I20260709 13:03:54.213191 18976 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:54.213769 18976 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.214143 18976 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:54.223169 19088 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:54.181118 19034 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:54.205176 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:54.228298 19054 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:54.235142 19041 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:54.235854 19054 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.287897 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.287312 19034 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:54.307602 15316 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:54.290699 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.290946 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:54.291657 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 86559.4us
I20260709 13:03:54.292275 19041 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:54.197933 18604 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.169433 18885 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.297703 15248 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:54.301970 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.160445 19062 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:03:54.302511 15365 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:54.303376 16030 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:54.289346 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:54.164134 18881 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.319356 19063 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:54.319564 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.204223 18901 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.329430 15245 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:54.319948 18624 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:54.357854 18881 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:54.330380 18604 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.358877 19034 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:54.320441 19041 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:54.363775 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.368512 19044 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:54.369289 18901 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:54.369849 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 83739.2us
I20260709 13:03:54.381244 15241 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:54.382961 15323 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:54.377894 15248 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:03:54.366477 18989 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:54.375351 19041 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:54.375798 19044 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:03:54.397935 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 167564us
W20260709 13:03:54.404846 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84126us
I20260709 13:03:54.384682 18881 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:54.378711 18976 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:54.431154 19097 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:03:54.436632 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 233920us
I20260709 13:03:54.440336 18901 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:54.441079 18901 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:54.448501 19006 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:54.426662 19007 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:54.451781 19007 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:54.454192 19006 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:54.404548 19044 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:54.461120 16030 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:54.473953 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:54.475548 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.476668 15241 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:54.463883 19063 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.478936 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.478852 18900 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:03:54.487779 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.488348 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.492079 15391 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:54.494539 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.498629 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:54.499039 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.499991 15241 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:54.506623 15245 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
W20260709 13:03:54.510075 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.514647 15390 raft_consensus.cc:2376] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8. Re-sending same reply.
W20260709 13:03:54.523072 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 43719.1us
I20260709 13:03:54.519783 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.525149 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.526629 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.482313 18881 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:03:54.513891 19017 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:54.535568 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:54.527542 15246 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:54.539306 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.498710 19063 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.533828 15248 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:03:54.544384 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.511161 18798 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:03:54.553694 15391 raft_consensus.cc:2368] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:03:54.515285 18358 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:03:54.562001 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.575230 18901 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:54.595486 18971 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.000s
I20260709 13:03:54.595654 15397 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:54.613698 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.616190 15317 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:54.614696 15393 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
W20260709 13:03:54.660070 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 145155us
I20260709 13:03:54.661926 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.663127 15245 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 9: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:54.663518 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.666667 15392 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
W20260709 13:03:54.625974 19102 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:03:54.646039 19116 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:54.627293 18885 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:54.675310 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:54.677857 19091 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.099s	user 0.000s	sys 0.004s
I20260709 13:03:54.680444 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 421) took 1019 ms. Trace:
I20260709 13:03:54.682447 19017 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:54.680977 15394 rpcz_store.cc:276] 0709 13:03:53.661299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.663598 (+  2299us) service_pool.cc:224] Handling call
0709 13:03:53.663973 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:53.664646 (+   673us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:53.912129 (+247483us) log.cc:844] Serialized 14 byte log entry
0709 13:03:54.201554 (+289425us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:54.313493 (+111939us) log.cc:844] Serialized 26 byte log entry
0709 13:03:54.313659 (+   166us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:54.313694 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.313764 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.680014 (+366250us) raft_consensus.cc:1685] finished
0709 13:03:54.680044 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.680226 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82379,"prepare.queue_time_us":117589,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":16932,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":21210,"thread_start_us":412113,"threads_started":2,"wal-append.queue_time_us":554210}
I20260709 13:03:54.683030 19017 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:54.675002 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.695297 15392 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:54.622618 18358 consensus_queue.cc:1243] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:03:54.719861 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.739843 15396 raft_consensus.cc:2410] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:03:54.740444 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.746770 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.747611 15391 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 9: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:54.698485 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.662209 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:03:54.748757 15246 raft_consensus.cc:606] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:54.749132 15246 raft_consensus.cc:614] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:54.675441 18976 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:54.611304 18971 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:54.701803 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 102545us
I20260709 13:03:54.702415 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:54.711258 19063 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:54.713687 19034 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.714213 19041 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:54.715374 19116 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:54.716917 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:54.782006 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 65168.5us
I20260709 13:03:54.719079 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.751924 15245 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:54.783541 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.752075 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.752373 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.717343 19044 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:54.752980 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.754106 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:54.755290 15325 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:54.758661 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.754106 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.786777 15391 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:54.751457 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.770644 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.788291 15395 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:54.784808 15323 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:54.771605 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.790195 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:54.792151 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.792713 15392 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:54.793455 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.790583 15394 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:54.788697 18881 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:54.802757 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:54.804154 15396 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:03:54.805904 15319 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:54.806306 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:54.801669 15393 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:54.814905 18898 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:54.815486 18898 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:54.815904 18778 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:54.816704 18778 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:54.818645 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.823312 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:54.824517 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.812155 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:54.826574 15391 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:54.827742 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.828418 15318 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:54.818799 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.831369 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.818820 18989 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:54.837078 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:54.831269 19118 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:54.862545 19063 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:54.802196 19034 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.842701 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:54.843241 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:54.865741 15394 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:54.849100 19120 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:03:54.850589 15245 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:03:54.852252 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.854571 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:54.857103 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:54.838481 15320 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:54.858566 15318 raft_consensus.cc:2410] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:03:54.859175 15392 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
W20260709 13:03:54.860808 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.861135 15323 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:03:54.838471 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.839529 19017 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:54.822291 18881 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:54.890501 15395 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:54.867169 15325 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:54.862886 19118 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.858022 18989 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.903232 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:54.901355 15391 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:54.904508 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:54.906193 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:54.906261 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.908351 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:54.866686 18971 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:54.909930 15323 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:54.911247 15318 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:54.902221 18776 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:54.914600 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.917374 15393 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:03:54.905189 19118 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:54.920491 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:54.921943 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:54.898700 19063 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.922863 15243 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 9: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:54.923854 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.924181 19063 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:54.925235 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.927208 19041 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:54.927492 18881 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.927284 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:54.929237 19034 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:54.931036 18898 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:54.934252 19044 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:54.935717 18645 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:54.936084 18776 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:54.936789 19017 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:54.937719 18776 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:54.863513 19116 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:54.906769 18989 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:54.917670 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.132218 15323 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:55.132576 15320 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:54.942363 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:54.943032 15245 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:54.943229 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:55.129827 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 230476us
W20260709 13:03:55.130388 15362 leader_election.cc:336] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.668s (SENT)
I20260709 13:03:55.130517 18604 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:55.140547 18885 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.969071 18898 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:55.147173 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:55.296856 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 166490us
I20260709 13:03:55.287000 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:55.332710 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:55.152226 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:55.241743 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 90046us
I20260709 13:03:55.353036 15324 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:54.936157 18645 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:55.375303 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:55.376412 15320 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:55.278836 18971 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.384824 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.278568 18604 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.396449 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 60912.8us
I20260709 13:03:55.251250 19063 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:55.306140 19017 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:55.289685 19121 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:55.411466 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.414162 15324 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:03:55.429114 19121 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.429714 15243 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:03:55.400331 19007 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.022s	sys 0.025s
I20260709 13:03:55.430467 18645 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.432014 18645 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:55.432404 19121 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:55.433387 18898 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:55.434175 18898 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:55.437158 18898 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:55.437935 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.418355 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:55.456017 15247 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:03:55.358014 18885 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:55.430452 19007 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.022s	sys 0.026s
I20260709 13:03:55.468576 15399 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:03:55.470831 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.472572 15324 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:55.470327 15399 pending_rounds.cc:85] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 4
I20260709 13:03:55.406256 18604 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:55.402698 18971 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.449543 19063 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.450126 19017 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.475014 15399 pending_rounds.cc:107] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:03:55.481711 15399 raft_consensus.cc:2889] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:55.482785 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 80726.7us
I20260709 13:03:55.481801 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.476202 18871 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:55.491834 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2470) took 1457 ms. Trace:
I20260709 13:03:55.492383 15316 rpcz_store.cc:276] 0709 13:03:54.031884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.149165 (+117281us) service_pool.cc:224] Handling call
0709 13:03:55.487381 (+1338216us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b54002a76d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:55.489595 (+  2214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105420672}
I20260709 13:03:55.495592 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:55.499670 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.499975 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:55.500485 15324 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:55.500651 15316 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:55.501642 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.502876 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.503957 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.504746 15324 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:03:55.505486 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.506559 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:55.508915 15324 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:55.509748 15316 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
W20260709 13:03:55.511253 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 113466us
I20260709 13:03:55.509320 15999 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:55.512992 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.513855 15316 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:55.520221 15399 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:55.523315 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:55.524412 15316 raft_consensus.cc:2410] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:03:55.525511 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:55.531030 15324 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:03:55.513800 19007 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:55.513266 19121 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:55.517727 19041 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:55.506982 19006 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:03:55.550706 15215 leader_election.cc:400] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
W20260709 13:03:55.551811 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 52525.6us
I20260709 13:03:55.553808 15215 leader_election.cc:403] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:03:55.544781 15399 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:55.565546 15316 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:55.572314 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.574849 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:55.576427 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 193784us
I20260709 13:03:55.573277 15324 raft_consensus.cc:2376] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12. Re-sending same reply.
I20260709 13:03:55.588193 15399 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:55.591572 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.592537 15316 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:55.596709 15324 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:55.608134 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.609429 15324 raft_consensus.cc:2410] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:03:55.552937 19121 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.611661 15316 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:55.621171 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.622170 15316 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:03:55.631191 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 715) took 2109 ms. Trace:
I20260709 13:03:55.604514 18871 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:03:55.631677 16033 rpcz_store.cc:276] 0709 13:03:53.521592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.526337 (+  4745us) service_pool.cc:224] Handling call
0709 13:03:53.526932 (+   595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:54.168170 (+641238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.630873 (+1462703us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54005f14d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:55.631124 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1454602496}
I20260709 13:03:55.634691 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.609886 18989 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:55.633167 18971 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:55.645138 15397 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:55.647356 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.637413 18604 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:55.648053 15322 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
W20260709 13:03:55.659559 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.662551 15320 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:55.664960 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.650597 18971 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.656793 18604 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:55.667440 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.660413 19063 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:55.674743 15320 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:55.653832 18871 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:03:55.679812 19140 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.679898 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:03:55.680513 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 158768us
W20260709 13:03:55.678836 19127 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 13:03:55.691196 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:55.691916 15322 raft_consensus.cc:2376] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9. Re-sending same reply.
W20260709 13:03:55.687353 19126 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:03:55.692507 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.672509 18971 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:55.698179 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.677448 18604 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:55.701924 15241 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:03:55.704754 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:55.704844 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.704872 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.705694 15243 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:55.704742 19131 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:03:55.705782 15324 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:55.694954 19034 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:55.708722 19121 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:55.708963 18989 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:55.710028 19130 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.078s	user 0.001s	sys 0.001s
W20260709 13:03:55.710806 19118 consensus_meta.cc:287] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.002s
I20260709 13:03:55.712320 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.713109 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.714221 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.714658 15324 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:55.715992 15394 raft_consensus.cc:2368] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:55.717083 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:55.717254 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.717941 18971 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:55.717862 18604 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:55.718823 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.718763 18971 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:55.719959 19141 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:55.720877 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.724602 15390 raft_consensus.cc:2368] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:55.724714 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.717876 15398 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:55.725517 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2514) took 1234 ms. Trace:
I20260709 13:03:55.722947 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.688577 19140 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:55.725822 15398 rpcz_store.cc:276] 0709 13:03:54.491206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.491380 (+   174us) service_pool.cc:224] Handling call
0709 13:03:55.717117 (+1225737us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:03:55.725464 (+  8347us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6179584}
I20260709 13:03:55.727681 15324 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:55.726141 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:55.728309 15320 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:55.728790 15243 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:55.730409 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.730495 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:55.731094 15322 raft_consensus.cc:2376] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9. Re-sending same reply.
W20260709 13:03:55.736166 15317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2457) took 1817 ms (client timeout 1557 ms). Trace:
W20260709 13:03:55.736670 15317 rpcz_store.cc:269] 0709 13:03:53.919252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.919437 (+   185us) service_pool.cc:224] Handling call
0709 13:03:55.735939 (+1816502us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54004038d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:55.736081 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961491200}
I20260709 13:03:55.738168 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.740732 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:55.711486 19034 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:55.749713 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2536) took 1006 ms. Trace:
I20260709 13:03:55.750285 15391 rpcz_store.cc:276] 0709 13:03:54.743798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.909327 (+165529us) service_pool.cc:224] Handling call
0709 13:03:54.909993 (+   666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:54.913994 (+  4001us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.914024 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:54.941927 (+ 27903us) log.cc:844] Serialized 26 byte log entry
0709 13:03:55.402960 (+461033us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:55.402987 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.403037 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:55.749484 (+346447us) raft_consensus.cc:1685] finished
0709 13:03:55.749505 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:55.749644 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17414,"raft.queue_time_us":3316,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":261406,"threads_started":1,"wal-append.queue_time_us":411227}
I20260709 13:03:55.721642 18776 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.715754 19006 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:55.763506 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.766701 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.711265 19118 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:55.770816 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:55.773780 15243 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:03:55.774978 15243 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:55.774880 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.775925 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.762971 19138 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:55.780537 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:55.781453 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:55.781811 15393 raft_consensus.cc:2368] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8.
I20260709 13:03:55.782496 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:55.783214 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 433) took 1041 ms. Trace:
I20260709 13:03:55.784854 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:55.786950 18871 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:55.787992 18989 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:55.788882 18871 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:55.788693 18989 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.789019 19034 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.788717 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:55.790360 18871 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:55.791170 18989 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:55.782671 18645 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:55.784372 15249 rpcz_store.cc:276] 0709 13:03:54.741605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.378792 (+637187us) service_pool.cc:224] Handling call
0709 13:03:55.379306 (+   514us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:55.394998 (+ 15692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.395043 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:55.463423 (+ 68380us) log.cc:844] Serialized 52 byte log entry
0709 13:03:55.639323 (+175900us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:55.678761 (+ 39438us) log.cc:844] Serialized 14 byte log entry
0709 13:03:55.782653 (+103892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.782738 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:55.783007 (+   269us) raft_consensus.cc:1685] finished
0709 13:03:55.783022 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:55.783157 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":223,"prepare.queue_time_us":68925,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":874,"raft.queue_time_us":6826,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":9212,"thread_start_us":291915,"threads_started":3,"wal-append.queue_time_us":199785}
I20260709 13:03:55.793586 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:55.790409 19034 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:55.729911 19141 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:55.794932 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 100696us
I20260709 13:03:55.795818 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.769955 18776 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.796977 18645 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:55.797423 18645 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:55.797772 18645 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:55.784363 18604 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:55.798817 18604 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.800951 18604 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:55.776969 18951 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.802644 18951 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:55.803118 19140 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:55.804560 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:55.804998 18951 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:55.805352 18989 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:55.768409 19006 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.806268 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.807156 15398 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:55.807670 19141 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:55.807902 19006 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:55.808085 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.808526 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.805554 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.809278 15391 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:55.809214 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.810281 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.810432 19140 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:55.805017 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:55.810912 15391 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:55.811681 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:55.811913 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:55.806329 18989 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:55.811879 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:55.814599 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:55.814790 15323 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:55.810313 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.816123 15394 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:55.816579 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:55.817315 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:55.818163 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.818928 15390 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:55.819594 15290 leader_election.cc:400] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:55.819869 15290 leader_election.cc:403] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:03:55.821048 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:55.818491 19063 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:55.826195 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:55.826288 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:55.827059 15244 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:55.818673 19121 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:55.832230 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.852948 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.854286 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.855398 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.856462 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.857182 15249 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:55.857894 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:55.914331 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.915943 15249 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 9: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:55.818598 19138 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:55.916991 19137 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:03:55.916728 19138 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:55.866874 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 52663.5us
I20260709 13:03:55.918941 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:55.849566 15243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:03:55.919909 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.920153 15243 raft_consensus.cc:606] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:55.867529 19118 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:55.920743 15243 raft_consensus.cc:614] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:55.868407 19121 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:55.921984 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:55.849452 18776 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:55.864848 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:55.923388 18895 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:55.925092 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:55.871201 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:55.876953 18745 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:55.878374 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 61843.5us
I20260709 13:03:55.906049 15390 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:55.928146 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1447) took 1003 ms. Trace:
I20260709 13:03:55.928622 16030 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:55.882658 19141 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
W20260709 13:03:55.929139 19111 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.303s	user 0.010s	sys 0.016s
I20260709 13:03:55.895859 19062 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:03:55.882738 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88345us
I20260709 13:03:55.930449 15290 leader_election.cc:400] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:55.930765 15290 leader_election.cc:403] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:03:55.882907 19145 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:55.886000 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.934537 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:55.934947 15248 raft_consensus.cc:2410] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:03:55.897301 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.888052 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.935797 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:55.936134 15245 raft_consensus.cc:2410] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:03:55.892409 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2547) took 1038 ms. Trace:
I20260709 13:03:55.893393 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.888406 15996 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:55.904289 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:55.938907 15317 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:03:55.940023 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51712.1us
I20260709 13:03:55.940395 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:03:55.905130 19139 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 13:03:55.907547 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 435) took 1165 ms. Trace:
I20260709 13:03:55.907747 15316 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:55.820899 18871 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:55.908535 18901 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:55.809923 18645 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:55.929744 19062 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:55.822746 19006 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:55.915824 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2534) took 1172 ms. Trace:
I20260709 13:03:55.950387 16030 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:55.920017 19138 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:55.875167 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:55.928552 15318 rpcz_store.cc:276] 0709 13:03:54.925136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.870879 (+945743us) service_pool.cc:224] Handling call
0709 13:03:55.928087 (+ 57208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:55.960359 15397 rpcz_store.cc:276] 0709 13:03:54.743056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.803790 (+ 60734us) service_pool.cc:224] Handling call
0709 13:03:55.915616 (+1111826us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b54002bc0d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:55.915754 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895502080}
I20260709 13:03:55.963495 15245 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:55.932430 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:55.872315 15323 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:55.964564 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1450) took 1038 ms. Trace:
I20260709 13:03:55.878373 15394 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:03:55.965623 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.965930 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.933182 15250 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:03:55.933933 15242 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:03:55.941236 15247 raft_consensus.cc:2376] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10. Re-sending same reply.
I20260709 13:03:55.967650 15242 pending_rounds.cc:85] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 6
I20260709 13:03:55.908289 15391 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:55.968039 15242 pending_rounds.cc:107] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:03:55.968418 15242 raft_consensus.cc:2889] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:55.968811 15242 pending_rounds.cc:107] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:03:55.968845 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.944161 15244 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:03:55.912050 18885 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:55.930158 18745 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:55.945199 18776 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:55.949945 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.976406 15390 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:55.936638 15399 rpcz_store.cc:276] 0709 13:03:54.854168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.598958 (+744790us) service_pool.cc:224] Handling call
0709 13:03:55.614452 (+ 15494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:55.648425 (+ 33973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.648455 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:55.659536 (+ 11081us) log.cc:844] Serialized 26 byte log entry
0709 13:03:55.776219 (+116683us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:55.776258 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.776324 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:55.892183 (+115859us) raft_consensus.cc:1685] finished
0709 13:03:55.892206 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:55.892343 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8552,"spinlock_wait_cycles":7682816,"thread_start_us":91052,"threads_started":1,"wal-append.queue_time_us":218550}
I20260709 13:03:55.794173 18881 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.150s
I20260709 13:03:55.818931 18989 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:55.821337 19140 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:55.969250 15242 raft_consensus.cc:2889] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:55.941931 15241 rpcz_store.cc:276] 0709 13:03:54.747183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.371942 (+624759us) service_pool.cc:224] Handling call
0709 13:03:55.397743 (+ 25801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.705310 (+307567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.907209 (+201899us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400315e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:55.907466 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698739968}
I20260709 13:03:55.962127 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:55.970508 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:55.985565 15391 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:55.985463 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:55.939283 19141 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9.
I20260709 13:03:55.971835 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:55.987803 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.986331 16031 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:55.974336 15318 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:55.964921 15323 rpcz_store.cc:276] 0709 13:03:54.925930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.811654 (+885724us) service_pool.cc:224] Handling call
0709 13:03:55.964502 (+152848us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:55.971221 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:55.975656 15398 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:55.934074 19121 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:55.993089 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:55.946442 18871 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.981170 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:55.997449 16030 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:55.985786 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:56.001152 15246 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:55.948046 18901 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:55.993819 15390 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:56.006150 15390 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:56.007639 15390 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:56.007992 16033 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:55.987401 18881 consensus_queue.cc:1243] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:56.012283 15242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:03:56.013038 15242 raft_consensus.cc:606] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:56.013389 15242 raft_consensus.cc:614] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:56.014050 15397 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:03:55.995293 15323 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:56.003449 18895 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.983402 19140 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.003916 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:56.004254 19022 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:03:56.015852 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 219716us
I20260709 13:03:56.017827 15391 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:55.989564 18885 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:56.033335 15394 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:55.971588 18957 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:03:55.944892 19145 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:55.996270 18776 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:56.015163 18871 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:56.010213 18881 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:56.042084 15323 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:56.026710 19140 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:56.047825 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57355.4us
I20260709 13:03:56.050891 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:56.048092 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:56.052579 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:56.027034 19022 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:56.050347 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:56.059357 15246 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:56.055073 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:56.055145 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:56.048728 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:56.057233 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:56.040138 18885 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:56.027806 18895 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:56.064404 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:56.063023 15247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c377e25836b14680beed769c143a593c"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:03:56.065631 15247 raft_consensus.cc:606] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:56.066110 15247 raft_consensus.cc:614] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:56.069576 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:56.070832 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:56.076438 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:56.044813 19069 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:03:56.034760 19062 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.070441 15318 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:56.058568 19028 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.054067 18881 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:56.055384 18776 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:56.064008 19006 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:03:56.055238 18745 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.112335 18745 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:56.113363 19098 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.600s	user 0.008s	sys 0.017s
I20260709 13:03:56.115228 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2465) took 2146 ms. Trace:
I20260709 13:03:56.114598 19022 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:56.097375 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:56.051235 18989 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:56.082837 19141 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:56.065394 18885 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:56.115653 15321 rpcz_store.cc:276] 0709 13:03:53.969176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.969937 (+   761us) service_pool.cc:224] Handling call
0709 13:03:54.009800 (+ 39863us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:54.025643 (+ 15843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.025696 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:54.026510 (+   814us) log.cc:844] Serialized 52 byte log entry
0709 13:03:54.171554 (+145044us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:54.171595 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.171662 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:56.112420 (+1940758us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:03:56.114867 (+  2447us) raft_consensus.cc:1685] finished
0709 13:03:56.114895 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.115134 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1966,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"spinlock_wait_cycles":8057600,"thread_start_us":144462,"threads_started":1,"wal-append.queue_time_us":436683}
I20260709 13:03:56.062999 19138 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:56.076069 18957 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:56.108036 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2537) took 1364 ms. Trace:
I20260709 13:03:56.107053 18895 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:56.101634 19034 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.125488 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:03:56.136018 15246 raft_consensus.cc:606] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:03:56.136502 15246 raft_consensus.cc:614] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:56.099272 19028 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.131520 15396 rpcz_store.cc:276] 0709 13:03:54.744104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.806071 (+ 61967us) service_pool.cc:224] Handling call
0709 13:03:56.107842 (+1301771us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54000271d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:56.107975 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2190703488}
I20260709 13:03:56.117715 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:56.127507 19096 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:56.145525 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48260.2us
I20260709 13:03:56.130590 19062 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:56.165735 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.137868 19022 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.171432 15318 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:56.144846 18989 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:56.106853 18881 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:56.156483 18645 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:56.194509 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.167661 18951 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:56.197805 15391 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:03:56.205999 15391 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:56.145063 19149 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:56.144407 19034 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:56.212739 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:56.209542 15397 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:03:56.137955 19138 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:56.228211 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 62965.3us
W20260709 13:03:56.228626 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 152325us
I20260709 13:03:56.239019 15393 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:56.236006 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:56.239961 15394 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:56.240633 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:56.204205 18951 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:56.262938 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 199339us
I20260709 13:03:56.272423 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:56.273275 15395 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:56.275775 15397 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:56.287670 15394 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:56.292196 15395 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:56.299091 15391 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:56.261053 18645 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:56.275801 19069 consensus_queue.cc:1243] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:56.306252 15397 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:56.275501 18878 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:56.276103 19145 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:56.316987 15395 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:56.282159 18900 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:56.274916 18951 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:56.323930 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:56.303247 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 370915us
I20260709 13:03:56.306762 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:56.328372 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:03:56.300549 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 364717us
I20260709 13:03:56.208295 18776 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.288089 18769 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:03:56.304554 19121 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:56.341329 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 223703us
I20260709 13:03:56.338762 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:56.337538 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:56.348562 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:56.276249 19148 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:03:56.321883 19069 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:56.321993 19145 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.342653 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:56.319043 18900 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:56.354312 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:56.309755 19007 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:03:56.358072 15397 raft_consensus.cc:2376] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10. Re-sending same reply.
W20260709 13:03:56.405696 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 103388us
I20260709 13:03:56.406009 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:56.412006 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:56.383311 19149 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:56.359306 19096 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:03:56.421352 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 91886.7us
I20260709 13:03:56.424752 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:56.355975 19121 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:56.428922 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 74702.5us
I20260709 13:03:56.430291 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:56.375975 19145 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.415901 19028 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:56.451462 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 168527us
W20260709 13:03:56.452004 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 215335us
I20260709 13:03:56.428743 19153 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:56.480798 19145 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:56.432057 18645 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:03:56.486673 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 61997.1us
I20260709 13:03:56.490190 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:56.490933 16025 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:56.472023 19034 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:56.466787 19163 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:56.473869 19069 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:56.509006 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 97117.3us
I20260709 13:03:56.510444 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:56.488433 19164 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:56.517442 19156 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:03:56.517560 18765 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:56.518268 18765 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:56.429598 19149 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:56.519248 19119 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.681s	user 0.007s	sys 0.010s
I20260709 13:03:56.520565 18770 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:56.521015 19121 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:56.522248 18770 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:03:56.523442 19157 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:03:56.525250 19153 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:56.526325 19153 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:56.526578 19178 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:56.526983 19153 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:56.528450 19178 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:56.492646 18878 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:56.529843 19179 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:56.531023 18878 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.521135 19149 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:56.540364 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45422.2us
I20260709 13:03:56.553690 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:56.484161 19138 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:56.516131 19164 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.447680 18900 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:56.568971 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 94960us
I20260709 13:03:56.571672 19138 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:56.568260 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 98358.4us
I20260709 13:03:56.604650 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:03:56.609398 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:56.609946 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.529927 19184 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:56.529872 19153 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:03:56.614542 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 60947.5us
I20260709 13:03:56.574373 19164 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:56.622073 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 147879us
W20260709 13:03:56.628681 19174 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 13:03:56.629647 19176 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 13:03:56.631934 18745 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.001s
I20260709 13:03:56.627868 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:56.633634 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:56.634419 19167 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:56.634711 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:56.635154 19167 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:56.635838 19167 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:56.638968 19189 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:56.639834 19189 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:56.640343 19189 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:56.640641 19187 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:56.605934 19034 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:56.646481 19034 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:56.647032 19034 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:56.517592 18645 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:56.650122 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 75035.2us
I20260709 13:03:56.654090 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:56.659207 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:56.519316 18765 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.666558 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:56.668344 19153 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:56.666272 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56339.9us
I20260709 13:03:56.668942 19153 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:56.657459 19173 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:03:56.671073 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.672338 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:56.673035 15392 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:03:56.608732 19138 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:56.674569 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:56.674454 19138 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.675360 15392 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:03:56.677269 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:56.678498 15392 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:56.679067 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:56.680205 15398 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:56.682076 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:56.658740 18745 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:56.675915 19138 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:56.607668 19179 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:03:56.684283 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:56.705770 18745 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.732060 19161 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:56.734977 19154 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:03:56.710551 19184 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.726404 18745 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:56.752703 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68484.5us
I20260709 13:03:56.760741 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:03:56.765196 19022 consensus_meta.cc:287] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.589s	user 0.002s	sys 0.009s
I20260709 13:03:56.770877 19181 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:03:56.771984 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:56.777747 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:56.724315 19183 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:03:56.778627 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:56.725410 18878 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:03:56.781067 15246 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:03:56.777922 18898 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:56.849233 18898 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.851646 19196 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:56.853875 19141 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:56.854399 19141 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:56.854624 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:56.855363 19141 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:56.855893 15390 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:56.856635 19141 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:56.857125 15398 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:56.859338 19028 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:56.860307 19118 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:56.860054 19028 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.863216 19028 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:56.777765 19022 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:56.762506 19191 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:03:56.885059 18901 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:56.884408 19062 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.714s	user 0.005s	sys 0.014s
I20260709 13:03:56.848191 19161 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:03:56.887880 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 217904us
I20260709 13:03:56.883210 19180 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:56.886826 19022 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:56.764925 19184 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.919051 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:56.752717 19189 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:56.918560 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52749.9us
I20260709 13:03:56.959755 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:56.961198 19201 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:56.897266 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 147986us
I20260709 13:03:56.962285 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:56.963641 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:56.964511 19148 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.964771 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:56.965579 15322 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:56.965286 19148 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:56.914495 19180 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:56.931932 19197 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:56.934485 19199 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:03:57.008447 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:57.009722 16027 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:56.936102 19200 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:56.936625 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:56.946419 19195 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:03:56.947125 19184 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:56.947584 19182 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:03:56.952417 19187 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:56.922091 19166 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:56.968062 18871 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.917s	user 0.009s	sys 0.002s
I20260709 13:03:56.983033 15244 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:56.960896 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:57.025285 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 64469.6us
W20260709 13:03:56.969265 18957 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.834s	user 0.008s	sys 0.004s
I20260709 13:03:56.960865 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:56.967118 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:56.976222 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:56.979146 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:56.976281 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:56.995232 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:56.987412 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:56.968334 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:56.989517 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:56.988615 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:56.996304 15213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.512s (SENT) [suppressed 45 similar messages]
I20260709 13:03:56.999491 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:57.002656 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:56.917404 19022 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:57.017010 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 80459.7us
I20260709 13:03:57.080564 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:57.015530 19200 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:57.021625 19062 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:57.004195 18885 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.866s	user 0.012s	sys 0.002s
I20260709 13:03:57.026434 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:57.083472 15324 raft_consensus.cc:2376] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10. Re-sending same reply.
W20260709 13:03:57.091701 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 96598.3us
I20260709 13:03:57.100237 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:57.082938 15322 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
W20260709 13:03:57.022485 18989 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.787s	user 0.004s	sys 0.010s
W20260709 13:03:57.130051 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 103694us
I20260709 13:03:57.022199 19166 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:57.086179 19140 consensus_meta.cc:287] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.036s	user 0.013s	sys 0.003s
I20260709 13:03:57.175426 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:03:57.174460 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 396746us
I20260709 13:03:57.078502 19044 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:57.177956 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:57.094723 18957 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:57.098573 19201 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:57.094269 19200 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:57.187937 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.187139 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:57.024390 19034 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.128863 19017 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:57.191143 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:57.198309 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:57.199909 16033 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:57.027058 18871 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.180269 18971 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:57.195910 18951 consensus_meta.cc:287] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.858s	user 0.013s	sys 0.000s
I20260709 13:03:57.179831 19166 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:57.188725 19044 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:57.211352 18971 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:57.224985 18971 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.225623 18871 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.226425 19186 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:57.227499 19177 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:57.202212 18645 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:57.214401 19188 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:57.215324 19194 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:57.215723 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 99074.3us
I20260709 13:03:57.131903 18885 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.197786 19069 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:57.128196 19167 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.221802 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:57.222093 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2126) took 1422 ms. Trace:
I20260709 13:03:57.182601 19140 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.216300 18951 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.235939 15399 rpcz_store.cc:276] 0709 13:03:55.799268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.977345 (+178077us) service_pool.cc:224] Handling call
0709 13:03:55.993189 (+ 15844us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:56.019720 (+ 26531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:56.019764 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:56.043885 (+ 24121us) log.cc:844] Serialized 26 byte log entry
0709 13:03:56.738176 (+694291us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b18004a98c0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:03:56.776926 (+ 38750us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:56.776964 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.777559 (+   595us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:57.217640 (+440081us) raft_consensus.cc:1685] finished
0709 13:03:57.217674 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:57.222021 (+  4347us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48058,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11812,"spinlock_wait_cycles":20989696,"thread_start_us":38544,"threads_started":1,"wal-append.queue_time_us":962755}
W20260709 13:03:57.221249 19138 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
I20260709 13:03:57.239028 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 438) took 1408 ms. Trace:
I20260709 13:03:57.253646 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 637) took 1306 ms. Trace:
I20260709 13:03:57.260979 15396 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:57.240501 19069 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.231601 18645 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.278867 15243 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:57.250633 15249 rpcz_store.cc:276] 0709 13:03:55.824130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.922146 (+ 98016us) service_pool.cc:224] Handling call
0709 13:03:55.922470 (+   324us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:55.922852 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:55.922884 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:55.936828 (+ 13944us) log.cc:844] Serialized 52 byte log entry
0709 13:03:56.174090 (+237262us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:56.209726 (+ 35636us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.210216 (+   490us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.970395 (+760179us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b1800466ae0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:03:57.230206 (+259811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.230314 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:57.231526 (+  1212us) raft_consensus.cc:1685] finished
0709 13:03:57.231556 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:57.232313 (+   757us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104808,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":10246,"raft.queue_time_us":24537,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":16315,"spinlock_wait_cycles":62357632,"thread_start_us":458496,"threads_started":2,"wal-append.queue_time_us":554576}
I20260709 13:03:57.239215 19006 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.282284 19180 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.253692 19186 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:57.283159 19186 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.283588 19186 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:57.284677 19170 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
W20260709 13:03:57.286929 18745 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.002s
W20260709 13:03:57.287303 19204 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:57.287423 18745 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.289908 18745 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.254149 16032 rpcz_store.cc:276] 0709 13:03:55.947662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.947815 (+   153us) service_pool.cc:224] Handling call
0709 13:03:56.010177 (+ 62362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.010420 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:56.173223 (+162803us) log.cc:844] Serialized 14 byte log entry
0709 13:03:56.272314 (+ 99091us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:56.272365 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:56.272409 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.272473 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:57.253456 (+980983us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b540043b2d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:57.253581 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":298309,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3460,"raft.queue_time_us":4502,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":9123,"spinlock_wait_cycles":103024512,"thread_start_us":205642,"threads_started":2,"wal-append.queue_time_us":289969}
I20260709 13:03:57.296802 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:57.316556 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 236048us
I20260709 13:03:57.320699 15322 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:57.253369 19177 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:03:57.292415 19069 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:57.293795 18645 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:57.331496 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 78296.6us
I20260709 13:03:57.273913 19188 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:03:57.336336 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:57.336844 15290 leader_election.cc:400] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8.
I20260709 13:03:57.338099 15290 leader_election.cc:403] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:03:57.296878 19006 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.328073 19207 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.340847 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:57.345263 15322 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:57.335975 18604 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:57.350494 18604 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:57.351398 18604 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.352653 18604 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:57.358831 15244 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:57.358716 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:57.360443 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:03:57.362998 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:57.363457 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.364708 15241 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:03:57.365667 15245 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:57.364568 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:57.366426 15248 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:57.367165 15244 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:57.368079 15249 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:57.369493 19148 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.337549 19212 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:03:57.370492 18885 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:57.336459 19180 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:03:57.372222 19006 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:57.372718 18587 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.336505 19170 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:03:57.337745 19062 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:03:57.374620 19170 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:57.375041 19170 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:57.322563 19044 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.375869 19170 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.377084 19170 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:57.370021 18898 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:57.378409 19191 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:57.385510 18951 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.390511 19215 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:57.395525 15244 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:57.396695 19062 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:57.394548 19211 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 13:03:57.400568 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66774.3us
I20260709 13:03:57.401575 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:57.391700 19167 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:57.408288 19209 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:57.397197 19062 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:57.408762 19209 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.409196 19209 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:57.409554 19062 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.410921 19062 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.411103 19006 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:57.412339 19200 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.413441 15247 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:57.400249 19191 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:57.414143 19188 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:57.368300 19183 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:57.416148 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:57.415315 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:57.391716 19034 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:57.471154 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:57.478569 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:57.486640 19200 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.492321 18901 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:57.415946 19188 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.495930 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:57.496608 15242 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:57.487545 19141 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.004s
I20260709 13:03:57.497402 15322 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:57.487402 19007 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:57.415941 19191 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:57.490298 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.471834 19170 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:57.470727 19138 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:57.511665 18951 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:57.511770 19138 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.358716 19207 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.497344 19140 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.505818 19134 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:57.504455 19007 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:57.521556 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 525260us
I20260709 13:03:57.517829 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:57.494033 18645 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.508147 19170 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.510550 18587 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 7. Current term is 8.
I20260709 13:03:57.514348 19148 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:57.600379 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:57.515775 19164 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.867s	user 0.012s	sys 0.000s
I20260709 13:03:57.522433 19138 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:57.505075 19194 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:03:57.523442 19134 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:57.628391 15250 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:57.521170 19044 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:03:57.605988 19140 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:03:57.670866 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 153154us
I20260709 13:03:57.602593 19170 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:57.511281 19209 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.626674 19188 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:57.615621 19141 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:57.670550 19138 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.684352 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.630355 19207 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:57.673012 19134 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:57.630107 18951 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:57.678701 18587 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:57.678567 18957 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.698180 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:03:57.613502 19148 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.606552 19164 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.691074 18971 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:57.680727 19194 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:03:57.627672 19007 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.681142 19177 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:03:57.717345 19231 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:57.693791 19166 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.727761 15242 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:03:57.692111 19188 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:03:57.699949 18951 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.699256 18587 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:57.777192 15322 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:57.682777 19034 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:03:57.692647 19141 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:57.779832 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 63266.5us
I20260709 13:03:57.712188 18957 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.782536 18951 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:57.805159 19212 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:03:57.777702 18976 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:57.820919 18957 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:57.812109 19201 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.008s
I20260709 13:03:57.821635 19201 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:57.785640 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.802640 19207 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:03:57.823563 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:57.824465 15242 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:03:57.822850 19212 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:57.825938 19212 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:57.791241 19231 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.827054 15390 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:03:57.827548 15390 pending_rounds.cc:85] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 4
I20260709 13:03:57.827865 15390 pending_rounds.cc:107] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:03:57.828168 15390 raft_consensus.cc:2889] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:57.828980 19231 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.786008 15321 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 9: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:57.838851 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1435) took 1926 ms. Trace:
I20260709 13:03:57.839412 15243 rpcz_store.cc:276] 0709 13:03:55.912651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.921721 (+  9070us) service_pool.cc:224] Handling call
0709 13:03:57.838526 (+1916805us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54001a8bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:57.838726 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3118321536}
I20260709 13:03:57.840970 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:57.841730 15243 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
W20260709 13:03:57.843871 19220 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.352s	user 0.003s	sys 0.000s
I20260709 13:03:57.844179 19166 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:57.847895 19219 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:57.848507 19219 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:03:57.857959 19022 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.000s
I20260709 13:03:57.849476 19219 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.867113 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 432) took 1693 ms. Trace:
I20260709 13:03:57.908043 15396 rpcz_store.cc:276] 0709 13:03:56.173811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.191944 (+ 18133us) service_pool.cc:224] Handling call
0709 13:03:56.223415 (+ 31471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:57.275951 (+1052536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.866773 (+590822us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400270954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:57.867032 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385623168}
I20260709 13:03:57.859213 18900 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:57.696630 19138 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.864696 19209 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.713701 19229 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.160s
W20260709 13:03:57.862695 19228 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:03:57.825747 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:57.715358 19200 raft_consensus.cc:2764] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:03:57.870381 19164 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:57.909250 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:57.804288 19186 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.520s	user 0.004s	sys 0.006s
I20260709 13:03:57.915100 15249 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:57.799574 19141 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.892359 19177 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:57.816785 19148 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.919034 19186 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.822829 18587 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.921284 15242 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:57.820974 18976 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.818485 19140 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.097s
W20260709 13:03:57.926589 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 927178us
I20260709 13:03:57.926692 19161 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:57.927158 19153 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:57.927439 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 749513us
I20260709 13:03:57.928787 19017 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:57.928588 19177 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.910111 19022 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.929832 18881 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.931639 19118 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:03:57.932788 19069 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.001s
I20260709 13:03:57.927431 18989 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:57.934824 19183 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:03:57.928632 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.946904 19161 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.935832 19138 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:57.938907 19007 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:57.947154 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 137979us
I20260709 13:03:57.966065 19148 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:57.966564 19148 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:57.969604 19186 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.971372 19022 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:57.956409 19118 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.948364 15248 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:57.955677 18881 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.929345 19205 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.977240 19118 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:57.977101 19205 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.977898 18881 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:57.957072 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:57.950605 19017 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.984354 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:57.985581 19017 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:57.986299 19017 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:57.960304 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:57.975104 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.009209 15395 raft_consensus.cc:2376] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10. Re-sending same reply.
I20260709 13:03:57.978616 19148 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:57.979336 19205 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:57.979950 19177 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:57.945761 19164 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:03:57.947906 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.985855 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:57.960127 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.033776 15392 raft_consensus.cc:2376] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11. Re-sending same reply.
I20260709 13:03:57.986562 18989 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:57.988185 19190 raft_consensus.cc:3055] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:57.989580 15397 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:58.050218 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:58.050979 15397 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:03:57.991075 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:58.054381 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.054718 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:57.962488 19161 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:58.044513 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:57.959509 19069 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:58.060355 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 74579.6us
I20260709 13:03:58.061687 19069 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.954018 19170 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:57.997435 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:58.044886 19148 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:57.998219 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:57.999401 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:58.000828 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:58.006006 18587 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:58.007859 18645 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:58.009127 15394 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 6.
I20260709 13:03:58.005878 19134 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.066587 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:58.062176 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:58.071543 15241 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:58.062415 18898 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:58.030978 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.078054 15395 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:58.068559 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:58.035072 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.031881 19164 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:58.044435 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2150) took 1186 ms. Trace:
I20260709 13:03:58.092613 15390 rpcz_store.cc:276] 0709 13:03:56.857749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.857868 (+   119us) service_pool.cc:224] Handling call
0709 13:03:56.858157 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:57.828737 (+970580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.036525 (+207788us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b5400153bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:58.044366 (+  7841us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227156352}
I20260709 13:03:58.050351 18976 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:57.990993 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.098435 15393 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:58.065243 16032 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:58.091445 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:58.101157 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:58.102873 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:58.010632 15213 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:58.076937 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:58.086800 15392 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:58.088600 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.106875 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:58.110646 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:58.111332 15244 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:58.114605 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:58.101814 16026 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:58.046609 19190 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:58.122349 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:58.093681 19205 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:58.130365 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:58.144623 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.096208 19180 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:58.138913 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:58.145411 15397 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:58.151736 16027 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:58.153101 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:58.154044 15248 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:58.145211 15250 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 6.
W20260709 13:03:58.170140 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 159602us
I20260709 13:03:58.138738 19118 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.188113 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:58.188639 15241 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:03:58.208364 15393 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:03:58.214900 15390 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:58.134812 19205 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:58.217362 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:58.220887 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:58.226814 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:58.228341 15393 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:58.229602 15392 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:03:58.230120 15213 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:58.230517 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:58.231639 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:58.232021 15316 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:58.188091 18989 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.242201 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:58.246881 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:58.248521 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.247080 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.191025 19138 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:58.249576 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.250126 15325 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:58.247798 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.250207 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.251081 15317 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:58.238138 19069 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:58.252938 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.219457 19143 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:03:58.239419 19246 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:03:58.145087 18951 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.147025 19164 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.241053 18645 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:58.321858 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:58.214761 19017 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.318269 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.199075 19180 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.243182 19186 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:58.419320 15248 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:58.316524 18957 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:58.223879 19205 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:58.225409 18898 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:58.334715 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.335428 15317 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:58.317245 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.426558 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:58.316969 19196 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.355368 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:58.357493 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.240877 19200 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:58.214332 19118 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.326143 19034 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:58.243032 19239 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:58.486177 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:58.423882 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.487759 15321 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:58.427132 15319 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:58.354568 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:58.427284 15322 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:58.430119 15317 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:03:58.317267 19170 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:58.478170 15320 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
W20260709 13:03:58.440284 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 198184us
I20260709 13:03:58.501437 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:03:58.479557 15398 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.020s	sys 0.026s
W20260709 13:03:58.502352 15398 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.020s	sys 0.026s
W20260709 13:03:58.328323 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78714.3us
I20260709 13:03:58.484905 19168 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:58.503219 15317 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:58.426479 18645 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:58.500075 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:58.456132 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.317265 18989 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.431211 18957 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:58.486582 19246 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:03:58.330209 19069 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.505535 19164 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:58.496827 19143 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.483767 19196 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.504045 19200 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:58.560056 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.479354 18898 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.523238 18957 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:58.416369 19017 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.506968 19134 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:58.327819 19190 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:58.539897 19242 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.465s	user 0.001s	sys 0.001s
I20260709 13:03:58.504973 19034 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.542712 19240 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:58.585398 15245 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:58.561795 19233 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:58.567242 19200 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.575100 19170 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:58.609211 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.624593 15393 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:58.505383 19239 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.531714 19209 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:03:58.621796 19244 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:58.566275 19207 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:03:58.629215 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:58.629659 19250 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.488s	user 0.001s	sys 0.000s
I20260709 13:03:58.622182 19200 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:58.607129 19168 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:58.623715 19170 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:58.562621 19143 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.624984 19241 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:58.672464 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.668305 15393 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
W20260709 13:03:58.687878 19253 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 13:03:58.688652 19034 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:58.671273 19170 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:58.691452 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:58.720839 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:58.723628 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:58.739555 15392 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:58.681500 19243 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.686440 18604 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:58.727416 19161 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.000s
I20260709 13:03:58.622421 19233 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:58.734036 18587 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.668s	user 0.008s	sys 0.000s
W20260709 13:03:58.789167 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 271415us
I20260709 13:03:58.720219 15396 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:58.744073 15324 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:58.760576 15319 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
W20260709 13:03:58.772512 15397 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.002s
I20260709 13:03:58.791510 15397 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:58.626372 18645 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:58.781087 19148 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.006s
I20260709 13:03:58.778512 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:03:58.785924 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 272629us
I20260709 13:03:58.799275 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.634527 19244 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.773752 19118 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:58.802001 15392 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:03:58.802772 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:58.731165 19196 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:58.775367 18989 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:58.802809 15393 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 9: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:58.804061 16031 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:03:58.805209 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.813380 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.813637 15396 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:58.814311 15317 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:03:58.814904 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.815507 15324 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:58.738590 18957 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.816581 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.730180 19170 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.818730 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.785796 19161 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.825219 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.826395 15320 raft_consensus.cc:2368] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9.
I20260709 13:03:58.786621 18604 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.830610 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.832249 19265 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.832863 19265 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.833391 19161 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:58.809909 19241 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:58.811102 19069 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:58.853791 15396 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:03:58.839460 19265 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:58.841670 19255 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 13:03:58.842000 19261 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:03:58.842358 19254 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:03:58.843109 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.843400 19170 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:58.884161 18604 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:58.843776 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.885396 19190 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:58.886189 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.886456 19257 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:03:58.887784 19257 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:58.888140 19257 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:58.888044 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.889304 15320 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:58.889215 19257 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.865325 19188 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:03:58.843940 19239 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:58.894260 18957 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:58.862051 19241 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:58.844345 19252 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.350s	user 0.001s	sys 0.000s
I20260709 13:03:58.845950 19233 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:58.848127 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:03:58.897157 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49094.6us
I20260709 13:03:58.844854 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:58.854862 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:58.898437 19034 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:58.898542 16029 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:58.807566 19134 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:03:58.857311 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:58.899048 19034 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:58.900211 15396 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:58.899967 19034 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.831080 19096 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:58.817415 19274 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:58.784868 19243 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.863164 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:58.863547 15322 raft_consensus.cc:2376] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9. Re-sending same reply.
I20260709 13:03:58.864703 19267 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:58.866501 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:58.913496 16032 raft_consensus.cc:2368] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11.
I20260709 13:03:58.730432 19168 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.916188 19017 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:58.917578 19143 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:58.918613 19257 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:58.919337 19259 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.919914 19259 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:58.872951 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.878872 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.879513 15395 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 6. Current term is 7. Ops: []
W20260709 13:03:58.924439 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.924630 15319 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:58.895551 19244 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:58.895431 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.897904 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:58.930931 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:58.855580 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:58.931602 19243 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:58.931903 16026 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:58.932376 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:58.933470 19199 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:58.933326 19200 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.933920 19186 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:58.952409 16029 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:03:58.911640 15396 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:03:58.910104 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.822078 19196 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:03:58.927536 15395 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:03:58.954679 19189 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:58.934352 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 615236us
I20260709 13:03:58.955276 19189 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:58.929353 19279 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:03:58.928995 19007 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:58.834388 18898 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:58.952152 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:58.963222 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:58.963411 16025 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:58.955670 15395 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:03:58.857522 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.929528 18765 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:58.929167 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.962059 15396 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:03:58.965355 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.898070 19241 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:58.965782 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.912328 19274 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:58.967022 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.967303 19274 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:58.958137 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:58.963475 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:58.971855 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:58.978870 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:58.954138 19143 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:58.983354 19143 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:03:58.983851 19143 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:58.984498 19215 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:58.985186 19215 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:58.926354 19096 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:58.982793 19241 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.988164 19096 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:58.952730 19186 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:58.982478 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2562) took 1018 ms. Trace:
I20260709 13:03:58.995452 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.995426 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:58.997398 15319 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:58.994175 15398 rpcz_store.cc:276] 0709 13:03:57.964632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.967572 (+  2940us) service_pool.cc:224] Handling call
0709 13:03:57.970371 (+  2799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:57.970589 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:58.503509 (+532920us) log.cc:844] Serialized 14 byte log entry
0709 13:03:58.982092 (+478583us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:58.982147 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:58.982197 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.982296 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:58.982423 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":377379,"prepare.queue_time_us":777,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":378836,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":632560,"threads_started":2,"wal-append.queue_time_us":188775}
I20260709 13:03:58.953887 19138 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:03:58.982117 18878 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:58.998204 19215 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:59.012823 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49423.2us
I20260709 13:03:59.013578 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:59.014268 15362 leader_election.cc:400] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9.
I20260709 13:03:59.014672 15362 leader_election.cc:403] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:03:59.015466 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 204053us
I20260709 13:03:59.015410 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:58.934477 19267 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.998955 18645 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:59.017201 15213 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:59.025708 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:58.918169 19212 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:58.988204 19241 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.027864 18885 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:59.052947 15325 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:59.036947 19259 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.029978 18881 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9.
I20260709 13:03:59.041103 19041 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.042135 19212 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:59.050076 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:59.053786 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:03:59.019903 19199 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.058038 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:59.023979 18645 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.067737 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:59.028699 19118 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:59.080053 15320 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:59.080367 15319 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:03:59.071087 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:59.071218 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:03:59.073077 15244 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
W20260709 13:03:59.054647 19205 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:03:59.079253 19206 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:59.056174 19138 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:59.086553 15244 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:59.056376 18885 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:59.086066 19233 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:59.091014 15248 raft_consensus.cc:2393] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:03:59.055317 18900 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:59.093993 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2561) took 1130 ms. Trace:
I20260709 13:03:59.103811 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.104892 15319 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:59.079973 18645 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:59.087419 19164 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.129578 15245 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:03:59.087700 19118 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.103044 15399 rpcz_store.cc:276] 0709 13:03:57.963743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.963910 (+   167us) service_pool.cc:224] Handling call
0709 13:03:57.968770 (+  4860us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:57.969156 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:58.219363 (+250207us) log.cc:844] Serialized 14 byte log entry
0709 13:03:58.988926 (+769563us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:58.989496 (+   570us) log.cc:844] Serialized 52 byte log entry
0709 13:03:58.989658 (+   162us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:58.989888 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:03:58.990033 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.990103 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:59.093751 (+103648us) raft_consensus.cc:1685] finished
0709 13:03:59.093771 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.093930 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":202661,"prepare.queue_time_us":2507,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":191943,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":11079,"spinlock_wait_cycles":12344192,"thread_start_us":718392,"threads_started":2,"wal-append.queue_time_us":579523}
I20260709 13:03:59.079128 19041 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.100597 18885 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.093488 19138 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.142902 19138 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.143424 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.125960 18900 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:59.144188 19138 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.144630 18900 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.133203 19118 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.136611 19239 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:59.147496 19239 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.138420 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.135792 19286 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:03:59.150962 19286 consensus_queue.cc:1243] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:03:59.151237 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.151821 19229 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:59.151965 15319 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:03:59.152246 19229 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:59.152954 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:59.153672 15319 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:03:59.154366 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:59.158823 19280 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:59.149977 19239 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.134616 19164 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.160444 18971 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:59.160984 18971 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:59.134204 19200 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.144284 15323 raft_consensus.cc:2410] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:03:59.093211 19199 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.166612 19219 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:59.174079 19217 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.698s	user 0.018s	sys 0.000s
I20260709 13:03:59.175195 19180 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.174108 16026 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:59.176498 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:59.176631 19186 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.177217 15319 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:59.177735 19186 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.178131 19267 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.096957 19206 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.153162 19229 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.180521 19206 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.180759 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.092381 19205 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.181026 19229 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:59.182930 19205 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:59.184003 15321 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:03:59.188582 15317 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:59.181840 15323 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:03:59.124146 19233 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:59.195539 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:59.132637 19196 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:03:59.200966 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 268647us
I20260709 13:03:59.206403 19143 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.208709 19143 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.209765 19233 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.210774 19161 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.211385 19161 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.164976 18885 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:59.215219 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.216763 15319 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:03:59.227324 19161 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:59.203162 19277 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:59.231980 18885 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.235441 15325 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:59.195602 19205 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.242120 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:59.248936 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:59.186091 19118 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.287030 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:59.238551 19153 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:59.234720 19196 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.292675 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:03:59.300318 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 283197us
I20260709 13:03:59.244359 19244 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:59.240532 19205 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.285894 18765 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:59.290933 19138 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:59.295120 19034 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:59.303910 19207 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:59.335148 19196 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.326289 19244 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.338375 19034 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.338841 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:59.339449 15325 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.339493 19034 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.340112 19244 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.342536 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2176) took 1950 ms. Trace:
I20260709 13:03:59.342980 15249 rpcz_store.cc:276] 0709 13:03:57.392366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.392578 (+   212us) service_pool.cc:224] Handling call
0709 13:03:57.401553 (+  8975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:57.917639 (+516086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.342261 (+1424622us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54001a90d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:03:59.342467 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180596096}
I20260709 13:03:59.343534 19164 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.343464 18971 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.345152 15321 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:59.345273 19191 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:59.345778 19191 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.346472 18645 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.346712 19191 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.347164 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.347880 15321 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:59.348011 19191 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.348861 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:59.349660 19118 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:59.306461 19180 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:03:59.350711 19257 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:59.350852 19180 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:59.351171 19257 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.351266 19180 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.333163 19138 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.352133 19257 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.353538 19257 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:59.353278 19138 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:59.353731 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:59.355954 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.358630 19282 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:59.359351 19282 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.360916 19274 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.329993 18765 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:59.362648 15322 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:59.363618 18645 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.363250 18765 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.364693 15322 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:59.365440 15324 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:03:59.368124 15321 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:03:59.369714 15321 pending_rounds.cc:85] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 4
I20260709 13:03:59.372066 15325 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:59.370075 15321 pending_rounds.cc:107] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:03:59.373224 15321 raft_consensus.cc:2889] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:59.331722 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 317587us
I20260709 13:03:59.345958 18971 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.376348 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2155) took 1130 ms. Trace:
W20260709 13:03:59.376596 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47195.7us
I20260709 13:03:59.377606 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.378106 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:03:59.378576 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.366894 19287 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.385928 19287 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.388484 19287 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.389062 19287 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:59.390878 19290 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:59.392760 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:59.393023 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:03:59.393875 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.394261 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:59.394966 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:59.395313 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:59.395922 15398 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:59.393023 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:59.396745 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:59.398123 19190 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:59.398262 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:59.398643 19190 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.398726 15395 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:59.399106 19190 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.400079 15395 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:59.401336 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:59.394999 15399 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:59.382355 15392 rpcz_store.cc:276] 0709 13:03:58.245499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.806636 (+561137us) service_pool.cc:224] Handling call
0709 13:03:58.806969 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:58.990576 (+183607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:58.990606 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:58.991025 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.172556 (+181531us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b48002001d8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366eb23aa1 00007f366eb1ab37 00007f366eb1a9ca 00007f366ec1226f 00007f366ec11f37 00007f366ec2655c 00007f366ec26508 00007f366ec26488 00007f366ec26443 00007f366ec256ec 00007f366db4fa96
0709 13:03:59.234743 (+ 62187us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:59.234796 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.234896 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:59.364082 (+129186us) raft_consensus.cc:1685] finished
0709 13:03:59.364100 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.376272 (+ 12172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183235,"raft.queue_time_us":186448,"raft.run_cpu_time_us":2030,"raft.run_wall_time_us":177557,"spinlock_wait_cycles":12873472,"thread_start_us":235707,"threads_started":1,"wal-append.queue_time_us":334338}
I20260709 13:03:59.403954 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.362035 19282 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:03:59.408217 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.419117 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:59.411404 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.413640 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.400776 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:59.421805 15396 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:03:59.425642 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.410990 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:59.430529 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.430763 15395 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:59.417466 19290 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:59.438130 19290 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.440071 19189 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.441352 19290 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.435546 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:59.406543 19194 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.446293 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:59.446581 19288 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.447027 19274 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.446900 19200 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:59.417552 19199 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.423069 19292 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:59.446007 15396 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:59.448855 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.429543 18645 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:59.432883 18900 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:59.463737 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:03:59.471529 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.352133 19180 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.513322 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:03:59.514462 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:59.459432 19282 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:59.517798 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 54154.8us
I20260709 13:03:59.503280 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2566) took 1511 ms. Trace:
I20260709 13:03:59.462401 19240 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:59.524402 15391 rpcz_store.cc:276] 0709 13:03:57.991827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.991948 (+   121us) service_pool.cc:224] Handling call
0709 13:03:57.992252 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:57.992634 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:57.992914 (+   280us) log.cc:844] Serialized 14 byte log entry
0709 13:03:58.223063 (+230149us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:58.223664 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:03:58.223794 (+   130us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:58.223826 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.223896 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:58.931256 (+707360us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b18002bc480. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f366dace58f 00007f3666b0d571 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd
0709 13:03:59.358336 (+427080us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b18002bc480. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:59.502937 (+144601us) raft_consensus.cc:1685] finished
0709 13:03:59.502969 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.503194 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93938,"prepare.queue_time_us":647,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":13533,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":12115,"spinlock_wait_cycles":15968896,"thread_start_us":220877,"threads_started":1,"wal-append.queue_time_us":247448}
I20260709 13:03:59.514923 18645 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.447729 19189 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:59.515748 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 66981.8us
I20260709 13:03:59.537735 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.510731 19291 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:59.460840 19194 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.444222 19207 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:03:59.572921 15289 leader_election.cc:400] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11.
I20260709 13:03:59.573314 15289 leader_election.cc:403] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:03:59.522369 15318 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:59.575179 18604 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11.
I20260709 13:03:59.541229 15394 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:03:59.524194 19096 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:59.520393 19121 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:59.558465 19017 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:59.577180 19017 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.514458 19199 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:59.560312 19297 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:03:59.527228 19274 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.569489 19153 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:59.590504 19153 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:59.570829 19205 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:59.534991 19240 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.595398 19240 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.596809 19288 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:59.589395 18951 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.516134 19287 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:03:59.539240 18645 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.600318 19274 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.615890 19199 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.616372 19274 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.617972 19153 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.620101 19194 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.578722 19007 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:03:59.622031 18770 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:03:59.574041 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:59.622608 18770 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:59.623216 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 49249.9us
I20260709 13:03:59.623826 18770 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.525532 19282 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.625399 19282 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.626097 18951 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.626817 18951 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:59.584192 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46540.9us
I20260709 13:03:59.589277 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 461) took 1357 ms. Trace:
I20260709 13:03:59.630657 15316 rpcz_store.cc:276] 0709 13:03:58.231403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.231536 (+   133us) service_pool.cc:224] Handling call
0709 13:03:58.231841 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:58.239899 (+  8058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.588946 (+1349047us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b54003b7ca0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfda02 00007f3669bf9dd6 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:59.589197 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9131264}
I20260709 13:03:59.631559 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.586562 19121 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:59.581844 19267 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.630959 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.604542 19017 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:59.632427 15324 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:03:59.639768 18951 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.641328 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:59.640940 19267 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.642361 19286 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:59.634367 19233 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.642971 19286 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.643393 19286 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:59.643322 19233 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.636277 19231 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:59.637423 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.649657 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:59.649807 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:59.650746 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.650697 15317 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:03:59.652273 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:59.651194 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:59.654449 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:59.657001 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.659994 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:59.646097 19233 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:03:59.666750 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 418510us
I20260709 13:03:59.649122 19288 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:59.658732 19287 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:59.655465 19017 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:03:59.675390 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.648463 19194 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:03:59.660490 18900 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:59.661213 19121 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:59.659698 19231 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:59.661664 19205 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:59.687084 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.672883 18898 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:59.666633 19292 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:59.676729 19287 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.700071 15316 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:03:59.700508 15316 pending_rounds.cc:85] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 4
I20260709 13:03:59.700742 15316 pending_rounds.cc:107] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:03:59.701010 15316 raft_consensus.cc:2889] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:59.705919 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.689714 19138 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.710804 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:59.688568 19121 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:59.687934 19017 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:03:59.720656 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.751175 19267 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.682004 18745 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:03:59.697369 19287 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.751260 19017 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:03:59.752908 15144 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 135) took 29802 ms (client timeout 15000 ms). Trace:
I20260709 13:03:59.723308 19189 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:59.725965 19241 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.732532 19274 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:59.735262 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:03:59.739059 19303 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:59.741629 19180 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:59.689093 19288 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 13:03:59.742717 15242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2181) took 2065 ms (client timeout 1570 ms). Trace:
I20260709 13:03:59.743752 19190 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.747079 15247 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:59.721999 19153 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:59.723187 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:59.710039 19206 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:59.768906 15322 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:59.753298 15144 rpcz_store.cc:269] 0709 13:03:29.951149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.976545 (+ 25396us) service_pool.cc:224] Handling call
0709 13:03:59.752831 (+29776286us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:54.582465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:54.689313 (+106848us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:54.689375 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:03:54.689399 (+    24us) tablet.cc:662] Decoding operations
0709 13:03:54.690693 (+  1294us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:54.690792 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:54.690826 (+    34us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:03:54.691934 (+  1108us) tablet.cc:701] Row locks acquired
0709 13:03:54.691992 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:03:54.692224 (+   232us) write_op.cc:270] Start()
0709 13:03:54.692407 (+   183us) write_op.cc:276] Timestamp: P: 1783602234692141 usec, L: 0
0709 13:03:54.692433 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:03:54.693370 (+   937us) log.cc:844] Serialized 4014 byte log entry
0709 13:03:55.683028 (+989658us) op_driver.cc:464] REPLICATION: finished
0709 13:03:55.925077 (+242049us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b18002192e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:03:55.925260 (+   183us) write_op.cc:301] APPLY: starting
0709 13:03:55.925354 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:55.925594 (+   240us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:55.925628 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:56.065095 (+139467us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:56.176518 (+111423us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:03:56.198423 (+ 21905us) write_op.cc:312] APPLY: finished
0709 13:03:56.323061 (+124638us) log.cc:844] Serialized 77 byte log entry
0709 13:03:56.349160 (+ 26099us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:56.358258 (+  9098us) write_op.cc:454] Released schema lock
0709 13:03:56.382340 (+ 24082us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:56.384542 (+  2202us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:56.384576 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2496046,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":113657,"apply.run_cpu_time_us":5666,"apply.run_wall_time_us":459244,"num_ops":10,"prepare.queue_time_us":174433,"prepare.run_cpu_time_us":18555,"prepare.run_wall_time_us":310251,"raft.queue_time_us":351449,"raft.run_cpu_time_us":15704,"raft.run_wall_time_us":141632,"replication_time_us":970369,"spinlock_wait_cycles":34522368,"thread_start_us":646631,"threads_started":4,"wal-append.queue_time_us":212890,"wal-append.run_cpu_time_us":28785,"wal-append.run_wall_time_us":2564254}]]}
I20260709 13:03:59.751611 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:59.770435 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:59.692987 19205 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.762180 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:59.763029 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:59.763422 15319 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:59.763823 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:59.756091 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:59.760365 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:03:59.755177 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:03:59.758678 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:03:59.764313 15242 rpcz_store.cc:269] 0709 13:03:57.677562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.825402 (+147840us) service_pool.cc:224] Handling call
0709 13:03:59.742364 (+1916962us) spinlock_profiling.cc:243] Waited 8.97 ms on lock 0x7b540010b154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:59.742585 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20636032}
I20260709 13:03:59.710846 18885 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:59.793715 16028 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:59.795351 16026 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:03:59.771828 16029 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:03:59.796195 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:03:59.798132 15317 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:59.777925 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:03:59.771704 16025 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.771266 16032 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:03:59.757709 19274 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.760969 19121 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:03:59.803433 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 333862us
W20260709 13:03:59.803800 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 273205us
I20260709 13:03:59.768626 19291 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.810139 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:03:59.812110 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:03:59.721747 19138 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.810474 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:03:59.795037 19205 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:59.820015 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.771624 19199 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:59.799467 19189 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:59.802327 18976 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:59.819368 19267 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:59.826205 18976 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:03:59.847906 16031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 726) took 1806 ms (client timeout 2245 ms). Trace:
W20260709 13:03:59.848371 16031 rpcz_store.cc:269] 0709 13:03:58.041205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.054436 (+ 13231us) service_pool.cc:224] Handling call
0709 13:03:59.847703 (+1793267us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b54001801d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:03:59.847823 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1721837440}
I20260709 13:03:59.802559 19118 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:03:59.819480 18745 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:03:59.851681 18745 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:59.852069 18745 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:03:59.852830 15325 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:03:59.853205 15325 pending_rounds.cc:85] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 5
I20260709 13:03:59.853428 15325 pending_rounds.cc:107] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:03:59.852998 18745 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.853672 15325 raft_consensus.cc:2889] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:59.807158 19153 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:03:59.824270 18878 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:59.856307 19140 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:59.856732 19140 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:03:59.854024 18745 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.857583 19140 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.873682 18976 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:59.868908 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.797921 19206 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.873571 19196 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:59.801174 18885 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.826905 19267 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.760115 18645 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.883526 19138 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.883888 18645 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.884476 18645 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.874126 19234 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:59.885097 18645 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.885582 19234 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:59.887321 18645 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:03:59.886106 19234 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:03:59.889142 19234 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.890770 19234 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:59.893251 19190 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:03:59.894388 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:03:59.895098 15398 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.896248 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 451) took 1652 ms. Trace:
I20260709 13:03:59.896492 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:03:59.897138 15320 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:59.898929 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.899694 15321 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:03:59.900615 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:03:59.815336 19291 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.800823 19231 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:03:59.880481 19196 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.875840 18900 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:03:59.881858 18885 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:03:59.881971 19267 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:59.896773 15397 rpcz_store.cc:276] 0709 13:03:58.243697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.793764 (+550067us) service_pool.cc:224] Handling call
0709 13:03:58.794090 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.200301 (+406211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.200328 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.237312 (+ 36984us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.706912 (+469600us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:59.706948 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.707014 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:59.895981 (+188967us) raft_consensus.cc:1685] finished
0709 13:03:59.896008 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.896177 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":188397,"raft.queue_time_us":189236,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":628486,"threads_started":2,"wal-append.queue_time_us":573335}
I20260709 13:03:59.908401 15322 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:03:59.874856 19140 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:59.772145 19257 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:03:59.920022 16032 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:59.870609 19212 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:59.945334 15398 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:03:59.770095 19287 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:03:59.840886 19199 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:03:59.985148 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.973507 16025 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:00.022150 15320 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:00.032446 15998 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:03:59.946820 19196 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:00.047955 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:03:59.976181 19288 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:03:59.987926 18885 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.987200 19191 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:00.064141 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 286334us
I20260709 13:03:59.878396 19274 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.069499 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:03:59.979884 18900 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.071300 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:00.082129 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:00.076295 15394 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:00.080792 15392 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:00.076273 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:00.063256 19212 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:00.060340 19313 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:00.032692 19257 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.039211 19241 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:04:00.090628 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:00.091217 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 281112us
I20260709 13:04:00.113593 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:00.089308 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:00.091733 15395 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:00.094399 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 458) took 2688 ms. Trace:
I20260709 13:04:00.095774 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.115429 15399 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:00.115300 15247 rpcz_store.cc:276] 0709 13:03:57.401160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.925248 (+524088us) service_pool.cc:224] Handling call
0709 13:03:59.746819 (+1821571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.767470 (+ 20651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.089380 (+321910us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b540010b150. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:00.089522 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4188380928}
I20260709 13:04:00.116343 19200 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.116894 19200 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.117792 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:00.118587 19311 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:00.119102 19200 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.119267 19311 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:00.119678 19200 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:00.120169 19311 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:00.111804 18878 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:04:00.120982 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:00.124396 15320 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:00.078212 19143 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:00.123580 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.120708 19311 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:00.126432 19207 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:00.123888 19200 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:00.127195 18900 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:00.093384 19286 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.127897 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:00.067224 19288 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.122025 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:00.128827 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.130856 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.130553 15392 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:00.160583 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.160892 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.132246 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.162009 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.162861 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.070399 19191 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.137195 15396 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:04:00.090499 19240 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:00.067791 18885 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.111322 19199 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.142082 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.113339 19212 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:00.109422 19313 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:00.159682 15394 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:00.195590 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.108858 19282 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.219584 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.220463 15396 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
W20260709 13:04:00.198066 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 76116.6us
I20260709 13:04:00.159596 18900 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.224509 18900 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.150804 19183 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:04:00.226598 19304 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 13:04:00.226701 18900 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:00.227675 19286 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.228102 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:00.229810 19121 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.230705 19288 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:00.230856 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.232065 19121 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:00.232111 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:00.246330 19314 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:04:00.246176 15320 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:00.232748 19320 raft_consensus.cc:2764] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:04:00.232897 19180 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:00.248708 19180 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.197561 19207 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:00.251083 19180 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.251564 19207 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.252923 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1455) took 1936 ms. Trace:
I20260709 13:04:00.255642 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.257242 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.258018 15392 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:04:00.238523 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:00.141712 19200 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.253327 15250 rpcz_store.cc:276] 0709 13:03:58.316827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.330786 (+ 13959us) service_pool.cc:224] Handling call
0709 13:03:58.416980 (+ 86194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:58.417273 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:58.417312 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.565437 (+1148125us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b2c000014c8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:03:59.565851 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.803139 (+237288us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:59.803179 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.803245 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.252596 (+449351us) raft_consensus.cc:1685] finished
0709 13:04:00.252616 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.252850 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3805568,"thread_start_us":236926,"threads_started":1,"wal-append.queue_time_us":446467}
I20260709 13:04:00.262882 16032 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:00.273849 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.275413 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:00.275609 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:00.196467 19240 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:00.277323 19240 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:00.259821 19317 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:04:00.279273 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:00.280666 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.281256 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:00.282212 15244 raft_consensus.cc:2410] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:00.283207 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:00.284211 19315 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:04:00.286178 18770 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.286852 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.288103 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.287457 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:00.290403 19180 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:00.291196 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:00.291442 15318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2501) took 2046 ms (client timeout 1962 ms). Trace:
I20260709 13:04:00.292083 15245 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:00.293286 15243 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:00.294466 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:00.295287 15249 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:00.295459 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:00.296348 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:00.291813 15318 rpcz_store.cc:269] 0709 13:03:58.245319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.247555 (+  2236us) service_pool.cc:224] Handling call
0709 13:04:00.291226 (+2043671us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400083c54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:00.291351 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2560844032}
I20260709 13:04:00.197330 19257 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.299921 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.225670 19287 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.232568 19199 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:00.306465 15241 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:04:00.307101 16030 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:04:00.308439 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:00.221918 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.311666 15396 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:00.165560 15395 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:00.303503 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:00.304265 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.304786 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.300570 15249 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:00.314157 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:00.317437 19041 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.312935 15394 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
W20260709 13:04:00.358181 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.363854 15247 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:04:00.318415 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.365352 15397 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
W20260709 13:04:00.368614 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60239.9us
I20260709 13:04:00.366262 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.324281 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:00.255966 19241 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:00.298564 19190 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:00.369668 15241 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:00.305620 19194 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:04:00.428457 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.403728 16032 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:00.441957 15396 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:00.400280 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:00.401226 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.424494 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:00.397847 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.400832 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.399154 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2151) took 2338 ms. Trace:
W20260709 13:04:00.448559 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 124375us
I20260709 13:04:00.444962 15390 rpcz_store.cc:276] 0709 13:03:58.032715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.104462 (+ 71747us) service_pool.cc:224] Handling call
0709 13:03:58.214634 (+110172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:58.219108 (+  4474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.370096 (+2150988us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54000280d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:00.371077 (+   981us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252699904}
I20260709 13:04:00.436074 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.375125 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:00.454555 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:00.308916 19121 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:00.370740 19291 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.301487 19191 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.467319 15250 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:00.498451 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.309883 19282 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.469621 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.518213 15247 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:00.519579 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.520859 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.372442 18900 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:00.490134 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 115128us
W20260709 13:04:00.521952 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.522567 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.491024 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:00.461803 19189 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.015s	sys 0.032s
I20260709 13:04:00.525393 15396 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:00.437317 19190 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:00.523823 15245 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:00.530798 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:00.536466 16032 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:04:00.486634 19313 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.461644 19287 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:00.366533 19199 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.540877 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:00.560313 16032 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:04:00.559290 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.562855 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:00.563235 15247 raft_consensus.cc:2410] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:00.439917 19241 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.568861 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:00.564116 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:00.524240 19290 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:04:00.534530 19140 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
I20260709 13:04:00.522538 19288 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:00.570765 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.515460 19319 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:00.466989 19322 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:00.577674 15291 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:00.300400 19311 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.487027 19121 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.588044 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.605408 15245 raft_consensus.cc:2368] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:00.606524 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.607306 15245 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:00.589190 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 394555us
I20260709 13:04:00.590124 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:00.608981 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.535070 19007 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:00.565752 19189 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.015s	sys 0.033s
W20260709 13:04:00.561856 19017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.006s	sys 0.050s
I20260709 13:04:00.611138 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:00.596443 19293 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.211s	user 0.015s	sys 0.007s
W20260709 13:04:00.613312 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.573395 19290 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:00.611284 19205 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.005s
I20260709 13:04:00.564733 18900 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:04:00.614318 15247 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:00.617928 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:00.633190 15318 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:00.627998 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:00.634081 15317 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:00.635071 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.636036 19231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.021s	sys 0.065s
W20260709 13:04:00.636528 19231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.021s	sys 0.065s
I20260709 13:04:00.566840 19292 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:04:00.637257 15316 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:00.602609 19194 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:00.535662 19212 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.613059 19311 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:00.648970 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:00.649909 15318 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:00.614467 19191 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.664284 15317 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:00.609534 15248 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:00.674748 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:00.685654 15318 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:00.687427 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 392001us
I20260709 13:04:00.613442 19189 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:00.617103 19017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.006s	sys 0.051s
I20260709 13:04:00.633024 19241 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.616339 19007 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.695349 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:00.747982 15392 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:00.702551 19290 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.613349 19190 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.707504 19199 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.688527 19191 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:00.687239 19267 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.653s	user 0.008s	sys 0.002s
I20260709 13:04:00.637281 19231 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.652319 19194 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:00.674346 19286 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.719290 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:00.723105 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2524) took 1338 ms. Trace:
I20260709 13:04:00.764544 15247 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:00.676744 18885 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.607865 19322 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.633697 19205 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.607731 19319 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:00.716810 19234 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.825s	user 0.009s	sys 0.004s
W20260709 13:04:00.730988 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 207206us
I20260709 13:04:00.731449 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 452) took 2388 ms. Trace:
I20260709 13:04:00.735291 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:00.770655 15397 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:04:00.736663 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:00.744094 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:00.730139 19028 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:00.752923 19241 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:00.769224 15393 rpcz_store.cc:276] 0709 13:03:58.342783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.838147 (+495364us) service_pool.cc:224] Handling call
0709 13:03:58.838677 (+   530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:58.993896 (+155219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:58.993941 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:58.994576 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.306576 (+312000us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:59.306622 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.306701 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.565702 (+1259001us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b2400396e18. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f36669939c4 00007f3666991acb 00007f3666b4cdc9 00007f3666b4ca55 00007f3666b4c09d 00007f366977e10e 00007f366979588c 00007f3669794bb6 00007f36697947d8 00007f366979e221
0709 13:04:00.728601 (+162899us) raft_consensus.cc:1685] finished
0709 13:04:00.728629 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.731341 (+  2712us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167613,"raft.queue_time_us":155761,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9318,"spinlock_wait_cycles":76508416,"thread_start_us":281482,"threads_started":1,"wal-append.queue_time_us":372399}
W20260709 13:04:00.754945 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.755995 15363 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:00.763027 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.764298 15325 rpcz_store.cc:276] 0709 13:03:59.384556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.402575 (+ 18019us) service_pool.cc:224] Handling call
0709 13:03:59.852364 (+449789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.854138 (+  1774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.722861 (+868723us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001e69d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:00.723026 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033718528}
W20260709 13:04:00.767382 16025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.015s	sys 0.004s
W20260709 13:04:00.781992 16025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.015s	sys 0.004s
I20260709 13:04:00.783051 15363 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:00.786331 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:00.788076 15245 raft_consensus.cc:2393] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:00.761507 19290 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:00.791126 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.795501 19319 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.790058 19017 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:00.790253 18885 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:00.766054 19190 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:00.765512 19194 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:00.798676 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 208646us
I20260709 13:04:00.763803 19267 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:00.787796 18745 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.915s	user 0.012s	sys 0.000s
I20260709 13:04:00.767629 19180 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:00.824433 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 87864.3us
I20260709 13:04:00.825577 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:00.815745 15247 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 8: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:00.835940 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:00.837495 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:00.844718 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:00.844972 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:00.844987 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:00.846395 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.848626 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:00.851749 15397 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:00.852854 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:00.853904 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.765877 19231 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.789084 19241 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:00.615142 19034 consensus_queue.cc:1175] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "edcf4a6bae7e4781bce325a586109ca5" responder_term: 11 status { last_received { term: 9 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: [10.11-10.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:00.864807 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.818142 19017 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.870414 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:00.820587 18885 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.859804 15243 raft_consensus.cc:2368] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11.
I20260709 13:04:00.859364 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:00.839761 19291 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.871527 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.863706 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:00.845197 19199 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:00.841233 19028 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:00.855741 19189 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.845691 19121 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.869300 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:00.885047 19313 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:00.886684 19333 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:04:00.886924 18770 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.001s
I20260709 13:04:00.768421 19286 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.893435 19286 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:00.871366 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 85182.3us
I20260709 13:04:00.894416 19344 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:00.895340 19344 raft_consensus.cc:2764] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:04:00.895196 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:00.872152 18885 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:00.897162 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:00.902673 19321 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:04:00.904573 15244 raft_consensus.cc:2410] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:04:00.905490 15322 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:04:00.905980 15322 pending_rounds.cc:85] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 6
I20260709 13:04:00.906293 15322 pending_rounds.cc:107] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 11.7
W20260709 13:04:00.906563 19334 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:04:00.906558 15322 raft_consensus.cc:2889] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:00.907109 19267 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.871961 19241 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:00.909273 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1463) took 1839 ms. Trace:
I20260709 13:04:00.909991 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.911660 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:00.912356 15242 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:00.913004 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.913986 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:00.919379 19329 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:04:00.920508 19196 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.853s	user 0.007s	sys 0.003s
I20260709 13:04:00.880012 19291 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.921257 19196 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:00.875018 19327 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:04:00.875324 19331 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:00.875839 19337 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:00.930181 19337 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:00.914892 15391 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:00.930702 19337 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:00.914201 15399 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:04:00.932737 19300 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.215s	user 0.004s	sys 0.008s
W20260709 13:04:00.876405 19324 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:04:00.876690 19338 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:00.854698 19234 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:04:00.934967 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2530) took 1093 ms. Trace:
I20260709 13:04:00.881633 19336 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:00.882542 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:00.935411 15316 rpcz_store.cc:276] 0709 13:03:59.841177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.841383 (+   206us) service_pool.cc:224] Handling call
0709 13:03:59.876724 (+ 35341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.637641 (+760917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.934724 (+297083us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54004038d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:00.934903 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1748942464}
W20260709 13:04:00.936223 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53750.1us
I20260709 13:04:00.936849 19338 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:00.937044 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:00.937983 19338 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:00.880139 19199 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.938495 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:00.938906 19199 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:00.939798 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.940886 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:00.890882 19335 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:04:00.922003 15247 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:00.798782 18951 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:04:00.925895 19191 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.943552 18951 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:00.944015 18951 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:00.944878 18951 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:00.945667 19240 consensus_meta.cc:287] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.000s
I20260709 13:04:00.946135 18951 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:00.924368 15393 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:00.926846 16031 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:00.869262 15397 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:00.923157 19291 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:00.929457 19339 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:04:00.935796 19336 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.925012 19007 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.866813 19180 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:00.905406 19231 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.915421 15365 leader_election.cc:400] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:00.951994 19322 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:00.952255 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.986670 15365 leader_election.cc:403] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:00.994346 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.872520 19017 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.880882 19341 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:00.909663 15246 rpcz_store.cc:276] 0709 13:03:59.070442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.084595 (+ 14153us) service_pool.cc:224] Handling call
0709 13:03:59.084938 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.360047 (+275109us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:59.360076 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.360592 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.705610 (+345018us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:59.705663 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.908868 (+1203205us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b5400119ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:00.908920 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.908969 (+    49us) raft_consensus.cc:1685] finished
0709 13:04:00.908982 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.909199 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":632033664,"thread_start_us":344578,"threads_started":1,"wal-append.queue_time_us":435902,"wal-append.run_cpu_time_us":1942,"wal-append.run_wall_time_us":1081559}
I20260709 13:04:00.957270 15248 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:04:00.958544 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.958947 15321 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:04:00.998782 15321 pending_rounds.cc:85] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 5
I20260709 13:04:00.999040 15321 pending_rounds.cc:107] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:04:00.999267 15321 raft_consensus.cc:2889] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:00.942977 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:01.000922 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 62695.2us
I20260709 13:04:00.999334 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:01.001749 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.001964 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:01.003376 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:00.924067 19313 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:00.959944 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:00.960479 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:01.005517 15317 raft_consensus.cc:2368] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:04:01.006683 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.007582 15317 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:01.008821 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.009629 15317 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:04:00.961313 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.961229 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:00.961388 15318 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:01.011355 15399 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:00.962030 15319 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:01.012045 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:00.964434 19205 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:00.966280 19206 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.966796 19196 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:00.916247 19325 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:00.970466 15249 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:01.041260 15249 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:04:01.044656 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.971261 15316 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:00.972069 18898 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:01.015125 19153 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:04:01.052781 19153 consensus_queue.cc:1243] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:01.052517 18898 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.946156 19240 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.056035 19240 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.972771 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:01.056643 19194 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:00.973636 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.058598 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.059247 15395 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:04:01.060114 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.061573 15395 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:01.061333 19241 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:00.950039 19200 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.644s	user 0.005s	sys 0.002s
I20260709 13:04:00.976830 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:00.996222 19341 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:00.994765 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 79497.1us
I20260709 13:04:00.985424 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:01.072944 15393 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.006763 19189 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:01.014158 15318 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:00.941912 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:00.978765 19331 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:01.020210 15319 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:01.020097 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:01.004637 15323 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:01.022768 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:01.023658 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.021654 19160 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:01.080222 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.081214 15245 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:01.026374 19338 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:01.000110 19319 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:00.985642 19336 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:00.973654 18885 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:00.995589 19062 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.032007 19188 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:01.062800 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 86119.8us
I20260709 13:04:00.980667 19348 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:01.064010 15242 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:04:01.101645 15395 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:04:01.064852 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.066552 15391 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:01.074402 15249 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:01.022673 19231 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:01.078698 15399 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:04:01.078951 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56291.7us
I20260709 13:04:01.078121 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.075567 19200 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.101679 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:01.122315 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44291.4us
I20260709 13:04:01.107611 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.141721 15399 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:01.083461 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.075181 19341 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:01.145059 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 127734us
I20260709 13:04:01.147825 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.075296 19196 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:01.119383 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.122084 15291 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:01.143098 15245 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.143332 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:01.103101 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.120905 15323 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:01.100850 19188 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.062503 19337 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.144368 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.144989 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.093823 19240 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.146603 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.165735 15318 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:01.146603 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.080044 19160 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:01.155584 15393 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:01.174147 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:01.175637 15291 leader_election.cc:400] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11.
I20260709 13:04:01.163923 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:01.161361 15319 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:01.179708 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.181196 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:01.182134 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.184346 15399 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:01.163044 19231 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:01.185107 19189 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:01.185432 19286 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:01.162870 19188 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:01.185875 19189 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:01.187539 19233 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:01.188422 19233 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:01.188740 19233 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:01.189543 19233 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.156286 18898 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:01.140512 19199 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.171237 19326 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:04:01.192076 19160 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:01.192654 19199 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.194535 19233 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.195887 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:01.170585 19257 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:04:01.185957 19286 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.199397 19286 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.199801 19240 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.185940 18900 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:01.201084 18900 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:01.201614 18900 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:01.201805 19231 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:01.203045 19231 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.206694 19290 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:01.208357 19196 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:01.209448 19196 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.144577 19288 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:01.092021 19331 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:01.211730 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.212036 19143 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
W20260709 13:04:01.212543 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 48725.9us
I20260709 13:04:01.213976 19143 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:01.214404 19143 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.214766 19143 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:01.102712 19350 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:01.218433 15250 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:04:01.222633 15393 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:01.206012 15395 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:01.110582 19062 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.235749 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.236326 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:01.236933 15318 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:01.237238 16030 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.230773 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.244575 15245 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:01.246333 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:01.247764 15325 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:01.151458 18878 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.248610 15318 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.255131 15316 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:01.260463 15321 raft_consensus.cc:2368] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:01.271081 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.272141 15245 raft_consensus.cc:2368] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11.
I20260709 13:04:01.244086 18898 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:04:01.283749 18898 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:01.273073 15365 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:01.263983 15322 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:04:01.243906 18885 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:01.290673 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.291312 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.291746 15318 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:01.295389 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.297242 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.297857 15244 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:01.293332 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 139838us
I20260709 13:04:01.296674 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:01.302809 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.304088 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.305090 15245 raft_consensus.cc:2410] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:01.308956 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:01.266927 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 265290us
I20260709 13:04:01.314494 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.316362 19205 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:01.291234 19352 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.063s	user 0.000s	sys 0.004s
I20260709 13:04:01.310051 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.320880 15291 leader_election.cc:400] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11.
I20260709 13:04:01.326097 15291 leader_election.cc:403] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:01.284186 18898 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:01.286417 19350 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.318737 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.329849 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:01.330140 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.331971 15322 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:01.285084 19194 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.259580 18878 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.337414 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:01.376083 15244 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:01.340032 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.343014 19017 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.318030 19349 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:01.344915 19350 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.349115 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.355255 19160 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.334954 19241 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.318084 19259 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:01.317190 19205 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.339715 19234 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:01.358469 16030 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:01.340811 19336 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:01.412535 19199 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.356621 19267 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:01.414949 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.441442 15322 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:01.431246 16028 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:01.428196 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.442700 15248 raft_consensus.cc:2376] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9. Re-sending same reply.
I20260709 13:04:01.444032 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.356346 19028 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:04:01.412477 19194 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:04:01.357707 18885 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:01.421535 19349 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:01.426133 19259 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.434427 15318 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:01.448333 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.419564 18898 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.450344 19160 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.451205 18976 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:01.453809 19177 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:01.456472 18878 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.458905 19017 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:01.459703 19350 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:01.460719 19344 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:01.435806 19336 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.468885 19337 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.470124 19205 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:01.470371 18900 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.481021 19200 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:01.447064 19240 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.479681 19259 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:01.475596 19190 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.495471 19344 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:01.446183 19199 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.481469 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:01.510892 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 173460us
I20260709 13:04:01.480140 18885 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:01.513300 18885 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.518944 19199 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:01.525242 19188 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.495271 19153 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.493955 18898 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:01.479156 19062 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:01.508644 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 82895.8us
I20260709 13:04:01.500085 19336 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:01.511751 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:01.482759 19341 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.550899 18900 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:01.530614 19349 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.552419 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.552599 19341 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:01.527436 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.529327 19344 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.554641 19344 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:01.531064 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.555655 15249 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:01.555860 19188 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.556890 15249 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:01.557893 15324 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:04:01.558272 15247 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:01.559719 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:01.560443 15399 raft_consensus.cc:2368] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8.
I20260709 13:04:01.561084 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:01.561615 15396 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:01.561847 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:01.562413 16030 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.534552 15248 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
W20260709 13:04:01.502701 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 165400us
I20260709 13:04:01.544015 16025 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:01.540107 19153 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.512034 19190 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.572790 19355 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.573576 19355 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.573937 19190 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.550500 19371 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:01.578994 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.567368 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:01.582432 15396 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:01.590360 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.593120 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:01.593705 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.594683 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:01.595492 19205 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:01.595806 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:01.595961 19205 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:01.596396 19205 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:01.597082 19319 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:01.597534 19319 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.597891 19319 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:01.594566 19354 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:01.599362 19354 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:01.594993 19189 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:01.600378 19189 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:01.600868 19189 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:01.603540 15363 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.605962 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:01.594609 19288 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.606416 19319 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.607116 19288 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.613817 19292 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:01.570700 16030 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:04:01.620664 15363 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.618659 19292 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:01.626142 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:01.581770 19286 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.629751 19286 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.630508 19368 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:01.632411 19341 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:01.581384 19234 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11.
I20260709 13:04:01.587404 19153 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:01.636174 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.637161 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1465) took 1171 ms. Trace:
I20260709 13:04:01.637553 15250 rpcz_store.cc:276] 0709 13:04:00.465758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.498120 (+ 32362us) service_pool.cc:224] Handling call
0709 13:04:01.637005 (+1138885us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b540010b654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:01.637091 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654041344}
I20260709 13:04:01.638767 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.640295 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.640221 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.641242 15322 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:01.639873 15250 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:04:01.578186 19371 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.638749 15323 pending_rounds.cc:85] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 5
I20260709 13:04:01.655234 15323 pending_rounds.cc:107] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:04:01.655611 15323 raft_consensus.cc:2889] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:01.647955 15247 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:01.649231 19370 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.650413 15250 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:01.641187 15316 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
W20260709 13:04:01.659408 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 92417.4us
I20260709 13:04:01.660290 15291 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:01.661685 15243 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:04:01.665091 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 69354.4us
I20260709 13:04:01.666218 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:01.672664 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:01.636236 19338 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.641355 19341 raft_consensus.cc:697] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:01.581502 19143 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.646930 18745 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:01.682952 19336 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.676859 19337 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:01.687459 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:01.676455 19368 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:01.658530 19371 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:01.691490 19380 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:01.692082 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:01.692428 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.625511 19189 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.659022 19234 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:01.696686 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.707495 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.720361 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.721597 15325 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:04:01.723338 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.724385 15325 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:01.729081 15325 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:04:01.734004 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 113469us
I20260709 13:04:01.736093 18885 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:01.738687 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:01.703748 19342 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.785s	user 0.000s	sys 0.004s
W20260709 13:04:01.746824 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.741623 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:01.711952 15146 catalog_manager.cc:5697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.670455 19370 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.703366 18898 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:01.748700 15146 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 5 to 8, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 8 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:01.732848 19017 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:01.758833 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:01.758354 15146 catalog_manager.cc:5697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.707607 19205 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.762606 15393 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:01.701272 19259 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.784183 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:01.787909 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.817277 15146 catalog_manager.cc:5697] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 3 to 7, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 7 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.819062 19205 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:01.819171 15146 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 6 to 8, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 8 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:01.732962 19234 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.823750 19234 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:01.824510 19259 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.824942 19381 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:01.758111 19292 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:01.821043 15146 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 8 to 12, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 12 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.826356 19292 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.828577 19189 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:01.826859 19336 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.832008 15393 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:01.732905 18745 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.830662 15146 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.834954 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.704802 19338 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.846061 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.846751 15399 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:04:01.847412 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:01.848060 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.848459 15146 catalog_manager.cc:5697] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.856117 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.856796 15318 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:01.857602 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:01.858132 18745 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.860780 19190 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:01.861514 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1469) took 1392 ms. Trace:
I20260709 13:04:01.862593 19387 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:01.863562 19387 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.865509 18976 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.866050 18976 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.868278 18976 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:01.868376 19370 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.871821 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.872520 15395 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
W20260709 13:04:01.874799 15398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2178) took 1724 ms (client timeout 1827 ms). Trace:
I20260709 13:04:01.875145 16031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 573) took 1344 ms. Trace:
I20260709 13:04:01.875555 16031 rpcz_store.cc:276] 0709 13:04:00.530989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.531190 (+   201us) service_pool.cc:224] Handling call
0709 13:04:01.874983 (+1343793us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54007c1d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:01.875085 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646426496}
W20260709 13:04:01.875938 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:01.876477 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:01.875191 15398 rpcz_store.cc:269] 0709 13:04:00.150783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.160540 (+  9757us) service_pool.cc:224] Handling call
0709 13:04:01.874565 (+1714025us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b5400271354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:01.874743 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1941913984}
I20260709 13:04:01.879735 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:01.861915 15242 rpcz_store.cc:276] 0709 13:04:00.469441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.913772 (+444331us) service_pool.cc:224] Handling call
0709 13:04:01.861349 (+947577us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b5400139cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:01.861456 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338940160}
I20260709 13:04:01.858068 15318 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:01.883549 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.874410 18885 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:01.893118 15390 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:01.895124 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.897044 15250 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:04:01.897599 15250 pending_rounds.cc:85] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 10
I20260709 13:04:01.897882 15250 pending_rounds.cc:107] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:04:01.898376 15250 raft_consensus.cc:2889] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:01.899871 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.901153 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:01.892087 19190 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:01.904486 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:01.904829 15146 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:01.905506 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.906687 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.906304 15146 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 6 to 9, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 9 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:01.907647 16025 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:01.907725 15146 catalog_manager.cc:5697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 6 to 9, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 9 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:01.833330 19017 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:01.904196 18885 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.931869 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:01.910395 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:01.933405 16030 raft_consensus.cc:2368] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8.
I20260709 13:04:01.932750 15146 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 7 to 8, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 8 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:01.935120 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:01.937992 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 89326.3us
I20260709 13:04:01.938972 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.940116 15398 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:01.908178 19331 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.845441 19205 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.909366 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:01.943193 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:01.911553 15242 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:01.942869 15146 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 3 to 8, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 8 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.865978 19387 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:01.943924 15317 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:01.909533 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:01.936039 15249 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:01.941329 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:01.943572 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:01.903577 15318 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:01.944846 16030 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:01.913280 19007 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:04:01.945871 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:01.948972 16031 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:04:01.945761 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:01.951828 15146 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:01.953293 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 52230.5us
W20260709 13:04:01.954936 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.892531 18878 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:01.957628 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.909296 19212 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.961474 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:01.971841 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.973142 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.973748 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:01.974047 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:01.974610 15394 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:01.974809 16032 raft_consensus.cc:2368] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:04:01.975441 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:01.975646 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:01.976565 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:01.977113 15394 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:01.979275 19143 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:01.980412 19118 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:01.981217 19118 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.913949 19336 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:01.932150 19160 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.968699 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:01.961796 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 464) took 1314 ms. Trace:
I20260709 13:04:01.991822 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:01.992835 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:01.993589 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.995069 15394 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:01.987990 15246 rpcz_store.cc:276] 0709 13:04:00.647039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.996827 (+349788us) service_pool.cc:224] Handling call
0709 13:04:01.030959 (+ 34132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.031179 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:01.108623 (+ 77444us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.961079 (+852456us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b18004c90c0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a
0709 13:04:01.961333 (+   254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:01.961399 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:01.961462 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.961564 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.961725 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69005,"prepare.queue_time_us":238010,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":8710,"raft.queue_time_us":5187,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":19008384,"thread_start_us":253777,"threads_started":2,"wal-append.queue_time_us":235024}
I20260709 13:04:01.904557 19190 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.959635 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:01.997709 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:01.833786 19341 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:02.003723 15146 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 6 to 7, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 7 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.007176 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:01.966549 19311 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:02.009770 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:01.961892 18900 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:01.996474 19259 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:01.965433 19189 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:02.017654 15146 catalog_manager.cc:5697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 1 to 6, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 6 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.023901 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:01.959645 19383 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:01.951404 19205 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:01.998940 19206 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:02.000557 18898 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:02.027451 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:02.018841 15318 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:01.991954 19336 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:01.991657 19160 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:02.031876 19190 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:02.036463 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:02.017760 19194 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:04:02.049485 19336 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:02.027156 19377 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:04:02.050338 18885 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:02.051520 19160 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:02.042078 19028 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:02.052316 19028 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.052461 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:02.052742 19028 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:02.036870 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:02.053767 16029 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:02.054155 18898 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:02.037542 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:02.055058 15213 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:02.039939 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:02.055408 18898 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.056136 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:02.057225 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:02.058440 19326 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:02.059036 19326 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:02.058653 19371 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.059927 19326 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.061666 19371 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:02.017875 19337 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:02.042492 15318 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:02.062947 19216 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:02.063048 19337 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:02.063441 19216 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:02.063894 19216 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:01.987339 19212 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.064318 19337 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.065877 19212 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:02.042305 19241 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:04:02.062472 19143 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:02.009618 19234 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:02.063774 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:02.057269 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:02.071197 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:02.076687 16029 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:02.077375 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:02.079022 15318 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:02.082322 16031 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:02.084501 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:01.986655 18878 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:02.098620 15391 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:02.090051 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:02.099917 15320 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:02.100018 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:02.100931 16029 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:02.013310 19344 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:04:02.117411 15146 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 3 to 6, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 6 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:02.028308 19189 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:02.097640 15213 leader_election.cc:400] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:04:02.118875 15213 leader_election.cc:403] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:02.119204 15146 catalog_manager.cc:5697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.124754 16031 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:02.087034 19206 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:02.139986 16025 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:04:02.140357 15320 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:02.088613 19191 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:02.101354 19190 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:02.149832 19190 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.150372 19190 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:02.101461 19331 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:04:02.155635 19286 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:02.150074 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:02.129786 19189 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:02.044492 19383 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.129106 19338 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:02.145124 19177 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:02.209945 19177 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:02.110495 18645 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:04:02.211184 19177 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.214785 19177 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:02.181335 19383 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:02.144137 19320 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:04:02.186578 15392 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:02.188084 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:02.144727 19191 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:02.190037 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1513) took 1055 ms. Trace:
W20260709 13:04:02.194836 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.234652 15321 rpcz_store.cc:276] 0709 13:04:01.134888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.147581 (+ 12693us) service_pool.cc:224] Handling call
0709 13:04:02.189805 (+1042224us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400412654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:02.189963 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233527040}
I20260709 13:04:02.229993 15396 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:02.235324 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:02.236315 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:02.199115 18885 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.167397 19206 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:02.044528 19017 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.204243 19118 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:02.177577 19205 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:02.218516 19319 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:02.220202 19288 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:02.231333 15322 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:04:02.240716 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 145116us
W20260709 13:04:02.246781 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.254055 15392 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:02.236940 19191 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:02.247812 19007 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:02.301311 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:02.255134 18885 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:02.317353 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:02.319072 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:02.320708 15249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92362862adca4227bb6dad04afd638cc"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:02.321475 15249 raft_consensus.cc:606] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:02.321559 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:02.321930 15249 raft_consensus.cc:614] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:02.324345 15250 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:02.325834 15247 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:02.260962 18745 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:04:02.328361 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:02.329988 15395 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:02.305339 19311 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.313809 19007 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.340859 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:02.329761 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:02.343257 15215 leader_election.cc:400] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8.
I20260709 13:04:02.343703 15215 leader_election.cc:403] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:04:02.345291 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:02.347903 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92211.7us
I20260709 13:04:02.341619 19259 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:02.355908 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 224608us
I20260709 13:04:02.357111 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:02.350031 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:02.360730 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:02.362938 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:02.364111 15394 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:02.338487 19007 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:02.350899 19320 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:02.352459 18645 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:04:02.402488 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 127187us
I20260709 13:04:02.373282 19212 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:02.364734 19346 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:02.409279 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49094.3us
I20260709 13:04:02.338320 19311 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.393287 19183 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:02.357033 19331 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:04:02.415916 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:02.356869 19259 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:02.426549 18878 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:02.427917 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2598) took 2277 ms. Trace:
I20260709 13:04:02.429031 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:02.467439 15399 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:02.467233 15390 rpcz_store.cc:276] 0709 13:04:00.150840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.452660 (+301820us) service_pool.cc:224] Handling call
0709 13:04:01.875267 (+1422607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.893708 (+ 18441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.427695 (+533987us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400271350. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:02.427854 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3268909952}
I20260709 13:04:02.431348 19355 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:02.433599 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1512) took 1313 ms. Trace:
I20260709 13:04:02.433718 19311 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:02.415607 19118 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:02.446808 19206 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:02.451401 15319 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:02.452906 19143 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:02.415818 18645 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:02.456975 19346 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:02.469345 15390 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:04:02.404495 19034 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 13:04:02.476951 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.472414 15324 rpcz_store.cc:276] 0709 13:04:01.120434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.133662 (+ 13228us) service_pool.cc:224] Handling call
0709 13:04:01.134127 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:01.558334 (+424207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.433316 (+874982us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54001e5ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:02.433531 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973998336}
I20260709 13:04:02.475386 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:02.407110 19326 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:04:02.419863 19212 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:02.471992 18885 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:02.474561 19380 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:02.547533 15399 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:02.542366 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:02.410885 19190 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:02.560238 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:02.537871 19395 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:04:02.569630 15323 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
W20260709 13:04:02.578538 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 285873us
W20260709 13:04:02.566102 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 90791.8us
I20260709 13:04:02.567288 15321 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:04:02.579393 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 220311us
I20260709 13:04:02.581053 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:02.563030 15390 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:02.585115 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:02.547953 19346 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.589085 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:02.551865 19399 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.594173 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:02.579049 19028 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.002s
I20260709 13:04:02.599568 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:02.599946 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:02.600509 15324 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:02.600979 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:02.578701 18885 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:02.537568 19118 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:02.612094 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 227510us
I20260709 13:04:02.608718 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:02.609436 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:02.610471 15289 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:02.600262 15323 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:04:02.615855 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:02.586277 19206 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:02.593330 19346 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:02.628333 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:02.651703 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:02.623142 15316 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:02.652694 15213 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:02.623803 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:02.618430 15321 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:02.627096 19331 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:02.627030 19414 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:04:02.628307 19398 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:04:02.628494 19290 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:02.629421 19406 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:04:02.631711 19404 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:04:02.611349 19028 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:02.634301 18645 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:02.635986 19401 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:04:02.637061 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:02.623745 19344 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:02.606510 19399 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:02.614890 19216 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
I20260709 13:04:02.612658 19233 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:02.641222 19118 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:02.576989 19380 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:02.614423 19241 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:04:02.643055 19206 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:02.644155 19368 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:02.644429 19402 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:02.596593 19337 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:02.626430 15324 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:02.592089 19338 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:02.649488 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:02.759137 15390 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:04:02.624059 19371 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:02.673913 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:02.679529 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:02.741318 16032 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:04:02.744179 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 121607us
I20260709 13:04:02.746757 15325 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:04:02.653501 19418 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:04:02.649436 19177 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
W20260709 13:04:02.773643 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 350134us
I20260709 13:04:02.741981 19331 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:02.674535 19290 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:02.748531 19189 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.548s	user 0.006s	sys 0.006s
I20260709 13:04:02.765056 19371 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.774432 19190 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:02.826169 19331 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.832615 19338 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.898515 19338 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.900660 19338 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:02.903443 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2193) took 1029 ms. Trace:
I20260709 13:04:02.903909 15392 rpcz_store.cc:276] 0709 13:04:01.873656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.964074 (+ 90418us) service_pool.cc:224] Handling call
0709 13:04:02.903220 (+939146us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003296d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:02.903376 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443941760}
I20260709 13:04:02.912469 19287 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.913133 19287 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:02.914896 19421 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:04:02.673211 19212 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.919787 19287 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:02.743848 19216 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.859807 19290 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:02.859936 18976 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:02.862071 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 580) took 1696 ms. Trace:
I20260709 13:04:02.766064 19191 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:02.867516 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2627) took 1307 ms. Trace:
I20260709 13:04:02.939421 15391 rpcz_store.cc:276] 0709 13:04:01.560484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.868237 (+307753us) service_pool.cc:224] Handling call
0709 13:04:01.868554 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.099205 (+230651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.867203 (+767998us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003d81d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:02.867438 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528023296}
I20260709 13:04:02.870800 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:02.875698 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 477) took 1240 ms. Trace:
I20260709 13:04:02.942124 15393 rpcz_store.cc:276] 0709 13:04:01.635269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.745368 (+110099us) service_pool.cc:224] Handling call
0709 13:04:02.875440 (+1130072us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b54001d9554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:02.875615 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7091584}
I20260709 13:04:02.877079 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 483) took 1240 ms. Trace:
I20260709 13:04:02.943991 15396 rpcz_store.cc:276] 0709 13:04:01.636853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.265172 (+628319us) service_pool.cc:224] Handling call
0709 13:04:02.265538 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.271008 (+  5470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.271052 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.271111 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:02.271156 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.876778 (+605622us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b54002b5a54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:02.876838 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.877009 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11982720}
I20260709 13:04:02.877883 15395 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:04:02.848649 19189 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:02.897933 19405 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 13:04:02.924005 19319 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.840122 19337 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.847705 19414 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:02.925429 19402 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:02.930259 16028 rpcz_store.cc:276] 0709 13:04:01.165366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.165573 (+   207us) service_pool.cc:224] Handling call
0709 13:04:01.165957 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.442287 (+276330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.861811 (+1419524us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54001801d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:02.862006 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581855488}
I20260709 13:04:02.851567 19371 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:02.964648 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 348844us
I20260709 13:04:02.857576 19331 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:02.862397 19007 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:02.981390 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:02.951956 15137 maintenance_manager.cc:419] P 6c48b19b0ac74d678c9f752e98013b9a: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033375
I20260709 13:04:02.989719 15399 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:02.938472 19341 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.949416 19190 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.002743 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:02.978050 19402 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:03.027781 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:02.991353 19414 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:02.974354 19319 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.061520 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:03.062438 15324 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:02.980803 19337 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:03.066823 19419 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:04:03.067905 19274 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:03.068216 19337 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.068894 19028 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:02.950251 19206 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.071100 19216 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.071303 19007 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.072652 19189 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:03.074000 19399 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.074360 19319 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:03.077494 19183 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:03.078083 19320 consensus_meta.cc:287] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.000s
I20260709 13:04:03.079465 19320 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8.
I20260709 13:04:03.010018 19338 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:04:03.083534 15362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.524s (SENT) [suppressed 13 similar messages]
I20260709 13:04:03.008016 19190 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:03.094537 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:03.095347 15316 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:03.096050 19190 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.096242 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:03.096982 15321 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:03.078049 19183 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:03.104938 19414 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:03.074146 19408 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.487s	user 0.000s	sys 0.000s
I20260709 13:04:03.102030 19346 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.116819 19191 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.003676 19341 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.081784 19233 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:03.064672 19205 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.082268 19177 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:03.122462 19380 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:03.127992 19346 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:03.159394 19415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.008s	sys 0.015s
I20260709 13:04:03.175716 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2197) took 1300 ms. Trace:
I20260709 13:04:03.178181 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 487) took 1132 ms. Trace:
I20260709 13:04:03.178746 15325 rpcz_store.cc:276] 0709 13:04:02.045650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.095097 (+ 49447us) service_pool.cc:224] Handling call
0709 13:04:02.095442 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:02.770438 (+674996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.177801 (+407363us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b540016dd54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:03.178092 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487835904}
I20260709 13:04:03.176292 15395 rpcz_store.cc:276] 0709 13:04:01.875271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.447912 (+572641us) service_pool.cc:224] Handling call
0709 13:04:02.877548 (+429636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:02.952389 (+ 74841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.175396 (+223007us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54001d9550. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:03.175626 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987113856}
W20260709 13:04:03.184173 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.014s
W20260709 13:04:03.184561 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.011s	sys 0.014s
W20260709 13:04:03.184866 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 532221us
I20260709 13:04:03.127425 19205 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.212097 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:03.162983 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 398492us
I20260709 13:04:03.218218 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:03.218519 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:03.168852 19034 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:03.160986 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 386201us
I20260709 13:04:03.193388 15214 leader_election.cc:400] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8.
W20260709 13:04:03.170498 19415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.008s	sys 0.015s
I20260709 13:04:03.165382 19191 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.129209 19233 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:03.222066 15316 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:03.223161 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:03.240224 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:03.227109 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:03.232326 19143 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:03.245509 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:03.232910 19383 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:03.233088 19034 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:03.254829 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:03.253453 19290 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:03.257618 19290 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:03.258059 19290 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:03.253537 19331 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.260617 19331 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.262398 19434 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:03.262885 19427 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 13:04:03.263005 19434 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.264973 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2199) took 1389 ms. Trace:
I20260709 13:04:03.229862 19320 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:03.124375 19402 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.228982 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:03.235956 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:03.241464 15395 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:03.248320 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:03.285181 15396 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:03.285558 15316 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:03.286556 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:03.252653 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.233392 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:03.234917 15325 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:04:03.246587 19426 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:04:03.220990 19346 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:03.229998 19216 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:03.298127 15396 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
W20260709 13:04:03.298609 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 69697.9us
W20260709 13:04:03.299777 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 66475.6us
W20260709 13:04:03.268721 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 272269us
I20260709 13:04:03.269845 15318 raft_consensus.cc:2410] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:04:03.280398 15319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2561) took 2085 ms (client timeout 1687 ms). Trace:
W20260709 13:04:03.302281 15319 rpcz_store.cc:269] 0709 13:04:01.195197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.216045 (+ 20848us) service_pool.cc:224] Handling call
0709 13:04:02.187860 (+971815us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:04:03.280079 (+1092219us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540021a7d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:03.280282 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533275776}
I20260709 13:04:03.265414 15397 rpcz_store.cc:276] 0709 13:04:01.875759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.458403 (+582644us) service_pool.cc:224] Handling call
0709 13:04:02.458807 (+   404us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:02.459205 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.459237 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:02.459911 (+   674us) log.cc:844] Serialized 52 byte log entry
0709 13:04:02.924856 (+464945us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:02.933831 (+  8975us) log.cc:844] Serialized 14 byte log entry
0709 13:04:02.953995 (+ 20164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.954098 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:03.262222 (+308124us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:03.264632 (+  2410us) raft_consensus.cc:1685] finished
0709 13:04:03.264737 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.264890 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4455,"prepare.queue_time_us":4785,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":25076,"raft.run_cpu_time_us":9089,"raft.run_wall_time_us":81497,"spinlock_wait_cycles":38729472,"thread_start_us":464442,"threads_started":1,"wal-append.queue_time_us":545660}
I20260709 13:04:03.290192 15391 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:03.235956 19400 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:04:03.293608 15322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1528) took 1658 ms (client timeout 1524 ms). Trace:
I20260709 13:04:03.293823 15324 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:04:03.293773 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 48385.6us
I20260709 13:04:03.310515 15214 leader_election.cc:400] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:04:03.310824 15214 leader_election.cc:403] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:03.224969 19257 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:04:03.295220 15241 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
W20260709 13:04:03.307565 15322 rpcz_store.cc:269] 0709 13:04:01.635390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.670155 (+ 34765us) service_pool.cc:224] Handling call
0709 13:04:03.293383 (+1623228us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54003e35d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:03.293530 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163982592}
I20260709 13:04:03.305022 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.303826 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:03.316370 15395 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:03.306720 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.244349 19191 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.256075 19383 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.256208 19143 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:03.357846 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 47473.5us
I20260709 13:04:03.296804 19338 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.337515 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:03.380555 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66072us
I20260709 13:04:03.380925 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:03.347958 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:03.338790 19430 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.314467 19140 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.351137 19191 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.346585 15396 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:03.391774 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.392015 15248 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:03.392166 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.392679 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.352106 19205 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:03.317056 19431 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:04:03.372561 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.419580 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:03.412758 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.423086 15393 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:03.395162 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.304250 19274 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:03.302491 19331 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:03.382421 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 81384.9us
I20260709 13:04:03.382831 15316 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:03.348989 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:03.305836 19216 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:03.440747 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:03.441740 19216 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:03.441969 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:03.443112 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:03.443776 15391 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:03.312215 19320 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:03.444828 19320 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.385166 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.303282 19434 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.445932 15390 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:03.345902 18745 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:04:03.446914 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:03.388126 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:03.448885 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:03.449496 15244 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:03.391171 15394 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:04:03.412038 19160 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:03.451530 19160 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.451767 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:03.452039 19160 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:03.452975 19143 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:03.391530 19311 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:04:03.393121 19439 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:04:03.454826 19371 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:03.455819 19034 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:03.455976 15320 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:03.457142 19371 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:03.379923 19233 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.415174 19140 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.460565 19402 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:03.461670 15244 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:03.414677 19212 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:04:03.462643 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:03.395453 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:03.463591 19341 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:03.463671 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 68314.8us
I20260709 13:04:03.451584 19383 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:03.393553 19430 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.397475 15399 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:03.466411 19177 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:03.466988 19177 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:03.467136 19433 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:03.398178 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:03.467891 19177 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.469445 15320 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:03.403771 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:03.470424 15250 raft_consensus.cc:2376] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12. Re-sending same reply.
I20260709 13:04:03.404878 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:03.466140 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:03.471320 15247 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
W20260709 13:04:03.472760 19344 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.736s	user 0.012s	sys 0.000s
I20260709 13:04:03.473237 19344 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:03.473274 19433 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:03.418412 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:03.433336 19183 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:03.474614 15242 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:04:03.425889 15249 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:03.475278 19368 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:03.475685 19368 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:03.390780 15397 raft_consensus.cc:2410] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:04:03.477066 19380 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.424757 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:03.427760 15317 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:03.338433 19420 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:04:03.430318 19205 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:03.431010 19017 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:03.385950 19287 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:03.390882 19326 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:03.435030 19432 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:04:03.393702 19435 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:03.390182 19338 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.443805 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.445158 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:03.545892 15322 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:03.472643 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:03.547336 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 74755.1us
I20260709 13:04:03.548307 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:03.549357 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:03.476608 19183 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.305925 19418 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:03.391520 15395 raft_consensus.cc:2410] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:03.428957 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:03.552989 15243 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
W20260709 13:04:03.423163 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 339662us
I20260709 13:04:03.484082 15246 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:03.485247 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 56911us
W20260709 13:04:03.480904 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 75398.4us
I20260709 13:04:03.494122 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:03.449544 19290 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:03.564066 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 112369us
I20260709 13:04:03.500222 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:03.501821 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:03.530856 15317 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
W20260709 13:04:03.462831 19437 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:04:03.427210 19274 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:03.559367 15244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:03.587610 15244 raft_consensus.cc:606] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:03.554978 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:03.575681 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:04.019622 15244 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:04.019222 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.020402 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:04.023218 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.024605 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:04.025710 15323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.011s	sys 0.010s
I20260709 13:04:04.026500 15320 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:03.637825 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:04.135869 19212 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:04.136327 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1550) took 1051 ms. Trace:
I20260709 13:04:04.022154 15247 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:04.035965 15243 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:03.616194 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:03.617040 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:04.043167 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:03.558751 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:04.048147 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:04.048547 16032 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:04.051801 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:03.589505 19028 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.061282 19140 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.067674 19183 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:03.585913 19241 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:03.580365 19259 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:03.596781 19274 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:03.510855 19287 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:03.546850 19206 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:04.072247 19290 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:03.592458 19337 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.076297 19338 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:03.474080 19344 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:04:04.084990 19371 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.495963 19380 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.323871 19287 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.324260 19371 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:03.579226 19381 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:04:04.327386 15393 raft_consensus.cc:2410] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:04:03.496655 19383 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:04.329090 19383 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.330643 19472 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.331504 19472 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.332552 19383 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:03.585436 19399 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:04:03.761241 19400 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:03.497151 19409 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:04.094437 19420 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:04:04.100587 15241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2205) took 3781 ms (client timeout 2402 ms). Trace:
I20260709 13:04:04.101179 15245 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:04:04.103051 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 546477us
I20260709 13:04:03.586596 19429 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:04.363528 19429 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.364202 19429 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:04.366096 19467 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.367250 19467 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.369427 18885 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:04.369823 19463 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.343415 19420 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:04.370865 19463 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.371668 19420 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.373216 19420 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:04.347867 19287 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:03.499744 19433 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.376353 19433 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.379979 15317 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:04:03.560633 19442 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.132445 15242 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:04.136539 19212 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:04.143291 15323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.012s	sys 0.011s
I20260709 13:04:04.151862 19434 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:04.153156 19435 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:04.153443 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:04.136925 15324 rpcz_store.cc:276] 0709 13:04:03.084535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.085027 (+   492us) service_pool.cc:224] Handling call
0709 13:04:03.293510 (+208483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.309774 (+ 16264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.135786 (+826012us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54003e35d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:04.136062 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478516096}
I20260709 13:04:04.161716 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.178282 15316 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:04:04.174644 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.195019 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.204049 19177 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:04.206159 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.185766 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.182018 19417 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:04.214846 19028 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.240571 19017 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:04.240885 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 198395us
I20260709 13:04:04.208842 19183 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:04.221753 19326 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.695s	user 0.014s	sys 0.021s
I20260709 13:04:04.296415 19007 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.299578 19206 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:04.293152 19427 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 13:04:04.293223 19241 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.311462 19337 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.315521 19205 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:04.325918 18976 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.319105 19259 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:04.342147 15241 rpcz_store.cc:269] 0709 13:04:00.318974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.399355 (+ 80381us) service_pool.cc:224] Handling call
0709 13:04:04.099926 (+3700571us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b54000adf54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:04.100244 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6556827392}
I20260709 13:04:04.320273 19415 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:04.329955 19160 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.877s	user 0.024s	sys 0.018s
I20260709 13:04:04.337462 19400 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.390844 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2586) took 1155 ms. Trace:
I20260709 13:04:04.345065 19409 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:04.361770 19383 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:04.370381 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:04.405443 15250 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:04.414026 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.414409 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:04.415359 19465 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:04:04.415930 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 494) took 1120 ms. Trace:
I20260709 13:04:04.416107 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2577) took 1199 ms. Trace:
I20260709 13:04:04.435988 15324 rpcz_store.cc:276] 0709 13:04:03.295775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.414619 (+1118844us) service_pool.cc:224] Handling call
0709 13:04:04.415074 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.415521 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.415549 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.415612 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:04.415666 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.415721 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.415860 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:04.405308 19183 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:04.439689 19442 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.436049 15323 rpcz_store.cc:276] 0709 13:04:03.216403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.465398 (+248995us) service_pool.cc:224] Handling call
0709 13:04:03.465723 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:03.466114 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.466144 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:03.466657 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:04:04.406718 (+940061us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:04.415699 (+  8981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.415791 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:04.415850 (+    59us) raft_consensus.cc:1685] finished
0709 13:04:04.415860 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.416036 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2514,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"thread_start_us":923511,"threads_started":1,"wal-append.queue_time_us":859963}
I20260709 13:04:04.442503 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:04.432451 19417 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:04.443403 19445 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.264s	user 0.004s	sys 0.000s
I20260709 13:04:04.444072 15323 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:04:04.417608 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49097.4us
I20260709 13:04:04.445402 19417 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.446179 19007 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.424686 15247 raft_consensus.cc:2410] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:04.428427 15317 rpcz_store.cc:276] 0709 13:04:03.227697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.378868 (+1151171us) service_pool.cc:224] Handling call
0709 13:04:04.379421 (+   553us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:04.380492 (+  1071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.383240 (+  2748us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:04.414117 19326 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:04:04.458156 19212 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.462512 19177 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.423503 19241 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:04.432505 18976 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.466408 19017 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.468623 18976 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:04.469323 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.463440 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:04.488447 19399 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.489220 19399 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.490250 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.433971 19383 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:04.492353 15241 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:04.494932 19259 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.497912 19274 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.498986 19409 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.502091 15246 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:04.499049 15244 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:04:04.505133 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.506428 19434 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.457741 19415 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.517277 15246 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:04:04.533583 19459 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:04.533895 19274 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:04.539299 19459 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.541788 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:04.543118 19435 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:04.548252 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 142744us
I20260709 13:04:04.551558 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.554898 19415 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.437973 19160 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.556430 18898 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:04.555797 19205 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:04.615074 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.580749 15247 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:04.602109 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 495) took 1306 ms. Trace:
I20260709 13:04:04.615954 15324 rpcz_store.cc:276] 0709 13:04:03.296000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.450120 (+1154120us) service_pool.cc:224] Handling call
0709 13:04:04.601177 (+151057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.601539 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.601585 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.601677 (+    92us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:04.601788 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.601856 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.602012 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:04.554594 19469 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:04.603298 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:04.628134 19417 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:04.636771 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.637085 19417 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:04.637854 15244 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:04.626752 19205 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:04.638897 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:04.564051 19290 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.640170 15241 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:04.601001 19274 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.642858 19205 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:04.645448 19402 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.184s	user 0.015s	sys 0.024s
I20260709 13:04:04.645059 19274 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.646289 19472 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.599601 19007 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:04.594118 19368 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.647549 19368 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:04.648157 19140 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:04.650403 19331 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:04.651908 19331 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:04.652388 19331 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:04.652783 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:04.654278 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 278811us
I20260709 13:04:04.654421 18885 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.654743 19028 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:04.647689 19274 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:04.655112 18885 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.656579 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.627276 19467 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:04.658604 18885 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:04.653741 19331 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.661674 19331 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:04.662504 19434 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:04.662755 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 349275us
W20260709 13:04:04.663345 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 1.08756e+06us
I20260709 13:04:04.663774 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:04.664609 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:04.665601 19274 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:04.659242 19417 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.615466 19337 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.670542 19415 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.598556 19233 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:04.671401 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:04.671736 19233 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.672456 15324 raft_consensus.cc:2410] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:04:04.674034 19274 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:04.674646 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:04.674888 19274 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.675921 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:04.676137 19212 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:04.676862 15317 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:04.614339 19160 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.678047 19274 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.615347 19433 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.657928 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.683987 15244 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:04.631884 18976 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:04.660508 18885 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:04.663718 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:04.705418 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:04.669806 19241 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.640622 19380 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:04.674801 19381 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:04.692108 19017 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:04.733829 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:04.703770 19233 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.659273 19467 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:04:04.738940 15247 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:04:04.760226 15998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.029s
W20260709 13:04:04.795841 15998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.003s	sys 0.036s
W20260709 13:04:04.794413 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.704411 19402 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.799062 15323 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 13:04:04.762300 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.811326 19402 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.814333 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:04.814678 19241 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.814972 19460 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:04.815667 15396 raft_consensus.cc:2410] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:04:04.816027 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 163411us
I20260709 13:04:04.764102 18885 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:04.796197 19331 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:04.815727 19460 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.818703 18885 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:04.819717 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 156125us
I20260709 13:04:04.821179 18885 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:04.790086 19206 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:04.822481 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 156301us
I20260709 13:04:04.822335 19400 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:04:04.822707 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.817999 15243 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:04.707612 19290 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:04.833572 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.830106 15365 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:04.759832 19474 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:04.838578 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:04.849567 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:04.854686 15323 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:04:04.855288 19344 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:04.855824 19380 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:04.856050 15243 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:04.863868 19483 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:04.864636 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 306437us
I20260709 13:04:04.865854 15323 pending_rounds.cc:85] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 6
I20260709 13:04:04.861537 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:04.881647 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:04.837096 19429 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.881719 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:04.883531 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56880.5us
I20260709 13:04:04.885221 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:04.877535 15323 pending_rounds.cc:107] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:04:04.890838 15323 raft_consensus.cc:2889] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:04.892647 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:04.893596 15323 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:04.895300 19344 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.899118 19460 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:04.895725 19380 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:04.902500 19212 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:04.902726 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 73071.8us
I20260709 13:04:04.903724 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:04.904573 19212 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:04.904613 15323 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:04.905392 19331 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:04.905929 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:04.906659 18745 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.907753 18745 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:04.908167 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:04.910115 18745 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:04.910419 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:04.912037 19463 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.906966 15215 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:04.924875 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:04.936650 19212 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:04.937064 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:04.938733 15317 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:04.938984 15324 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:04:04.939155 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 115502us
I20260709 13:04:04.939455 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2580) took 1643 ms. Trace:
I20260709 13:04:04.939563 19433 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.940266 19433 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.940958 15999 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:04.924165 19380 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:04.942953 19007 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:04.943423 19007 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:04.943395 19380 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.944044 19007 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:04.940038 15318 rpcz_store.cc:276] 0709 13:04:03.217163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.106419 (+889256us) service_pool.cc:224] Handling call
0709 13:04:04.107308 (+   889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:04.395437 (+288129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.395470 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:04.434332 (+ 38862us) log.cc:844] Serialized 26 byte log entry
0709 13:04:04.789897 (+355565us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:04.789951 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.790188 (+   237us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:04.860312 (+ 70124us) raft_consensus.cc:1685] finished
0709 13:04:04.860341 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.860517 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84988,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":325,"thread_start_us":462708,"threads_started":2,"wal-append.queue_time_us":313926}
I20260709 13:04:04.947273 19290 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.936713 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:04.949479 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2579) took 1732 ms. Trace:
I20260709 13:04:04.919697 19368 raft_consensus.cc:2764] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:04:04.949882 15316 rpcz_store.cc:276] 0709 13:04:03.216927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.477636 (+260709us) service_pool.cc:224] Handling call
0709 13:04:03.545900 (+ 68264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:04.407060 (+861160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.949148 (+542088us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400084654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:04.949421 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1436871424}
I20260709 13:04:04.956655 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:04.906518 19383 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:04.955194 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:04.969779 15324 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
W20260709 13:04:04.971581 19450 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.731s	user 0.000s	sys 0.002s
W20260709 13:04:04.968616 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 61738.9us
W20260709 13:04:04.992722 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 51925.3us
I20260709 13:04:04.955706 19429 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:04.955587 18745 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:05.006485 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 86723us
I20260709 13:04:05.008484 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:05.009248 15398 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:05.010674 19441 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:05.011057 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:05.016575 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.017525 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.066390 19492 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:05.066998 19492 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:05.067507 19492 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:05.074787 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:05.078267 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2571) took 1863 ms. Trace:
I20260709 13:04:05.078843 19383 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:05.079505 18885 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:05.080065 18885 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.080523 18885 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:04.957494 19381 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 13:04:05.083252 19017 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:05.083729 19017 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:05.084728 19017 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.087688 19017 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:05.089131 19118 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:04:05.090049 19118 consensus_queue.cc:1243] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 9.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:04:05.090821 19118 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:05.091238 19118 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:05.092468 19118 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:05.094372 19485 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:04:05.096248 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2584) took 1869 ms. Trace:
I20260709 13:04:05.096625 15319 rpcz_store.cc:276] 0709 13:04:03.227028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.377013 (+1149985us) service_pool.cc:224] Handling call
0709 13:04:04.377518 (+   505us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:04.400462 (+ 22944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.400510 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:04.413574 (+ 13064us) log.cc:844] Serialized 52 byte log entry
0709 13:04:04.694040 (+280466us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:04.694093 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.694191 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:05.095901 (+401710us) raft_consensus.cc:1685] finished
0709 13:04:05.095920 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.096064 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14844,"raft.queue_time_us":19347,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":20526,"thread_start_us":279965,"threads_started":1,"wal-append.queue_time_us":445156}
W20260709 13:04:05.099550 15246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 482) took 1540 ms (client timeout 1761 ms). Trace:
I20260709 13:04:05.099854 19205 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:05.100163 15246 rpcz_store.cc:269] 0709 13:04:03.559413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.569313 (+  9900us) service_pool.cc:224] Handling call
0709 13:04:05.099261 (+1529948us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400315e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:05.099451 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850580352}
I20260709 13:04:05.071194 19368 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.102718 19368 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:05.104269 19491 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:05.105511 19368 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:05.110695 15396 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:05.083480 19206 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:04:05.097646 19183 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.004s
I20260709 13:04:05.293419 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:04:05.299407 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 450106us
I20260709 13:04:05.078774 15321 rpcz_store.cc:276] 0709 13:04:03.214781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.218960 (+  4179us) service_pool.cc:224] Handling call
0709 13:04:03.219243 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:03.219563 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.219589 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:03.220039 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:04:03.491833 (+271794us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:03.544816 (+ 52983us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.546814 (+  1998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.546886 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:04.970662 (+1423776us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:05.077759 (+107097us) raft_consensus.cc:1685] finished
0709 13:04:05.077860 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.078057 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23872,"prepare.queue_time_us":53210,"prepare.run_cpu_time_us":15457,"prepare.run_wall_time_us":493057,"raft.queue_time_us":35945,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":17689,"spinlock_wait_cycles":37477760,"thread_start_us":271426,"threads_started":1,"wal-append.queue_time_us":1018978}
I20260709 13:04:05.303784 19473 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:05.304623 19473 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:05.304818 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.305253 19473 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:05.310719 16027 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:05.313184 19331 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:05.314009 19331 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:05.304000 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.292101 19206 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:05.320477 19118 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:05.326000 19331 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.330246 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:05.331521 16031 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:04:05.334180 19205 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:05.290879 19140 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.338083 19140 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.341413 19140 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.286854 19183 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:05.344362 16033 raft_consensus.cc:2368] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:05.344872 19183 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.345548 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 596) took 1300 ms. Trace:
I20260709 13:04:05.345997 16033 rpcz_store.cc:276] 0709 13:04:04.045094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.051211 (+  6117us) service_pool.cc:224] Handling call
0709 13:04:05.345282 (+1294071us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400581e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:05.345462 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2706280832}
I20260709 13:04:05.291882 19381 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:05.355367 15394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.032s	sys 0.064s
W20260709 13:04:05.366494 15394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.032s	sys 0.064s
W20260709 13:04:05.371984 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.357913 19409 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:05.382586 16027 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:05.383311 15398 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:05.373695 19140 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:04:05.386536 19140 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:05.386962 19140 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:05.388213 19140 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.388984 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.389794 19140 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:05.390307 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.390048 15316 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:05.385825 15363 leader_election.cc:400] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:05.394806 15363 leader_election.cc:403] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:05.393010 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:05.383961 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 371045us
I20260709 13:04:05.398962 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:05.399796 16033 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:05.410945 19482 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:05.417261 15213 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:05.425534 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:05.408535 19380 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.431536 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:05.436236 16027 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:05.436911 19206 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.437070 15390 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:04:05.437529 15390 pending_rounds.cc:85] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 5
I20260709 13:04:05.437827 15390 pending_rounds.cc:107] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:04:05.438191 15390 raft_consensus.cc:2889] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:05.434072 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:05.391348 19381 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:05.442703 15316 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:05.437647 19206 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.445928 15317 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:05.443950 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:05.450102 16027 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:05.450878 15390 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:05.451349 19206 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:05.452265 19495 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 13:04:05.452486 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:05.453092 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:05.454723 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.456421 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.457580 15321 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 13 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:05.458863 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:05.460191 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:05.461632 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:05.454770 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.463982 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.465497 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.467442 15321 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
W20260709 13:04:05.475502 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 89890.1us
I20260709 13:04:05.471851 15396 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:05.473057 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.479419 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:05.488080 19212 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:04:05.448176 19290 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:05.448320 19491 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:05.471570 19368 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:05.476271 19205 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:05.502216 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:05.512499 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:05.439452 19380 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.524092 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:05.501396 19290 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.510557 19368 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:05.531528 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.501206 19491 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:05.533203 15396 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:04:05.563875 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 136971us
I20260709 13:04:05.488757 19482 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.522886 19206 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:05.572937 15397 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:05.532236 19290 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:05.537751 19368 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:05.534098 19491 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:05.576823 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:05.565968 19435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.005s	sys 0.018s
I20260709 13:04:05.581391 15398 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:05.585661 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:05.590042 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:05.590482 19482 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:05.566833 19429 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.594826 15391 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:05.595968 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:05.600701 15396 raft_consensus.cc:2368] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
W20260709 13:04:05.588558 19435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.005s	sys 0.019s
I20260709 13:04:05.602715 19380 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:05.612182 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 150930us
I20260709 13:04:05.579025 19206 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.662834 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:05.661748 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:05.669731 15396 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
W20260709 13:04:05.682402 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78691.8us
I20260709 13:04:05.683897 16033 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:05.684733 16027 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:05.686580 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.686952 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.692265 15324 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:05.611928 19429 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:05.783428 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 119903us
W20260709 13:04:05.791744 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 87421.9us
W20260709 13:04:05.712786 19476 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.071s	user 0.015s	sys 0.002s
W20260709 13:04:05.794338 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 303893us
W20260709 13:04:05.798180 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 219143us
W20260709 13:04:05.700997 19017 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.613s	user 0.013s	sys 0.000s
I20260709 13:04:05.805370 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:05.790699 19500 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
W20260709 13:04:05.818166 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 316061us
I20260709 13:04:05.820580 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:05.823797 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.830189 19501 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:04:05.824060 19331 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:04:05.839365 19512 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:05.839697 19311 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:05.839949 19512 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.840217 19311 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:05.840451 19512 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:05.841246 19311 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.842581 19311 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:05.844849 19499 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.439s	user 0.000s	sys 0.001s
I20260709 13:04:05.854427 19430 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.855948 19430 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.856671 19430 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:05.861018 19430 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:05.862571 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2653) took 2304 ms. Trace:
I20260709 13:04:05.801879 19381 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:05.864928 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 65063.1us
W20260709 13:04:05.842774 19503 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:04:05.878827 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:05.871487 18885 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.003s
I20260709 13:04:05.867074 19442 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:05.894878 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 600) took 1706 ms. Trace:
I20260709 13:04:05.895391 16028 rpcz_store.cc:276] 0709 13:04:04.188516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.188926 (+   410us) service_pool.cc:224] Handling call
0709 13:04:04.189552 (+   626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:04.258575 (+ 69023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.258616 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:04.300887 (+ 42271us) log.cc:844] Serialized 26 byte log entry
0709 13:04:04.401532 (+100645us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:04.401593 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.401688 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:05.602894 (+1201206us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:05.889573 (+286679us) raft_consensus.cc:1685] finished
0709 13:04:05.889595 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.894665 (+  5070us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67733,"raft.queue_time_us":127940,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":15517,"spinlock_wait_cycles":26477824,"thread_start_us":83194,"threads_started":1,"wal-append.queue_time_us":109364}
I20260709 13:04:05.872172 19331 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.880950 19500 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:04:05.882419 15396 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:04:05.909089 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 88625.7us
W20260709 13:04:05.903661 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 88448.8us
I20260709 13:04:05.899803 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:05.894933 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 72525.8us
I20260709 13:04:05.865629 15399 rpcz_store.cc:276] 0709 13:04:03.558038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.559337 (+  1299us) service_pool.cc:224] Handling call
0709 13:04:03.559648 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:03.560092 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:04.683799 (+1123707us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b18002bb040. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1
0709 13:04:04.685627 (+  1828us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b18002bb040. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:04.689391 (+  3764us) spinlock_profiling.cc:243] Waited 958 us on lock 0x7b18002bb040. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9
0709 13:04:04.846092 (+156701us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.008264 (+162172us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.008458 (+   194us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:05.009053 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:04:05.009214 (+   161us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:05.009246 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.009345 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:05.844187 (+834842us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:05.862120 (+ 17933us) raft_consensus.cc:1685] finished
0709 13:04:05.862142 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.862354 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51314,"prepare.queue_time_us":527964,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":98,"raft.queue_time_us":57721,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":23566,"spinlock_wait_cycles":101626880,"thread_start_us":203224,"threads_started":2,"wal-append.queue_time_us":540100}
I20260709 13:04:05.875574 19380 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:05.925570 19344 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.925926 19380 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.928364 19380 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:05.934033 19490 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.036s	user 0.012s	sys 0.000s
W20260709 13:04:05.934337 19502 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.357s	user 0.001s	sys 0.000s
I20260709 13:04:05.935828 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 497) took 1125 ms. Trace:
I20260709 13:04:05.936205 15394 rpcz_store.cc:276] 0709 13:04:04.809953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.810103 (+   150us) service_pool.cc:224] Handling call
0709 13:04:04.810503 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:04.811212 (+   709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.811260 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:04.812014 (+   754us) log.cc:844] Serialized 26 byte log entry
0709 13:04:05.366938 (+554924us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:05.366979 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.367047 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:05.935578 (+568531us) raft_consensus.cc:1685] finished
0709 13:04:05.935599 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.935748 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3490,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":126,"thread_start_us":538978,"threads_started":1,"wal-append.queue_time_us":667829}
I20260709 13:04:05.939636 19433 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.941330 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:05.941653 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 48477.9us
I20260709 13:04:05.942749 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:05.943352 15241 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:05.944181 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:05.944710 15241 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:05.890352 19205 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:05.890632 19381 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.899082 19118 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.577s	user 0.012s	sys 0.000s
I20260709 13:04:05.947427 19381 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.950938 15390 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:04:05.951329 15390 pending_rounds.cc:85] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 3
I20260709 13:04:05.951597 15390 pending_rounds.cc:107] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:04:05.951823 15390 raft_consensus.cc:2889] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:05.952942 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:05.953508 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:05.911497 19513 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:05.915746 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:05.889601 18885 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.918115 19441 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:05.953872 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.918749 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:05.919886 15393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2650) took 2480 ms (client timeout 2133 ms). Trace:
W20260709 13:04:05.921192 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.921597 19517 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:05.922348 19331 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:05.963104 15393 rpcz_store.cc:269] 0709 13:04:03.439712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.443540 (+  3828us) service_pool.cc:224] Handling call
0709 13:04:05.919565 (+2476025us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54001950d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:05.919777 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1796404992}
I20260709 13:04:05.922621 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:05.923403 19459 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.923677 15247 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:05.924293 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:05.924535 19371 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.925076 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:05.924891 19368 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:05.953060 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.974534 15324 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:05.911027 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:05.958643 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58929.8us
I20260709 13:04:05.968242 15244 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 6.
W20260709 13:04:05.941686 19492 consensus_meta.cc:287] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.874s	user 0.013s	sys 0.000s
W20260709 13:04:05.978928 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 63239.6us
W20260709 13:04:05.962026 19383 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.881s	user 0.000s	sys 0.013s
I20260709 13:04:05.886724 19430 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:04:05.998329 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:05.979696 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.982010 15243 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:05.983455 18885 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:05.983882 19368 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.984104 19511 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:05.985226 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:05.986079 15316 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:05.979856 15397 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 5.
I20260709 13:04:05.982419 19466 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.991500 19402 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.993151 19259 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:05.994294 15399 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:04:05.994633 15391 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:04:06.082374 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:05.997627 15241 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:06.007658 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:06.004321 19475 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.325s	user 0.001s	sys 0.013s
I20260709 13:04:06.011931 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:06.012784 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:06.088090 15247 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
W20260709 13:04:06.088749 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 58828.2us
I20260709 13:04:06.089149 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:05.972092 19515 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:04:05.966156 19441 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:06.009696 19491 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.014381 19458 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:06.114723 19458 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.115970 19491 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:06.117880 19458 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:05.968809 19140 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:04:05.900229 19017 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:04:06.008502 19331 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:06.122293 19331 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:06.122869 19331 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.123309 19331 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:06.016695 19311 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:04:06.009009 19508 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:06.018831 15390 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:04:06.134840 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:05.995323 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:06.135922 15244 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:04:06.136574 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.137079 15244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:06.023627 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:06.139984 19402 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:06.028855 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:06.022447 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2651) took 2465 ms. Trace:
I20260709 13:04:06.143033 15324 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:04:06.143702 19409 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.758s	user 0.005s	sys 0.005s
I20260709 13:04:06.069031 15321 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:06.142721 15395 rpcz_store.cc:276] 0709 13:04:03.557311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.569476 (+ 12165us) service_pool.cc:224] Handling call
0709 13:04:03.569878 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.332458 (+762580us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:04.332882 (+   424us) log.cc:844] Serialized 14 byte log entry
0709 13:04:04.455283 (+122401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.455341 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:04.455406 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.019260 (+1563854us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540009bfd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:06.019321 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.022263 (+  2942us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9491,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":179,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":1644,"spinlock_wait_cycles":1752778496,"thread_start_us":121772,"threads_started":1,"wal-append.queue_time_us":386818,"wal-append.run_cpu_time_us":1730,"wal-append.run_wall_time_us":1067819}
I20260709 13:04:06.069754 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:06.071404 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:05.994602 19473 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.002s
I20260709 13:04:05.950147 19381 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:06.083063 15396 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:06.087080 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:06.098809 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 145398us
I20260709 13:04:06.160733 15249 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.098208 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.022902 19371 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:06.107203 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 94517.4us
I20260709 13:04:06.110301 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:06.204962 15241 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:06.111109 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:06.081725 19466 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:05.972369 19513 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.113699 19515 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:06.020179 15325 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:06.138079 15244 raft_consensus.cc:606] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
W20260709 13:04:06.217777 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 192399us
I20260709 13:04:06.207646 19473 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.150969 16025 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:06.001202 19492 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.215195 15398 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
W20260709 13:04:06.212924 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 62814.8us
I20260709 13:04:06.216511 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:06.228120 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 210961us
I20260709 13:04:06.242096 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:06.254292 15243 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:04:06.254891 15243 pending_rounds.cc:85] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 6
I20260709 13:04:06.255115 15243 pending_rounds.cc:107] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:04:06.255357 15243 raft_consensus.cc:2889] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:06.212420 19508 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:06.263721 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.266506 15393 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:06.264657 15397 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 5.
I20260709 13:04:06.264384 19331 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.276679 19331 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:06.282732 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.284479 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1504) took 2891 ms. Trace:
I20260709 13:04:06.284961 15248 rpcz_store.cc:276] 0709 13:04:03.393090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.393221 (+   131us) service_pool.cc:224] Handling call
0709 13:04:03.393507 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:04.104387 (+710880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.104486 (+    99us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:04.106346 (+  1860us) log.cc:844] Serialized 26 byte log entry
0709 13:04:04.381713 (+275367us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:04.381772 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.944502 (+562730us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540011add4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:04.944557 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.003711 (+1059154us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:06.284063 (+280352us) raft_consensus.cc:1685] finished
0709 13:04:06.284090 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.284269 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":469692,"raft.queue_time_us":550570,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":374,"spinlock_wait_cycles":393780736,"thread_start_us":256016,"threads_started":1,"wal-append.queue_time_us":428011}
W20260709 13:04:06.286468 19505 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.422s	user 0.002s	sys 0.005s
I20260709 13:04:06.286830 19430 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:06.287846 15248 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:06.287559 19430 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.226850 19381 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.290807 19381 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.291343 19430 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:06.293080 19381 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:06.292771 19441 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.293987 19515 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.294790 15390 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:06.295112 19206 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:06.296357 19515 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:06.294283 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:06.296393 19368 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:06.297003 19515 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:06.270197 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:06.298589 16029 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:06.259416 19519 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:06.299540 19466 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:06.300042 19519 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:06.300161 19206 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:06.299551 15215 leader_election.cc:400] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:04:06.301088 15215 leader_election.cc:403] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:06.299587 19473 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:06.302763 19492 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:06.301087 19519 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.304858 19429 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:06.301988 19311 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:06.258750 19402 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:04:06.297907 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:06.308180 19402 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:06.308372 19508 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.309875 15399 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:04:06.303524 19177 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:06.220118 19435 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:04:06.302026 15215 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:06.293501 19290 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.696s	user 0.005s	sys 0.002s
I20260709 13:04:06.308957 19402 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9.
I20260709 13:04:06.311617 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:06.318819 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56568.9us
I20260709 13:04:06.320478 15241 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:06.328578 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:06.329838 15397 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:06.331341 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:06.312208 19017 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:06.354481 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.357076 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:06.360790 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:06.360955 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:06.361670 15325 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 6: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:06.362320 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:06.363315 15316 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:06.374148 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:06.377511 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:06.380815 15249 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:04:06.363695 19458 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:04:06.383100 19521 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:06.330461 19492 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:06.363870 19522 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:06.383966 19521 consensus_queue.cc:1243] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:06.394130 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.357196 19017 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:06.326012 19290 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.402501 19206 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:06.389533 19259 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:06.388736 19344 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:04:06.357817 19429 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:04:06.527678 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2578) took 3311 ms. Trace:
I20260709 13:04:06.412230 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:06.533416 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 535160us
W20260709 13:04:06.482339 19007 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 1.538s	user 0.011s	sys 0.004s
I20260709 13:04:06.535187 15320 rpcz_store.cc:276] 0709 13:04:03.216671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.470394 (+253723us) service_pool.cc:224] Handling call
0709 13:04:03.470694 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.144297 (+673603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.527278 (+2382981us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54002a76d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:06.527578 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300378368}
I20260709 13:04:06.538724 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:06.407248 19417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.704s	user 0.017s	sys 0.030s
I20260709 13:04:06.542487 15390 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:06.540397 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:06.406774 19430 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:06.457376 19512 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.003s
I20260709 13:04:06.529546 19523 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:06.556476 19523 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:06.556638 19368 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:06.411813 19441 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:06.557466 19523 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:06.552083 19417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.883s	user 0.019s	sys 0.036s
I20260709 13:04:06.558831 19523 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:06.403266 19522 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:06.541702 19007 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.557360 19368 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.409097 19017 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:06.536959 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 205726us
I20260709 13:04:06.409204 19515 raft_consensus.cc:2764] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:04:06.498389 19371 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:06.577455 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.553782 19519 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:06.549005 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:06.533504 19259 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:06.587800 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:06.594092 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:06.601500 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.599826 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:06.582950 19417 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.582639 19519 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:06.573511 19512 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:06.595635 19524 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:04:06.614480 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 77218.6us
I20260709 13:04:06.555272 19430 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.595321 19259 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:06.622005 19458 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:06.619132 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.610044 19381 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:06.610131 19491 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:06.657202 16030 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:06.607141 19371 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.613073 19515 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:06.618439 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.660300 15324 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:06.659487 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 330949us
I20260709 13:04:06.623854 19430 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.716943 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:06.732596 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 127352us
I20260709 13:04:06.729301 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:06.748345 15319 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:06.717804 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 50806.1us
I20260709 13:04:06.662726 19381 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.669449 19458 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:06.753051 19433 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:06.753409 15325 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:06.753505 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2582) took 3535 ms. Trace:
I20260709 13:04:06.753080 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:06.770380 15317 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:06.746992 15390 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:06.620278 19417 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.792181 19458 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.794570 19417 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:06.795634 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1563) took 1333 ms. Trace:
I20260709 13:04:06.796878 19429 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.796079 15323 rpcz_store.cc:276] 0709 13:04:05.462262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.118692 (+656430us) service_pool.cc:224] Handling call
0709 13:04:06.119126 (+   434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:06.119629 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.119666 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:06.120309 (+   643us) log.cc:844] Serialized 52 byte log entry
0709 13:04:06.317997 (+197688us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:06.318039 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.318111 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.795411 (+477300us) raft_consensus.cc:1685] finished
0709 13:04:06.795432 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.795576 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7316,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":154,"thread_start_us":196859,"threads_started":1,"wal-append.queue_time_us":286369}
I20260709 13:04:06.797403 19429 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.762334 15319 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
W20260709 13:04:06.798913 19533 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:04:06.799579 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:06.800241 15319 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:06.768013 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:06.803107 15316 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:06.768462 19433 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:06.790117 19536 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:04:06.804679 19433 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.769163 15322 rpcz_store.cc:276] 0709 13:04:03.217645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.142464 (+924819us) service_pool.cc:224] Handling call
0709 13:04:04.198486 (+ 56022us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:04.545829 (+347343us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:04.545883 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:04.643547 (+ 97664us) log.cc:844] Serialized 26 byte log entry
0709 13:04:04.843452 (+199905us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:04.843670 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.753000 (+1909330us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400375354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:06.753060 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.753112 (+    52us) raft_consensus.cc:1685] finished
0709 13:04:06.753128 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.753340 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":173,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"spinlock_wait_cycles":576483072,"thread_start_us":77771,"threads_started":1,"wal-append.queue_time_us":215266,"wal-append.run_cpu_time_us":3587,"wal-append.run_wall_time_us":1501915}
I20260709 13:04:06.807099 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:06.808406 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:06.805960 19433 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:06.811121 19520 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 13:04:06.814127 19530 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:04:06.815160 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.815873 15398 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
W20260709 13:04:06.795686 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.628134 19522 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:06.729593 19402 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:06.826721 15390 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:06.833278 15319 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:06.767138 19381 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:06.842991 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.846823 15390 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:06.858145 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:06.858911 15319 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:06.862051 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 94604.7us
I20260709 13:04:06.669902 19519 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.867873 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.868957 15390 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:06.845068 19399 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:06.860002 19522 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:06.883886 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.884822 15390 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:06.861220 19290 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:06.890717 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:06.894263 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:06.895275 16027 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:06.898567 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:06.889058 15319 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:06.867913 19417 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:06.901971 15398 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:06.909837 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 163686us
I20260709 13:04:06.913832 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:06.914626 15390 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:06.917934 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:06.917974 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:06.919109 16024 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:06.920970 15398 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:04:06.922461 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:06.926121 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:06.927068 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 601) took 2517 ms. Trace:
I20260709 13:04:06.908404 19417 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.915410 19534 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:06.928442 19548 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:06.947189 19513 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:06.950155 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:06.929877 19538 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:04:06.933442 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1506) took 3507 ms. Trace:
I20260709 13:04:06.922477 19007 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:06.934046 19528 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:04:06.936188 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 846634us
I20260709 13:04:06.960703 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:06.942757 19535 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:04:06.945544 19402 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:06.928278 16032 rpcz_store.cc:276] 0709 13:04:04.409986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.417331 (+  7345us) service_pool.cc:224] Handling call
0709 13:04:04.432310 (+ 14979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:04.469590 (+ 37280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.469630 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:04.470323 (+   693us) log.cc:844] Serialized 26 byte log entry
0709 13:04:04.720011 (+249688us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:04.720078 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.923569 (+2203491us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b540067eb54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:06.923626 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.923678 (+    52us) raft_consensus.cc:1685] finished
0709 13:04:06.923700 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.926978 (+  3278us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43403,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":6473,"spinlock_wait_cycles":81569664,"thread_start_us":234682,"threads_started":1,"wal-append.queue_time_us":414411,"wal-append.run_cpu_time_us":2469,"wal-append.run_wall_time_us":1080922}
I20260709 13:04:06.931557 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.954474 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:06.964465 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:06.928179 19311 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:06.956275 15245 rpcz_store.cc:276] 0709 13:04:03.426265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.468522 (+ 42257us) service_pool.cc:224] Handling call
0709 13:04:04.100300 (+631778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.342241 (+241941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.928284 (+2586043us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54000adf50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:06.933388 (+  5104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1452026752}
I20260709 13:04:06.967269 15398 raft_consensus.cc:2376] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8. Re-sending same reply.
I20260709 13:04:06.958348 19412 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:06.971233 19355 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:06.987157 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:06.972385 19508 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:06.973019 19550 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:04:06.974601 15289 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:06.976706 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:06.947224 19548 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:06.972493 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2218) took 1005 ms. Trace:
I20260709 13:04:06.929232 19546 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:04:06.966096 19402 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:06.969377 19311 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.982383 19007 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:06.970026 19513 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:06.996093 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:07.003513 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:06.997411 15395 rpcz_store.cc:276] 0709 13:04:05.967422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.144747 (+177325us) service_pool.cc:224] Handling call
0709 13:04:06.145030 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:06.197800 (+ 52770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.197828 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:06.278569 (+ 80741us) log.cc:844] Serialized 26 byte log entry
0709 13:04:06.467193 (+188624us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:06.467254 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.467327 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.972278 (+504951us) raft_consensus.cc:1685] finished
0709 13:04:06.972303 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.972437 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1064,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":64899,"thread_start_us":188070,"threads_started":1,"wal-append.queue_time_us":371651}
I20260709 13:04:06.982761 19412 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:07.008391 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:07.000741 19544 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:04:07.015585 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.014773 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.017879 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.000553 19549 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:07.012049 19412 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:07.021070 19286 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.010s	sys 0.007s
I20260709 13:04:07.023696 19381 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.001183 19311 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.011667 19399 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:07.029805 19355 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:07.006623 19513 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:07.010269 19290 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.030764 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.070665 19290 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.071422 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.072242 15394 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:07.073217 19290 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:07.034932 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.074498 19513 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:07.037798 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2670) took 1235 ms. Trace:
W20260709 13:04:07.038658 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 67234.4us
I20260709 13:04:07.001492 19007 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:07.086087 19368 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.086567 19007 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.046736 15398 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:04:07.004005 19547 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:07.029234 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:07.053982 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.091799 15395 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
W20260709 13:04:07.049506 19286 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.011s	sys 0.008s
I20260709 13:04:07.058739 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:04:07.060544 19381 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:07.062640 19399 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:07.016291 19344 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:07.010010 19433 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:04:07.066661 15390 raft_consensus.cc:2368] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14.
I20260709 13:04:07.067219 19355 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.082424 19290 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:07.081957 19542 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:04:07.083051 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 602) took 2202 ms. Trace:
I20260709 13:04:07.084472 19140 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.077410 15391 rpcz_store.cc:276] 0709 13:04:05.804324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.804910 (+   586us) service_pool.cc:224] Handling call
0709 13:04:05.825903 (+ 20993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:06.084590 (+258687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.037528 (+952938us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400154ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:07.037727 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351589760}
I20260709 13:04:07.090687 19547 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.123188 19548 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:07.125232 19554 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:07.128476 19206 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.595s	user 0.004s	sys 0.007s
I20260709 13:04:07.129220 19412 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.139019 19556 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:07.139204 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 110055us
W20260709 13:04:07.140489 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 165967us
W20260709 13:04:07.141849 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 133591us
I20260709 13:04:07.140489 16025 rpcz_store.cc:276] 0709 13:04:04.880676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.880868 (+   192us) service_pool.cc:224] Handling call
0709 13:04:07.082819 (+2201951us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001680d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:07.082958 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2904208256}
I20260709 13:04:07.151902 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:07.153079 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:07.136394 19368 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:07.168182 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.168361 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:07.169826 15249 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.170753 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2645) took 3755 ms. Trace:
I20260709 13:04:07.171303 19558 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:07.171859 19558 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.148392 19344 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:07.172309 19433 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:07.171201 15392 rpcz_store.cc:276] 0709 13:04:03.412596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.413386 (+   790us) service_pool.cc:224] Handling call
0709 13:04:03.478919 (+ 65533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.479150 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:03.492890 (+ 13740us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.382437 (+1889547us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b18002fef60. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:04:05.580395 (+197958us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:05.581115 (+   720us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:05.581262 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.581326 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:07.167305 (+1585979us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b5400328cd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:07.167468 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65029,"prepare.queue_time_us":12563,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":14465,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":114611328,"thread_start_us":190230,"threads_started":1,"wal-append.queue_time_us":2059725,"wal-append.run_cpu_time_us":1467,"wal-append.run_wall_time_us":1003377}
I20260709 13:04:07.172916 19433 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:07.172688 19344 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.146826 19140 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.174788 19412 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.163290 19546 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:07.175609 19546 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.176155 19140 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.176278 19548 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.176824 19140 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.176887 19548 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.177444 19140 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.172353 19558 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:07.179092 19548 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.179708 19548 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.180128 19548 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.180932 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:07.178879 19259 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.182196 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.182497 15243 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:07.186110 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.189347 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:07.192708 15242 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:07.179718 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.187167 15248 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:07.189704 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:07.185878 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.195029 15250 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:04:07.185636 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.148432 19206 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:07.202930 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:07.200906 15245 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:04:07.149266 19399 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:07.208707 16024 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:07.210389 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:07.210567 15247 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:04:07.211539 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.212222 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:07.213346 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:07.213672 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.213964 15248 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:07.214116 16025 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:07.168586 19286 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.214666 15250 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:07.214368 15246 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:07.145141 19290 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.215515 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:07.215713 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:07.182210 19548 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.184034 19259 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.187783 19429 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.174799 19344 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.219488 15242 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.250559 15318 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:07.218128 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.173882 19433 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.251232 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:07.232738 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.229517 15249 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:04:07.252585 15247 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:04:07.253535 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.253535 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.255198 15245 raft_consensus.cc:2410] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:07.253575 16024 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:04:07.255900 16024 pending_rounds.cc:85] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 8
I20260709 13:04:07.214968 19412 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.256479 16024 pending_rounds.cc:107] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:04:07.258047 16024 raft_consensus.cc:2889] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:07.257329 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 104331us
I20260709 13:04:07.223410 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:07.259871 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:07.211009 19417 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.211400 19550 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:07.208307 19554 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:07.259002 15241 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:07.167667 19556 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:07.261113 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 112017us
I20260709 13:04:07.261415 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:07.217746 19546 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:07.262439 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.204573 19402 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.263101 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:07.268226 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.209527 19430 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.270673 19430 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:07.222961 19017 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.625s	user 0.012s	sys 0.000s
I20260709 13:04:07.271522 19402 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.271479 19017 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.273316 15397 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:07.261551 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.262549 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.275259 15316 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:07.275498 15247 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:04:07.276197 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:07.277391 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.278266 15250 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 13 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:07.279011 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.279625 15247 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:07.280790 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:07.281930 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.265323 19412 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.283082 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:07.283499 19290 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:07.284117 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:07.249316 19563 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:07.275033 15321 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:07.274598 15245 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:07.286302 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.288028 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:07.267632 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45999.8us
I20260709 13:04:07.290470 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.290815 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.291690 15247 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:07.288492 15242 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:04:07.294052 15244 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:07.295879 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:07.298940 15316 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:07.299006 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:07.284320 19412 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.265606 19554 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.221055 19286 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.256721 19311 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.312541 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:07.319387 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51500us
I20260709 13:04:07.317502 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:07.322118 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.322607 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:07.323192 15247 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:07.274317 19017 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:07.305984 19554 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:07.306435 19402 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:07.317356 19564 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:07.327703 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.313598 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.329864 15245 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 13:04:07.326934 19564 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:07.332259 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:07.319847 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45659.1us
I20260709 13:04:07.330626 19430 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:07.324582 19548 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:04:07.267251 19550 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.341295 15243 raft_consensus.cc:2368] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7.
I20260709 13:04:07.282128 19558 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.296849 19555 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:04:07.348006 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.350521 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:07.350739 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 127405us
I20260709 13:04:07.351992 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.353041 15242 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:07.353816 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:07.354417 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:07.355126 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:07.339190 19344 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:07.355031 16028 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
W20260709 13:04:07.362079 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.285602 19399 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.340340 19564 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:07.369717 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:07.333105 19259 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:04:07.333292 19429 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:04:07.372892 19571 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:07.373837 19412 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:07.371033 19563 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:07.374989 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.381891 15316 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:07.355325 19355 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.367226 19140 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.369370 19344 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:07.403880 15248 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:07.391203 19412 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:07.375468 19417 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:04:07.428820 15248 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:07.381083 19562 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:04:07.398536 19550 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.398568 18898 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:04:07.715265 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:07.728701 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:07.728343 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:07.546038 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2673) took 1628 ms. Trace:
W20260709 13:04:07.457880 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 87235.1us
I20260709 13:04:07.729512 16028 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
W20260709 13:04:07.622543 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 294378us
I20260709 13:04:07.727936 15247 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:07.729694 16031 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:07.578845 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 676) took 2270 ms. Trace:
I20260709 13:04:07.718297 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.729722 15393 rpcz_store.cc:276] 0709 13:04:05.917459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.004377 (+ 86918us) service_pool.cc:224] Handling call
0709 13:04:06.004665 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.266973 (+262308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.545774 (+1278801us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54002b5554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:07.545969 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599395584}
I20260709 13:04:07.735044 15317 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:07.721560 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:07.741742 15323 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:07.744035 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:07.722389 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 679) took 2412 ms. Trace:
I20260709 13:04:07.734658 16029 rpcz_store.cc:276] 0709 13:04:05.308756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.329089 (+ 20333us) service_pool.cc:224] Handling call
0709 13:04:05.329601 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.299185 (+969584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.578473 (+1279288us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b540041d2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:07.578761 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227759360}
I20260709 13:04:07.746620 16030 rpcz_store.cc:276] 0709 13:04:05.310000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.310265 (+   265us) service_pool.cc:224] Handling call
0709 13:04:05.310660 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.663413 (+1352753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.722066 (+1058653us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540043b2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:07.722325 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2927944064}
I20260709 13:04:07.702188 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2219) took 1731 ms. Trace:
W20260709 13:04:07.750351 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.738798 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:07.730140 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:07.488324 19189 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.491348 19556 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.522948 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:07.761708 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 238878us
I20260709 13:04:07.763466 15289 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:07.763897 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:07.666682 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:07.769688 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:07.770181 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.533988 19572 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:04:07.783273 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:07.778043 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1574) took 1825 ms. Trace:
I20260709 13:04:07.784296 15324 rpcz_store.cc:276] 0709 13:04:05.952647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.143843 (+191196us) service_pool.cc:224] Handling call
0709 13:04:06.144131 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.746528 (+602397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.777764 (+1031236us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54002ed6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:07.777979 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112123264}
I20260709 13:04:07.771157 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.787663 15249 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:07.771226 15247 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.495024 19286 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:07.493171 19523 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.459565 19469 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:07.495832 19290 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:07.776582 19512 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.750281 15396 rpcz_store.cc:276] 0709 13:04:05.970413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.212714 (+242301us) service_pool.cc:224] Handling call
0709 13:04:06.242076 (+ 29362us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:06.242546 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:06.305596 (+ 63050us) spinlock_profiling.cc:243] Waited 8.5 ms on lock 0x7b180039f460. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d522 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:06.408716 (+103120us) log.cc:844] Serialized 14 byte log entry
0709 13:04:06.589220 (+180504us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:06.607467 (+ 18247us) log.cc:844] Serialized 52 byte log entry
0709 13:04:06.607741 (+   274us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:06.608061 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 13:04:07.398308 (+790247us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b180039f460. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f366dace58f 00007f3666b0d571 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd
0709 13:04:07.398630 (+   322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.398718 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:07.698878 (+300160us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b180039f460. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:07.701836 (+  2958us) raft_consensus.cc:1685] finished
0709 13:04:07.701871 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:07.702095 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":872908,"prepare.queue_time_us":479441,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":2411,"raft.queue_time_us":801129,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":17330,"spinlock_wait_cycles":31483904,"thread_start_us":219753,"threads_started":2,"wal-append.queue_time_us":258236}
I20260709 13:04:07.777894 19558 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:07.427807 19565 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:07.815992 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.501214 19212 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.316s
I20260709 13:04:07.778846 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:07.779085 15393 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:07.560868 19563 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.543298 19412 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.780381 19189 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.780674 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.766198 19550 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:07.765661 19578 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:07.800323 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:07.845681 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:07.608019 19513 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
I20260709 13:04:07.492756 19429 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.565872 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.493000 19546 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.707135 19547 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:07.665200 19311 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:07.652913 15399 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:07.806876 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.750459 19381 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.816092 19290 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.750140 19551 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:07.812798 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 74121.8us
I20260709 13:04:07.910426 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:07.911811 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:07.813396 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49968.3us
I20260709 13:04:07.913163 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.811828 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.817001 15394 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:04:07.819169 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:07.914335 15249 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 7.
I20260709 13:04:07.782971 19515 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:07.808593 19007 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.721s	user 0.008s	sys 0.003s
I20260709 13:04:07.918180 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:07.927924 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.929802 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:07.930832 15321 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 7: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:07.931869 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.932854 15321 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:07.933837 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.936233 15214 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:07.801944 19519 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:07.842914 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 79089.9us
I20260709 13:04:07.801672 19417 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:07.800575 19556 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:07.968222 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:07.803272 19573 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:04:07.630601 19344 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.657307 19467 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.160s
I20260709 13:04:07.848856 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:07.851745 15396 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:07.815807 19548 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:07.819928 19368 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:04:07.865867 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 199287us
I20260709 13:04:07.866573 19513 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.868947 19546 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.868904 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:07.807855 15247 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:04:07.838836 19571 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:04:07.820116 19523 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.996467 19583 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:07.903132 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:07.913626 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.062700 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:07.935444 19551 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.914744 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:07.916368 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.946713 19007 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.862980 19578 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:07.909344 19381 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.949955 19588 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:04:07.987236 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 51080us
I20260709 13:04:08.101341 15319 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:07.987425 19547 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:07.988547 19212 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:07.990104 15394 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:04:07.952291 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.960529 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.899248 19517 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:07.993155 15323 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:08.112443 16024 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:07.935139 15321 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
W20260709 13:04:07.986449 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52224.1us
I20260709 13:04:07.996444 19177 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:07.960101 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:07.935050 19590 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:07.997357 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:07.810662 19549 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.002s
I20260709 13:04:07.867570 19429 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:07.962214 19286 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:04:08.037357 15397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2233) took 1436 ms (client timeout 1531 ms). Trace:
I20260709 13:04:07.960665 19511 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:08.128307 19511 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.128762 19511 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:08.128978 19381 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:08.125247 15397 rpcz_store.cc:269] 0709 13:04:06.581881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.582078 (+   197us) service_pool.cc:224] Handling call
0709 13:04:08.018434 (+1436356us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b5400328cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:08.018596 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542950784}
I20260709 13:04:08.045248 15393 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:08.045738 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:08.130628 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:08.108911 19212 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.037935 19584 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:08.131151 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:08.131399 15397 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:08.131829 15393 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:08.131969 15318 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:08.132305 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:08.132762 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:08.133401 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:08.042303 19548 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:08.135121 19548 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:08.135807 19429 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:07.812398 19469 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.042773 19593 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:07.983453 15135 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9e997bc5c2942178cde4c670df97100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 89940175e5444593aab6b3a025624b5b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:08.092386 19513 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:08.096388 19546 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:08.100358 19551 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:08.101310 19189 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:08.106395 15317 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:08.107327 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 112240us
I20260709 13:04:08.061472 19583 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.131484 19584 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:08.135850 19578 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:08.116676 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:08.165102 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48556.8us
I20260709 13:04:08.114276 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:08.101800 19588 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:08.069872 19534 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:08.070313 19557 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.127601 19286 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:08.127769 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:08.130009 19007 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:08.125075 19590 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:08.027073 19581 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:04:08.130926 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 85290.8us
I20260709 13:04:07.769794 19206 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:08.110311 19492 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:08.133378 15393 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:04:08.136730 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 139455us
I20260709 13:04:08.071323 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:08.153723 15135 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 170506us
I20260709 13:04:08.123693 19290 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:08.018774 19417 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.178277 19534 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.188093 19571 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:08.131244 19212 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:08.143596 19564 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.003s
I20260709 13:04:08.131505 19368 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:08.111420 19430 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:04:08.136602 19549 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:08.109309 15325 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:08.196359 19206 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:08.146973 19573 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:08.166123 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:08.290563 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 124508us
I20260709 13:04:08.291414 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:08.262598 19534 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:08.180524 15394 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:08.119303 19517 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:08.163724 19515 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:08.199677 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 152110us
I20260709 13:04:08.207629 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:08.207852 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:08.162035 19583 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:08.156330 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:08.299594 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:08.247228 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54295.7us
I20260709 13:04:08.247516 19605 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:08.151995 19593 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.249629 19523 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:08.254118 15393 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 7.
I20260709 13:04:08.256904 19469 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:08.178105 19588 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:08.187355 19286 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:08.263082 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:08.166306 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:08.300778 19412 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:04:08.317804 19554 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.963s	user 0.008s	sys 0.006s
I20260709 13:04:08.364339 19554 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.276502 19368 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:08.301389 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 93852.8us
I20260709 13:04:08.300141 19573 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:08.333662 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 177431us
I20260709 13:04:08.330404 19140 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:08.336977 15393 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:08.290045 19206 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:08.355554 15316 raft_consensus.cc:2410] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:08.362597 15397 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:08.262081 19571 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:08.198208 19557 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.355294 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:08.353706 19584 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:08.158154 15317 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:04:08.368254 16032 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:04:08.368433 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:08.403733 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:08.300797 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:08.405313 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 50122us
I20260709 13:04:08.299096 19561 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:08.277555 19564 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.392334 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2620) took 1059 ms. Trace:
I20260709 13:04:08.366747 19412 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.396430 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:08.385818 19399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.007s	sys 0.025s
I20260709 13:04:08.409606 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:08.411083 15213 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:08.407783 15319 rpcz_store.cc:276] 0709 13:04:07.332663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.108515 (+775852us) service_pool.cc:224] Handling call
0709 13:04:08.120772 (+ 12257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:08.121002 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:08.271934 (+150932us) log.cc:844] Serialized 14 byte log entry
0709 13:04:08.391953 (+120019us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:08.392014 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:08.392074 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.392149 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:08.392273 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15639,"prepare.queue_time_us":270401,"raft.queue_time_us":125,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":9134,"thread_start_us":238853,"threads_started":2}
I20260709 13:04:08.389540 19492 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:08.417174 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:08.413345 19399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.007s	sys 0.026s
I20260709 13:04:08.425071 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:08.398248 19571 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.408617 19412 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:08.414959 19515 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:08.440284 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 139623us
I20260709 13:04:08.441016 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:08.414746 19589 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:08.424005 19546 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:08.413539 19429 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:08.420711 19523 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:08.419853 19551 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:08.460438 15244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1535) took 1251 ms (client timeout 1533 ms). Trace:
I20260709 13:04:08.464915 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:08.401162 19599 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:04:08.470822 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:08.481884 15215 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:08.427986 19561 raft_consensus.cc:697] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:08.468847 15244 rpcz_store.cc:269] 0709 13:04:07.209224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.215475 (+  6251us) service_pool.cc:224] Handling call
0709 13:04:08.460221 (+1244746us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b5400315954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:08.460361 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115486464}
I20260709 13:04:08.446889 19290 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:08.475805 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:08.430440 19140 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:04:08.527257 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:08.473341 19604 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:04:08.470495 19603 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:04:08.529757 15321 raft_consensus.cc:2410] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:04:08.473485 19592 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:04:08.539498 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2611) took 1284 ms. Trace:
I20260709 13:04:08.540036 15320 rpcz_store.cc:276] 0709 13:04:07.254917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.296713 (+ 41796us) service_pool.cc:224] Handling call
0709 13:04:07.317914 (+ 21201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:07.588624 (+270710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:07.588674 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:07.755394 (+166720us) log.cc:844] Serialized 26 byte log entry
0709 13:04:07.844267 (+ 88873us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:07.844304 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.844373 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:08.539242 (+694869us) raft_consensus.cc:1685] finished
0709 13:04:08.539270 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:08.539426 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1867,"raft.queue_time_us":23702,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":106,"thread_start_us":189348,"threads_started":2,"wal-append.queue_time_us":343191}
I20260709 13:04:08.468232 19596 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.542613 19596 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.545692 19596 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:08.546881 15996 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.512s (SENT) [suppressed 15 similar messages]
I20260709 13:04:08.533318 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:08.472581 19288 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:08.468008 19189 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:08.551753 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 76036.9us
I20260709 13:04:08.555239 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:08.471148 19492 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:08.470916 19546 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.553014 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:08.549955 15317 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:04:08.535910 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 118835us
I20260709 13:04:08.848549 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:08.825263 19417 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:08.783097 19511 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.004s
I20260709 13:04:08.803295 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:08.678435 19607 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.219s	user 0.003s	sys 0.001s
I20260709 13:04:08.795564 19565 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:08.859025 19565 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:08.859865 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 505) took 1057 ms. Trace:
I20260709 13:04:08.810942 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:08.861783 15244 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:08.824561 19575 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:04:08.808760 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:08.724185 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:08.763316 19564 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:08.734097 19554 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:08.682034 19548 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.001s
I20260709 13:04:08.932533 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:08.802500 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:08.589294 19609 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:08.686713 19561 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.731387 19517 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:08.557652 19288 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.559835 19523 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:04:08.679620 19618 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.140s	user 0.003s	sys 0.000s
I20260709 13:04:08.644349 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:08.463996 19368 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.679102 19593 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:08.813975 19626 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:08.594578 19590 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:08.738148 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:08.762635 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:08.810359 19598 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.617s	user 0.001s	sys 0.000s
I20260709 13:04:08.729175 19559 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:08.683499 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2628) took 1195 ms. Trace:
I20260709 13:04:08.803040 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2613) took 1547 ms. Trace:
I20260709 13:04:08.673219 18745 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.779143 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:08.931658 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 259016us
W20260709 13:04:08.821638 19624 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:04:08.475631 19573 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:08.556556 19140 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:08.789959 19612 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:04:08.758894 19615 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:04:08.645315 19290 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:08.493325 19429 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:08.674281 19611 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:08.524886 19371 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:08.681638 19515 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:08.567895 16029 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 9: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:08.600431 19595 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:04:08.844671 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 289009us
I20260709 13:04:08.857147 15250 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:08.860291 15245 rpcz_store.cc:276] 0709 13:04:07.802298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.932002 (+129704us) service_pool.cc:224] Handling call
0709 13:04:07.932318 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:07.950877 (+ 18559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:07.950928 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:07.961923 (+ 10995us) log.cc:844] Serialized 26 byte log entry
0709 13:04:08.278566 (+316643us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:08.278608 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.278681 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:08.859612 (+580931us) raft_consensus.cc:1685] finished
0709 13:04:08.859633 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:08.859795 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18017,"raft.queue_time_us":54435,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":235790,"threads_started":1,"wal-append.queue_time_us":383785}
I20260709 13:04:08.761703 19571 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.853552 19492 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:09.028407 19381 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:08.989943 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 138598us
W20260709 13:04:09.014628 19575 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:04:09.049417 15324 rpcz_store.cc:276] 0709 13:04:07.255369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.102735 (+847366us) service_pool.cc:224] Handling call
0709 13:04:08.103055 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:08.103448 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:08.395524 (+292076us) log.cc:844] Serialized 14 byte log entry
0709 13:04:08.497941 (+102417us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:08.501364 (+  3423us) log.cc:844] Serialized 52 byte log entry
0709 13:04:08.501672 (+   308us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:08.502112 (+   440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.502261 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:08.802827 (+300566us) raft_consensus.cc:1685] finished
0709 13:04:08.802846 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:08.802985 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20078,"prepare.queue_time_us":244015,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":8405,"raft.queue_time_us":24437,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":31992,"thread_start_us":300352,"threads_started":2,"wal-append.queue_time_us":294091}
I20260709 13:04:09.050963 19579 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:09.051890 19288 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:08.872661 19511 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:08.978641 19212 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.699s	user 0.015s	sys 0.000s
W20260709 13:04:09.180421 15290 leader_election.cc:336] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.531s (SENT)
I20260709 13:04:08.856395 19546 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:08.940694 16033 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:09.053020 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2695) took 1119 ms. Trace:
I20260709 13:04:08.941277 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:09.053432 19007 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:09.053869 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 315793us
W20260709 13:04:09.030434 19519 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.032s	user 0.014s	sys 0.003s
I20260709 13:04:09.054553 15247 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:09.054437 19626 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:08.962278 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:09.040022 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.021s	sys 0.038s
I20260709 13:04:08.933416 15244 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
W20260709 13:04:09.209540 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.021s	sys 0.040s
W20260709 13:04:09.137715 19622 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:04:09.056038 19609 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:09.059233 15316 rpcz_store.cc:276] 0709 13:04:07.487696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.960205 (+472509us) service_pool.cc:224] Handling call
0709 13:04:08.683244 (+723039us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54001e5fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:08.683430 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534337792}
I20260709 13:04:09.217576 15248 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:08.855901 19402 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.258s
I20260709 13:04:09.180948 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:09.196125 15396 rpcz_store.cc:276] 0709 13:04:07.933124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.057824 (+124700us) service_pool.cc:224] Handling call
0709 13:04:08.603422 (+545598us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:04:09.052947 (+449525us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4080512}
I20260709 13:04:09.222646 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:09.223241 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:09.070561 19331 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.004s	sys 0.021s
I20260709 13:04:09.204512 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:09.205440 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:09.144704 19633 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
W20260709 13:04:09.132457 19623 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
W20260709 13:04:09.131382 19617 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.416s	user 0.001s	sys 0.000s
W20260709 13:04:09.210136 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 728323us
W20260709 13:04:09.071960 19589 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 13:04:09.212036 19566 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:09.216322 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:08.853081 19596 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.261s
I20260709 13:04:09.348672 15392 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:04:09.221464 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44012.5us
I20260709 13:04:09.225683 16030 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:09.057643 18898 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:09.245642 19517 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:09.177613 19290 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:08.961117 19548 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:09.206596 19583 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.867s	user 0.012s	sys 0.004s
W20260709 13:04:09.210032 19547 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.038s	sys 0.021s
I20260709 13:04:09.205710 19007 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.248831 15250 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:09.114127 19597 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:09.059973 19189 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.161s
W20260709 13:04:09.226222 19412 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.002s
I20260709 13:04:08.856206 19551 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.346s
W20260709 13:04:09.227586 19331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.007s	sys 0.023s
I20260709 13:04:09.115589 19554 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:04:09.257011 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:09.259163 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2678) took 1481 ms. Trace:
I20260709 13:04:09.217744 19578 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.071110 18745 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.222522 19609 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.193727 19381 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:09.205219 19588 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.835s	user 0.004s	sys 0.008s
I20260709 13:04:09.192781 19212 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.389025 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:09.350000 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:09.352018 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 135828us
I20260709 13:04:09.353979 16031 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:09.357405 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2629) took 1869 ms. Trace:
W20260709 13:04:09.360170 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 179776us
W20260709 13:04:09.390611 15290 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.569s (SENT)
I20260709 13:04:09.391163 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:09.390298 15323 rpcz_store.cc:276] 0709 13:04:07.487972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.113946 (+625974us) service_pool.cc:224] Handling call
0709 13:04:08.118440 (+  4494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:08.138197 (+ 19757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:08.138261 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:08.138933 (+   672us) log.cc:844] Serialized 26 byte log entry
0709 13:04:08.316668 (+177735us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:08.316726 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.316824 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:09.357146 (+1040322us) raft_consensus.cc:1685] finished
0709 13:04:09.357165 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:09.357334 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19286,"raft.queue_time_us":27195,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":2686,"thread_start_us":151952,"threads_started":1,"wal-append.queue_time_us":375838}
W20260709 13:04:09.351137 19581 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:04:09.265081 19589 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:09.264358 19557 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:09.354826 19206 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.955s	user 0.008s	sys 0.002s
I20260709 13:04:09.352488 19564 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:09.354252 19441 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:09.370074 15246 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:09.361485 19547 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.039s	sys 0.021s
I20260709 13:04:09.352859 19559 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:09.374187 19616 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.821s	user 0.002s	sys 0.000s
I20260709 13:04:09.378257 19641 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:09.357733 19140 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:09.379492 19578 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.362989 19583 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:09.382660 19636 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:09.371670 15390 rpcz_store.cc:276] 0709 13:04:07.778174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.916349 (+138175us) service_pool.cc:224] Handling call
0709 13:04:07.916754 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:08.150968 (+234214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:08.151016 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:08.151648 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 13:04:08.363752 (+212104us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:08.363805 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.363890 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:09.258907 (+895017us) raft_consensus.cc:1685] finished
0709 13:04:09.258927 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:09.259095 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7247,"raft.queue_time_us":206096,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":11305,"thread_start_us":400578,"threads_started":2,"wal-append.queue_time_us":371124}
I20260709 13:04:09.387584 19609 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:09.384614 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 127685us
W20260709 13:04:09.368966 19534 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.035s	user 0.011s	sys 0.000s
I20260709 13:04:09.364398 19007 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:09.385419 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:09.351014 15399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2230) took 2884 ms (client timeout 1924 ms). Trace:
I20260709 13:04:09.397631 19626 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:09.471460 19519 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:09.516139 19311 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:09.516548 19311 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:09.517365 19311 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:09.369928 19412 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.399690 19212 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:09.399399 19588 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.520233 19412 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:09.521229 19588 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:09.400255 19635 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:04:09.524083 16025 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
W20260709 13:04:09.524816 19565 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.001s
I20260709 13:04:09.525265 19565 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:09.354161 18898 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:09.402535 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:09.374260 19286 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.010s	user 0.011s	sys 0.000s
I20260709 13:04:09.527222 19286 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.528020 18898 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:09.528774 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 524) took 1260 ms. Trace:
I20260709 13:04:09.529502 19286 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:09.403854 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:09.426631 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:09.385387 19563 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:09.535398 16028 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 9: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:09.387727 19648 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:09.473731 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 123808us
W20260709 13:04:09.372586 19634 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:04:09.480863 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 90275.8us
I20260709 13:04:09.484407 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:04:09.471663 19630 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.588s	user 0.004s	sys 0.001s
I20260709 13:04:09.414217 19511 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:09.486088 15319 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
W20260709 13:04:09.471259 19639 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:04:09.487254 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:09.477192 19017 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:09.476749 19636 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:09.488049 19429 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:09.559689 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:09.492007 19548 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:09.474009 19556 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:09.501610 19534 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:09.562655 19556 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:09.563594 19556 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.564499 19534 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:09.564671 19556 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:09.565096 19311 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:09.545164 19563 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.468546 19551 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:09.515523 19288 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.566530 19551 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.568624 19551 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:09.490504 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2683) took 1591 ms. Trace:
I20260709 13:04:09.494412 19645 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:04:09.569725 19645 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:09.570113 19645 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:09.570636 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2689) took 1639 ms. Trace:
I20260709 13:04:09.571041 19645 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.572547 19645 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:09.571242 15393 rpcz_store.cc:276] 0709 13:04:07.931394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.405398 (+474004us) service_pool.cc:224] Handling call
0709 13:04:08.405770 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:08.424746 (+ 18976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:08.424781 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:08.428780 (+  3999us) log.cc:844] Serialized 26 byte log entry
0709 13:04:08.753068 (+324288us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:08.753131 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.753235 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:09.570327 (+817092us) raft_consensus.cc:1685] finished
0709 13:04:09.570357 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:09.570552 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18546,"raft.queue_time_us":34710,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":18564,"thread_start_us":294391,"threads_started":1,"wal-append.queue_time_us":541056}
I20260709 13:04:09.495293 19583 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:09.429342 19605 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:09.499668 15399 rpcz_store.cc:269] 0709 13:04:06.466356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.467834 (+  1478us) service_pool.cc:224] Handling call
0709 13:04:09.350156 (+2882322us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b5400153bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:09.350932 (+   776us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528911616}
I20260709 13:04:09.415433 19564 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:09.575346 19017 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.575685 19564 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.577081 19564 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:09.398052 19381 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:09.415001 19441 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:09.579295 19441 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:09.580013 19636 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:09.580539 19441 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:09.583586 19565 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:09.587459 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:09.398042 19627 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.683s	user 0.000s	sys 0.003s
I20260709 13:04:09.427426 19206 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:09.503981 19571 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:09.589227 15394 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:09.564538 19491 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:04:09.590739 19206 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:09.591547 19491 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:09.591948 19491 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:09.505534 18745 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:09.592830 19491 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:09.512284 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:09.513870 19546 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:09.483896 19641 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:09.606518 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 131719us
I20260709 13:04:09.569263 15398 rpcz_store.cc:276] 0709 13:04:07.898936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.330864 (+431928us) service_pool.cc:224] Handling call
0709 13:04:08.331336 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:08.338131 (+  6795us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:08.338177 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:08.353896 (+ 15719us) log.cc:844] Serialized 26 byte log entry
0709 13:04:09.117023 (+763127us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b1800449b60. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:04:09.266339 (+149316us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:09.266455 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:09.266595 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:09.490016 (+223421us) raft_consensus.cc:1685] finished
0709 13:04:09.490063 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:09.490415 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8087,"raft.queue_time_us":31037,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":20916,"spinlock_wait_cycles":5942656,"thread_start_us":147069,"threads_started":1,"wal-append.queue_time_us":989175}
I20260709 13:04:09.515475 19552 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:09.531165 16027 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:04:09.530479 16029 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
W20260709 13:04:09.544999 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 60662.3us
I20260709 13:04:09.612730 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:09.529166 15325 rpcz_store.cc:276] 0709 13:04:08.267938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.387055 (+119117us) service_pool.cc:224] Handling call
0709 13:04:08.398652 (+ 11597us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:08.421094 (+ 22442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:08.421126 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:08.421621 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:04:08.891854 (+470233us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:08.891910 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.892016 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:09.528556 (+636540us) raft_consensus.cc:1685] finished
0709 13:04:09.528574 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:09.528712 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12617,"raft.queue_time_us":12778,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":19119,"thread_start_us":427847,"threads_started":1,"wal-append.queue_time_us":635180}
I20260709 13:04:09.550254 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:09.611423 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 68422.4us
I20260709 13:04:09.614581 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:09.616225 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:09.548832 19626 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:09.618598 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 68508.6us
I20260709 13:04:09.556360 19578 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:09.560519 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2682) took 1714 ms. Trace:
I20260709 13:04:09.623304 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:09.624449 15244 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:09.623524 15395 rpcz_store.cc:276] 0709 13:04:07.845801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.926112 (+ 80311us) service_pool.cc:224] Handling call
0709 13:04:07.926627 (+   515us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:08.181545 (+254918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:08.181565 (+    20us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:08.189797 (+  8232us) log.cc:844] Serialized 52 byte log entry
0709 13:04:08.600342 (+410545us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b48002001d8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366eb23aa1 00007f366eb1ab37 00007f366eb1a9ca 00007f366ec1226f 00007f366ec11f37 00007f366ec2655c 00007f366ec26508 00007f366ec26488 00007f366ec26443 00007f366ec256ec 00007f366db4fa96
0709 13:04:08.719961 (+119619us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:08.741866 (+ 21905us) log.cc:844] Serialized 14 byte log entry
0709 13:04:09.058645 (+316779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:09.058727 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:09.146858 (+ 88131us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:09.519860 (+373002us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b1800449ce0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d557 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:09.560270 (+ 40410us) raft_consensus.cc:1685] finished
0709 13:04:09.560294 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:09.560456 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":622917,"prepare.queue_time_us":21485,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":520571,"raft.run_cpu_time_us":6815,"raft.run_wall_time_us":581741,"spinlock_wait_cycles":74088192,"thread_start_us":695380,"threads_started":2,"wal-append.queue_time_us":525955}
I20260709 13:04:09.624747 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:09.561769 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 519) took 1755 ms. Trace:
I20260709 13:04:09.475057 19140 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:09.590988 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2685) took 1689 ms. Trace:
I20260709 13:04:09.625489 15394 rpcz_store.cc:276] 0709 13:04:07.902030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.331807 (+429777us) service_pool.cc:224] Handling call
0709 13:04:08.332157 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.589643 (+1257486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:09.590762 (+  1119us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54001554d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:09.590932 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2890530048}
I20260709 13:04:09.504606 19557 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:09.427614 19290 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:09.513100 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:09.594182 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 609) took 1558 ms. Trace:
I20260709 13:04:09.600677 15323 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:09.607422 16033 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:09.633239 16025 rpcz_store.cc:276] 0709 13:04:08.036060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.036274 (+   214us) service_pool.cc:224] Handling call
0709 13:04:08.056903 (+ 20629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.524593 (+1467690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:09.593951 (+ 69358us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54001801d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:09.594122 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3373575040}
I20260709 13:04:09.554143 19007 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.619122 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:09.619655 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:09.619731 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:09.620146 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:09.594098 19491 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:09.617897 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:09.625325 15318 rpcz_store.cc:276] 0709 13:04:07.805996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.133700 (+327704us) service_pool.cc:224] Handling call
0709 13:04:08.134014 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:08.139150 (+  5136us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:08.139176 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:08.145150 (+  5974us) log.cc:844] Serialized 26 byte log entry
0709 13:04:08.393991 (+248841us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:08.394130 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.394529 (+   399us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:09.373453 (+978924us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:09.561471 (+188018us) raft_consensus.cc:1685] finished
0709 13:04:09.561492 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:09.561708 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7532288,"thread_start_us":222001,"threads_started":1,"wal-append.queue_time_us":292059}
W20260709 13:04:09.620266 15290 connection.cc:256] RPC call timeout handler was delayed by -1.5246879389999322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 13:04:09.646121 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.645732 16028 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
W20260709 13:04:09.646806 15290 connection.cc:256] RPC call timeout handler was delayed by -1.4358761419999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 13:04:09.643410 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:09.630618 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:09.630991 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:09.630998 15399 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:09.632210 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:09.618705 16026 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:09.644974 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:09.647281 15290 connection.cc:256] RPC call timeout handler was delayed by -1.3928167950000443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 13:04:09.629724 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:09.659747 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:09.660751 15290 connection.cc:256] RPC call timeout handler was delayed by -1.1525167949999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:04:09.661306 15290 connection.cc:256] RPC call timeout handler was delayed by -1.025616795000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
I20260709 13:04:09.609124 19552 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:09.649037 15392 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:04:09.643456 15390 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:09.648298 15241 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:09.663926 15395 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:09.663334 15244 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:09.663323 15242 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:09.622371 19648 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:09.628872 19017 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:09.608668 19549 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:09.684983 15321 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:09.621948 19381 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:09.702437 15325 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:04:09.659498 19557 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:09.750888 15324 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:09.659762 19626 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:09.751528 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:09.752025 19655 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:04:09.759519 19641 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:09.762010 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:09.643776 19551 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:04:09.772264 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:09.964260 15394 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:04:09.846215 15290 leader_election.cc:336] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.511s (SENT)
W20260709 13:04:09.824803 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.969774 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:09.901950 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.960366 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:09.971066 15392 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:09.946946 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:09.878968 15398 raft_consensus.cc:2410] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:09.973875 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:09.974215 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:09.974542 15324 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:09.975297 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:09.975533 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:09.974828 15241 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.976125 15324 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:09.977023 15242 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:04:09.773078 16033 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:09.978022 15244 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:09.984217 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:09.984311 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:09.961347 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 341752us
I20260709 13:04:09.985034 15242 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:09.985553 15365 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:09.714358 19206 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.284s
W20260709 13:04:09.925503 19512 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.023s	sys 0.047s
I20260709 13:04:10.017120 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:10.019049 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:10.019057 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:10.021576 15242 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:10.005156 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 158983us
I20260709 13:04:10.006474 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:09.848439 19583 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.861850 18898 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:10.024148 15290 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.553s (SENT)
I20260709 13:04:09.961192 19007 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:09.862064 19605 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:10.030638 15290 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.682s (SENT)
W20260709 13:04:10.032435 15290 leader_election.cc:336] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.924s (SENT)
I20260709 13:04:09.974807 19578 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:10.042547 19605 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.042958 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:10.034137 19206 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:10.044759 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:10.017597 19458 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:10.004762 19381 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.022886 19441 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:09.782743 19549 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:10.034426 15290 leader_election.cc:336] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 2.100s (SENT)
I20260709 13:04:09.857254 19140 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.045632 15321 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:10.069873 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:10.022428 19512 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.023s	sys 0.048s
W20260709 13:04:10.058745 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.066179 19568 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 2.572s	user 0.013s	sys 0.021s
I20260709 13:04:10.019424 19417 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:04:10.005924 19546 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:04:10.092104 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:10.036922 19583 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.077409 15242 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:09.928284 19609 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.086202 15318 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:10.088868 15241 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:04:10.027926 19552 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.054150 19578 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:10.087283 19563 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:10.207451 15395 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:10.063638 19381 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:10.242256 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 236066us
I20260709 13:04:10.273757 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:10.276060 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:10.277510 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:10.282616 15321 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:10.282851 15365 leader_election.cc:400] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7.
I20260709 13:04:10.283346 15365 leader_election.cc:403] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:10.289412 19601 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 6. Current term is 7.
I20260709 13:04:10.294696 15365 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:10.207716 19441 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:10.302707 19601 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:10.302768 19441 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:10.303614 19601 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:10.304883 19601 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.095803 19626 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.284302 19206 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:10.287058 18898 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:10.288362 19559 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:10.378418 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.396194 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.414027 15392 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:10.362859 19552 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:10.427682 15325 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.655s	user 0.009s	sys 0.001s
I20260709 13:04:10.428284 15325 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:10.432016 15324 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:10.433604 15324 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:10.321735 19645 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.749s	user 0.002s	sys 0.008s
I20260709 13:04:10.448066 15321 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:10.314728 19491 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
W20260709 13:04:10.384506 19556 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.819s	user 0.014s	sys 0.001s
I20260709 13:04:10.368788 19583 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:10.312893 19557 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:10.306162 19441 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:10.367280 19206 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:10.517293 19561 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.040s	sys 0.036s
I20260709 13:04:10.506134 15390 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:10.371417 19549 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:10.507243 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 695) took 1122 ms. Trace:
I20260709 13:04:10.530929 16033 rpcz_store.cc:276] 0709 13:04:09.384373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.385122 (+   749us) service_pool.cc:224] Handling call
0709 13:04:10.506978 (+1121856us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54005f14d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:10.507149 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247991168}
I20260709 13:04:10.312088 19578 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:10.336261 19609 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:10.437361 19458 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:10.446852 18898 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:10.495461 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 472162us
I20260709 13:04:10.549175 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.550595 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.520206 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:10.437265 19511 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.025s	sys 0.114s
W20260709 13:04:10.524233 19564 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.947s	user 0.012s	sys 0.001s
I20260709 13:04:10.554607 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:10.545900 15321 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:10.406742 19559 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:10.524012 19557 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.523422 19206 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:10.551765 15324 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:10.542651 19578 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.553275 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.555395 15396 raft_consensus.cc:2376] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11. Re-sending same reply.
W20260709 13:04:10.560530 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 526086us
W20260709 13:04:10.556361 19511 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.025s	sys 0.114s
I20260709 13:04:10.564363 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:10.564389 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.565228 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.566869 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.569681 15324 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:10.584563 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:10.585601 15321 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:10.570731 15393 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:04:10.539602 19561 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.040s	sys 0.037s
I20260709 13:04:10.587864 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.588660 15391 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:10.592942 15396 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:10.562101 18745 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.563732 19441 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:10.572294 15290 leader_election.cc:336] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 2.120s (SENT)
I20260709 13:04:10.598479 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:10.600468 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:10.606383 19631 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.827s	user 0.010s	sys 0.009s
I20260709 13:04:10.612912 19288 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:10.615923 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:10.616653 16033 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:10.618696 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:10.619602 19596 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:10.620035 19596 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:10.620946 19596 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:10.561556 19567 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:04:10.560302 18898 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:10.631347 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 692) took 3141 ms. Trace:
I20260709 13:04:10.632704 16032 rpcz_store.cc:276] 0709 13:04:07.489698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.489875 (+   177us) service_pool.cc:224] Handling call
0709 13:04:07.490433 (+   558us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:08.406326 (+915893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.631096 (+2224770us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b540073fad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:10.631285 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018214144}
W20260709 13:04:10.600492 19663 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:10.631394 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:10.634876 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:10.571244 19557 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:10.639539 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.640141 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:10.643208 19140 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:10.643379 19523 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:10.644011 19523 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:10.643165 19596 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:10.644937 19523 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.648554 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:10.603415 15290 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 2.213s (SENT)
I20260709 13:04:10.661252 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:10.589677 19578 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.656324 15395 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:10.657569 16033 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:10.659868 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:10.632063 19381 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:10.661139 19669 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:10.680235 19669 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.680989 18898 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:10.601207 19441 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.682423 19605 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:10.683750 19441 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:10.633284 19675 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:10.679384 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:10.686656 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:10.687633 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.663597 19631 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:04:10.697230 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.601688 18745 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:10.686810 19668 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:04:10.637336 19626 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:04:10.723811 19665 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:10.726284 19670 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:10.726284 19573 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:10.686183 19606 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:10.774976 16033 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:10.754985 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:10.698400 19636 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.115s	user 0.010s	sys 0.007s
I20260709 13:04:10.687815 19559 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:10.806170 19670 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.826588 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.831812 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 509) took 1210 ms. Trace:
I20260709 13:04:10.854048 15245 rpcz_store.cc:276] 0709 13:04:09.620982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.621140 (+   158us) service_pool.cc:224] Handling call
0709 13:04:09.621502 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.627900 (+  6398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:09.627934 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:09.627975 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:09.628022 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.831403 (+1203381us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b540010ca54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:10.831489 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:10.831698 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14177024}
I20260709 13:04:10.832854 16031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 614) took 2109 ms. Trace:
I20260709 13:04:10.794734 19609 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:10.838624 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.855937 16031 rpcz_store.cc:276] 0709 13:04:08.723423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.723584 (+   161us) service_pool.cc:224] Handling call
0709 13:04:08.731336 (+  7752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.410729 (+679393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.832607 (+1421878us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b540067eb54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:10.832795 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431413632}
I20260709 13:04:10.858521 19589 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:10.866655 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1592) took 1056 ms. Trace:
I20260709 13:04:10.816538 19606 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:10.870110 15318 rpcz_store.cc:276] 0709 13:04:09.810090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.329882 (+519792us) service_pool.cc:224] Handling call
0709 13:04:10.407045 (+ 77163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:10.407364 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:10.567473 (+160109us) log.cc:844] Serialized 14 byte log entry
0709 13:04:10.865871 (+298398us) log.cc:844] Serialized 14 byte log entry
0709 13:04:10.866140 (+   269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:10.866214 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:10.866309 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.866403 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:10.866575 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":281431,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":217,"spinlock_wait_cycles":5192448,"thread_start_us":412110,"threads_started":2}
I20260709 13:04:10.879091 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:10.824851 19670 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:10.820082 19636 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.891557 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:10.891944 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 288568us
I20260709 13:04:10.892449 15397 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:10.869988 19589 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:10.909863 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.872094 19669 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:10.919487 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.867444 19609 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:10.923391 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:10.924556 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.925748 15397 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:10.928107 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:10.928411 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 227020us
W20260709 13:04:10.929905 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 289856us
I20260709 13:04:10.930244 15399 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:10.931595 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:10.932179 15399 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:10.940155 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:10.934553 19552 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.000s
I20260709 13:04:10.940862 15397 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:04:10.945447 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:10.947691 15996 leader_election.cc:336] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.512s (SENT)
I20260709 13:04:10.948202 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:10.958928 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.964184 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:10.964815 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:10.966152 15399 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:04:10.967908 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.969708 15399 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:10.973611 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:10.960578 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:10.943115 19669 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.962780 19557 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:10.979111 19669 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:10.981575 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1596) took 1137 ms. Trace:
I20260709 13:04:10.982005 15325 rpcz_store.cc:276] 0709 13:04:09.843850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.429171 (+585321us) service_pool.cc:224] Handling call
0709 13:04:10.429621 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:10.572489 (+142868us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:10.572519 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:10.573149 (+   630us) log.cc:844] Serialized 52 byte log entry
0709 13:04:10.891406 (+318257us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:10.891468 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.891532 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:10.981338 (+ 89806us) raft_consensus.cc:1685] finished
0709 13:04:10.981356 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:10.981512 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157463,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8051,"thread_start_us":420308,"threads_started":2,"wal-append.queue_time_us":363581}
I20260709 13:04:10.987821 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:10.989024 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:10.989235 19562 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:10.989710 19562 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:10.990094 19562 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:10.969379 19567 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:10.945719 19564 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:04:10.991307 15321 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:10.965648 19512 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:10.996409 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:10.950657 19578 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:10.975785 15399 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:11.007930 18745 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:11.007489 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:11.009080 19636 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.009248 15399 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:11.010792 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.950407 19606 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.013208 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:11.016770 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:10.966027 19589 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:10.997980 19675 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:10.975715 19492 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:11.029421 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.032975 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:11.026755 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:11.034364 15399 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:11.032174 19589 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:11.032531 19492 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:11.030247 19680 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:04:11.068631 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:11.024972 19625 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:11.055601 19578 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:11.002216 19596 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:11.071641 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:11.070829 19578 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:11.076828 19578 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.076090 19513 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:11.078802 19513 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:11.079208 19513 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:11.079851 19596 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.081462 19683 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:11.076031 19597 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.083448 19609 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.031118 19512 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:11.084281 19512 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:11.084707 19512 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:11.085285 19441 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:11.086421 19441 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:11.086758 19441 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:11.087870 19636 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.087594 19441 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.088371 19636 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.088814 19441 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:11.090896 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.091538 15249 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:11.085466 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:11.095047 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2292) took 2288 ms. Trace:
I20260709 13:04:11.095606 15247 rpcz_store.cc:276] 0709 13:04:08.806667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.811931 (+  5264us) service_pool.cc:224] Handling call
0709 13:04:08.812320 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.205819 (+393499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.094724 (+1888905us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54001397d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:11.094971 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556511104}
W20260709 13:04:11.096589 15999 connection.cc:256] RPC call timeout handler was delayed by -1.236534086000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
I20260709 13:04:11.097049 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2299) took 2239 ms. Trace:
I20260709 13:04:11.102736 15247 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:11.103816 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.105050 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.105823 15241 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:11.106115 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.107300 15247 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:11.108583 15241 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:11.097445 15250 rpcz_store.cc:276] 0709 13:04:08.857804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.193609 (+335805us) service_pool.cc:224] Handling call
0709 13:04:09.198801 (+  5192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.359374 (+160573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.096826 (+1737452us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b540001f754. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:11.096995 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71308672}
I20260709 13:04:11.112550 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:11.114830 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:11.116508 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.117400 15241 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 9: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:11.119464 15247 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:04:11.126047 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.111629 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:11.127411 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.130813 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:11.070003 19675 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:11.137271 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.144219 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.151912 19596 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:11.152530 15250 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:11.152978 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.153656 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.152578 19594 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:11.155025 19594 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:11.134416 19584 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.293s	user 0.022s	sys 0.020s
W20260709 13:04:11.157064 19584 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.385s	user 0.023s	sys 0.021s
I20260709 13:04:11.152534 19578 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:11.156672 19206 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.562s	user 0.005s	sys 0.005s
I20260709 13:04:11.142333 19561 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:11.141736 15244 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:11.083367 19597 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.139262 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.177822 15247 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:11.154270 15250 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:11.158650 16033 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:04:11.176258 15394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2706) took 1532 ms (client timeout 1583 ms). Trace:
W20260709 13:04:11.179616 15394 rpcz_store.cc:269] 0709 13:04:09.643918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.644667 (+   749us) service_pool.cc:224] Handling call
0709 13:04:11.176101 (+1531434us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54002b6454. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:11.176199 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604549376}
I20260709 13:04:11.181290 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.165268 15249 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:11.138586 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.110975 19595 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:11.110550 19567 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.125991 18898 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:11.169533 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:11.125801 19605 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:11.151953 19381 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:11.135171 19564 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:11.155874 19594 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.174491 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.175266 19566 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:11.150866 19562 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.184378 19578 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:11.187201 19561 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:11.182585 15241 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:11.182888 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 150376us
I20260709 13:04:11.187409 15394 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:11.154203 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.191179 15244 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:11.200537 19636 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:11.140583 19288 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:04:11.134984 19649 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:04:11.207563 19566 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:11.175761 19492 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:11.208369 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 613) took 2619 ms. Trace:
I20260709 13:04:11.211194 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2296) took 2394 ms. Trace:
I20260709 13:04:11.238972 15394 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:11.238965 15246 rpcz_store.cc:276] 0709 13:04:08.816588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.050151 (+233563us) service_pool.cc:224] Handling call
0709 13:04:09.050487 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.429032 (+378545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.210941 (+1781909us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54001a81d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:11.211129 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734561664}
I20260709 13:04:11.182490 15245 raft_consensus.cc:2410] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:11.190487 18898 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:11.179121 19206 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.263825 15241 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:11.265604 15250 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
W20260709 13:04:11.267733 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.235996 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:11.146800 19670 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.238633 16030 rpcz_store.cc:276] 0709 13:04:08.588850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.643645 (+ 54795us) service_pool.cc:224] Handling call
0709 13:04:08.678030 (+ 34385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.350448 (+672418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.207990 (+1857542us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54006fed54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:11.208290 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246198144}
I20260709 13:04:11.242358 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:11.244458 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 172930us
I20260709 13:04:11.244570 19701 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:11.245204 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.246305 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:11.204053 19689 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:11.247816 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:11.248003 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78580.3us
I20260709 13:04:11.252257 19687 raft_consensus.cc:2764] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:04:11.251907 19512 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.203668 19381 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.240432 19595 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:11.238791 19578 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:11.258682 19561 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.259407 19513 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.273164 15392 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:11.261229 18898 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:11.274991 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:11.275564 19690 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:11.297240 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.278622 15249 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:11.281551 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:11.299523 16032 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:11.281886 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.282354 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.284473 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:11.301928 16033 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:11.301734 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.285105 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:11.303277 16030 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:11.294580 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.281023 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:11.295812 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.306470 15325 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:11.325026 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:11.329033 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.329993 15365 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:11.331655 15316 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:11.335166 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.338147 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:11.338380 19566 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.339507 19566 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:11.339617 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:11.340296 15321 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:11.310101 19458 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:11.343155 19458 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:11.309840 19402 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:11.346719 19402 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.347193 19402 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:11.347440 19691 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:04:11.190338 19567 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.352329 19567 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.289968 19595 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:11.354696 19595 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.356052 19595 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.356715 19511 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:11.357195 19511 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:11.361104 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 694) took 1979 ms. Trace:
I20260709 13:04:11.361562 16027 rpcz_store.cc:276] 0709 13:04:09.384053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.387361 (+  3308us) service_pool.cc:224] Handling call
0709 13:04:09.398665 (+ 11304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:09.613248 (+214583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.360801 (+1747553us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400632c54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:11.361034 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303897344}
W20260709 13:04:11.364728 19672 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.561s	user 0.001s	sys 0.001s
I20260709 13:04:11.366883 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.338899 15318 raft_consensus.cc:2376] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14. Re-sending same reply.
I20260709 13:04:11.372637 16030 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:11.374156 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.375355 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.380642 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.381649 15316 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:11.382923 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.390067 15321 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:11.393539 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.395840 15321 raft_consensus.cc:2393] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:11.289609 19381 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:11.287371 19512 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.397883 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.407917 15325 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:11.408851 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.409503 15325 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:04:11.411057 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.405879 15316 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.406983 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:11.420083 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.275808 19701 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:11.292527 19513 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.423272 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.425068 19596 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.330883 19562 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.430814 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:11.433727 19693 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:04:11.434590 19700 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:11.306667 19690 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:11.430814 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.331384 19689 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:11.290525 19578 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
I20260709 13:04:11.442592 15318 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:11.443261 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:09.476377 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:11.451713 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.370086 19702 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 13:04:11.423847 19492 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:11.469305 19609 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.469910 19551 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:11.470518 19557 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:11.471153 19552 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:11.471725 19636 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.437028 19605 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:04:11.358120 19511 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.438783 19288 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:04:11.511773 19690 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.525736 19288 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:11.466499 19597 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:11.510986 19595 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.499993 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:11.503062 19697 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:11.502472 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.486438 19609 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:11.496716 15319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 527) took 2294 ms (client timeout 1593 ms). Trace:
W20260709 13:04:11.540760 15319 rpcz_store.cc:269] 0709 13:04:09.202518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.203432 (+   914us) service_pool.cc:224] Handling call
0709 13:04:11.496459 (+2293027us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54004038d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:11.496603 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603077376}
I20260709 13:04:11.497743 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2708) took 1747 ms. Trace:
I20260709 13:04:11.542017 15395 rpcz_store.cc:276] 0709 13:04:09.750553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.771363 (+ 20810us) service_pool.cc:224] Handling call
0709 13:04:11.497562 (+1726199us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54001d9a54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:11.497680 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538580352}
I20260709 13:04:11.528929 19589 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:11.504681 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.495909 19640 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:11.507385 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:11.546592 16031 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:11.509042 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.513836 19593 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:11.519837 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:11.520491 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:11.491963 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.466056 19523 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.499275 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:11.531416 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 111463us
I20260709 13:04:11.555371 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:11.463281 19698 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:11.516243 19206 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:11.478410 19579 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.506390 19670 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:11.563928 19206 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:11.564589 19206 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:11.433714 18898 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.565634 19206 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.568037 18898 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:11.550745 19511 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.573184 19669 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:11.534559 19381 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:11.577205 19381 consensus_queue.cc:1243] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:11.577977 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2649) took 1946 ms. Trace:
I20260709 13:04:11.578455 15323 rpcz_store.cc:276] 0709 13:04:09.631885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.633872 (+  1987us) service_pool.cc:224] Handling call
0709 13:04:09.634164 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:10.094835 (+460671us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:10.598832 (+503997us) log.cc:844] Serialized 14 byte log entry
0709 13:04:10.909725 (+310893us) log.cc:844] Serialized 14 byte log entry
0709 13:04:10.910484 (+   759us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:10.910552 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:10.910624 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.575784 (+665160us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b18003c84a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:11.577716 (+  1932us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54001c61d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:11.577769 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:11.577915 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7998,"prepare.queue_time_us":588340,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":3727,"raft.queue_time_us":1425,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":3722,"spinlock_wait_cycles":1061162496,"thread_start_us":805536,"threads_started":2,"wal-append.queue_time_us":346637}
W20260709 13:04:11.592455 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.595921 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.597760 15323 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:11.550050 16025 raft_consensus.cc:2376] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12. Re-sending same reply.
I20260709 13:04:11.559710 16028 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:11.564136 19579 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.579998 19698 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:11.524574 19551 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.546193 19708 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:04:11.529981 19552 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.560642 19523 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.503705 19689 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.584228 19606 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:11.585381 19402 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.524255 19557 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:11.532384 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 89228.7us
I20260709 13:04:11.586035 19546 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:11.545670 15316 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:11.535727 19636 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.546058 19640 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:11.611186 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.624449 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:11.624781 15318 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:11.613130 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:11.615774 15323 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:11.617758 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:11.556473 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:11.627403 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 71002.7us
I20260709 13:04:11.586813 19675 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:11.610097 19698 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:11.625146 15320 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:11.619515 15321 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:11.629873 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 194185us
I20260709 13:04:11.634202 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:11.629132 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.636610 15249 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:11.641953 18898 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:11.643060 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.643203 19605 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:11.644268 15246 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:11.644848 15249 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:11.646059 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.646440 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.647622 18898 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:11.648378 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.648403 15250 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:11.649084 15247 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:11.650449 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.650974 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.646998 15249 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:11.654276 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.655203 15250 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:11.655474 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.652801 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.657075 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:11.653040 19605 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:11.658046 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.658895 18898 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:11.659071 15241 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:11.659407 18898 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:11.658298 19605 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:11.659885 18898 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.660307 19605 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.667421 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:11.669198 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.670404 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.671291 15241 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:11.673280 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.675765 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:11.678153 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.594276 19593 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:04:11.547232 19701 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.683023 19701 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.682741 19640 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.683910 19640 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:11.682092 15241 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:11.671049 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:11.714912 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.687330 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:11.631108 19441 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:11.635336 19546 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:11.702673 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.718825 15391 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 7: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:11.733640 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:11.734790 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:11.735394 15391 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:11.731046 15394 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:11.731752 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:11.739456 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:11.739260 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 218844us
I20260709 13:04:11.686612 19288 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:11.741888 15396 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:04:11.743693 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72930.6us
W20260709 13:04:11.757279 15390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2709) took 2006 ms (client timeout 1543 ms). Trace:
I20260709 13:04:11.747121 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:11.747881 19492 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:11.750587 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.758777 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2253) took 1210 ms. Trace:
I20260709 13:04:11.759167 15392 rpcz_store.cc:276] 0709 13:04:10.548778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.548912 (+   134us) service_pool.cc:224] Handling call
0709 13:04:11.758591 (+1209679us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54001dae54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:11.758722 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662414720}
I20260709 13:04:11.753564 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.760505 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:11.761482 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:11.754336 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.762007 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:11.763535 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:11.764192 16024 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:04:11.757691 15390 rpcz_store.cc:269] 0709 13:04:09.751029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.761744 (+ 10715us) service_pool.cc:224] Handling call
0709 13:04:11.757104 (+1995360us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b540026ff54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:11.757210 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1234707840}
I20260709 13:04:11.768049 15393 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:11.770038 15395 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:11.772032 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:11.772158 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 160155us
I20260709 13:04:11.702157 19594 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:11.778023 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.775985 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:11.778964 16031 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:04:11.779681 15390 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:11.731071 19700 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:11.695518 19712 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:11.783301 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:11.783850 16030 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:11.775267 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.783301 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:11.784643 15249 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:11.780244 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.787328 15250 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:11.795708 16025 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:04:11.693132 19605 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.763589 19715 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:11.802995 15398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2701) took 2187 ms (client timeout 1558 ms). Trace:
W20260709 13:04:11.803645 15398 rpcz_store.cc:269] 0709 13:04:09.615872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.616003 (+   131us) service_pool.cc:224] Handling call
0709 13:04:11.802719 (+2186716us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400194bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:11.802900 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601892096}
I20260709 13:04:11.775283 19669 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:11.807075 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66241.4us
I20260709 13:04:11.820946 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:11.824563 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:11.742851 19546 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.808240 19593 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:11.827865 19556 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:11.828572 19707 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:11.828680 19669 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:11.755295 19706 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:04:11.855437 19579 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.856350 19579 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:11.857288 19579 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:04:11.857656 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.857676 19579 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:11.862643 19402 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:11.864290 19402 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.864784 19402 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.822293 19594 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:11.866554 19594 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.866971 19594 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:11.868850 15391 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:11.818580 19715 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:11.855302 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53091.8us
I20260709 13:04:11.884140 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:11.814844 19670 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:11.896220 15393 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:11.861830 19579 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:11.900008 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:11.902992 15392 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:11.901669 15241 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:04:11.890501 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.835546 19726 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:11.918646 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:11.921927 15249 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:11.882160 19609 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.901335 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.922771 15247 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:11.924124 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:11.908797 16024 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:11.831622 19573 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:04:11.903716 19676 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:04:11.903872 19593 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.857718 19700 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:11.925098 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:12.076428 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:12.021189 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2284) took 4705 ms. Trace:
W20260709 13:04:12.066208 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:12.078948 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:11.938747 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 165028us
I20260709 13:04:12.078118 15248 rpcz_store.cc:276] 0709 13:04:07.315656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.429983 (+114327us) service_pool.cc:224] Handling call
0709 13:04:08.094787 (+664804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.218057 (+1123270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.208965 (+1990908us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540025cbd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:12.020986 (+812021us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540025cbd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:12.021131 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3422423680}
W20260709 13:04:11.950902 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.021986 15397 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:04:11.975625 15246 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
W20260709 13:04:12.078357 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 153325us
I20260709 13:04:11.910187 19625 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:11.965166 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:11.949138 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 47873.9us
I20260709 13:04:12.086907 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:11.925864 19552 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.978329 19557 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.931294 19712 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:12.088238 15214 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:12.084156 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:12.089265 19573 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:12.089684 19573 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:12.089716 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:11.964730 19290 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:12.093132 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:12.093896 19701 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:12.084919 16024 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:04:12.094834 19701 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:12.080564 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:11.925526 19670 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:12.095260 19701 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.094954 19707 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:12.095647 19670 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:12.029345 19605 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:12.095914 19707 consensus_queue.cc:1243] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:12.096035 19344 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:11.926064 19523 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:12.006894 19381 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:12.090265 19573 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.008523 19551 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:11.922792 19726 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:12.090739 19565 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:12.091293 19177 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:12.009996 19492 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:11.985741 19729 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.992666 19549 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:12.088446 19552 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:12.020568 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 500) took 4280 ms. Trace:
I20260709 13:04:12.120043 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:12.121294 16031 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:12.089457 19712 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.011277 19715 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:12.074585 19589 consensus_meta.cc:287] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.003s
I20260709 13:04:11.910964 19702 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.196s
I20260709 13:04:12.097644 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:12.096324 19670 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:11.924993 19579 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:12.104537 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 180486us
I20260709 13:04:12.025499 19716 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:12.106148 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:12.027256 19546 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:11.908365 18898 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.028625 19636 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:12.112195 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:12.112771 19177 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:12.205152 19177 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:12.205282 16029 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:12.205513 18898 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:12.205616 19593 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:12.095700 19701 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:12.195431 19731 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:04:12.113901 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:12.208645 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 94834.4us
I20260709 13:04:12.208750 19731 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:12.209443 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:12.004869 19609 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:12.210281 19605 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:12.210855 19605 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:12.209448 19731 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.211836 19731 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:12.211910 19605 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.091801 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:12.214836 15392 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:12.215176 19597 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:12.215649 19597 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:12.216107 19595 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.002s
I20260709 13:04:12.216564 19595 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:12.217522 19589 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:12.221964 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:12.080785 19594 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.222697 15249 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.222784 19713 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:12.223222 19713 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:12.224094 19713 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.224313 19594 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:12.225277 19713 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:12.103425 19625 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:12.203882 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 425931us
I20260709 13:04:12.227957 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:12.016889 19698 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.157740 15247 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:12.168864 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:12.086621 19676 consensus_queue.cc:1243] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:12.167243 19551 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.060537 19402 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:12.241632 19551 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.244189 19551 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:12.245875 19698 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:12.250876 19625 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.229972 15249 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:12.283689 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:12.120428 15243 rpcz_store.cc:276] 0709 13:04:07.740273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.740422 (+   149us) service_pool.cc:224] Handling call
0709 13:04:07.769578 (+ 29156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:08.101806 (+332228us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:08.262718 (+160912us) log.cc:844] Serialized 14 byte log entry
0709 13:04:08.718444 (+455726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:08.718525 (+    81us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:08.718598 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:09.143788 (+425190us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:11.326906 (+2183118us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b18003bb060. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419
0709 13:04:12.020285 (+693379us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540011a8d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:12.020331 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:12.020471 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":268498,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4370,"raft.queue_time_us":187,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":9506,"spinlock_wait_cycles":1037125120,"thread_start_us":605816,"threads_started":2,"wal-append.queue_time_us":521248,"wal-append.run_cpu_time_us":7073,"wal-append.run_wall_time_us":1486506}
I20260709 13:04:12.228173 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:12.285826 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 57731.7us
I20260709 13:04:12.286567 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:12.287674 15362 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:12.094355 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:12.230520 15394 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:04:12.108218 19523 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:12.226027 19596 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.784s	user 0.009s	sys 0.002s
W20260709 13:04:12.232529 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 134929us
I20260709 13:04:12.108494 19565 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:12.237417 19640 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:12.201675 19716 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:12.167150 19556 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:12.237396 19669 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:12.252902 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:12.330771 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 78000us
I20260709 13:04:12.105777 19557 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:12.108421 19726 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:12.265785 19710 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.568s	user 0.008s	sys 0.003s
I20260709 13:04:12.268066 19594 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.270689 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:12.121747 19549 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:12.105057 19381 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.276070 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:12.112646 19709 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:12.278522 15395 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:12.302489 19706 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:12.280058 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:12.099856 19344 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.282469 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:12.279460 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.127043 19729 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:12.302301 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 472001us
I20260709 13:04:12.294368 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:12.300899 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:12.290380 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 196084us
I20260709 13:04:12.297628 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:12.302393 15317 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:04:12.299641 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:12.361521 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:12.361522 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:12.361594 15316 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:12.338060 19523 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:12.322825 19640 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.325943 19596 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:12.325826 19716 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.326869 19556 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.328563 19728 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:12.334688 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.338523 19417 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:12.334771 19593 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.334432 19557 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.315601 19589 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:12.301805 19017 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:12.302405 19683 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:12.256177 19731 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.281955 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:12.361891 15325 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.381165 19636 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:12.293884 15323 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:04:12.404583 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 122710us
I20260709 13:04:12.390516 19417 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.413770 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:12.414712 15323 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:12.413810 15395 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:12.384402 19698 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:12.371897 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.427874 15317 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:04:12.346100 19669 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:12.379745 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:12.314571 19492 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:04:12.390056 19637 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:04:12.395767 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:12.438809 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 73080.2us
I20260709 13:04:12.369699 19640 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.412675 19676 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:12.442986 15325 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:12.350176 19594 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.402352 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2259) took 1849 ms. Trace:
I20260709 13:04:12.427512 19698 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.398015 19557 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:12.451637 19730 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:04:12.436883 19523 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.460327 19597 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.461625 19597 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.393937 19596 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.462306 19596 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.377960 19609 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:04:12.390576 19715 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:04:12.404515 19716 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:12.402359 19017 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:12.381583 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.446101 19636 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:12.463824 19729 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:12.436015 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56349.7us
I20260709 13:04:12.436825 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.444294 15395 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:12.474172 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:12.464185 19698 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.478701 19596 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:12.473135 19017 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.420495 19417 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:12.397578 19593 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.446799 15323 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:12.447508 15399 rpcz_store.cc:276] 0709 13:04:10.552902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.036865 (+483963us) service_pool.cc:224] Handling call
0709 13:04:11.114358 (+ 77493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:11.408170 (+293812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:11.408199 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:11.425075 (+ 16876us) log.cc:844] Serialized 26 byte log entry
0709 13:04:11.523048 (+ 97973us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:11.523104 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.523241 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:12.265151 (+741910us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:12.398382 (+133231us) raft_consensus.cc:1685] finished
0709 13:04:12.398407 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:12.402279 (+  3872us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24403,"raft.queue_time_us":37822,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":14014720,"thread_start_us":366445,"threads_started":2,"wal-append.queue_time_us":191569}
W20260709 13:04:12.487722 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.363300 19709 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:12.490168 15399 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:12.448933 15396 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:04:12.450965 16025 raft_consensus.cc:1217] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Deduplicated request from leader. Original: 6.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 13:04:12.382789 19565 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.450399 19140 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.464268 16026 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:12.495136 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:12.390914 19549 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.501052 16029 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:12.499881 19140 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.502599 15248 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:12.504946 19573 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.496439 19594 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:12.507730 19701 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:12.471477 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.472393 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:12.513622 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:12.476205 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:12.481192 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.515905 15317 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:12.518167 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:12.520009 15396 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:12.483171 19290 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:12.525058 19290 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.525552 19290 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:12.526592 19492 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:12.527195 19492 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:12.528096 19492 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.530208 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:12.530511 19637 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:12.531234 19609 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:12.531751 15393 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:12.534500 19344 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:12.493422 16025 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:04:12.365517 15319 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:12.544044 15391 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:04:12.544440 15391 pending_rounds.cc:85] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 7
I20260709 13:04:12.544647 15391 pending_rounds.cc:107] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:04:12.544868 15391 raft_consensus.cc:2889] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:12.546129 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:12.495405 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.548604 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.549170 15323 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:12.549929 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:12.542503 19594 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:12.553022 19594 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:12.553463 19737 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:04:12.554262 19690 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:12.554697 19690 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:12.555564 19593 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:12.556638 19731 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:12.557032 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.559935 15243 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:04:12.552798 15397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2282) took 1626 ms (client timeout 1940 ms). Trace:
W20260709 13:04:12.561604 15397 rpcz_store.cc:269] 0709 13:04:10.926408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.963902 (+ 37494us) service_pool.cc:224] Handling call
0709 13:04:12.543567 (+1579665us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540009abd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:12.552725 (+  9158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2430211456}
I20260709 13:04:12.444017 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.521956 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:12.524116 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.492597 15395 raft_consensus.cc:3055] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:12.537330 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.515952 19381 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:12.515460 19683 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:04:12.541486 19290 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.566361 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:12.572978 15247 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:12.568222 15325 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:12.566893 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:12.575273 15245 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:12.575783 15399 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:12.570624 15390 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:12.567158 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:12.577490 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:12.568005 15395 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:12.499267 19709 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.578127 15244 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:12.578887 15395 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.579843 15395 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.553483 19594 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.582012 15249 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:04:12.542356 19556 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:12.583374 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:12.584012 15250 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:04:12.523310 19728 raft_consensus.cc:2764] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:04:12.585521 15244 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:12.577502 19609 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.586993 19609 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.589226 19609 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:12.590617 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:12.591571 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:12.555593 19690 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.592432 15320 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:04:12.594362 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72495.2us
I20260709 13:04:12.597441 15319 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:12.599663 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.600333 15317 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:12.601970 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:12.603040 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.603711 15324 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:12.604636 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.569042 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:12.606302 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.607347 15325 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:12.609680 15244 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:12.611398 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:12.612169 15241 raft_consensus.cc:2368] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13.
I20260709 13:04:12.655870 15324 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:12.636375 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:12.638876 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.617569 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:12.634120 15325 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:12.598486 19565 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:12.659264 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:12.659888 15324 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:12.660373 15393 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:12.662519 15395 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:12.663133 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:12.617471 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:12.637950 15999 leader_election.cc:400] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13.
I20260709 13:04:12.664904 15999 leader_election.cc:403] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:12.659894 15241 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:12.664103 15250 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:12.664151 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:12.668089 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:12.669581 15242 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:12.658356 19730 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:12.675742 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.614182 19728 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.562733 19719 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.672214 19637 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13.
I20260709 13:04:12.493112 19669 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.612763 19596 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:12.612916 19381 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.671972 15324 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:12.665817 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:12.680486 15325 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:12.671070 19690 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:12.655609 19609 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.599241 19731 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.613010 19674 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:12.680493 19714 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:04:12.599532 19640 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.707156 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:12.725014 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:12.706629 19730 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:12.732841 19730 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.672930 19605 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:04:12.736773 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:12.678544 19670 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.677232 19177 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.735613 19596 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:12.773797 19596 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.774943 19557 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.769497 19712 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:04:12.782385 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.784444 19748 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:12.727793 19609 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:12.787015 15146 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 136) took 20128 ms (client timeout 15000 ms). Trace:
I20260709 13:04:12.787312 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:12.787945 19593 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:12.788229 15392 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:12.788370 19593 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.788743 19593 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.789929 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2305) took 1143 ms. Trace:
I20260709 13:04:12.760140 19606 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:12.790485 15246 rpcz_store.cc:276] 0709 13:04:11.646020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.646140 (+   120us) service_pool.cc:224] Handling call
0709 13:04:12.789698 (+1143558us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b540010c054. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:12.789842 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635863808}
I20260709 13:04:12.803660 19676 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:12.804764 19676 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.790671 19606 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.806839 19606 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:12.807050 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.704546 19381 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.810425 19344 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.811064 15395 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:12.811107 19344 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.812299 19381 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:12.813671 19344 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:12.814404 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 250981us
I20260709 13:04:12.735771 19700 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:12.816509 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:12.822994 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.829973 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:12.831516 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:12.832525 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:12.833964 19636 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:12.834483 19551 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:12.834981 19551 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:12.835863 19551 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.836887 19551 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:12.837029 19670 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:12.834519 19636 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.838918 19636 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:12.841804 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.699579 19719 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:12.844823 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 472695us
W20260709 13:04:12.833395 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 108482us
I20260709 13:04:12.847846 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:12.854326 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:12.854944 19742 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:04:12.855976 19177 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:12.855062 16024 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:12.857445 15321 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:12.865336 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:12.867914 15996 leader_election.cc:336] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.593s (SENT)
I20260709 13:04:12.766978 19637 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:04:12.822925 19700 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.787325 19609 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:12.874209 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:12.875286 15320 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:12.822551 19573 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:12.873880 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:12.920150 15243 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:04:12.856245 19724 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:12.878090 15245 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:04:12.921021 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56656.3us
I20260709 13:04:12.805981 19017 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.838924 19290 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:12.880050 15291 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:12.894840 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.691246 19728 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.927363 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:12.930220 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:12.926326 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 189604us
I20260709 13:04:12.934486 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:12.934901 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:12.936450 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:12.863209 19675 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:12.864027 19523 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:12.939847 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:12.942540 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.941190 15321 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:12.943408 15318 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:12.943264 15324 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:12.943203 15316 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:12.944707 19573 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.944988 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.945282 19573 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.946033 19017 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:12.946807 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2298) took 1214 ms. Trace:
I20260709 13:04:12.947563 19573 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:12.948194 19714 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:12.948596 19714 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:12.948990 19714 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:12.803696 19726 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:12.956861 19288 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:12.957773 19441 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:12.863691 19749 raft_consensus.cc:2764] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:04:12.961319 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:12.964406 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:12.878511 19701 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:12.990556 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 110590us
I20260709 13:04:12.972337 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:12.992446 15247 raft_consensus.cc:2376] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8. Re-sending same reply.
I20260709 13:04:12.945655 15317 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
W20260709 13:04:12.964694 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 119103us
I20260709 13:04:12.724253 19731 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.987133 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:12.870309 19417 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.986155 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:12.987972 15392 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:12.877988 19700 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:12.923959 19724 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.877368 19698 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.932044 19368 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.947206 15391 rpcz_store.cc:276] 0709 13:04:11.732720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.869734 (+137014us) service_pool.cc:224] Handling call
0709 13:04:12.543701 (+673967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:12.571551 (+ 27850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.946607 (+375056us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b540009abd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:12.946748 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549248256}
I20260709 13:04:12.973178 15324 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:13.023597 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:12.931519 19609 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:04:13.001528 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:13.025637 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:13.029112 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:13.031024 19288 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:13.023599 15396 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:13.015852 19701 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:13.042654 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:12.949045 18898 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.021747 19724 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:12.961225 19730 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:12.969019 19597 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:13.014578 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:13.035501 19492 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:13.017064 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:13.060374 15395 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:12.961831 19523 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.707770 19674 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:12.922981 19702 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:04:12.969977 19556 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.042950 15317 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:04:13.013260 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 48942.1us
W20260709 13:04:13.076256 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:12.787606 15146 rpcz_store.cc:269] 0709 13:03:52.658727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.662418 (+  3691us) service_pool.cc:224] Handling call
0709 13:04:12.786703 (+20124285us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:02.635175 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:02.635806 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:02.635841 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:04:02.635862 (+    21us) tablet.cc:662] Decoding operations
0709 13:04:02.637321 (+  1459us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:02.637381 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:02.637408 (+    27us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:04:02.640298 (+  2890us) tablet.cc:701] Row locks acquired
0709 13:04:02.640313 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:04:02.640469 (+   156us) write_op.cc:270] Start()
0709 13:04:02.640571 (+   102us) write_op.cc:276] Timestamp: P: 1783602242640424 usec, L: 0
0709 13:04:02.640587 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:04:02.641368 (+   781us) log.cc:844] Serialized 7158 byte log entry
0709 13:04:04.143468 (+1502100us) op_driver.cc:464] REPLICATION: finished
0709 13:04:04.411186 (+267718us) write_op.cc:301] APPLY: starting
0709 13:04:04.416573 (+  5387us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:04.550644 (+134071us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:04.604052 (+ 53408us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:04.816880 (+212828us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:04.817402 (+   522us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=36
0709 13:04:04.817456 (+    54us) write_op.cc:312] APPLY: finished
0709 13:04:04.818041 (+   585us) log.cc:844] Serialized 125 byte log entry
0709 13:04:04.936510 (+118469us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:05.008238 (+ 71728us) write_op.cc:454] Released schema lock
0709 13:04:05.008340 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:05.335523 (+327183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:05.335571 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":988643,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":237421,"apply.run_cpu_time_us":76995,"apply.run_wall_time_us":939101,"num_ops":18,"prepare.queue_time_us":330643,"prepare.run_cpu_time_us":32775,"prepare.run_wall_time_us":203853,"raft.queue_time_us":516084,"raft.run_cpu_time_us":39742,"raft.run_wall_time_us":693440,"replication_time_us":991671,"thread_start_us":726106,"threads_started":5,"wal-append.queue_time_us":646364,"wal-append.run_cpu_time_us":21017,"wal-append.run_wall_time_us":2374587}]]}
I20260709 13:04:12.870505 19593 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.051818 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:13.016124 15999 leader_election.cc:336] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.645s (SENT)
I20260709 13:04:12.969462 19675 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.014591 19017 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:04:13.036441 19441 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:13.057852 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.057652 19701 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:13.062371 19523 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:13.067440 19698 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.067845 19719 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.062393 19757 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:13.068454 19597 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:13.060575 19730 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:13.050714 19381 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.082748 19556 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.083287 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:13.119068 15244 raft_consensus.cc:2410] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:13.084438 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.119696 15324 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:04:13.120285 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 104206us
I20260709 13:04:13.057312 19709 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:13.086911 15241 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:13.085728 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:13.299654 19523 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.301261 19556 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.301478 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:13.303375 19557 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.106310 15392 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
W20260709 13:04:13.075517 19713 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.850s	user 0.012s	sys 0.000s
I20260709 13:04:13.304939 19523 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.309119 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:13.309835 16032 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:13.312220 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:13.313014 15318 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:13.107612 15250 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:13.315189 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:13.315409 19636 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.316465 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:13.317636 19636 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.320421 19732 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:13.320971 19732 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:13.324329 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 552) took 1070 ms. Trace:
I20260709 13:04:13.325003 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1578) took 1121 ms. Trace:
I20260709 13:04:13.325410 15248 rpcz_store.cc:276] 0709 13:04:12.203380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.203908 (+   528us) service_pool.cc:224] Handling call
0709 13:04:12.204256 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:12.503033 (+298777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.324773 (+821740us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54004493d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:13.324944 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":685257600}
I20260709 13:04:13.326607 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:13.327721 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:13.328433 15248 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:13.324775 15390 rpcz_store.cc:276] 0709 13:04:12.259610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.500135 (+240525us) service_pool.cc:224] Handling call
0709 13:04:12.570421 (+ 70286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:12.576796 (+  6375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.324084 (+747288us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b54001d9f50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:13.324251 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160590592}
I20260709 13:04:13.060797 19492 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.110404 15242 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:13.108608 15136 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.246s	user 0.001s	sys 0.012s
W20260709 13:04:13.338308 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.113086 19726 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.114274 15394 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:13.123076 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:13.231432 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 237785us
I20260709 13:04:13.130934 19593 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:13.104655 19573 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:13.337670 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:13.113679 19640 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.286616 19731 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.286909 19290 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:13.344007 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 258372us
I20260709 13:04:13.175663 19730 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.188755 19701 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.349421 19750 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:13.289803 15320 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:13.172634 19597 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.356192 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.160187 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:13.290620 19715 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:13.291230 19675 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.291334 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:13.109211 19441 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.293757 19724 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.119757 19381 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.107375 19757 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.296190 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:13.297501 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:13.284317 19690 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.000s
I20260709 13:04:13.283638 19417 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.298698 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:13.366550 15325 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:13.298969 19749 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:13.131924 19594 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 13:04:13.300029 15395 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:13.107491 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:13.367653 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.373703 15319 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:13.375422 15319 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:13.375934 16024 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:04:13.314020 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:13.331413 15397 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:13.378090 15318 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:13.331717 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:13.329756 15322 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:04:13.334978 16031 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:13.302214 15241 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:13.055871 18898 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.340883 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:13.163367 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:13.342053 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:13.345216 15250 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:13.344066 19290 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.347996 19565 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:13.358333 19557 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:04:13.358860 19511 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.358709 19556 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:04:13.351215 15321 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:13.338637 19606 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
I20260709 13:04:13.352313 15320 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:04:13.357406 15392 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:13.295344 19714 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.342561 19492 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:13.453162 19714 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:13.450614 19573 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:13.454209 19605 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:13.454412 19573 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.454811 19605 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:13.454977 19573 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:13.455915 19605 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.423329 19750 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:04:13.457545 19605 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:13.330189 19709 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:13.361642 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.361106 19441 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:13.367601 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:13.367707 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:13.368865 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.369876 16032 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:13.368099 19702 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.399683 15325 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:13.437019 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 107046us
I20260709 13:04:13.405118 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.408954 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.438514 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:13.439232 15244 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:13.406323 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.491523 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.491935 15250 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:13.492309 15390 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:04:13.493448 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.465569 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.380645 15318 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:13.390717 15247 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:04:13.369488 19636 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:04:13.492069 19749 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:04:13.494602 19702 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.502748 19549 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:13.450543 19606 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.503262 19749 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:13.503662 19749 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:13.450819 19511 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.502307 19593 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:13.505862 19593 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.506790 19511 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.508095 19593 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:13.367931 19757 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:13.509835 19709 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.511324 19724 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.511426 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.512723 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:13.414024 19625 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:04:13.378742 19594 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.451254 19685 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.463028 15242 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:13.496222 15249 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:13.438509 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.491097 19714 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.530661 19685 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.532064 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:13.532994 15320 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:13.533402 19715 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:13.533993 19715 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:13.486621 19417 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:04:13.500991 19731 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:13.536038 19290 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.536573 19417 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:13.537001 19417 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:13.486606 19690 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:04:13.512813 16024 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:04:13.424829 19402 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:13.539350 19402 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:13.379601 19640 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.165s
I20260709 13:04:13.540355 19594 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.504558 19749 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.541713 19749 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:13.542912 15322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 529) took 4339 ms (client timeout 1512 ms). Trace:
W20260709 13:04:13.543318 15322 rpcz_store.cc:269] 0709 13:04:09.203223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.203538 (+   315us) service_pool.cc:224] Handling call
0709 13:04:13.542706 (+4339168us) spinlock_profiling.cc:243] Waited 4.09 s on lock 0x7b54002ee0d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:13.542815 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9398442368}
I20260709 13:04:13.545526 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:13.547281 19381 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:13.548528 19573 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.504769 19606 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.550943 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:13.504601 19702 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.552193 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:13.515452 16029 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:13.516264 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:13.500353 19674 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.289845 19700 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:13.523072 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 114212us
I20260709 13:04:13.587548 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.590432 19625 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:13.523391 15392 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:13.595156 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.595970 15392 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
W20260709 13:04:13.524606 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59168us
W20260709 13:04:13.600063 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.530877 19714 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.552309 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.553323 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2717) took 1005 ms. Trace:
I20260709 13:04:13.523380 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:13.554651 15363 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:13.518886 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:13.526104 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:13.572284 15241 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:13.584057 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:13.585239 15250 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:13.597956 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:13.524151 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:13.623245 15322 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:13.461539 19565 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:13.649214 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:13.628321 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:13.571408 19724 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:13.639618 15390 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:13.608083 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2716) took 1060 ms. Trace:
I20260709 13:04:13.601603 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.572536 19556 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:13.640584 15398 rpcz_store.cc:276] 0709 13:04:12.547589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.368605 (+821016us) service_pool.cc:224] Handling call
0709 13:04:13.553258 (+184653us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:13.641606 15399 raft_consensus.cc:2410] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:13.642107 16031 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:13.662539 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.636047 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:13.617883 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:13.642917 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:13.638834 19640 consensus_queue.cc:1243] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:13.638140 19674 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.674158 15317 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:13.650331 19606 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:13.417830 19728 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.522346 19177 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:13.583910 19769 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:04:13.654343 18898 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:13.653033 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 55712.8us
I20260709 13:04:13.537969 19690 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:04:13.639210 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 84631.3us
I20260709 13:04:13.409228 19669 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.229s
I20260709 13:04:13.640390 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:13.690495 15325 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:13.468683 19140 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.622344 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:13.666290 15397 rpcz_store.cc:276] 0709 13:04:12.547282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.591299 (+ 44017us) service_pool.cc:224] Handling call
0709 13:04:13.607822 (+1016523us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54000276d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:13.607992 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645384960}
I20260709 13:04:13.650863 19565 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:13.643411 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 155835us
I20260709 13:04:13.676575 15242 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:13.638662 19702 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:04:13.680236 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 156975us
I20260709 13:04:13.714897 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:13.716605 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:13.680554 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 79050.5us
I20260709 13:04:13.570937 19546 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:04:13.373483 19719 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.198s
I20260709 13:04:13.395402 19732 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.657290 19676 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:13.681782 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.686115 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.692555 15321 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:13.746136 15394 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:13.537967 19417 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.720099 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.679217 19683 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:13.731709 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:13.759666 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:13.760011 15321 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:13.683820 19511 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:13.731709 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.745052 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:13.719261 18898 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.747339 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:13.725247 15390 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:13.710038 19690 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:13.772886 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52878.2us
I20260709 13:04:13.773458 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.774142 15215 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.774780 15390 raft_consensus.cc:2410] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:13.761260 15325 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:13.777320 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:13.685428 19606 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.768028 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:13.778705 15322 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:13.779850 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.769536 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.780620 15391 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:13.728055 19573 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:13.728381 19724 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:13.779665 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.685180 19674 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.758738 19728 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:13.765945 15242 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:13.781908 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.768409 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:13.812829 15392 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:13.782877 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:13.783095 15390 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:13.763921 19676 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:13.731726 19596 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.711011 19177 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.763049 19597 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.808925 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:13.816372 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:13.825497 15325 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:13.825788 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.826445 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:13.827662 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:13.719825 19556 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:04:13.818981 15396 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 9: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:13.819329 15319 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:13.775305 19640 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:13.775164 19750 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:13.775419 19716 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:13.823752 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.862493 15392 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:13.779726 19606 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:13.863823 15392 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:04:13.832279 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 129070us
I20260709 13:04:13.866544 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:13.842136 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:13.869220 15242 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:13.842713 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:13.811244 19417 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:13.846179 15322 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:13.781420 18898 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.655683 15136 maintenance_manager.cc:643] P 6c48b19b0ac74d678c9f752e98013b9a: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.576s	user 0.171s	sys 0.142s Metrics: {"bytes_written":30450,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":276488,"dirs.run_cpu_time_us":455,"dirs.run_wall_time_us":64529,"drs_written":1,"lbm_read_time_us":420,"lbm_reads_lt_1ms":4,"lbm_write_time_us":267322,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":8,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":331545,"threads_started":2,"update_count":18,"wal-append.queue_time_us":181982}
I20260709 13:04:13.851524 19782 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:13.816932 19719 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:13.811978 19702 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.886586 19676 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.887558 15397 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:13.889154 15397 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:13.891722 15250 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:13.895828 15398 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:04:13.906996 19675 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:13.907627 19675 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:13.908710 19675 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.871642 19709 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:13.910784 19709 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.913126 19709 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:13.861994 19597 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.915781 19402 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.917213 19402 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:13.780130 19290 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:04:13.855072 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:13.855746 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.857188 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:13.817358 19724 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:13.934484 19782 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:04:13.910054 19675 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:13.942189 19724 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.943401 19441 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.945644 19441 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:13.790578 19777 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:04:13.919518 15390 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:13.784456 19636 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:13.885733 19702 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.923439 15325 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:13.853885 19557 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:13.927711 15397 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:13.860844 19728 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:13.930033 15392 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:13.834386 19381 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:04:13.947252 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:13.950929 19430 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:13.953336 15137 maintenance_manager.cc:419] P 6c48b19b0ac74d678c9f752e98013b9a: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8120 bytes on disk
I20260709 13:04:13.954056 15321 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:04:14.011571 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 297436us
I20260709 13:04:13.858487 19712 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:13.959559 15394 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:13.960490 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 104808us
I20260709 13:04:14.016987 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:13.962486 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 105371us
W20260709 13:04:13.994549 19605 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.000s
I20260709 13:04:13.936149 19593 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.029868 15395 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:13.969967 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:13.921356 16031 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:13.844586 19596 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:13.971153 15391 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:13.964059 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:13.988783 15242 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:13.843830 19492 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:13.996351 15247 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:13.852478 19690 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.019081 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.877568 15317 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:14.001358 19762 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:13.961364 19700 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:13.959138 19290 consensus_queue.cc:1243] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:14.027176 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:13.996284 19728 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:14.033126 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 63231us
I20260709 13:04:14.049508 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:14.050397 15136 maintenance_manager.cc:643] P 6c48b19b0ac74d678c9f752e98013b9a: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.025s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":531,"lbm_reads_lt_1ms":4}
W20260709 13:04:14.035025 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 71088.1us
I20260709 13:04:14.040725 15247 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:14.051795 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:14.052945 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:13.993412 19714 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:14.044101 15319 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 13:04:13.872095 19716 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:14.000190 19430 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:14.045702 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 94575.6us
I20260709 13:04:14.063721 19492 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:14.064216 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:14.064793 19690 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:14.057173 15242 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:14.066411 15242 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:14.067190 15242 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:14.067993 15242 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:14.068800 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:14.069131 15242 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:13.997583 19669 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:04:14.031245 19441 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:14.070868 19441 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:14.071938 19441 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:14.073194 19441 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:14.057541 19579 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:04:14.060374 19709 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:14.061163 19344 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:14.053676 19549 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:14.063306 19716 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:14.050495 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:14.050980 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:14.066593 19719 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:04:14.032187 19770 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.310s	user 0.001s	sys 0.000s
I20260709 13:04:14.063496 19625 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:14.078930 19771 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 13:04:14.079910 19776 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 13:04:14.076696 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 474488us
I20260709 13:04:14.066443 19640 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:14.163391 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:14.033305 19759 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:14.164754 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 82945.9us
I20260709 13:04:14.043233 19675 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:14.044700 19557 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:04:14.165181 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.168844 15396 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:14.048285 19556 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:14.057392 19728 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:14.081067 19636 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:04:14.172103 19756 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:04:14.165141 19140 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:14.165985 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:14.038684 19593 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:14.033015 19712 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.176815 19640 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:14.238797 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1581) took 1673 ms. Trace:
I20260709 13:04:14.267030 15243 rpcz_store.cc:276] 0709 13:04:12.565004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.565165 (+   161us) service_pool.cc:224] Handling call
0709 13:04:12.654016 (+ 88851us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:12.923101 (+269085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.238448 (+1315347us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400139cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:14.238722 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611462912}
I20260709 13:04:14.175434 19368 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:14.271101 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 257840us
I20260709 13:04:14.180435 15242 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:04:14.251641 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 85726.4us
I20260709 13:04:14.272437 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:14.276180 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:14.290832 19511 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:14.198032 19557 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:14.215272 19783 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:14.214013 19140 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:14.217370 19636 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:14.271334 19759 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:04:14.315639 19551 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:04:14.321058 19790 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:14.321557 19790 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:14.322402 19790 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.323585 19790 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:14.325078 15244 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:14.326506 18898 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:14.328250 19549 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:14.328796 19549 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:14.331903 15321 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:14.333410 19689 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:14.309979 19140 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:14.334156 19689 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:14.310704 19177 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:14.310166 19719 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:14.335016 19689 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:14.275892 19674 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:14.298166 19783 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:14.336685 19685 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:14.337637 19781 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:04:14.338507 19573 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:14.339114 19669 consensus_queue.cc:1243] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:14.340255 19344 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:04:14.340857 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 290383us
I20260709 13:04:14.341086 19670 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:14.341578 19625 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:14.343071 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.342049 19675 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:14.299053 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:14.372146 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 321216us
W20260709 13:04:14.384802 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 320656us
W20260709 13:04:14.392997 16032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.001s	sys 0.013s
W20260709 13:04:14.409703 16032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.001s	sys 0.013s
I20260709 13:04:14.409907 15394 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:14.370528 19719 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:14.418530 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:14.383188 19344 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:14.424716 16030 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:04:14.415480 19749 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.873s	user 0.017s	sys 0.000s
I20260709 13:04:14.428005 16029 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:04:14.428416 16029 pending_rounds.cc:85] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 9
I20260709 13:04:14.389724 19596 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:14.428736 16029 pending_rounds.cc:107] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:04:14.433943 16029 raft_consensus.cc:2889] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:14.429631 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 152527us
I20260709 13:04:14.399005 19177 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:04:14.417094 19670 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:14.412417 19669 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:04:14.413954 19513 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:04:14.442556 19715 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.908s	user 0.010s	sys 0.011s
I20260709 13:04:14.382143 19640 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:14.443320 19749 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:14.440099 19712 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:14.454391 19786 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:04:14.434657 19636 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:14.466094 19784 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:04:14.465766 19675 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.427879 19792 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
W20260709 13:04:14.456971 19778 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.285s	user 0.002s	sys 0.000s
W20260709 13:04:14.473346 19785 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:04:14.473613 19757 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.965s	user 0.009s	sys 0.004s
I20260709 13:04:14.474037 19757 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.476469 19757 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:14.470386 19719 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:14.444038 19791 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:04:14.478976 19749 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:14.479776 19606 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260709 13:04:14.480269 19606 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.480392 19749 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.437230 19783 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.482936 19606 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:14.483709 19783 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:14.468411 19593 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:14.458384 19794 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:04:14.494583 19791 consensus_queue.cc:1243] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:14.495455 19791 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:14.495931 19791 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:14.497076 19791 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.499246 19791 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:14.463819 19715 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.509114 19715 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:14.337841 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.587963 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 642) took 1049 ms. Trace:
W20260709 13:04:14.588371 19806 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:04:14.602385 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1593) took 1491 ms. Trace:
I20260709 13:04:14.603084 15241 rpcz_store.cc:276] 0709 13:04:13.110597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.659213 (+548616us) service_pool.cc:224] Handling call
0709 13:04:13.659567 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:13.667375 (+  7808us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.667421 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.676674 (+  9253us) log.cc:844] Serialized 26 byte log entry
0709 13:04:14.000895 (+324221us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:14.000936 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.001008 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.601729 (+600721us) raft_consensus.cc:1685] finished
0709 13:04:14.601770 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.602059 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7432,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9952,"thread_start_us":269248,"threads_started":1,"wal-append.queue_time_us":579742}
I20260709 13:04:14.439224 19417 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:04:14.608094 19417 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:14.608973 19417 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:14.610643 19344 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:14.573433 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 297095us
I20260709 13:04:14.619145 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 531) took 1500 ms. Trace:
I20260709 13:04:14.619894 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:14.619781 15246 rpcz_store.cc:276] 0709 13:04:13.118578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.985004 (+866426us) service_pool.cc:224] Handling call
0709 13:04:13.985493 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:13.986003 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.986046 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.996875 (+ 10829us) log.cc:844] Serialized 26 byte log entry
0709 13:04:14.307176 (+310301us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:14.307215 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.307283 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.618450 (+311167us) raft_consensus.cc:1685] finished
0709 13:04:14.618487 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.618830 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1200,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8744,"thread_start_us":258316,"threads_started":1,"wal-append.queue_time_us":397578}
I20260709 13:04:14.622610 19640 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:14.631851 19670 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:14.638873 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.639541 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:14.640082 19640 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.641027 19640 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:14.647814 19757 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:14.649212 19344 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:14.588794 16032 rpcz_store.cc:276] 0709 13:04:13.537857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.550351 (+ 12494us) service_pool.cc:224] Handling call
0709 13:04:13.550711 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:13.551060 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.551090 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.552309 (+  1219us) log.cc:844] Serialized 26 byte log entry
0709 13:04:14.410126 (+857817us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:14.410167 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.410256 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.587090 (+176834us) raft_consensus.cc:1685] finished
0709 13:04:14.587147 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.587632 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":181991,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":24749,"thread_start_us":857401,"threads_started":1,"wal-append.queue_time_us":884691}
I20260709 13:04:14.433195 19557 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:14.649657 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.655253 19417 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:14.656320 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 492847us
I20260709 13:04:14.657516 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:14.658488 19715 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.659397 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:14.662106 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:14.659406 19715 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:14.668102 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47279.1us
W20260709 13:04:14.607946 19808 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:04:14.677687 19675 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.678901 19675 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.657984 19417 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:14.685176 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:14.687526 15241 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:14.685278 19177 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:14.712790 19177 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:14.716326 19787 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.292s	user 0.000s	sys 0.002s
I20260709 13:04:14.717386 19690 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.690660 19749 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:14.692351 15396 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
W20260709 13:04:14.720376 19800 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:04:14.723973 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:14.709874 19780 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.859s	user 0.001s	sys 0.002s
I20260709 13:04:14.734512 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:14.735654 16024 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:14.736030 15323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2665) took 2312 ms (client timeout 2504 ms). Trace:
W20260709 13:04:14.736728 15323 rpcz_store.cc:269] 0709 13:04:12.423111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.549725 (+126614us) service_pool.cc:224] Handling call
0709 13:04:14.735413 (+2185688us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54004038d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:14.735733 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2516811520}
I20260709 13:04:14.738528 15246 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:14.740814 16026 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:14.742614 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:14.743839 16031 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:14.698287 19715 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:14.701663 19675 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:14.703850 19719 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:14.704864 19774 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.854s	user 0.000s	sys 0.003s
W20260709 13:04:14.707461 19779 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.858s	user 0.004s	sys 0.000s
I20260709 13:04:14.707182 19593 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:14.709611 19802 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.759227 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 639) took 1300 ms. Trace:
W20260709 13:04:14.760030 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.759776 16025 rpcz_store.cc:276] 0709 13:04:13.458880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.459055 (+   175us) service_pool.cc:224] Handling call
0709 13:04:13.459414 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:13.459762 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.459790 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.460271 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:04:13.731215 (+270944us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:13.731277 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.733106 (+  1829us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.706164 (+973058us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:14.758632 (+ 52468us) raft_consensus.cc:1685] finished
0709 13:04:14.758653 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.759024 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":957,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":10180,"spinlock_wait_cycles":10867072,"thread_start_us":260121,"threads_started":1,"wal-append.queue_time_us":388233}
W20260709 13:04:14.743726 19773 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.894s	user 0.001s	sys 0.006s
I20260709 13:04:14.759779 19802 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.744213 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1589) took 1634 ms. Trace:
I20260709 13:04:14.764150 15245 rpcz_store.cc:276] 0709 13:04:13.109191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.536579 (+427388us) service_pool.cc:224] Handling call
0709 13:04:13.536927 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:13.602630 (+ 65703us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.602659 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.645255 (+ 42596us) log.cc:844] Serialized 26 byte log entry
0709 13:04:13.817869 (+172614us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:13.817911 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.817978 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.708615 (+890637us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:14.743657 (+ 35042us) raft_consensus.cc:1685] finished
0709 13:04:14.743682 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.744013 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19377,"raft.queue_time_us":19546,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":52943,"spinlock_wait_cycles":17468288,"thread_start_us":140533,"threads_started":1,"wal-append.queue_time_us":191066}
I20260709 13:04:14.767805 15245 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:14.768338 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2732) took 1358 ms. Trace:
I20260709 13:04:14.770543 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:14.697006 19565 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.965s	user 0.011s	sys 0.011s
W20260709 13:04:14.757462 19728 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.003s
I20260709 13:04:14.768157 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:14.744757 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1645) took 1750 ms. Trace:
I20260709 13:04:14.768836 15390 rpcz_store.cc:276] 0709 13:04:13.409544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.816279 (+406735us) service_pool.cc:224] Handling call
0709 13:04:13.816540 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:13.961403 (+144863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.767665 (+806262us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540009bfd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:14.768130 (+   465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236365568}
I20260709 13:04:14.716367 19177 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:14.777361 15396 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:14.780118 19749 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.785205 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:14.785384 19749 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.787254 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:14.788160 15244 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:14.788720 19749 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:14.789237 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:14.789674 19719 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.718214 19690 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.790138 15244 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:14.794521 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:14.800470 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.801808 16031 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:14.803908 19640 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:14.804004 19690 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:14.806422 19290 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:14.808863 19802 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:14.809015 19597 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:14.809597 19709 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:04:14.822429 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:14.781502 19728 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:14.814146 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.832490 19719 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:14.833776 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48846.9us
I20260709 13:04:14.774973 15316 rpcz_store.cc:276] 0709 13:04:12.979680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.992779 (+ 13099us) service_pool.cc:224] Handling call
0709 13:04:12.993227 (+   448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:13.028253 (+ 35026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.028290 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:13.905025 (+876735us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b2c0012b498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:04:13.905767 (+   742us) log.cc:844] Serialized 52 byte log entry
0709 13:04:14.171971 (+266204us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:14.172031 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.172135 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.715145 (+543010us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:14.718292 (+  3147us) raft_consensus.cc:1685] finished
0709 13:04:14.718326 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.729989 (+ 11663us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33017,"raft.queue_time_us":28630,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":11750,"spinlock_wait_cycles":23573120,"thread_start_us":265689,"threads_started":1,"wal-append.queue_time_us":468764}
I20260709 13:04:14.835762 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:14.836548 15396 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:14.837103 19749 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.838079 19749 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.839872 19685 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.840494 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:14.840577 19685 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.820245 19513 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:14.838629 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:14.844269 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:14.846361 19749 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:14.847244 19606 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:14.847745 19606 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.847100 19594 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:14.848196 19606 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:14.848412 19594 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.849255 19594 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:14.851455 19732 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:14.852262 15396 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:14.853018 15391 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:04:14.854938 19772 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.935s	user 0.003s	sys 0.000s
I20260709 13:04:14.854926 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:14.859017 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 530) took 1740 ms. Trace:
I20260709 13:04:14.859565 15250 rpcz_store.cc:276] 0709 13:04:13.118314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.892741 (+774427us) service_pool.cc:224] Handling call
0709 13:04:14.238702 (+345961us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:14.251890 (+ 13188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:14.251939 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:14.252702 (+   763us) log.cc:844] Serialized 52 byte log entry
0709 13:04:14.625430 (+372728us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:14.625524 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.625675 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.625765 (+    90us) raft_consensus.cc:1685] finished
0709 13:04:14.625780 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.858535 (+232755us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400139cd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:14.858836 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15287,"raft.queue_time_us":27510,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":20341,"spinlock_wait_cycles":794587392,"thread_start_us":319826,"threads_started":1,"wal-append.queue_time_us":172526}
I20260709 13:04:14.796765 15215 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:14.863900 19728 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:14.865331 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:14.855121 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:14.867834 19809 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.345s	user 0.002s	sys 0.000s
I20260709 13:04:14.868227 15245 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:14.869511 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:14.870561 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:14.870827 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2342) took 1143 ms. Trace:
W20260709 13:04:14.858871 19402 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.921s	user 0.003s	sys 0.018s
I20260709 13:04:14.872133 15247 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:14.872479 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:14.873793 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:14.875089 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:14.842028 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:14.861981 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:14.858616 19815 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:04:14.793987 15147 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:04:14.876878 19690 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.878322 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:14.880237 15289 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:14.884933 16024 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
W20260709 13:04:14.875241 19441 consensus_meta.cc:287] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.801s	user 0.021s	sys 0.000s
I20260709 13:04:14.891537 19685 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:14.892930 16031 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:04:14.859658 19140 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.525s	user 0.017s	sys 0.008s
I20260709 13:04:14.889590 16025 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
W20260709 13:04:14.843103 15290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.531s (SENT) [suppressed 38 similar messages]
I20260709 13:04:14.871277 15243 rpcz_store.cc:276] 0709 13:04:13.727203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.268403 (+541200us) service_pool.cc:224] Handling call
0709 13:04:14.291040 (+ 22637us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:14.574530 (+283490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:14.574620 (+    90us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:14.576179 (+  1559us) log.cc:844] Serialized 52 byte log entry
0709 13:04:14.753179 (+177000us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:14.780053 (+ 26874us) log.cc:844] Serialized 14 byte log entry
0709 13:04:14.791709 (+ 11656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.794397 (+  2688us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.815918 (+ 21521us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b18002dd8a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:14.870390 (+ 54472us) raft_consensus.cc:1685] finished
0709 13:04:14.870489 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.870652 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26613,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":2517,"raft.queue_time_us":16682,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":10089,"spinlock_wait_cycles":4096896,"thread_start_us":458883,"threads_started":2,"wal-append.queue_time_us":217489}
I20260709 13:04:14.782727 19565 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:14.911959 15247 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:14.914537 15242 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:14.893744 19140 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:14.909549 19702 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:14.913739 15289 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:14.907348 19402 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:14.927119 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:14.930359 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:14.933487 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:14.933918 15245 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:14.935133 15250 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:14.896732 19690 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:14.926816 19402 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:14.933048 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:14.932933 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:14.929098 19701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.004s	sys 0.016s
I20260709 13:04:14.950250 16025 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:14.932981 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:14.958657 16028 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:14.945657 19402 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:14.974571 19565 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:14.946429 19344 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:15.031868 19344 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.032471 19344 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:14.976320 15324 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:14.978298 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:15.034684 16024 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:15.034543 19606 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.037181 19606 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:15.033514 16025 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:14.990770 15242 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:15.038981 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:15.039373 19594 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.040009 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:15.040498 15242 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:15.041075 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:15.041507 15242 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:15.041702 19594 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:14.991277 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 259449us
I20260709 13:04:14.968215 19702 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:14.970070 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:15.000587 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:14.983448 19140 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.002492 16031 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:15.042860 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:15.003448 15250 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:04:15.045748 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:15.004223 19597 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.976882 15147 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.976181 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2326) took 1833 ms. Trace:
W20260709 13:04:14.959029 19701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.005s	sys 0.016s
I20260709 13:04:15.014528 19593 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:15.017717 19579 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:15.018666 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 110390us
I20260709 13:04:14.978176 19690 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:14.945600 19728 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:15.027618 19814 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:04:15.028445 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 645) took 1082 ms. Trace:
I20260709 13:04:15.075323 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 644) took 1113 ms. Trace:
W20260709 13:04:15.028810 19813 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:15.029310 19803 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.090334 19803 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.030333 19675 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:14.943295 19441 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:15.092211 19675 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:15.043166 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 93543.5us
W20260709 13:04:15.048758 19818 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260709 13:04:15.075395 19596 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:15.045773 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:15.097222 19782 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:15.098969 15396 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:15.094851 19597 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.043484 19702 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:15.100723 19702 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.043409 16027 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:15.101099 15394 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:04:15.059103 15248 rpcz_store.cc:276] 0709 13:04:13.076761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.437286 (+360525us) service_pool.cc:224] Handling call
0709 13:04:13.437671 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:13.438057 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:13.512899 (+ 74842us) log.cc:844] Serialized 14 byte log entry
0709 13:04:13.904480 (+391581us) spinlock_profiling.cc:243] Waited 993 us on lock 0x7b18001002a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:14.345495 (+441015us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b18001002a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:04:14.784149 (+438654us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:14.859925 (+ 75776us) log.cc:844] Serialized 52 byte log entry
0709 13:04:14.861526 (+  1601us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:14.862175 (+   649us) log.cc:844] Serialized 14 byte log entry
0709 13:04:14.889635 (+ 27460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.899444 (+  9809us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.904135 (+  4691us) raft_consensus.cc:1685] finished
0709 13:04:14.904160 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.910183 (+  6023us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26415,"prepare.queue_time_us":74672,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":97,"raft.queue_time_us":60824,"raft.run_cpu_time_us":393,"raft.run_wall_time_us":24161,"spinlock_wait_cycles":23332992,"thread_start_us":405640,"threads_started":1,"wal-append.queue_time_us":1159270}
I20260709 13:04:15.084406 19783 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.103451 15397 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:04:15.103653 19783 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.104916 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:15.105886 15244 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:04:15.107199 15244 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:15.101137 19702 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:15.107954 19791 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:15.109043 19791 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:04:15.110839 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65247.1us
I20260709 13:04:15.042182 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:15.111295 16027 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
W20260709 13:04:15.054412 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 211477us
I20260709 13:04:15.063863 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:15.079384 19417 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.092273 19441 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.003644 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:15.094097 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:15.094403 19606 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.046906 19636 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:15.109825 19791 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:04:15.125682 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:15.094801 15249 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:15.095902 19596 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.046877 19140 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:04:15.113615 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 52621.8us
I20260709 13:04:15.085616 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:15.110639 19790 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:15.077370 16029 rpcz_store.cc:276] 0709 13:04:13.945942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.953986 (+  8044us) service_pool.cc:224] Handling call
0709 13:04:13.954322 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:14.434676 (+480354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.027857 (+593181us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b5400581e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:15.028230 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088347520}
I20260709 13:04:15.097895 19782 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.141079 19782 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.142043 19675 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.085979 19712 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:15.142884 19549 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.017s
I20260709 13:04:15.143023 19712 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.143455 19549 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.145711 19712 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:15.109512 19430 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.119942 19732 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:15.075057 19579 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:15.079676 19802 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.093995 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:15.086490 19593 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.077487 16030 rpcz_store.cc:276] 0709 13:04:13.945577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.950363 (+  4786us) service_pool.cc:224] Handling call
0709 13:04:13.950766 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:14.425364 (+474598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.030053 (+604689us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b54000d98d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:15.058475 (+ 28422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077127424}
I20260709 13:04:15.085089 19594 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.083474 15147 catalog_manager.cc:5697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 4 to 8, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 8 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.130004 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:15.146817 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.082734 19728 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.157232 15316 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:04:15.124097 19690 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:15.120223 19783 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.126026 19701 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:15.149638 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:15.159699 19597 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:15.161324 19430 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:15.137797 19417 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.161713 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.148882 19732 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.138517 19790 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:15.138157 19606 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:15.173902 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 98414.1us
I20260709 13:04:15.136350 19565 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:04:15.177487 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 47606.2us
I20260709 13:04:15.145747 19549 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.173588 19732 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:15.163017 19690 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:15.164350 19701 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.205001 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.201376 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:15.208503 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:15.209110 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:15.209471 15244 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:15.189512 19636 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:04:15.213198 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.223011 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 129281us
I20260709 13:04:15.197677 19701 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:15.222498 15147 catalog_manager.cc:5697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.218858 19597 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:15.221470 19712 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:15.187436 19675 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:04:15.242507 19513 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:15.243719 19417 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.243881 19593 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:15.244282 19177 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.244560 19593 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:15.244360 19708 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:04:15.245069 19177 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:15.247531 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 244187us
I20260709 13:04:15.243920 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:15.198647 19715 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:04:15.242511 15316 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:15.210116 19565 consensus_queue.cc:1243] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:15.220753 19594 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.241889 15147 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.233541 19441 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:15.261340 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:15.267642 15323 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:15.239444 19636 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:15.202955 19670 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:04:15.226148 19344 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.268402 19597 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:15.311921 19820 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:04:15.312611 15316 pending_rounds.cc:85] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 8
I20260709 13:04:15.313000 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.299052 19441 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:15.304471 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:15.314653 19708 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:15.321570 15147 catalog_manager.cc:5697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 4 to 8, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 8 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:04:15.322507 15316 pending_rounds.cc:107] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:04:15.347004 15316 raft_consensus.cc:2889] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:15.367874 16027 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:15.271636 19402 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:15.406471 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 320949us
W20260709 13:04:15.402457 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 103789us
I20260709 13:04:15.331084 19708 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:15.424471 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 180626us
W20260709 13:04:15.424844 19827 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
W20260709 13:04:15.426338 19825 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:04:15.431303 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 174826us
I20260709 13:04:15.431933 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.432154 19669 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:15.432677 19606 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:15.434087 19594 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:15.434288 15319 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:15.422418 15318 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:15.291711 19690 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:15.438002 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 87301.7us
I20260709 13:04:15.442992 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:15.443205 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.444614 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:15.444389 19597 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:15.446966 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 149043us
W20260709 13:04:15.438736 19815 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.093s	user 0.000s	sys 0.003s
I20260709 13:04:15.453734 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:15.455343 19557 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:15.456275 19344 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:15.457602 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.463302 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:15.446674 19669 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:15.470324 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:15.471278 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.473474 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.446357 19728 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.474071 15318 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:04:15.346880 19790 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.478147 15317 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:15.474977 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:15.490267 15322 raft_consensus.cc:2410] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:15.464972 19596 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:15.492430 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 50887.1us
I20260709 13:04:15.471911 19690 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:15.474735 19669 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:15.496701 19551 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:15.512959 19551 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:15.513495 19551 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:15.513168 19712 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:15.513778 19803 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.497208 19402 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:15.478804 19594 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:15.499557 19549 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:15.500324 19724 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:15.501072 19829 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:15.501155 19708 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.502928 19579 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.542876 19579 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:15.542968 19708 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:15.513008 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:15.546437 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:15.547448 19816 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.603s	user 0.004s	sys 0.011s
W20260709 13:04:15.527336 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 64119us
I20260709 13:04:15.549437 19712 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:15.488660 15147 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 2 to 7, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 7 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.550966 19712 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:15.551635 15147 catalog_manager.cc:5697] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.552124 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:15.553191 15147 catalog_manager.cc:5697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 4 to 8, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 8 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.535343 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:15.554594 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:15.554688 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:15.555406 15393 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.555994 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:15.556614 15396 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:15.548450 19441 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:15.548954 19606 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:15.549063 19675 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:15.552052 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:15.553912 15391 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:04:15.499274 19670 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:15.541707 19724 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:15.550159 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:15.558436 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:15.541247 15244 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:15.591024 15397 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:15.591543 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:15.592216 15392 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:15.521049 19177 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:15.594482 15147 catalog_manager.cc:5697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 4 to 8, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 8 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.595896 19689 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.573161 15391 pending_rounds.cc:85] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 6
I20260709 13:04:15.608698 15391 pending_rounds.cc:107] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:04:15.609210 15391 raft_consensus.cc:2889] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:15.452522 19636 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:15.608108 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 43571.2us
I20260709 13:04:15.608625 15393 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:15.567772 19596 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:04:15.637884 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.563277 19606 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.562971 19441 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.669953 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:15.676409 15244 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:15.685140 15147 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 5, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 5 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:15.570518 19702 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.598311 19557 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:15.589213 19724 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:15.702680 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:15.704814 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:15.683187 19441 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:15.706465 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:15.706688 19597 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:15.707096 19597 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:15.707485 19597 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:15.710484 19593 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:15.712101 19702 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.718495 19417 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:15.721791 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:15.707108 16026 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:15.597069 19594 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 13:04:15.683626 19606 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:15.730089 15996 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:15.597432 19675 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.739791 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:15.726191 15147 catalog_manager.cc:5697] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 6, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 6 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.748363 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:15.767652 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:15.770404 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:15.771888 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:15.766853 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:15.731670 19596 consensus_queue.cc:1243] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:15.768612 15243 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
W20260709 13:04:15.773667 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 276799us
I20260709 13:04:15.781272 19140 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:15.785117 15392 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:15.785108 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:15.786741 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 196612us
I20260709 13:04:15.788743 15147 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 6 to 8, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 8 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:15.782716 19702 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:15.792778 19702 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.794651 15393 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:15.795745 19702 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.796494 19840 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.765596 19402 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:15.754846 19430 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.785873 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:15.811614 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 255816us
I20260709 13:04:15.724514 19689 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.794029 19712 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:15.731302 19557 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.817936 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:15.829456 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.787812 19803 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:15.765480 19417 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:04:15.841940 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:15.827759 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:15.830474 15147 catalog_manager.cc:5697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.838708 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:15.813511 19402 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:15.814814 19177 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.813820 19842 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:15.797238 19840 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.834836 19715 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.870057 15147 catalog_manager.cc:5697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 4 to 7, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 7 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.873401 15243 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:15.874591 15317 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:15.874876 19675 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:15.876827 19840 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:15.877050 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:15.877540 19689 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:15.842036 19344 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:15.884701 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:15.895311 16026 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:04:15.889612 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 119281us
I20260709 13:04:15.859490 19402 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:15.893884 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.897050 15319 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:15.897555 15322 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:15.861043 19712 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:15.894685 15147 catalog_manager.cc:5697] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 4, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 4 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:15.897469 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:15.903203 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:15.849355 19430 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.909166 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:15.910296 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:15.885841 19803 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:15.915959 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.893515 19842 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:15.912279 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:15.923653 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 173954us
W20260709 13:04:15.935695 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.896078 19848 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:15.909152 19845 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.903417 19670 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.943181 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.910286 19689 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:15.891515 19177 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.888687 19715 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:15.923504 19842 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.958333 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:15.908725 19840 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:04:15.951746 19689 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.964038 15391 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:15.941970 19701 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.004s
I20260709 13:04:15.942212 19782 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:15.980360 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:15.982623 15147 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 4 to 6, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 6 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:15.987823 15319 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:15.996850 15320 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:04:15.894289 19724 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:15.979616 19689 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:15.964038 19842 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:16.010159 15147 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 4 to 7, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 7 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:04:15.982391 19782 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.031199 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.031243 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.035495 15317 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:16.001945 19596 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:15.953361 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 135528us
I20260709 13:04:16.004871 19790 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.979841 19670 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.057056 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:16.074390 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2695) took 2430 ms. Trace:
I20260709 13:04:16.074903 15324 rpcz_store.cc:276] 0709 13:04:13.635342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.661922 (+ 26580us) service_pool.cc:224] Handling call
0709 13:04:13.662221 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.033915 (+1371694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.028799 (+994884us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002a76d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:16.065853 (+ 37054us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2911105280}
I20260709 13:04:15.983457 19701 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.090862 15321 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:16.091929 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.093317 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.081983 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.003327 19854 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:04:16.088239 19715 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:16.033269 19782 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:16.094100 15317 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:15.988961 19803 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:16.093914 19732 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.873s	user 0.006s	sys 0.005s
I20260709 13:04:16.074689 15147 catalog_manager.cc:5697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:16.101679 15396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.007s
W20260709 13:04:16.113099 15396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.009s	sys 0.007s
W20260709 13:04:16.104158 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 203693us
W20260709 13:04:16.114209 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.127611 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.077242 19636 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.070688 19596 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.000588 19845 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.151754 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.156607 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.133898 19675 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.095398 19441 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.210826 19441 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:16.056381 19857 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.259s
I20260709 13:04:16.211192 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:16.211943 15241 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:16.211699 19606 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.179229 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.180523 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.214146 15247 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:16.215328 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:16.215576 19871 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.216130 19871 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.216498 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:16.217217 19690 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.715s	user 0.008s	sys 0.003s
I20260709 13:04:16.218659 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1619) took 1015 ms. Trace:
I20260709 13:04:16.218304 19675 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:16.219909 19844 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:04:16.219044 15250 rpcz_store.cc:276] 0709 13:04:15.203813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.460802 (+256989us) service_pool.cc:224] Handling call
0709 13:04:15.461168 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.487826 (+ 26658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.487860 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:15.490272 (+  2412us) log.cc:844] Serialized 26 byte log entry
0709 13:04:15.748624 (+258352us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:15.748689 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.748788 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:16.218390 (+469602us) raft_consensus.cc:1685] finished
0709 13:04:16.218419 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.218594 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10379,"raft.queue_time_us":2155,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":38179,"thread_start_us":188856,"threads_started":1,"wal-append.queue_time_us":652001}
W20260709 13:04:16.221211 19850 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:04:16.221872 15397 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 9: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:16.063899 19712 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:16.186169 19579 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.006s
I20260709 13:04:16.130326 19732 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.204273 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:16.205121 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:16.227859 16026 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:16.190536 19875 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.173777 19848 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.221144 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.234143 15250 raft_consensus.cc:2410] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:16.221764 19596 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:16.218000 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:16.151464 19557 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:16.171182 15147 catalog_manager.cc:5697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.217238 15247 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:16.189411 19709 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.175034 19702 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.226965 15322 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:16.214829 19870 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:16.197448 19430 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.197566 19685 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:16.233072 19669 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.005s
I20260709 13:04:16.223243 19701 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:16.242044 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.206092 19636 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.238354 19871 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.241914 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:16.267650 15395 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:16.239830 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 84753us
I20260709 13:04:16.244830 19606 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:16.252974 19845 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:16.253399 19417 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:16.256678 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.278963 19685 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.279515 19417 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.279996 19417 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:16.281322 19685 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.281661 19749 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:16.241451 15244 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:16.282117 19749 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:16.238989 19875 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.254304 19709 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.282922 19732 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:16.283596 19732 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:16.284226 19732 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.286595 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.286805 19803 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.287389 15245 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:16.258041 19702 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.290405 15248 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:16.260289 19511 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:16.259935 15147 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 7, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 7 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:16.261046 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.258868 15250 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 7.
I20260709 13:04:16.253779 19848 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.278185 19636 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.278558 19177 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.291695 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:16.259455 19669 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.305388 19709 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.305754 19848 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:16.306258 15247 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:16.306061 19749 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.322819 19749 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:16.322806 19551 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.809s	user 0.006s	sys 0.007s
W20260709 13:04:16.307121 19802 consensus_meta.cc:287] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.142s	user 0.016s	sys 0.000s
I20260709 13:04:16.305238 19875 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:16.326924 19551 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.349496 19551 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.300351 19511 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:16.351106 19511 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.352288 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 558) took 1257 ms. Trace:
I20260709 13:04:16.352495 19511 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:16.352746 15390 rpcz_store.cc:276] 0709 13:04:15.095073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.098731 (+  3658us) service_pool.cc:224] Handling call
0709 13:04:15.099097 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.149002 (+ 49905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.149037 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:15.149596 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:04:15.237880 (+ 88284us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:15.237921 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.351823 (+1113902us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b540034ba54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:16.351878 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:16.351928 (+    50us) raft_consensus.cc:1685] finished
0709 13:04:16.351943 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.352187 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2048,"raft.queue_time_us":30276,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":12047,"spinlock_wait_cycles":85310848,"thread_start_us":77260,"threads_started":1,"wal-append.queue_time_us":163793}
I20260709 13:04:16.356258 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.364970 15391 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:16.357309 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.363459 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:16.362715 15318 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
W20260709 13:04:16.443885 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 95494.5us
I20260709 13:04:16.445456 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:16.362990 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:16.450096 15241 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:16.455638 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:16.456663 15241 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:16.447293 16029 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:16.476183 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:16.473290 19596 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.480207 19596 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.473594 19709 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.483932 19842 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.489625 19709 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.492189 19842 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.492645 19709 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.493534 19709 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:16.495507 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.343953 19802 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:16.488703 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:16.484543 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:16.483664 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 143002us
I20260709 13:04:16.484207 15323 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:16.501091 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 567) took 1204 ms. Trace:
I20260709 13:04:16.501523 15323 rpcz_store.cc:276] 0709 13:04:15.296392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.302807 (+  6415us) service_pool.cc:224] Handling call
0709 13:04:16.357152 (+1054345us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:04:16.500989 (+143837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24462208}
I20260709 13:04:16.504318 15241 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:16.377974 19702 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:16.517211 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:16.521056 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.510967 16027 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:04:16.534530 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 343979us
I20260709 13:04:16.527781 15391 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:16.535491 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:16.535163 15289 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:16.541878 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:16.545316 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 99963.5us
I20260709 13:04:16.546274 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:16.485764 19669 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.546700 15316 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:16.548782 15323 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:16.556972 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:16.557960 15322 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:16.557036 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.558388 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:16.562660 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:16.488242 19417 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.569213 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.570755 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.512012 19875 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:04:16.513464 19594 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:04:16.573915 15391 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:16.572896 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:16.607316 16029 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:16.524997 19882 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:16.520298 19596 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:16.570163 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.542773 19709 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.569885 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1590) took 3449 ms. Trace:
I20260709 13:04:16.569324 19513 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:16.562515 19701 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:16.568907 19579 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:04:16.575624 19732 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.563669 19702 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:16.579294 19857 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:16.579757 19402 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.657s	user 0.007s	sys 0.005s
I20260709 13:04:16.579178 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.617666 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:16.620210 15394 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 16 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:04:16.580054 19870 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:16.561060 19848 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:16.584165 19344 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:16.621824 19715 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:16.622115 19848 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.622251 19344 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.622597 19848 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:16.622874 19344 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:16.584028 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:16.584914 19685 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:16.579248 15399 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:16.598846 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:16.602342 19865 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:16.625811 15399 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:16.625627 19701 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.626183 15393 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:16.628252 19701 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:16.551064 19845 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:16.626791 15399 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.629041 19845 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.630165 15399 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:16.630317 15325 raft_consensus.cc:2410] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:04:16.631286 19845 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.564079 19803 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:16.632781 19803 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.613380 16033 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:16.635041 19803 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.635259 19344 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.638262 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:16.639053 19689 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.564s	user 0.005s	sys 0.005s
I20260709 13:04:16.639235 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.639559 19689 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.640532 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:16.641100 15248 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:16.641126 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.613521 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.612128 15249 rpcz_store.cc:276] 0709 13:04:13.109533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.553824 (+444291us) service_pool.cc:224] Handling call
0709 13:04:13.554183 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.135784 (+1581601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.524545 (+1388761us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001a77d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:16.558587 (+ 34042us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3541776640}
I20260709 13:04:16.645848 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.643448 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:16.675628 16031 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:16.664108 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.674499 15390 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
W20260709 13:04:16.681905 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 286011us
W20260709 13:04:16.683499 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.697808 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:16.646395 19597 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.938s	user 0.013s	sys 0.001s
I20260709 13:04:16.703460 15323 raft_consensus.cc:2410] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:04:16.639273 19344 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:16.705782 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:16.706507 15316 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:16.710937 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.711436 15324 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:16.712968 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:16.711031 15320 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:16.750837 15399 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:04:16.660296 19845 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:16.622399 19715 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.757253 15213 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:16.617453 19709 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.647362 19402 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.768939 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.642021 19689 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.676342 19857 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.759507 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.771514 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:16.642427 19702 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.770320 15399 pending_rounds.cc:85] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 6
I20260709 13:04:16.790104 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:16.703578 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.808351 16029 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:16.815140 15399 pending_rounds.cc:107] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:04:16.759636 19732 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:16.823060 19732 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.823894 19702 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.824497 19702 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:16.772648 19876 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:04:16.825111 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:16.816777 15324 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:16.825168 19732 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.827034 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:16.819656 15322 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:16.827733 15324 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:16.827991 19790 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.758s	user 0.014s	sys 0.001s
I20260709 13:04:16.828255 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:16.828516 19843 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.828851 15322 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:16.829061 19843 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.797112 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.796797 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.819953 15399 raft_consensus.cc:2889] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:16.807904 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.832580 15244 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:16.797667 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:16.821987 15316 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:04:16.800843 19867 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.805987 19579 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.858805 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2756) took 1306 ms. Trace:
I20260709 13:04:16.746580 19597 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.860066 15399 rpcz_store.cc:276] 0709 13:04:15.552699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.557806 (+  5107us) service_pool.cc:224] Handling call
0709 13:04:15.590975 (+ 33169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.579037 (+988062us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54002f10a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfc1c0 00007f3669bfd231 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c
0709 13:04:16.858542 (+279505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.858743 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441089280}
I20260709 13:04:16.830839 15320 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:16.858644 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.865794 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.811308 15249 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:16.790809 19715 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:16.809520 19140 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:16.753547 19848 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.842368 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:16.875370 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 85384.3us
I20260709 13:04:16.877663 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:16.807632 19865 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:16.879622 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:16.865650 15247 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:16.881894 15249 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:16.827411 19791 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:16.890172 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:16.868969 19417 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:16.892658 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 311758us
I20260709 13:04:16.902676 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.906054 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.906719 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.907212 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.908154 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:16.909436 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:16.906778 15390 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:16.910671 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:16.911660 15390 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:16.911983 15393 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:04:16.912938 15390 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:16.918618 19872 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:16.920118 19871 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:16.920542 19871 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:16.921520 19871 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.922863 19871 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:16.922917 16031 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
W20260709 13:04:16.926874 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.927642 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:16.872701 19732 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:16.928475 15320 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:16.796432 19845 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:16.927035 15397 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:16.873131 19886 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:16.938717 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:16.886014 19689 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:16.927652 19344 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:16.956020 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:16.892895 19685 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:16.936919 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:16.950412 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 556) took 1783 ms. Trace:
I20260709 13:04:16.889384 19791 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:16.953336 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:16.956804 15250 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:16.961236 15395 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:16.857669 19867 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:16.951963 19878 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:04:16.886620 19803 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:04:16.965744 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:16.878942 19551 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:04:16.966174 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2759) took 1412 ms. Trace:
I20260709 13:04:16.931293 19511 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:16.961213 15398 rpcz_store.cc:276] 0709 13:04:15.079619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.086945 (+  7326us) service_pool.cc:224] Handling call
0709 13:04:15.087373 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.177227 (+ 89854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.177270 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.177316 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:15.177345 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.860250 (+1682905us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b54003291d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:16.860314 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.860459 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195678080}
I20260709 13:04:16.934567 19675 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:16.888942 19579 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:16.972556 19875 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:16.955904 19689 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.956141 19344 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:16.988749 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:16.965968 19829 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:17.011554 15247 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:17.019037 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 218856us
I20260709 13:04:16.971829 19728 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:04:16.978956 15396 rpcz_store.cc:276] 0709 13:04:15.553537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.557164 (+  3627us) service_pool.cc:224] Handling call
0709 13:04:15.557497 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:16.113616 (+556119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.113661 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:16.164259 (+ 50598us) log.cc:844] Serialized 26 byte log entry
0709 13:04:16.543111 (+378852us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:16.558876 (+ 15765us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.965679 (+406803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.965801 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:16.965864 (+    63us) raft_consensus.cc:1685] finished
0709 13:04:16.965884 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.966082 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40609,"prepare.queue_time_us":19877,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":30819,"raft.queue_time_us":141110,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":11128,"thread_start_us":1226140,"threads_started":3,"wal-append.queue_time_us":455323}
I20260709 13:04:16.960403 19861 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:04:17.001361 19675 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:16.957231 19732 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:17.021888 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68662.9us
I20260709 13:04:17.037667 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:17.013602 19832 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:04:17.031697 15322 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:17.032284 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:17.063453 19782 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.929s	user 0.015s	sys 0.000s
I20260709 13:04:17.063967 15215 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:17.004269 19886 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:17.065062 19886 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.066648 19867 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.067288 19886 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.005533 19689 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:17.067600 19709 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.068152 19709 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:17.045243 19675 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.070955 19845 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.072104 19675 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.031076 19551 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:17.073673 19551 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.051962 19344 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.075376 19344 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:17.052630 15248 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:17.076186 19551 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.077025 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:17.077719 15248 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:17.078792 19724 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.079677 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:17.081460 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:17.082345 15243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 538) took 1353 ms (client timeout 1594 ms). Trace:
I20260709 13:04:17.053332 19732 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.056865 19597 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.057013 19402 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.029618 19712 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:17.060377 19889 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:04:17.061403 19857 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:17.044482 19791 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:17.082830 15243 rpcz_store.cc:269] 0709 13:04:15.729074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.808512 (+ 79438us) service_pool.cc:224] Handling call
0709 13:04:17.082092 (+1273580us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b540001e354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:17.082248 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66974592}
I20260709 13:04:17.084472 15324 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:17.088482 15320 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:17.094156 15248 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:17.072811 19675 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:17.151955 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:17.152905 16031 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:17.056728 15247 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:17.104215 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:17.155885 15249 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:17.091990 19845 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.123204 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:17.150123 15318 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1663) took 1271 ms (client timeout 1624 ms). Trace:
I20260709 13:04:17.172780 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:17.173838 15247 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:17.175000 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:17.122044 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:17.178620 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.107797 19899 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:17.102386 19511 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:04:17.186051 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 261874us
I20260709 13:04:17.187274 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.188373 15249 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:17.095042 19886 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:04:17.191530 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 252888us
I20260709 13:04:17.179744 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:17.157974 15318 rpcz_store.cc:269] 0709 13:04:15.878486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.879030 (+   544us) service_pool.cc:224] Handling call
0709 13:04:17.149930 (+1270900us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400374e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:17.150054 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063090560}
I20260709 13:04:17.195341 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.196766 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:17.197708 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:17.063939 19782 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:17.186596 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 75682.1us
I20260709 13:04:17.199015 15996 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:17.200266 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:17.180886 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.201949 15247 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:17.106729 19732 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:04:17.171633 19675 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.218765 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.219835 15249 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:17.183194 19829 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:17.117654 19895 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:17.225725 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:17.227826 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:17.241894 16026 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:04:17.242501 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 138430us
I20260709 13:04:17.242972 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:17.172055 19402 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:04:17.244971 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:17.118156 19712 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.212733 19886 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:17.220690 19791 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:17.220072 19848 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.190541 19790 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:04:17.192716 19845 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.192286 19871 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:04:17.221341 19867 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:17.238945 19908 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:17.253878 19802 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:17.249680 19732 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:17.290040 19906 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:17.238112 19551 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:04:17.240479 19898 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:17.252830 19675 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.262405 19701 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.265631 19842 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:17.296232 19848 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:17.296736 19802 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.282605 19912 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:17.391422 16027 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:17.379662 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2367) took 1071 ms. Trace:
I20260709 13:04:17.391734 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:17.392148 15243 rpcz_store.cc:276] 0709 13:04:16.308481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.378687 (+1070206us) service_pool.cc:224] Handling call
0709 13:04:17.379089 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:17.379287 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:17.379313 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:17.379353 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:17.379401 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.379453 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.379573 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:17.325599 19579 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.353395 19709 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:17.386669 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:17.399672 16024 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:17.294555 19867 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:17.324133 19908 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:17.295616 19511 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:04:17.404269 15289 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:17.407900 19867 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.410586 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2348) took 1087 ms. Trace:
I20260709 13:04:17.411001 15394 rpcz_store.cc:276] 0709 13:04:16.322728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.620921 (+298193us) service_pool.cc:224] Handling call
0709 13:04:16.621291 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:16.646550 (+ 25259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.646583 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:16.681237 (+ 34654us) log.cc:844] Serialized 26 byte log entry
0709 13:04:16.982470 (+301233us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:16.982529 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.982622 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.410318 (+427696us) raft_consensus.cc:1685] finished
0709 13:04:17.410339 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.410522 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26520,"raft.queue_time_us":24991,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":20108,"thread_start_us":271703,"threads_started":1,"wal-append.queue_time_us":445023}
I20260709 13:04:17.414299 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 571) took 1245 ms. Trace:
I20260709 13:04:17.414718 15317 rpcz_store.cc:276] 0709 13:04:16.168514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.168716 (+   202us) service_pool.cc:224] Handling call
0709 13:04:16.189936 (+ 21220us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:16.289981 (+100045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.290010 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:16.290755 (+   745us) log.cc:844] Serialized 52 byte log entry
0709 13:04:16.526683 (+235928us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:16.526746 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.413764 (+887018us) spinlock_profiling.cc:243] Waited 99.6 ms on lock 0x7b54002ed1d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:17.413827 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.413884 (+    57us) raft_consensus.cc:1685] finished
0709 13:04:17.413908 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.414188 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11661,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":12341,"spinlock_wait_cycles":229084032,"thread_start_us":235340,"threads_started":1,"wal-append.queue_time_us":321089}
I20260709 13:04:17.337206 19872 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:04:17.355876 19675 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:17.417894 15243 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:17.390146 19802 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:17.421900 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:17.426777 16031 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:17.395810 19842 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:17.353678 19701 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.399863 19848 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:17.431643 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2370) took 1096 ms. Trace:
I20260709 13:04:17.435115 15241 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:17.416324 19709 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:17.440645 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:17.405783 19915 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:17.406620 19871 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:17.441395 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2344) took 1196 ms. Trace:
W20260709 13:04:17.444072 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 218443us
W20260709 13:04:17.446849 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 203950us
I20260709 13:04:17.449381 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:17.430310 19579 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:17.400295 19912 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.438262 15243 rpcz_store.cc:276] 0709 13:04:16.330860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.394060 (+1063200us) service_pool.cc:224] Handling call
0709 13:04:17.405777 (+ 11717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:17.426346 (+ 20569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.426588 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:17.434345 19675 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.443879 15391 rpcz_store.cc:276] 0709 13:04:16.244660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.616652 (+371992us) service_pool.cc:224] Handling call
0709 13:04:16.662013 (+ 45361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:16.685745 (+ 23732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.685792 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:16.712065 (+ 26273us) log.cc:844] Serialized 52 byte log entry
0709 13:04:17.030558 (+318493us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:17.106929 (+ 76371us) log.cc:844] Serialized 14 byte log entry
0709 13:04:17.170552 (+ 63623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.170655 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.441091 (+270436us) raft_consensus.cc:1685] finished
0709 13:04:17.441118 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.441317 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63215,"prepare.queue_time_us":75620,"prepare.run_wall_time_us":3573,"raft.queue_time_us":96456,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":7412,"spinlock_wait_cycles":53002368,"thread_start_us":318066,"threads_started":1,"wal-append.queue_time_us":553825}
I20260709 13:04:17.429472 19886 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.470832 19865 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:17.471619 19865 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:17.472999 19911 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:04:17.471004 19670 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.476065 19865 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.477659 19782 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:17.446050 19430 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:17.479846 19430 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:17.480374 19430 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:17.482684 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 237789us
I20260709 13:04:17.443075 19915 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:17.464906 19724 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:17.455101 19579 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:17.501561 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 94667.4us
I20260709 13:04:17.511631 19579 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:17.512300 19905 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:04:17.487068 19712 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.489379 19915 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.469234 19871 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.494184 19724 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:17.511441 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:17.534089 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49998.5us
W20260709 13:04:17.543797 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 151539us
I20260709 13:04:17.529107 19845 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.555154 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:17.556330 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.557410 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.558339 15316 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
W20260709 13:04:17.559144 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.559674 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:17.536147 19724 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:17.557252 15323 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:17.565258 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:17.565433 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:17.566730 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.572240 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.573719 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.578140 19701 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.539064 19928 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:04:17.592924 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.596375 15291 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:17.527089 19842 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.530591 19908 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.535679 19848 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.604668 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1630) took 1418 ms. Trace:
I20260709 13:04:17.605154 15248 rpcz_store.cc:276] 0709 13:04:16.186617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.190077 (+1003460us) service_pool.cc:224] Handling call
0709 13:04:17.218698 (+ 28621us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:17.251236 (+ 32538us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:17.425570 (+174334us) log.cc:844] Serialized 14 byte log entry
0709 13:04:17.544073 (+118503us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:17.548585 (+  4512us) log.cc:844] Serialized 52 byte log entry
0709 13:04:17.548752 (+   167us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:17.548954 (+   202us) log.cc:844] Serialized 14 byte log entry
0709 13:04:17.549168 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.549255 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.604430 (+ 55175us) raft_consensus.cc:1685] finished
0709 13:04:17.604453 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.604606 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45162,"prepare.queue_time_us":319946,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":23791,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":9515,"spinlock_wait_cycles":23795328,"thread_start_us":223694,"threads_started":2,"wal-append.queue_time_us":165588}
I20260709 13:04:17.577018 19845 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:17.575362 19916 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:17.599253 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:17.583456 19928 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:17.618026 15291 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:17.535476 19709 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.614643 19845 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.631639 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.635592 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:17.648083 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.630789 19845 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:17.655462 15291 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:17.631954 19685 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:17.631045 19928 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:17.670480 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.671221 15248 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:17.674436 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:17.678907 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:17.666404 19670 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:17.680349 19344 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:17.680914 19344 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:17.681329 19344 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:17.683372 19920 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:17.663759 19701 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:17.662508 19685 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:17.623988 19916 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.685137 15248 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:17.673754 19675 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.679440 19912 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:17.696267 19923 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:04:17.699551 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.700314 19430 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.707336 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2337) took 1643 ms. Trace:
I20260709 13:04:17.709784 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:17.710428 19177 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:17.711297 19918 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:04:17.692477 19944 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:17.764546 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54862.9us
W20260709 13:04:17.718887 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.766268 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:17.687315 19701 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:17.724457 19869 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.402s	user 0.005s	sys 0.001s
I20260709 13:04:17.724491 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2712) took 1191 ms. Trace:
I20260709 13:04:17.693379 19871 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.726739 16031 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:17.728391 19843 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.730767 16028 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:04:17.762566 19715 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.005s
I20260709 13:04:17.731499 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:17.833839 16025 raft_consensus.cc:2368] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13.
I20260709 13:04:17.689689 19685 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:17.731979 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:17.732620 15241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2368) took 1423 ms (client timeout 1662 ms). Trace:
W20260709 13:04:17.835932 15241 rpcz_store.cc:269] 0709 13:04:16.308783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.541896 (+233113us) service_pool.cc:224] Handling call
0709 13:04:17.732397 (+1190501us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54001a8bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:17.732539 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897938688}
I20260709 13:04:17.733752 19876 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:17.839051 19914 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:17.839296 19876 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:17.839504 19914 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:17.839921 19914 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:17.840216 19876 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.841457 19876 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:17.741920 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.743638 19675 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.746054 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 729) took 1370 ms. Trace:
I20260709 13:04:17.846122 16033 rpcz_store.cc:276] 0709 13:04:16.376345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.473795 (+ 97450us) service_pool.cc:224] Handling call
0709 13:04:17.745807 (+1272012us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540041d2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:17.745960 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257203584}
I20260709 13:04:17.846217 19675 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:17.747013 19935 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.132s	user 0.001s	sys 0.001s
I20260709 13:04:17.848593 19675 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:17.831897 19732 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:17.768059 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:17.770592 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.771740 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:17.851089 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 83102.3us
I20260709 13:04:17.852067 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:17.783932 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:17.854337 15318 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:17.730952 16024 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:17.784963 15325 rpcz_store.cc:276] 0709 13:04:16.533459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.536032 (+  2573us) service_pool.cc:224] Handling call
0709 13:04:17.722009 (+1185977us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b5400218ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:17.724399 (+  2390us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161050752}
W20260709 13:04:17.831126 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 231945us
I20260709 13:04:17.831301 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2364) took 1525 ms. Trace:
I20260709 13:04:17.831547 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.838687 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.856526 15317 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:17.856841 15248 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:17.784010 19867 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:17.749081 15392 rpcz_store.cc:276] 0709 13:04:16.064500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.064662 (+   162us) service_pool.cc:224] Handling call
0709 13:04:16.065170 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:16.095443 (+ 30273us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:16.130522 (+ 35079us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.445440 (+314918us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.445651 (+   211us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:16.479932 (+ 34281us) log.cc:844] Serialized 26 byte log entry
0709 13:04:16.480109 (+   177us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:16.480162 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.480264 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.700304 (+1220040us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b18001fe760. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:17.707051 (+  6747us) raft_consensus.cc:1685] finished
0709 13:04:17.707079 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.707257 (+   178us) inbound_call.cc:177] Queueing success response
0709 13:04:17.736870 (+ 29613us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b18001fe760. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
Metrics: {"mutex_wait_us":143521,"prepare.queue_time_us":29104,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":2666,"raft.queue_time_us":370424,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":10707,"spinlock_wait_cycles":16817280,"thread_start_us":162217,"threads_started":1,"wal-append.queue_time_us":350650}
I20260709 13:04:17.854221 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:17.786365 19908 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:17.842608 15247 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:17.863091 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.831467 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2366) took 1523 ms. Trace:
I20260709 13:04:17.856302 15249 rpcz_store.cc:276] 0709 13:04:16.306054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.228948 (+922894us) service_pool.cc:224] Handling call
0709 13:04:17.248626 (+ 19678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:17.248848 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:04:17.426783 (+177935us) log.cc:844] Serialized 14 byte log entry
0709 13:04:17.830911 (+404128us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:17.830968 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:17.831019 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.831086 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.831228 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266171,"prepare.queue_time_us":274183,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":271181,"thread_start_us":293169,"threads_started":2,"wal-append.queue_time_us":242243}
I20260709 13:04:17.855880 15213 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:17.859134 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.785130 19701 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:17.861426 15322 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:17.861572 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:17.859436 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.784454 19944 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:17.763762 19177 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.889127 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.889273 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.892504 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.895262 15248 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:17.864745 15242 rpcz_store.cc:276] 0709 13:04:16.308191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.247780 (+939589us) service_pool.cc:224] Handling call
0709 13:04:17.255681 (+  7901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:17.255910 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:17.517246 (+261336us) log.cc:844] Serialized 14 byte log entry
0709 13:04:17.831049 (+313803us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:17.831102 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:17.831145 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.831230 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.831396 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":295164,"prepare.queue_time_us":292585,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4493,"raft.queue_time_us":266684,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":243287,"threads_started":2,"wal-append.queue_time_us":177790}
I20260709 13:04:17.891374 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:17.900511 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.867579 19843 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:17.867465 19842 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.906464 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:17.844305 19715 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.911360 19927 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:17.912462 15243 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:17.912560 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:17.913187 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.907007 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:17.863262 19908 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:17.777508 19579 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.893380 19636 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:17.915683 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:17.914491 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:17.844995 19915 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.915918 15323 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:17.919818 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.922353 15322 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:17.923333 15241 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:17.903928 19791 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.927219 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.932587 15323 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:04:17.905263 19402 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:17.888598 19848 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:17.902074 19140 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:17.942530 19702 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:17.942823 19140 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.904517 19843 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:17.919534 19689 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.851s	user 0.013s	sys 0.000s
I20260709 13:04:17.902539 19675 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:17.968971 19675 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:17.930040 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:17.934247 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:17.969476 19675 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:17.970150 19557 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:17.970944 19557 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:17.938427 15316 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:17.921370 19908 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:17.925974 19929 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:17.930343 19912 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:17.975823 19912 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.976235 19912 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:17.941387 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:17.981418 15241 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:04:17.982360 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2373) took 1630 ms. Trace:
I20260709 13:04:17.982769 15241 rpcz_store.cc:276] 0709 13:04:16.352165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.980586 (+1628421us) service_pool.cc:224] Handling call
0709 13:04:17.981051 (+   465us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:17.982016 (+   965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.982292 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:17.949314 15321 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 563) took 2795 ms (client timeout 1553 ms). Trace:
W20260709 13:04:17.984611 15321 rpcz_store.cc:269] 0709 13:04:15.154174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.161299 (+  7125us) service_pool.cc:224] Handling call
0709 13:04:17.949091 (+2787792us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b5400375354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:17.949242 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109736192}
I20260709 13:04:17.986071 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:17.986927 19715 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.925041 19636 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:17.950834 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:17.952088 19670 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:04:17.988116 19636 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:17.988713 19670 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:17.989116 19670 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:17.989500 19670 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:17.990808 15321 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:17.992123 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:17.956614 19948 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:04:17.957458 19430 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.953680 19843 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:17.945341 19140 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.958703 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:18.005631 15241 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:17.960397 19845 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:17.963003 19579 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:17.963718 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:17.968544 19802 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 13:04:18.006515 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1635) took 1436 ms. Trace:
W20260709 13:04:17.986429 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:17.955858 19949 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:04:17.917419 19842 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.012178 19867 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.003722 15321 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:04:17.958789 19944 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.031746 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:18.010725 19724 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.007054 15241 rpcz_store.cc:276] 0709 13:04:16.570486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.983720 (+1413234us) service_pool.cc:224] Handling call
0709 13:04:17.984104 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.006201 (+ 22097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.006456 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:18.010660 19845 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.011327 15325 raft_consensus.cc:2368] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:17.996521 15318 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:17.936923 19791 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.021195 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:17.948189 19402 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.035411 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:18.007532 19916 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.046327 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:18.040354 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:17.951946 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:17.999934 19689 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:17.992777 19848 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.013373 19802 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.040330 19417 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:18.079098 16030 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:18.080215 15321 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:04:18.087445 16032 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:04:18.088622 15324 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:18.092592 15249 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:18.091037 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:18.074005 19177 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:18.042428 19344 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:18.143986 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.042649 19908 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.082032 19417 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.192363 19417 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:18.192860 19802 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:18.199712 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 109712us
I20260709 13:04:18.199981 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:18.201579 15241 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:18.032574 19867 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.208730 15320 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:18.204221 19956 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:04:18.227234 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:18.228134 15241 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:18.214262 19926 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:04:18.239863 19926 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:18.240423 19926 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.242525 19926 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:18.248884 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:18.209805 19915 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:18.261350 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 545) took 1242 ms. Trace:
I20260709 13:04:18.261998 15241 rpcz_store.cc:276] 0709 13:04:17.018912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.244865 (+1225953us) service_pool.cc:224] Handling call
0709 13:04:18.260605 (+ 15740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.260875 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:18.260916 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:18.260977 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:18.261034 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.261111 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:18.261269 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:18.272732 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:18.284435 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 83274.1us
I20260709 13:04:18.288569 15244 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:18.289451 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 546) took 1257 ms. Trace:
I20260709 13:04:18.289891 15244 rpcz_store.cc:276] 0709 13:04:17.031834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.277309 (+1245475us) service_pool.cc:224] Handling call
0709 13:04:18.288396 (+ 11087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.289130 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.289379 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:18.277045 19830 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.308421 19854 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:18.308755 19689 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:18.314503 19954 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:04:18.308525 19670 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.316416 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:18.316917 19670 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.317067 15319 raft_consensus.cc:2376] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13. Re-sending same reply.
I20260709 13:04:18.318128 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:18.308439 19344 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.318608 19685 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.323441 19685 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.318074 19417 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.306100 19830 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.331715 19791 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.332703 19417 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.324337 19908 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:18.319422 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:18.334386 15323 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:18.335150 15319 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:18.337472 19912 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:18.338570 19957 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:04:18.306725 19842 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.332842 19830 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:18.321051 19675 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.288313 19832 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:18.339301 19914 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.329319 19636 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.326179 19867 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.348634 16029 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:18.340288 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:18.364403 16033 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
W20260709 13:04:18.361549 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 100112us
I20260709 13:04:18.370812 15322 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:18.372503 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2388) took 1176 ms. Trace:
I20260709 13:04:18.372938 15241 rpcz_store.cc:276] 0709 13:04:17.196171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.283077 (+1086906us) service_pool.cc:224] Handling call
0709 13:04:18.283455 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.283732 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:18.293516 (+  9784us) log.cc:844] Serialized 14 byte log entry
0709 13:04:18.372142 (+ 78626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:18.372190 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:18.372240 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.372298 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:18.372445 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1078,"prepare.queue_time_us":10065,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":77180,"threads_started":1}
I20260709 13:04:18.373603 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:18.375031 15241 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:18.340382 19912 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.375527 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:18.340442 19832 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:18.376495 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 107623us
I20260709 13:04:18.395679 19832 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:18.396973 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:18.397528 19848 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.398372 15365 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:18.399297 19928 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.727s	user 0.007s	sys 0.004s
I20260709 13:04:18.399260 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:18.375970 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 103372us
I20260709 13:04:18.377270 16033 raft_consensus.cc:2368] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
I20260709 13:04:18.388170 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:18.392839 19402 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:18.401036 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:18.403976 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:18.399823 19928 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.415223 19973 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:18.420311 19973 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:18.420689 19973 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.421005 19973 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:18.406005 19749 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:18.424257 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1628) took 2251 ms. Trace:
I20260709 13:04:18.424090 19749 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.410538 19685 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:18.427099 19685 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:18.427520 19685 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:18.428580 19843 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.431519 19830 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:18.432006 19830 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:18.432073 19928 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.432476 19830 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.417982 19914 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.424712 15245 rpcz_store.cc:276] 0709 13:04:16.172656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.288044 (+115388us) service_pool.cc:224] Handling call
0709 13:04:17.083604 (+795560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:17.109191 (+ 25587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:17.109236 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:17.182732 (+ 73496us) log.cc:844] Serialized 26 byte log entry
0709 13:04:17.436991 (+254259us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:17.545323 (+108332us) log.cc:844] Serialized 14 byte log entry
0709 13:04:17.545581 (+   258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.545675 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.604333 (+ 58658us) raft_consensus.cc:1685] finished
0709 13:04:17.604352 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:18.424043 (+819691us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b540001e350. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:18.424189 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17306,"prepare.queue_time_us":140515,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":1938,"raft.queue_time_us":6207,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":26613,"spinlock_wait_cycles":1828818304,"thread_start_us":299016,"threads_started":2,"wal-append.queue_time_us":331040}
I20260709 13:04:18.434268 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:18.437659 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:18.448733 15241 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:18.449491 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:18.412211 19916 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:18.440114 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:18.444777 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:18.438012 15250 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:04:18.455108 19832 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.456916 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:18.457381 19832 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:18.448815 19970 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.452214 19916 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:18.459721 19916 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:18.460024 19702 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:18.462082 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:18.462842 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:18.467581 19974 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:18.468210 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2389) took 1271 ms. Trace:
I20260709 13:04:18.468627 15244 rpcz_store.cc:276] 0709 13:04:17.196494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.293244 (+1096750us) service_pool.cc:224] Handling call
0709 13:04:18.306142 (+ 12898us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.306406 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:18.366363 (+ 59957us) log.cc:844] Serialized 14 byte log entry
0709 13:04:18.467859 (+101496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:18.467917 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:18.467970 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.468032 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:18.468152 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19965,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":1013,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":160409,"threads_started":2}
I20260709 13:04:18.471477 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:18.472311 15250 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:18.477460 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:18.478324 15319 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:18.485231 15241 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
W20260709 13:04:18.467356 19701 consensus_meta.cc:287] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.003s
I20260709 13:04:18.498682 19636 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.500038 19675 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.489205 19177 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.501127 19177 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.503404 19177 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:18.505674 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:18.508612 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:18.508671 15291 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:18.512617 15245 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:18.513099 19177 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:18.513527 19177 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.513859 19177 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:18.512815 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:18.470626 19749 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.474406 19974 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:18.516897 19551 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:18.517999 15250 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:18.522763 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:18.511694 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:18.520296 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:18.525517 15244 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:18.526031 19845 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:18.556217 19845 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:18.556754 19845 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:18.492863 19701 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.560573 19701 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.463915 19970 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.562557 15317 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:18.562809 19882 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:18.563308 19882 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.564723 19970 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.526191 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:18.565455 19882 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:18.526787 19551 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.568723 19551 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:18.566038 15248 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:18.573103 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:18.574119 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:18.573968 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:18.533970 15325 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:18.575582 19872 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.576160 19872 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.578053 19344 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:18.538584 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:18.579107 19430 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:18.523810 19832 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.579367 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:18.579543 15322 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:18.579905 19832 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.581179 15291 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:18.524300 19702 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:18.582080 19344 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:18.582422 19702 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:18.582641 19344 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:18.582861 19702 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:18.582999 19832 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:18.583668 19344 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.585193 19845 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:18.550280 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 151060us
I20260709 13:04:18.574802 15241 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:18.587069 16024 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:18.588132 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:18.588788 16032 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:18.578125 19675 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:18.579542 19430 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:18.591323 19430 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.592952 19430 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:18.589684 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:18.594569 16026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 728) took 2224 ms (client timeout 2079 ms). Trace:
I20260709 13:04:18.594799 16025 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:04:18.595042 16026 rpcz_store.cc:269] 0709 13:04:16.370663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.370799 (+   136us) service_pool.cc:224] Handling call
0709 13:04:18.594327 (+2223528us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54005f14d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:18.594465 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753928064}
I20260709 13:04:18.596055 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:18.596240 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:18.596909 16029 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:18.583669 19832 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.596773 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:18.598889 19832 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.532051 19974 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.565330 15317 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:18.546618 19973 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.603011 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:18.575685 15245 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:18.608935 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:18.596042 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:18.612105 15319 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:18.618631 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:18.615258 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:18.594589 19854 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:18.673830 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 272845us
W20260709 13:04:18.613106 19979 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.145s	user 0.002s	sys 0.001s
I20260709 13:04:18.606122 19872 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.606894 19551 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:18.612879 19670 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.669296 19579 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:18.612435 19675 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:18.703020 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.705746 15392 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:18.680030 19975 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.213s	user 0.000s	sys 0.002s
I20260709 13:04:18.713377 15244 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:18.714023 15242 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:18.681509 19749 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.728286 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:18.734563 15392 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:18.738372 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.745100 15391 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:18.739264 15394 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:18.748553 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.750644 15399 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:04:18.754254 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 160538us
I20260709 13:04:18.749420 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.756686 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.679057 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:18.765380 16027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 808) took 2212 ms (client timeout 2209 ms). Trace:
W20260709 13:04:18.765904 16027 rpcz_store.cc:269] 0709 13:04:16.553443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.562385 (+  8942us) service_pool.cc:224] Handling call
0709 13:04:18.765155 (+2202770us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b5400632c54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:18.765288 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883064576}
I20260709 13:04:18.742053 19579 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:18.701644 19551 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.769093 15363 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:18.707212 19670 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.776834 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.763163 19982 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:18.777594 15398 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:18.743834 19749 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.746857 19882 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:04:18.786213 16027 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:18.753854 19685 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.771806 19854 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:18.784756 19749 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.791772 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:18.791849 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 173333us
I20260709 13:04:18.772094 19984 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:18.799453 15396 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:18.800856 19670 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.801731 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:18.801530 19863 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:18.802407 15398 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:04:18.802486 19830 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.805228 19830 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:18.805948 19830 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:18.787076 19709 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:18.810642 15398 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:18.810668 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:18.817726 15244 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:18.813553 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:18.813068 15392 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:18.799113 19982 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:18.853128 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.856986 15392 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:18.856376 19749 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:18.817415 19863 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:04:18.816640 19830 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.856822 19981 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:18.818763 19709 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.856012 19579 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:18.866918 19980 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:18.867214 19830 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:18.867978 19551 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:18.869282 19832 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:18.903008 15291 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:18.874678 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.875088 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.905078 15399 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
I20260709 13:04:18.886612 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:18.889074 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:18.891961 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 73186.2us
I20260709 13:04:18.850512 19984 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:18.915853 15393 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:18.921078 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 152086us
I20260709 13:04:18.868271 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.875690 15390 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:04:18.925715 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 246699us
I20260709 13:04:18.884366 15245 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:04:18.872797 15244 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:18.926158 15390 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:18.863758 19685 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.930806 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:18.930636 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 138151us
I20260709 13:04:18.901557 19973 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:18.881361 19845 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:18.880494 19886 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.879809 19876 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.932516 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.956079 15399 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:18.880834 19989 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.937733 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.910046 19749 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:18.962177 19749 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.875073 19709 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:18.949692 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:18.967658 15398 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:18.941876 15390 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.960942 15395 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:04:18.969019 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.969616 15395 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:18.892608 19344 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.859376 19982 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.982947 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:18.983594 16027 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:18.983853 19982 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:18.984699 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:18.986568 19984 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.860404 19675 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:18.971095 15363 leader_election.cc:400] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13.
I20260709 13:04:18.993297 15363 leader_election.cc:403] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:04:18.916255 19916 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.975637 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:18.967053 19886 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.980897 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:18.880247 19177 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.973374 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:18.873667 19702 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.956547 19551 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.004710 15399 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:18.935554 19832 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:04:18.967393 19845 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:19.014679 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 81148.1us
I20260709 13:04:19.012069 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:18.959121 19701 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:19.008816 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:19.016160 19970 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:19.016395 19973 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:19.016642 19732 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:19.016810 19982 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:04:19.018543 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.019018 15362 leader_election.cc:400] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:19.010004 19972 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:19.038501 15362 leader_election.cc:403] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:19.039369 15398 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:19.041517 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1685) took 1137 ms. Trace:
I20260709 13:04:18.977766 19876 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:18.874732 19854 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:19.041899 15320 rpcz_store.cc:276] 0709 13:04:17.904338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.968446 (+ 64108us) service_pool.cc:224] Handling call
0709 13:04:17.968856 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.209252 (+240396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.041294 (+832042us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400218ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:19.041466 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551153920}
I20260709 13:04:18.994972 19344 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.978215 19989 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:18.990278 19992 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:04:19.033386 19970 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:19.000255 19969 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:04:19.023126 19872 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:04:19.039513 19701 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:19.060572 19860 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:19.060631 19999 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:19.029975 19845 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:19.061424 19916 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:19.024469 19551 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:19.059942 19970 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.063444 19876 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:19.065215 19989 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:19.055037 19982 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:04:19.066136 19992 consensus_queue.cc:1243] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:04:19.065277 19969 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:19.202471 19969 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:19.203573 19969 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:19.204873 19969 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.067719 16027 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:04:19.068578 19985 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:04:19.069033 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:19.075908 19886 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:19.077482 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:19.094400 19675 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:19.096297 19732 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:19.099599 19702 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:19.026750 19981 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:04:19.151904 19430 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.558s	user 0.020s	sys 0.000s
I20260709 13:04:19.157493 19701 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:19.216594 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:19.217257 16029 raft_consensus.cc:2376] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14. Re-sending same reply.
I20260709 13:04:19.059087 19927 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:19.219321 19845 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:19.207201 19982 consensus_queue.cc:1243] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:04:19.221272 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:19.167793 19995 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:19.201709 19882 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:19.208894 16030 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:19.205654 19973 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13.
I20260709 13:04:19.223616 19995 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:19.224711 19995 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:19.227059 19177 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:19.229928 19344 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:19.232442 19830 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:19.235507 19830 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:19.237115 19551 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:19.243643 19924 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:19.244319 19924 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:19.246783 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2371) took 2895 ms. Trace:
I20260709 13:04:19.247362 15243 rpcz_store.cc:276] 0709 13:04:16.351094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.465720 (+1114626us) service_pool.cc:224] Handling call
0709 13:04:17.483907 (+ 18187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:17.913225 (+429318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.246452 (+1333227us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540010ca54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:19.246708 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":985046784}
I20260709 13:04:19.196594 19996 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:19.259042 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:19.259994 15316 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:19.261145 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:19.262705 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:19.263059 15322 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:19.263487 15325 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:19.263626 19929 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.264228 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:19.264761 15390 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:19.264981 15317 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:19.264276 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:19.266026 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:19.266208 15325 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:19.266922 15317 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:19.268093 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:19.268685 15317 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:19.245483 19924 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:19.271514 19995 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:19.271698 19924 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:19.272890 15393 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:19.273257 15393 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:19.264875 15322 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:19.276479 15316 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:19.285010 15390 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:04:19.285741 15390 pending_rounds.cc:85] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 10
I20260709 13:04:19.286340 19140 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:19.288050 19724 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:19.292153 15390 pending_rounds.cc:107] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:04:19.274017 15393 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:19.296641 15390 raft_consensus.cc:2889] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:19.302157 15393 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.264181 19929 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:19.283214 19715 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.313014 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:19.317871 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:19.326493 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:19.335283 15393 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:04:19.335813 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:19.340441 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:19.335860 15393 pending_rounds.cc:85] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 9
I20260709 13:04:19.345871 15393 pending_rounds.cc:107] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:04:19.346141 15317 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:19.296051 19871 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:04:19.347468 15393 raft_consensus.cc:2889] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:19.304683 19551 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:04:19.371173 19929 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:19.343291 19886 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:19.375842 19970 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:19.377707 15325 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:19.405061 19709 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:19.325057 19715 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:19.367357 19832 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:04:19.431692 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:19.432993 15325 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:19.433413 20009 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:19.433712 16031 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:19.345607 19876 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:19.425182 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:19.437552 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:19.441275 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:19.429766 15289 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:19.412328 19732 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:19.434612 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:19.349682 19724 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:19.378010 19970 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:19.446060 15316 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:19.447261 19886 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:19.459193 19886 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.459715 19886 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:19.436605 19876 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:19.463011 19876 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.449648 19724 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:19.466778 19724 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.436906 19843 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:19.434036 20009 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:19.477347 15291 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:19.417785 19140 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:04:19.451869 19551 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:19.476352 19177 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:19.482843 15244 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:19.447932 19732 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:19.452452 19929 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:19.494778 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:19.496625 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:19.492982 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:19.495956 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:19.501278 19177 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:19.492961 19929 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.512199 19929 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:19.489306 19845 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:19.478219 19970 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:04:19.527866 15365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.026s	sys 0.030s
W20260709 13:04:19.528296 15365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.027s	sys 0.030s
W20260709 13:04:19.529009 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 913758us
I20260709 13:04:19.520862 19732 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:19.448764 15213 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:19.542752 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 113091us
I20260709 13:04:19.546805 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:19.552776 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.015s	sys 0.019s
W20260709 13:04:19.553560 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.015s	sys 0.019s
W20260709 13:04:19.554179 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 542139us
I20260709 13:04:19.560463 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:19.555071 15289 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:19.571336 15362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.032s	sys 0.074s
W20260709 13:04:19.573283 15362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.033s	sys 0.074s
I20260709 13:04:19.533741 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:19.489583 19344 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:04:19.573129 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:19.557878 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:19.588126 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:19.588763 15244 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:19.589069 15245 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:19.591723 15247 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:04:19.576781 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 557863us
I20260709 13:04:19.531538 19845 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:19.599388 15241 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:19.537048 19177 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:19.557132 19430 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:19.608011 19995 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:19.608196 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 74575.6us
I20260709 13:04:19.608448 19344 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:19.609627 19702 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:19.616091 19702 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:19.616566 19860 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:19.616384 19845 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:19.617424 19860 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:04:19.611953 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.552579 19984 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.015s	sys 0.046s
I20260709 13:04:19.614009 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:19.615160 15319 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:19.551187 19991 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:04:19.618384 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 63430.5us
I20260709 13:04:19.536562 19982 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:04:19.640102 15289 leader_election.cc:400] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
I20260709 13:04:19.622190 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:19.640498 15289 leader_election.cc:403] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:04:19.630609 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.634275 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.617031 19702 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:19.642202 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.643998 15392 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:19.593134 19732 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:19.616248 19715 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:19.640844 15250 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:19.640357 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:19.647150 15319 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:19.649446 15395 raft_consensus.cc:2368] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
I20260709 13:04:19.640410 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:19.651554 15316 raft_consensus.cc:2368] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
W20260709 13:04:19.658483 15363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.028s	sys 0.054s
W20260709 13:04:19.659119 15363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.029s	sys 0.054s
W20260709 13:04:19.659538 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 628150us
W20260709 13:04:19.530057 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 521274us
I20260709 13:04:19.667397 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:19.668715 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.669694 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:19.671005 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.671883 15392 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:19.668624 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:19.675123 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.676193 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.677289 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.678009 15398 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:19.679651 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.680256 15395 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:19.681066 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.683485 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.683084 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:04:19.636526 19984 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.015s	sys 0.046s
I20260709 13:04:19.686736 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.687153 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:19.687456 15392 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:19.620520 19860 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:19.623061 19177 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:19.661607 15363 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:19.710021 20013 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:19.710893 20013 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:19.698096 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.719738 15393 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
I20260709 13:04:19.698956 15399 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:19.700198 15245 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:19.700441 15395 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:19.714004 20013 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:19.730633 15321 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.010s
W20260709 13:04:19.731984 15321 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.008s	sys 0.011s
W20260709 13:04:19.731520 15323 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.032s	sys 0.043s
W20260709 13:04:19.733103 15323 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.032s	sys 0.043s
I20260709 13:04:19.735234 20027 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:19.640103 19992 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:19.741936 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:19.650796 19430 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:19.743227 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:19.744971 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 83459.5us
I20260709 13:04:19.649268 19995 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:19.809831 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:19.810873 16033 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:19.736084 20027 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:19.746479 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.747102 15250 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:19.682963 19912 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
I20260709 13:04:19.682081 19715 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.748922 15397 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:19.885339 16030 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:19.650063 19830 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
W20260709 13:04:19.803561 15320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.003s	sys 0.010s
I20260709 13:04:19.806707 15398 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:19.888314 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:19.783087 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 100067us
I20260709 13:04:19.701972 19969 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:19.754163 19675 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.018s
W20260709 13:04:19.935623 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.928062 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:19.702414 19709 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:19.701318 19177 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:19.769412 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.748056 19984 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:19.764918 19974 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.005s	sys 0.018s
I20260709 13:04:19.699803 19916 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
W20260709 13:04:19.750571 19981 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.017s	sys 0.015s
I20260709 13:04:19.753185 19702 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:19.881973 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.024046 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:19.886142 15214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.003s	sys 0.015s
W20260709 13:04:19.819499 19701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.006s	sys 0.010s
I20260709 13:04:19.908140 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:19.889250 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:19.888434 15320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.004s	sys 0.011s
I20260709 13:04:20.070734 15393 raft_consensus.cc:2368] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
I20260709 13:04:19.736610 20005 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.182s
W20260709 13:04:19.913846 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 340803us
W20260709 13:04:19.915726 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.898286 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.075335 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:20.075871 15397 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:20.076556 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:19.941357 19551 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:19.928646 19915 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:19.874704 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:19.940337 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:19.953655 20017 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.221s	user 0.000s	sys 0.003s
W20260709 13:04:19.955358 20019 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
W20260709 13:04:20.016337 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 567641us
I20260709 13:04:20.027236 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.425815 15395 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:19.871102 20012 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:20.020246 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 405235us
I20260709 13:04:20.434706 20012 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:20.435118 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:20.435369 20012 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:20.436791 15291 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:20.437711 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:20.062721 15399 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:20.063097 15214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.006s	sys 0.015s
W20260709 13:04:20.439138 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 1.09872e+06us
I20260709 13:04:20.439502 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:20.440294 15320 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:20.440452 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:19.933274 19675 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.015s	sys 0.021s
I20260709 13:04:20.441398 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:20.442155 19675 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:20.442754 19675 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:20.019085 19974 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.006s	sys 0.020s
I20260709 13:04:20.018715 19749 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.929118 19969 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:20.030773 19981 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.017s	sys 0.019s
I20260709 13:04:20.443888 20038 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:19.890486 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2739) took 1891 ms. Trace:
I20260709 13:04:20.084653 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.444401 20038 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:20.444931 20038 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:20.445186 15391 raft_consensus.cc:2368] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
I20260709 13:04:20.088529 15316 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:20.444538 15324 rpcz_store.cc:276] 0709 13:04:17.997601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.089471 (+ 91870us) service_pool.cc:224] Handling call
0709 13:04:18.089744 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.089930 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:19.226592 (+1136662us) log.cc:844] Serialized 14 byte log entry
0709 13:04:19.888695 (+662103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:19.888809 (+   114us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:19.888887 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.888982 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:19.889154 (+   172us) inbound_call.cc:177] Queueing success response
0709 13:04:20.151240 (+262086us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
Metrics: {"mutex_wait_us":1137406,"prepare.queue_time_us":1149108,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":161180,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":26071,"spinlock_wait_cycles":70295168,"thread_start_us":659524,"threads_started":2,"wal-append.queue_time_us":493113}
I20260709 13:04:19.884241 19992 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.090142 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:19.957175 19177 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:20.074796 19701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.006s	sys 0.010s
I20260709 13:04:20.024791 20009 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:20.144276 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65526.3us
I20260709 13:04:19.930387 19715 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:19.957379 20020 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:20.425490 20040 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:20.032840 19970 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:19.929206 19882 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.212s
I20260709 13:04:19.911731 19860 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.419081 20047 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:20.419202 20037 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:20.178824 19915 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:20.426618 16028 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
W20260709 13:04:20.426219 15242 consensus_meta.cc:287] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.865s	user 0.013s	sys 0.002s
W20260709 13:04:20.430495 20041 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 13:04:20.389418 19430 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.434034 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:20.442553 20039 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:20.443295 19675 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:20.020269 19886 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.003s
I20260709 13:04:20.444098 19969 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:20.443885 19749 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.447723 20043 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:20.020346 20011 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:20.426008 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:20.442032 15320 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.450532 15398 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
W20260709 13:04:20.480278 20006 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.609s	user 0.004s	sys 0.003s
I20260709 13:04:20.565793 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.567592 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.568882 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.569852 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.570585 15398 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:20.571583 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.573123 15398 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:20.465302 15248 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:19.958302 19854 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.454s
I20260709 13:04:20.475034 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.476156 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.575068 19974 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:20.575502 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.577196 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:20.456962 19871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.016s	sys 0.087s
W20260709 13:04:20.456879 20015 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.700s	user 0.003s	sys 0.004s
I20260709 13:04:20.418458 20013 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:20.193611 19551 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:20.466346 20030 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.732s	user 0.009s	sys 0.005s
I20260709 13:04:20.496025 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.497611 15241 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:20.577430 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.422459 19995 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:20.478886 19916 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:20.547189 15321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.085s	sys 0.192s
W20260709 13:04:20.605702 15321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.085s	sys 0.192s
I20260709 13:04:20.547312 15390 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:20.465720 19927 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:20.609582 19927 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.610116 19927 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:20.610442 20031 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:04:20.611199 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 580) took 2621 ms. Trace:
W20260709 13:04:20.611469 20032 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:04:20.611636 15321 rpcz_store.cc:276] 0709 13:04:17.989783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.083272 (+ 93489us) service_pool.cc:224] Handling call
0709 13:04:18.083501 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.083644 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:04:18.099629 (+ 15985us) log.cc:844] Serialized 14 byte log entry
0709 13:04:19.732523 (+1632894us) log.cc:844] Serialized 14 byte log entry
0709 13:04:20.610761 (+878238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:20.610819 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:20.610881 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:20.610978 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:20.611137 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":869890,"prepare.queue_time_us":2016931,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":56731,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":6071,"thread_start_us":1584955,"threads_started":3,"wal-append.queue_time_us":307398,"wal-append.run_cpu_time_us":1243,"wal-append.run_wall_time_us":1021020}
I20260709 13:04:20.613786 19944 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:20.469496 20010 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.712s	user 0.000s	sys 0.008s
I20260709 13:04:20.552203 15395 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:20.615188 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.615731 15395 raft_consensus.cc:2376] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10. Re-sending same reply.
I20260709 13:04:20.616668 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.617358 15395 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:20.617617 20039 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:20.618587 19916 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:20.478615 20014 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.465310 19988 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:04:20.482151 20023 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.753s	user 0.002s	sys 0.013s
W20260709 13:04:20.483178 19708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.042s	sys 0.092s
I20260709 13:04:20.478861 19990 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:20.626132 20014 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:20.455924 15323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.022s	sys 0.047s
W20260709 13:04:20.655107 15323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.022s	sys 0.047s
I20260709 13:04:20.575584 19974 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:20.581465 19973 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:20.583704 19140 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:20.584331 20024 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.402s	user 0.002s	sys 0.008s
I20260709 13:04:20.578047 15392 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:20.467703 19991 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:04:20.497334 20020 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.593135 19749 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:20.595543 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2759) took 1166 ms. Trace:
I20260709 13:04:20.674916 15325 rpcz_store.cc:276] 0709 13:04:19.428939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.448729 (+ 19790us) service_pool.cc:224] Handling call
0709 13:04:19.453201 (+  4472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:19.453705 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:19.453748 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:19.454390 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:04:19.758207 (+303817us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:19.758276 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.758495 (+   219us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:20.595294 (+836799us) raft_consensus.cc:1685] finished
0709 13:04:20.595316 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:20.595470 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5815,"raft.queue_time_us":1093,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":13861,"thread_start_us":298583,"threads_started":1,"wal-append.queue_time_us":964815}
I20260709 13:04:20.676587 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2741) took 2423 ms. Trace:
I20260709 13:04:20.595155 20012 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.501636 19970 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:20.145673 20027 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:20.601824 20033 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:04:20.601635 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.546447 20040 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:20.603475 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.705896 15393 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:20.600322 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.707217 15398 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:20.606918 15242 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
W20260709 13:04:20.587556 19871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.017s	sys 0.087s
I20260709 13:04:20.608376 19995 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.608762 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.605711 19996 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.717684 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.618137 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.719563 15395 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 7.
W20260709 13:04:20.551225 15362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.025s	sys 0.049s
W20260709 13:04:20.720577 15362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.026s	sys 0.055s
W20260709 13:04:20.720952 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 836871us
I20260709 13:04:20.619246 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2782) took 1871 ms. Trace:
I20260709 13:04:20.618031 20039 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.591061 20005 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.625321 15320 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:20.501431 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.732383 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.590731 20013 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:20.587778 19886 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:20.561067 15290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.984s (SENT) [suppressed 18 similar messages]
I20260709 13:04:20.733264 15395 raft_consensus.cc:2368] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
W20260709 13:04:20.663005 15999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.019s	sys 0.006s
W20260709 13:04:20.734025 15999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.019s	sys 0.006s
I20260709 13:04:20.699837 19970 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:20.626382 19988 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:20.624099 20037 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:20.780500 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:20.650763 19708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.042s	sys 0.093s
I20260709 13:04:20.590565 20011 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.677110 15323 rpcz_store.cc:276] 0709 13:04:18.253418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.335166 (+ 81748us) service_pool.cc:224] Handling call
0709 13:04:18.335483 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:18.365752 (+ 30269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:18.365779 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:18.369803 (+  4024us) log.cc:844] Serialized 52 byte log entry
0709 13:04:18.447690 (+ 77887us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:18.581802 (+134112us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:19.818807 (+1237005us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b1800329fe0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f366d5f23c7 00007f3669c049a7 00007f3669c140bf
0709 13:04:19.874934 (+ 56127us) log.cc:844] Serialized 14 byte log entry
0709 13:04:20.676258 (+801324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:20.676337 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:20.676377 (+    40us) raft_consensus.cc:1685] finished
0709 13:04:20.676387 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:20.676523 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":830967,"prepare.queue_time_us":791896,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":35154,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4380,"spinlock_wait_cycles":24424576,"thread_start_us":1346108,"threads_started":3,"wal-append.queue_time_us":80321,"wal-append.run_cpu_time_us":5271,"wal-append.run_wall_time_us":1231277}
I20260709 13:04:20.703850 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:20.708068 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2425) took 1223 ms. Trace:
I20260709 13:04:20.650509 19981 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:20.681710 19863 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.017s
W20260709 13:04:20.731886 19929 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.219s	user 0.014s	sys 0.004s
I20260709 13:04:20.711994 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:20.785629 15242 rpcz_store.cc:276] 0709 13:04:19.538143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.538554 (+   411us) service_pool.cc:224] Handling call
0709 13:04:20.707989 (+1169435us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:20.684684 20030 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:04:20.609645 20035 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:04:20.667289 19990 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:20.669446 19973 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:20.793905 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:20.793591 19973 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.794976 19973 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:20.796607 20046 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:04:20.721788 15394 rpcz_store.cc:276] 0709 13:04:18.748176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.748579 (+   403us) service_pool.cc:224] Handling call
0709 13:04:18.764966 (+ 16387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:18.922665 (+157699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:18.922727 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:18.923794 (+  1067us) log.cc:844] Serialized 26 byte log entry
0709 13:04:19.338185 (+414391us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:19.338261 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.338359 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:20.619030 (+1280671us) raft_consensus.cc:1685] finished
0709 13:04:20.619052 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:20.619180 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8542,"raft.queue_time_us":53337,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":19997,"thread_start_us":486012,"threads_started":2,"wal-append.queue_time_us":682672}
I20260709 13:04:20.798218 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2755) took 1371 ms. Trace:
I20260709 13:04:20.728901 15325 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:20.732450 15391 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.620010 19915 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:20.734607 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:20.631138 19732 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.962s	user 0.008s	sys 0.004s
I20260709 13:04:20.737267 19984 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.738631 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:20.739373 15997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.022s	sys 0.067s
I20260709 13:04:20.741199 19886 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:20.742442 19724 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.275s	user 0.008s	sys 0.010s
I20260709 13:04:20.743623 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 594) took 1437 ms. Trace:
W20260709 13:04:20.788168 19863 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.000s	sys 0.017s
I20260709 13:04:20.744360 19715 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:20.745294 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:20.813874 16028 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:20.742022 15249 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:20.703941 19992 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:20.746685 20014 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:20.713474 19916 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.749953 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.825013 15392 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:20.684594 19140 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.786360 19991 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:04:20.758409 20005 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:20.762466 20025 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.055s	user 0.008s	sys 0.008s
I20260709 13:04:20.624125 20047 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.763796 15362 leader_election.cc:400] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:20.838083 15362 leader_election.cc:403] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:20.763574 19996 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.764619 15399 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:20.765811 19995 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:20.766173 20009 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.767166 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.845643 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:20.846098 15998 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.011s	sys 0.023s
I20260709 13:04:20.733166 19882 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.775586 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.852939 15395 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:20.853331 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.854184 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.855206 15395 raft_consensus.cc:2368] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
W20260709 13:04:20.729346 19876 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.266s	user 0.016s	sys 0.002s
I20260709 13:04:20.811887 19984 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.734894 20039 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:20.803284 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.861075 15394 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
W20260709 13:04:20.805050 15997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.022s	sys 0.068s
I20260709 13:04:20.798664 15322 rpcz_store.cc:276] 0709 13:04:19.427341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.427720 (+   379us) service_pool.cc:224] Handling call
0709 13:04:19.438992 (+ 11272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:19.449757 (+ 10765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:19.449804 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:19.469107 (+ 19303us) log.cc:844] Serialized 26 byte log entry
0709 13:04:19.914260 (+445153us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:19.914326 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.914441 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:20.797992 (+883551us) raft_consensus.cc:1685] finished
0709 13:04:20.798013 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:20.798163 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8192,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":6032,"thread_start_us":444615,"threads_started":1,"wal-append.queue_time_us":716585}
I20260709 13:04:20.806725 19969 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.808557 15317 rpcz_store.cc:276] 0709 13:04:19.306457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.349795 (+ 43338us) service_pool.cc:224] Handling call
0709 13:04:19.386740 (+ 36945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:19.387146 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:19.387175 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:19.387666 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:04:19.754722 (+367056us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:19.754785 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.754892 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:20.743418 (+988526us) raft_consensus.cc:1685] finished
0709 13:04:20.743438 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:20.743564 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":284,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":128,"thread_start_us":366620,"threads_started":1,"wal-append.queue_time_us":554672}
I20260709 13:04:20.742934 20013 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.821959 15393 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:20.748767 16029 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:20.811617 19872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.003s	sys 0.019s
I20260709 13:04:20.784109 19924 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:04:20.754807 20040 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.810652 19860 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:20.828620 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 388224us
I20260709 13:04:20.811239 19871 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.791416 19929 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.835877 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1686) took 2910 ms. Trace:
I20260709 13:04:20.875021 16032 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 13:04:20.846514 15998 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.011s	sys 0.023s
I20260709 13:04:20.846360 15390 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:20.846800 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 83227us
I20260709 13:04:20.879310 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:20.832113 19843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.011s	sys 0.014s
I20260709 13:04:20.786682 15319 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:20.786422 19974 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.798667 19981 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.815658 19724 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:20.868276 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 442337us
I20260709 13:04:20.898818 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:20.899643 15247 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
W20260709 13:04:20.870890 19872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.003s	sys 0.020s
I20260709 13:04:20.871640 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:20.877825 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 949774us
I20260709 13:04:20.917775 15998 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:20.875478 15318 rpcz_store.cc:276] 0709 13:04:17.925514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.071826 (+146312us) service_pool.cc:224] Handling call
0709 13:04:18.076016 (+  4190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:18.088808 (+ 12792us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:19.211299 (+1122491us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18003eb900. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f366d5f23c7 00007f3669c049a7 00007f3669c140bf 00007f3669c14038
0709 13:04:19.708623 (+497324us) log.cc:844] Serialized 14 byte log entry
0709 13:04:20.066278 (+357655us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:20.389150 (+322872us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b2c0012b498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:04:20.429536 (+ 40386us) log.cc:844] Serialized 26 byte log entry
0709 13:04:20.453595 (+ 24059us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:20.453650 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:20.453757 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:20.795993 (+342236us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:20.835584 (+ 39591us) raft_consensus.cc:1685] finished
0709 13:04:20.835609 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:20.835786 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46660,"prepare.queue_time_us":1133727,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":40610,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":17495,"spinlock_wait_cycles":35158400,"thread_start_us":809938,"threads_started":2,"wal-append.queue_time_us":845047}
I20260709 13:04:20.794083 19990 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.891731 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:20.892168 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:20.920156 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:20.869520 15245 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:20.834344 19675 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.871658 15363 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:20.951789 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 80244.3us
I20260709 13:04:20.907223 15390 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:20.952740 15363 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:20.921622 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.924311 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.949901 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2424) took 1465 ms. Trace:
I20260709 13:04:20.953963 15399 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:20.954113 15397 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:20.925459 19724 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:20.926491 19551 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:20.963734 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:20.856943 20009 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.938395 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:20.940320 19140 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:20.940846 19715 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:20.944046 20011 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:20.867777 19876 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.859057 19882 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:20.948606 19996 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:20.949271 20053 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.015154 20053 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.017832 20053 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:20.952629 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:21.019351 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:21.020617 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:21.021174 15392 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
W20260709 13:04:20.890949 19843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.012s	sys 0.014s
I20260709 13:04:20.953186 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:20.953985 15249 rpcz_store.cc:276] 0709 13:04:19.484590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.484725 (+   135us) service_pool.cc:224] Handling call
0709 13:04:20.949511 (+1464786us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540001e854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:20.949762 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2865781632}
I20260709 13:04:21.048903 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:21.049679 15249 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
W20260709 13:04:20.919728 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 48174.1us
I20260709 13:04:21.050957 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:21.045969 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:20.930622 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:20.976948 15245 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:21.053364 15241 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:20.986059 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:20.990350 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 103183us
I20260709 13:04:20.957610 20014 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:20.922688 20013 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:21.005620 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.058660 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 167117us
I20260709 13:04:20.997433 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:21.059521 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:21.006844 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:20.920717 20055 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:21.007920 20050 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:04:20.997071 19992 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:20.818823 19988 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.012943 20054 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.196s
I20260709 13:04:20.962477 19832 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:20.887874 19871 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:20.881683 19995 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:04:21.031091 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:21.046444 16031 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:21.052549 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:21.060320 19709 raft_consensus.cc:2764] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:04:21.095604 15318 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:21.054085 15399 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:20.993498 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:20.985918 19974 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.054104 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:21.106418 15323 raft_consensus.cc:2410] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:04:21.106086 16028 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:21.055454 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:21.060003 15397 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:21.060868 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 499804us
I20260709 13:04:21.066687 15398 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:21.059962 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:21.067397 15247 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:21.064474 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:21.065183 15242 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:21.065999 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:21.060106 15317 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:21.046937 19702 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.963s	user 0.007s	sys 0.004s
I20260709 13:04:20.917052 20038 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.080353 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:20.854594 20037 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:21.117108 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:21.097612 15244 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:21.075151 19860 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.054997 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:21.122263 15319 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:21.014012 19970 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:21.134470 15391 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:04:21.167966 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 103567us
W20260709 13:04:21.172981 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 113048us
I20260709 13:04:21.174437 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:21.052414 19430 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 13:04:21.170244 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 114854us
W20260709 13:04:21.176992 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.177284 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:21.181234 15399 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:21.087708 19992 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:21.192619 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:21.137486 19177 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.000s
I20260709 13:04:21.195673 15248 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:21.189611 15397 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:21.105470 19988 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:21.193310 15318 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:21.176113 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:21.185649 19732 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:04:21.191583 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 273855us
I20260709 13:04:21.233060 16031 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:21.233700 15391 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:04:21.237142 15244 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:21.195225 19843 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:21.256842 15399 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:21.191185 19749 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:21.194977 20053 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:21.252202 15318 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:21.239589 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:21.259029 15399 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:21.078753 20055 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.267310 15244 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:21.167399 19860 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.194739 19929 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:21.268792 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 92781.8us
W20260709 13:04:21.276809 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.203179 19999 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:21.240826 20052 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:04:21.275658 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:21.288738 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:21.289314 15244 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:21.240967 19732 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.200340 20039 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:21.295413 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:21.296427 15249 raft_consensus.cc:2368] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13.
I20260709 13:04:21.297573 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:21.256130 19843 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:21.205976 19177 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.276271 19724 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:04:21.308077 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.292693 19732 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:21.286983 20005 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:21.331336 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:21.305728 20038 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:21.274492 19749 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:21.337179 19927 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.003s
W20260709 13:04:21.375754 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 189144us
I20260709 13:04:21.339455 19984 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:21.343323 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:21.313448 19675 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:21.333043 19969 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:21.333215 20009 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:21.349758 20047 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:21.354555 19882 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:21.292425 19999 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:21.328536 19981 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:21.357978 15243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2418) took 1877 ms (client timeout 1927 ms). Trace:
W20260709 13:04:21.398100 15243 rpcz_store.cc:269] 0709 13:04:19.480538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.480705 (+   167us) service_pool.cc:224] Handling call
0709 13:04:21.345917 (+1865212us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540025bcd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:21.357920 (+ 12003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3155560192}
I20260709 13:04:21.359201 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:21.327363 19992 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.332782 20060 raft_consensus.cc:2764] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:04:21.306125 20058 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:21.116248 19982 consensus_queue.cc:1175] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "edcf4a6bae7e4781bce325a586109ca5" responder_term: 14 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: [13.10-13.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:21.362411 15324 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:21.339350 15249 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:21.337983 19724 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:21.396453 19970 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:21.657553 15249 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:21.308674 19843 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:21.377074 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:21.385743 15246 raft_consensus.cc:2368] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:21.383313 19927 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:21.391947 20069 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:04:21.372731 19876 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:21.393187 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 218804us
W20260709 13:04:21.594018 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.676143 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.397264 15244 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:21.605062 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:21.676875 15248 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: []
W20260709 13:04:21.677791 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 72820.9us
I20260709 13:04:21.679047 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:21.606695 15396 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.002s
I20260709 13:04:21.681224 15396 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
W20260709 13:04:21.615131 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.683650 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:21.684587 15248 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:21.645234 20058 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:21.637383 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 405087us
W20260709 13:04:21.397558 20068 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:04:21.643460 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:21.389755 20072 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:21.650622 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:21.395776 20067 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.651615 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:21.326046 15317 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
W20260709 13:04:21.647296 20056 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:04:21.664309 20073 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.172s	user 0.000s	sys 0.002s
I20260709 13:04:21.689663 15243 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:21.691202 15244 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:21.692209 16033 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:04:21.637087 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 401190us
I20260709 13:04:21.659711 19724 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:21.699391 15242 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.762740 15245 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:21.679760 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:21.687042 20066 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
W20260709 13:04:21.712574 20089 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.323s	user 0.000s	sys 0.000s
I20260709 13:04:21.713107 19969 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:21.723448 15250 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:21.723794 16031 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 9: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:21.769550 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2391) took 1183 ms. Trace:
I20260709 13:04:21.730602 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:21.769979 15398 rpcz_store.cc:276] 0709 13:04:20.585644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.734372 (+148728us) service_pool.cc:224] Handling call
0709 13:04:21.769393 (+1035021us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b540009abd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:21.769494 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609636608}
W20260709 13:04:21.770453 20078 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:04:21.770817 16028 raft_consensus.cc:2410] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:04:21.692535 20038 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:21.733121 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2802) took 1255 ms. Trace:
I20260709 13:04:21.772621 20012 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:21.772256 15397 rpcz_store.cc:276] 0709 13:04:20.478066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.208262 (+730196us) service_pool.cc:224] Handling call
0709 13:04:21.208718 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.248304 (+ 39586us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.248352 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.262349 (+ 13997us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.593497 (+331148us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:21.593542 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.593613 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:21.732882 (+139269us) raft_consensus.cc:1685] finished
0709 13:04:21.732902 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.733056 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14244,"raft.queue_time_us":20614,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":279843,"threads_started":1,"wal-append.queue_time_us":438220}
I20260709 13:04:21.774091 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 598) took 1093 ms. Trace:
I20260709 13:04:21.723420 20067 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:21.775664 19830 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:21.774510 15321 rpcz_store.cc:276] 0709 13:04:20.680806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.680952 (+   146us) service_pool.cc:224] Handling call
0709 13:04:20.707882 (+ 26930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:20.859806 (+151924us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:21.006273 (+146467us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.095226 (+ 88953us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.354044 (+258818us) spinlock_profiling.cc:243] Waited 7.48 ms on lock 0x7b180044d520. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1
0709 13:04:21.358942 (+  4898us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b180044d520. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:21.656628 (+297686us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:21.656691 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:21.656745 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.773870 (+117125us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400077e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:21.773916 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.774039 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116515,"prepare.queue_time_us":357468,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":6413,"raft.queue_time_us":137072,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":41366,"spinlock_wait_cycles":393760000,"thread_start_us":632354,"threads_started":3,"wal-append.queue_time_us":251253}
I20260709 13:04:21.776106 19830 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:21.776939 20067 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:21.777056 19830 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.778671 19830 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:21.779194 19999 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:21.780530 20055 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:21.733477 19988 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.001s
I20260709 13:04:21.737994 19882 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.738770 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.718482 19876 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:21.742590 19177 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:21.743588 20013 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.003s
I20260709 13:04:21.743973 19927 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:21.745064 20009 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:21.746260 20014 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.746547 19973 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.951s	user 0.006s	sys 0.006s
I20260709 13:04:21.697939 20072 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:21.746713 19984 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:21.748860 20054 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:21.750622 20093 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:04:21.755026 20084 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:04:21.758301 20079 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:04:21.758886 20074 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.424s	user 0.000s	sys 0.001s
W20260709 13:04:21.759410 20059 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.396s	user 0.001s	sys 0.000s
I20260709 13:04:21.698633 20060 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:21.777043 15398 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:04:21.781971 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 98437.9us
I20260709 13:04:21.782464 15246 raft_consensus.cc:1217] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Deduplicated request from leader. Original: 10.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:04:21.694664 20058 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:21.786091 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.741835 19915 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.000s
I20260709 13:04:21.786978 15390 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:21.724341 19860 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:21.802713 19732 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.802201 19430 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:21.806620 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:21.765017 20039 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:21.790133 19882 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:21.809854 15365 leader_election.cc:400] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13.
I20260709 13:04:21.820343 15242 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:21.877733 15365 leader_election.cc:403] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:21.812523 15290 connection.cc:256] RPC call timeout handler was delayed by -1.3682325139999421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
I20260709 13:04:21.836089 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2386) took 1274 ms. Trace:
I20260709 13:04:21.837802 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2388) took 1253 ms. Trace:
W20260709 13:04:21.878268 15290 connection.cc:256] RPC call timeout handler was delayed by -1.2532441910000216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
I20260709 13:04:21.838289 19981 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.832298 20076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.062s	sys 0.092s
I20260709 13:04:21.878511 15393 rpcz_store.cc:276] 0709 13:04:20.584801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.759852 (+1175051us) service_pool.cc:224] Handling call
0709 13:04:21.760168 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.760390 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:21.760732 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.832105 (+ 71373us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.837362 (+  5257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:21.837429 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:21.837491 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.837578 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.837728 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4992,"prepare.queue_time_us":4244,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":2634,"raft.queue_time_us":9606,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":197,"thread_start_us":69852,"threads_started":1,"wal-append.queue_time_us":99695}
I20260709 13:04:21.848019 20072 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:21.855193 15246 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:04:21.855111 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2398) took 1246 ms. Trace:
I20260709 13:04:21.890986 15398 rpcz_store.cc:276] 0709 13:04:20.608538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.770984 (+1162446us) service_pool.cc:224] Handling call
0709 13:04:21.771283 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.854802 (+ 83519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.855045 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:21.862428 19944 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:21.865572 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1702) took 1442 ms. Trace:
I20260709 13:04:21.894901 15316 rpcz_store.cc:276] 0709 13:04:20.423159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.446887 (+ 23728us) service_pool.cc:224] Handling call
0709 13:04:20.447318 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:20.447605 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:20.831705 (+384100us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.755999 (+924294us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b1800435640. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a
0709 13:04:21.833959 (+ 77960us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.865095 (+ 31136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:21.865177 (+    82us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:21.865255 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.865319 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.865495 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111691,"prepare.queue_time_us":558698,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":6460,"raft.queue_time_us":112443,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":2500,"spinlock_wait_cycles":46460032,"thread_start_us":612391,"threads_started":2,"wal-append.queue_time_us":439483}
I20260709 13:04:21.865621 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:21.867563 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.870280 19990 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.857561 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:21.835807 20014 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:21.852556 19984 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.877053 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2803) took 1398 ms. Trace:
I20260709 13:04:21.878427 15399 rpcz_store.cc:276] 0709 13:04:20.561335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.269352 (+708017us) service_pool.cc:224] Handling call
0709 13:04:21.269666 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.269880 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:21.595101 (+325221us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.835726 (+240625us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:21.835787 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:21.835836 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.835907 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.836033 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":258541,"prepare.queue_time_us":42764,"prepare.run_cpu_time_us":753,"prepare.run_wall_time_us":6118,"raft.queue_time_us":3605,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4572,"thread_start_us":525860,"threads_started":2}
W20260709 13:04:21.881335 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 71621.9us
I20260709 13:04:21.907912 15391 rpcz_store.cc:276] 0709 13:04:20.478421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.238032 (+759611us) service_pool.cc:224] Handling call
0709 13:04:21.238504 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.253634 (+ 15130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.253683 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.254448 (+   765us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.321780 (+ 67332us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:21.376163 (+ 54383us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.376457 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.376544 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:21.876758 (+500214us) raft_consensus.cc:1685] finished
0709 13:04:21.876780 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.876952 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14053,"prepare.queue_time_us":320357,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3496,"raft.queue_time_us":14596,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":6446,"thread_start_us":66762,"threads_started":1,"wal-append.queue_time_us":125063}
I20260709 13:04:21.905704 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:21.909145 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:21.884013 15290 leader_election.cc:336] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.662s (SENT)
I20260709 13:04:21.881587 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 674) took 1008 ms. Trace:
I20260709 13:04:21.889815 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:21.910492 15290 leader_election.cc:336] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.741s (SENT)
I20260709 13:04:21.893419 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:21.906893 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49521.6us
I20260709 13:04:21.910523 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:21.913448 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:21.903725 15398 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:21.906455 15241 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
W20260709 13:04:21.911839 15290 connection.cc:256] RPC call timeout handler was delayed by -1.1990066209999668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 13:04:21.914400 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2412) took 1298 ms. Trace:
I20260709 13:04:21.914722 15398 rpcz_store.cc:276] 0709 13:04:20.616155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.902877 (+1286722us) service_pool.cc:224] Handling call
0709 13:04:21.903286 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.914046 (+ 10760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.914344 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:21.918008 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:21.918721 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:21.876309 19701 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.891171 20076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.063s	sys 0.092s
I20260709 13:04:21.864843 19876 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:04:21.901782 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 210993us
I20260709 13:04:21.876922 19430 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:21.865108 19915 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:21.925004 15391 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:21.935726 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:21.922561 15290 connection.cc:256] RPC call timeout handler was delayed by -1.1964362209998853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2364s for a response
W20260709 13:04:21.927481 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.929229 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2407) took 1314 ms. Trace:
I20260709 13:04:21.936491 15391 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:21.936720 15393 rpcz_store.cc:276] 0709 13:04:20.614922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.902413 (+1287491us) service_pool.cc:224] Handling call
0709 13:04:21.928743 (+ 26330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.928923 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.928945 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:21.928985 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:21.929015 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.929063 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.929175 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:21.929981 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 756) took 1193 ms. Trace:
I20260709 13:04:21.885790 19860 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13.
I20260709 13:04:21.894482 19944 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:21.952870 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:21.916290 19992 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:21.937958 16030 rpcz_store.cc:276] 0709 13:04:20.737038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.744241 (+  7203us) service_pool.cc:224] Handling call
0709 13:04:20.744676 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:20.996793 (+252117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:20.997328 (+   535us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.008106 (+ 10778us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.190245 (+182139us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:21.190288 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.190357 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:21.929695 (+739338us) raft_consensus.cc:1685] finished
0709 13:04:21.929723 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.929904 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48227,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":357056,"threads_started":2,"wal-append.queue_time_us":340968}
W20260709 13:04:21.959582 20108 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:21.959939 20099 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:21.960505 20099 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:21.961199 20092 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:04:21.959604 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:21.963454 15393 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:21.915992 20039 raft_consensus.cc:2764] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:04:21.923225 20013 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:21.934275 20080 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:21.937553 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:21.936653 15290 leader_election.cc:336] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.885s (SENT)
W20260709 13:04:21.907167 19974 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.783s	user 0.012s	sys 0.000s
I20260709 13:04:21.949173 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:21.977480 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:21.978030 15394 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:21.932294 15365 leader_election.cc:400] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:21.923058 20038 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:21.921594 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:21.981868 15391 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:21.972072 15393 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:21.972990 15320 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:21.910072 16024 rpcz_store.cc:276] 0709 13:04:20.873698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.873863 (+   165us) service_pool.cc:224] Handling call
0709 13:04:20.874271 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:20.890164 (+ 15893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:20.890212 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:20.890855 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.072264 (+181409us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:21.072315 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.072388 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:21.879505 (+807117us) raft_consensus.cc:1685] finished
0709 13:04:21.879525 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.881526 (+  2001us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62486,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":129675,"threads_started":1,"wal-append.queue_time_us":677716}
I20260709 13:04:21.930830 19988 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:21.928025 19832 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:21.931013 19999 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:21.976575 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:21.979159 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 52199.5us
I20260709 13:04:21.979730 19863 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:21.899827 19981 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:21.982496 16032 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:21.930372 20044 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:04:21.985114 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 63590.3us
I20260709 13:04:21.985584 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:22.032462 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46988.1us
I20260709 13:04:21.990203 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:22.024194 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:21.934484 19701 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:22.025410 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88782.3us
W20260709 13:04:22.046274 15290 connection.cc:256] RPC call timeout handler was delayed by -1.1553330979999146s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 13:04:21.917514 19990 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:21.973683 20013 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:22.047242 20013 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:22.048321 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:22.049861 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:21.989296 20039 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:22.044306 15393 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:04:22.046705 15290 connection.cc:256] RPC call timeout handler was delayed by -1.134206620999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
I20260709 13:04:22.059607 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:22.059649 15290 connection.cc:256] RPC call timeout handler was delayed by -1.0779330979999031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
I20260709 13:04:21.975274 20012 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:22.062314 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:22.031021 19974 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.030779 19916 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.066370 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:22.070281 15323 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 13: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:22.045096 19860 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:22.044699 19988 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:22.080482 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.067948 16031 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:22.053223 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2387) took 1468 ms. Trace:
I20260709 13:04:22.072384 15317 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:22.069579 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:22.049084 19927 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:22.057200 20040 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:22.085085 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:22.085813 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:22.025034 19832 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:22.093250 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.098071 15325 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:22.098333 19882 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:21.986282 19944 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.098907 20099 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.099241 19944 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:22.099357 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.099649 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.092033 19992 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:04:22.100968 19992 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:22.101507 19992 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:22.101449 19863 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:22.102753 19992 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.103781 20027 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:22.104094 19992 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:22.057045 20037 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:04:22.049876 19430 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.106820 20040 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:22.107057 19430 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:22.056886 20080 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:04:22.067003 20012 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.101085 15316 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:22.112716 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.111137 19882 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:22.123227 15318 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:22.132001 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2413) took 1515 ms. Trace:
I20260709 13:04:22.132166 15393 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:22.088240 19177 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.074534 20112 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:22.138593 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.139422 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:22.145398 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 94027.5us
I20260709 13:04:22.123935 20080 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:22.135576 20086 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.476s	user 0.000s	sys 0.003s
I20260709 13:04:22.125427 20012 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:22.122464 19927 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:22.125162 19882 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:22.078148 19974 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.161844 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.188081 15318 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:04:22.096227 19973 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:04:22.191526 15397 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:04:22.190651 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 135331us
I20260709 13:04:22.091609 19860 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.194064 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:22.141374 20039 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:22.197162 15396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2377) took 2306 ms (client timeout 2364 ms). Trace:
I20260709 13:04:22.145334 19732 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:22.198603 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:22.200507 15247 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:22.151481 20100 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:22.198400 15396 rpcz_store.cc:269] 0709 13:04:19.883682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.885018 (+  1336us) service_pool.cc:224] Handling call
0709 13:04:22.189898 (+2304880us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b5400328cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:22.190040 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2159532800}
I20260709 13:04:22.200070 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.202416 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.203383 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.200080 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.204661 15245 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:22.141558 20055 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:04:22.205611 20106 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:04:22.205717 20055 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:22.206214 20055 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:22.210572 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.191624 20014 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.203383 19988 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.142117 19177 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.214006 19915 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.141425 20072 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.198160 20040 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.230631 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.216194 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.217100 20100 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.254865 15242 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:04:22.219960 20113 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:22.232007 19999 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:22.233230 19981 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.237474 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:22.228703 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:22.258118 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 182143us
I20260709 13:04:22.260543 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:22.260867 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.232692 19724 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.262985 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.263604 15396 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:22.264958 19724 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.265319 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:22.217582 19927 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.266500 15248 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:22.215842 20020 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.229595 19872 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:22.267570 19872 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:22.223824 20014 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.266522 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.227108 19882 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.269590 15318 raft_consensus.cc:2410] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:04:22.270642 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.272083 15290 leader_election.cc:400] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
I20260709 13:04:22.268397 19872 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.224711 19832 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.228822 19177 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:22.220289 20116 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:04:22.169035 20080 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.282337 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.311210 15322 raft_consensus.cc:2368] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13.
I20260709 13:04:22.312117 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.312362 20080 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.312776 15322 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:22.223451 19974 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.233743 20072 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.283700 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:22.287983 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.288579 15247 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:22.275041 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:22.295079 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.295593 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.235531 20123 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.327651 15394 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:22.305707 15396 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:22.291369 20100 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.295928 19916 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:22.266057 19915 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:22.216650 19984 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:22.307232 19872 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:22.307605 20088 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:22.207101 20055 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.307933 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.329170 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.330277 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.331346 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:22.337481 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.325922 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:22.305193 15325 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:22.373607 15394 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:04:22.320657 20122 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:04:22.327378 20109 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
W20260709 13:04:22.320721 19843 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.000s
I20260709 13:04:22.317194 19871 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:22.358184 15396 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:22.316597 20013 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:22.319785 20104 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:04:22.373979 15249 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:22.327595 19724 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:22.318936 19990 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:22.374818 19944 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:04:22.375259 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 305756us
W20260709 13:04:22.374873 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49042us
I20260709 13:04:22.338032 19970 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.324247 20037 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.337755 19732 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:22.322747 20060 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:22.343825 19916 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:22.318528 20039 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.358682 15245 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:22.336931 20123 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.428344 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.428989 15245 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:22.383978 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:22.430382 15394 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:22.431309 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.432391 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:22.433403 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.434070 15394 raft_consensus.cc:2368] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12.
W20260709 13:04:22.389957 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.440115 20013 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:22.397076 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.440797 19732 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.386089 19843 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.444763 16027 raft_consensus.cc:2410] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:04:22.444674 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:22.401486 19724 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.425987 19916 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.452560 20064 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:22.425798 20037 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.453326 20064 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:22.426157 19970 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.399763 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:22.400285 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 757) took 1654 ms. Trace:
I20260709 13:04:22.456583 16033 rpcz_store.cc:276] 0709 13:04:20.746317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.746480 (+   163us) service_pool.cc:224] Handling call
0709 13:04:20.746875 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.725522 (+978647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.399988 (+674466us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b54007c1d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:22.400222 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173479296}
I20260709 13:04:22.400501 20128 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.459789 20128 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.459282 15249 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:04:22.400622 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 116994us
I20260709 13:04:22.409119 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:22.411402 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1649) took 1125 ms. Trace:
I20260709 13:04:22.462002 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:22.462409 15246 rpcz_store.cc:276] 0709 13:04:21.285609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.673429 (+387820us) service_pool.cc:224] Handling call
0709 13:04:21.782336 (+108907us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.890696 (+108360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.411100 (+520404us) spinlock_profiling.cc:243] Waited 83.9 ms on lock 0x7b54001a77d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:22.411314 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193000832}
I20260709 13:04:22.463943 19708 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:22.464380 19708 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:22.413532 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2767) took 1300 ms. Trace:
I20260709 13:04:22.465266 19708 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.467343 20096 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:22.465996 15320 rpcz_store.cc:276] 0709 13:04:21.113651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.118263 (+  4612us) service_pool.cc:224] Handling call
0709 13:04:21.118509 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.982540 (+864031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.413187 (+430647us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b540021a2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:22.413445 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1964695808}
I20260709 13:04:22.478605 19982 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:22.419778 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:22.479197 15324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 601) took 1785 ms (client timeout 2175 ms). Trace:
I20260709 13:04:22.479415 19982 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:22.420123 20058 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.003s
W20260709 13:04:22.479727 15324 rpcz_store.cc:269] 0709 13:04:20.694195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.703578 (+  9383us) service_pool.cc:224] Handling call
0709 13:04:22.479000 (+1775422us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54001c57d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:22.479131 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277834496}
I20260709 13:04:22.480525 20058 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:22.481473 15390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2409) took 1866 ms (client timeout 2096 ms). Trace:
I20260709 13:04:22.481761 16030 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:04:22.481890 15390 rpcz_store.cc:269] 0709 13:04:20.615451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.952933 (+337482us) service_pool.cc:224] Handling call
0709 13:04:22.481268 (+1528335us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b5400154fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:22.481374 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1698339072}
I20260709 13:04:22.385421 20055 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:22.425688 15244 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:22.384562 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.508548 15390 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:22.509012 19982 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.378314 19915 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:22.509699 19915 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:22.509852 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:22.483044 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2406) took 1868 ms. Trace:
I20260709 13:04:22.512573 15397 rpcz_store.cc:276] 0709 13:04:20.614646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.774064 (+1159418us) service_pool.cc:224] Handling call
0709 13:04:22.191027 (+416963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:22.192186 (+  1159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.482859 (+290673us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400328cd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:22.482985 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":958055808}
I20260709 13:04:22.083003 15392 rpcz_store.cc:276] 0709 13:04:20.584382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.333299 (+748917us) service_pool.cc:224] Handling call
0709 13:04:21.337623 (+  4324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.338181 (+   558us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:21.902754 (+564573us) log.cc:844] Serialized 14 byte log entry
0709 13:04:22.052610 (+149856us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:22.052664 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:22.052704 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.052774 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.052895 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":270996,"prepare.queue_time_us":343364,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":2704,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6688,"thread_start_us":446941,"threads_started":2,"wal-append.queue_time_us":143045}
I20260709 13:04:22.509048 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:22.514067 20053 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:22.514858 20053 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:22.515967 20053 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.516968 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:22.518013 20054 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:22.518424 20054 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.518771 20054 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:22.528393 20013 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:22.500715 15247 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:22.529162 20013 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.510154 19915 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:22.417356 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.532819 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.534756 19982 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.535413 19982 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.537009 15250 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:22.544322 16030 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:22.546339 15390 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:04:22.556811 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47812.3us
W20260709 13:04:22.562500 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.564844 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:22.567128 15324 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:04:22.568890 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.570770 15396 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
W20260709 13:04:22.571118 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 109196us
I20260709 13:04:22.582855 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:22.133920 15399 rpcz_store.cc:276] 0709 13:04:20.616397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.908219 (+1291822us) service_pool.cc:224] Handling call
0709 13:04:21.908536 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.984228 (+ 75692us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:22.027417 (+ 43189us) log.cc:844] Serialized 14 byte log entry
0709 13:04:22.131499 (+104082us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:22.131582 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:22.131652 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.131745 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.131918 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8422,"prepare.queue_time_us":46863,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":40455,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":102,"spinlock_wait_cycles":7592192,"thread_start_us":109642,"threads_started":2,"wal-append.queue_time_us":76110}
I20260709 13:04:22.578173 19984 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:22.590337 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:22.591094 15324 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:22.573457 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:22.592589 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:22.593981 15290 leader_election.cc:400] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 pre-election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
I20260709 13:04:22.577075 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:22.595148 15316 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:22.595230 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.596172 15320 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:22.597314 15390 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:22.587288 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:22.578934 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.568954 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.599583 15395 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:04:22.599893 15399 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:22.602804 15320 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:22.619320 15399 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:22.623171 15215 leader_election.cc:400] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12.
I20260709 13:04:22.623637 15215 leader_election.cc:403] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:22.596474 19708 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:22.638734 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 43910.4us
I20260709 13:04:22.640038 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:22.640836 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 82899.8us
I20260709 13:04:22.641243 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:22.638631 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 61672.6us
I20260709 13:04:22.644802 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.645560 15245 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:22.642107 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:22.649075 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.649127 15241 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:22.650085 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.650923 15316 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
W20260709 13:04:22.652608 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 65484.6us
I20260709 13:04:22.652799 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:22.653611 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:22.650601 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:22.656751 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.657192 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:22.579038 19876 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:22.685290 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:22.685603 15249 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:22.685748 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.658651 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:22.660698 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.686925 15247 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:22.663492 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.687800 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.687840 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.688735 15247 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:22.690512 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.690650 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.691578 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.692705 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:22.638572 19984 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.598176 19701 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:22.659565 15320 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:22.638322 20044 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:22.697079 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.699103 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.578655 19992 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.107s
I20260709 13:04:22.701318 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:22.596553 20096 raft_consensus.cc:2764] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:04:22.684116 20128 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:22.704057 19973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.021s	sys 0.051s
I20260709 13:04:22.696177 15324 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:22.649155 20027 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:22.730513 20027 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.730882 19749 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.732889 20027 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.734411 16030 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:22.734663 20027 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:22.735726 20027 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12.
I20260709 13:04:22.717316 15395 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:22.719489 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:22.649185 19843 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.739712 19984 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.656297 19944 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:22.740922 19944 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:22.741369 19944 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:22.656049 20049 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:22.656175 20058 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.722580 20013 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:22.650967 20067 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:22.689489 19177 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:22.659909 19732 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.596544 19981 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:04:22.657725 20009 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.695991 19709 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:22.737074 20123 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.737519 19832 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:22.738399 20094 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:22.698307 20072 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:22.739403 19974 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:04:22.698483 19927 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:22.697909 20118 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:04:22.728955 19924 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:22.712275 20100 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:04:22.659395 20088 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:04:22.757694 19724 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.756982 19177 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:22.658977 20064 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:22.758832 19984 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:22.798674 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.768771 19970 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:22.769134 20037 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:22.770865 19709 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.774422 19860 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:22.760246 20067 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.798082 19882 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:22.792429 20072 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:22.746219 19915 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.807132 20115 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.813416 20088 consensus_queue.cc:1243] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:22.830962 19177 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:22.827670 19924 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:22.978798 20126 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:04:22.979367 19924 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:22.843750 20012 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.648s	user 0.015s	sys 0.002s
I20260709 13:04:22.982874 20012 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:22.984436 16028 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:22.847242 19709 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:22.958673 20072 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:22.974632 20127 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.581s	user 0.007s	sys 0.000s
I20260709 13:04:23.005342 15247 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:23.015395 15242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.009s	sys 0.005s
W20260709 13:04:23.016041 15242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.009s	sys 0.005s
I20260709 13:04:23.018119 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:23.018343 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:23.019464 15248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.004s	sys 0.007s
W20260709 13:04:23.019902 15248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.004s	sys 0.007s
I20260709 13:04:22.840517 19984 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:23.047448 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:23.054052 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:23.063575 15247 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:23.065114 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:23.003777 19832 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:23.066008 16024 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:23.003793 20115 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:23.088793 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2810) took 2077 ms. Trace:
I20260709 13:04:23.089382 15398 rpcz_store.cc:276] 0709 13:04:21.011220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.925376 (+914156us) service_pool.cc:224] Handling call
0709 13:04:21.925698 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.071859 (+146161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.071889 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.072381 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:04:22.342890 (+270509us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:22.342947 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.343047 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:22.834289 (+491242us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:23.084492 (+250203us) raft_consensus.cc:1685] finished
0709 13:04:23.084521 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.088702 (+  4181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25054,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"spinlock_wait_cycles":13831936,"thread_start_us":349844,"threads_started":2,"wal-append.queue_time_us":296424}
W20260709 13:04:23.098176 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:23.086676 19988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.023s
W20260709 13:04:23.088653 19830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.022s
I20260709 13:04:23.075167 19832 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:23.119462 15246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.022s
W20260709 13:04:23.120873 15246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.000s	sys 0.023s
I20260709 13:04:23.097617 20088 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:23.122502 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 463906us
W20260709 13:04:23.109004 19830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.007s	sys 0.022s
W20260709 13:04:23.109107 19988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.006s	sys 0.023s
W20260709 13:04:23.122476 15243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.004s	sys 0.026s
W20260709 13:04:23.129423 15243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.007s	sys 0.037s
W20260709 13:04:23.123661 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 463189us
I20260709 13:04:23.127748 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:23.115989 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 414782us
I20260709 13:04:23.135637 16024 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:23.084380 20040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.006s	sys 0.017s
W20260709 13:04:23.114732 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 457586us
I20260709 13:04:23.139771 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:23.134573 19872 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.775s	user 0.011s	sys 0.009s
I20260709 13:04:23.084143 20044 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:23.152776 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:23.163689 20115 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:23.146744 19944 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:23.129000 20088 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:23.151218 20037 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:23.154511 19915 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:23.170912 20072 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:23.172482 20044 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:23.150470 20040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.007s	sys 0.017s
I20260709 13:04:23.179224 19709 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:23.180850 20054 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.010s
I20260709 13:04:23.181732 19984 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:23.153569 19988 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:04:23.185292 20067 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:23.185992 20055 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.009s
I20260709 13:04:23.196486 20112 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:04:23.197152 19916 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.746s	user 0.014s	sys 0.001s
W20260709 13:04:23.198308 19708 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.003s
W20260709 13:04:23.205771 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.023s
W20260709 13:04:23.209610 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 56929.6us
W20260709 13:04:23.216553 15321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.020s	sys 0.036s
W20260709 13:04:23.217805 15393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.007s	sys 0.016s
I20260709 13:04:23.225239 16025 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
W20260709 13:04:23.225611 15321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.020s	sys 0.036s
I20260709 13:04:23.212601 20039 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:23.218436 20062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.009s	sys 0.019s
W20260709 13:04:23.218578 19876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.010s	sys 0.009s
W20260709 13:04:23.225745 15393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.008s	sys 0.016s
I20260709 13:04:23.231019 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:23.238402 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2821) took 1037 ms. Trace:
I20260709 13:04:23.212827 20049 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:23.225243 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.000s	sys 0.024s
W20260709 13:04:23.270339 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 627921us
W20260709 13:04:23.240324 20062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.010s	sys 0.020s
I20260709 13:04:23.263780 15319 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:23.221495 20112 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:23.280516 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:23.289165 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:23.289736 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:23.292040 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:23.292927 16033 raft_consensus.cc:2410] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:04:23.293928 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:23.217160 19177 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:23.221980 20054 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:23.237391 19876 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:23.270545 20154 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:23.237864 20040 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:04:23.226476 19916 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:23.275592 19984 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:04:23.268970 20067 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:23.300056 20128 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.350340 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:23.327873 20132 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:23.365584 15325 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:23.297592 19988 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:23.331009 20149 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.096s
W20260709 13:04:23.413667 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.016s	sys 0.015s
W20260709 13:04:23.437749 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.016s	sys 0.015s
W20260709 13:04:23.438465 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 815457us
I20260709 13:04:23.299765 20080 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 13:04:23.424055 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 293796us
I20260709 13:04:23.362911 20132 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.362701 20037 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.332719 19860 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.347129 20150 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:23.612686 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:23.279089 20115 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 13:04:23.466459 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 332165us
I20260709 13:04:23.369170 20128 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:23.614718 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:23.469381 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:23.469738 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:23.511703 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:23.589679 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 121065us
I20260709 13:04:23.339354 20154 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:23.482566 19882 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.665266 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:23.616487 15246 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:23.669529 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:23.671489 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 57014.7us
I20260709 13:04:23.673749 15289 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:23.590910 20132 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:23.584287 20053 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:23.589778 19982 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:23.675274 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:23.679625 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:23.679631 19944 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:23.689394 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:23.675802 19882 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:23.691075 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:23.692239 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:23.692472 19882 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:23.693315 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:23.693897 15244 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:23.693940 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:23.763438 16024 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:23.694689 15321 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:23.694880 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:23.696223 20140 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.400s	user 0.001s	sys 0.000s
W20260709 13:04:23.696926 20138 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.333s	user 0.000s	sys 0.000s
I20260709 13:04:23.698173 16033 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:23.698251 20054 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:23.425109 20049 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:23.746646 20162 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:23.674710 20064 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260709 13:04:23.702805 20137 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.462s	user 0.000s	sys 0.001s
I20260709 13:04:23.704618 20009 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.709473 20153 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:23.710721 20058 raft_consensus.cc:3055] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:23.713382 20144 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.295s	user 0.000s	sys 0.000s
I20260709 13:04:23.612846 20150 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.715085 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:23.718921 15324 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:23.613030 20072 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:23.420941 20112 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:23.657030 20088 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:23.461093 19876 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:23.731539 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 479894us
W20260709 13:04:23.959627 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.613895 20037 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:23.720188 19982 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:23.730311 20016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.035s	sys 0.043s
I20260709 13:04:23.727059 19990 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:23.652141 20141 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:04:23.726698 20062 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:23.735146 20134 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.465s	user 0.000s	sys 0.001s
I20260709 13:04:23.729441 19924 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:04:23.674929 20145 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:04:23.721510 20053 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.018477 20062 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.024010 20053 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:23.729663 19872 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:04:24.025377 15250 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
W20260709 13:04:23.761427 15290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.045s	sys 0.060s
W20260709 13:04:24.026443 15290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.045s	sys 0.061s
I20260709 13:04:24.026611 20037 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:24.027145 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 899442us
I20260709 13:04:23.731163 20148 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:04:23.756348 19988 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.976707 19982 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.029529 19988 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:23.973645 20016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.036s	sys 0.043s
I20260709 13:04:24.032392 19988 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.033838 20163 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:24.034520 20163 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.034976 20163 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.039129 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2451) took 1709 ms. Trace:
I20260709 13:04:24.039742 15242 rpcz_store.cc:276] 0709 13:04:22.329501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.329853 (+   352us) service_pool.cc:224] Handling call
0709 13:04:22.330221 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.330564 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.330603 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.331214 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:04:23.016484 (+685270us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:23.016530 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.016674 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.038806 (+1022132us) raft_consensus.cc:1685] finished
0709 13:04:24.038836 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.039048 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":684885,"threads_started":1,"wal-append.queue_time_us":891619}
I20260709 13:04:23.765373 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:24.042847 19988 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:24.043555 19988 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.044018 19988 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:24.046275 19990 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:23.928941 19916 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:24.047591 19990 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:23.765393 19882 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.765866 15316 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:23.620865 19860 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.050093 19882 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:23.927428 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:24.053763 15244 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:23.768807 19984 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:23.940078 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2454) took 1608 ms. Trace:
I20260709 13:04:23.938687 20112 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:23.932138 20152 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.497s	user 0.001s	sys 0.000s
I20260709 13:04:23.910609 20058 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:23.868541 20055 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
W20260709 13:04:23.974987 20151 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.384s	user 0.001s	sys 0.000s
W20260709 13:04:24.115844 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 446364us
W20260709 13:04:24.117250 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89290.7us
W20260709 13:04:24.122542 15362 leader_election.cc:336] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.621s (SENT)
I20260709 13:04:24.123219 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:24.139755 15362 leader_election.cc:336] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.691s (SENT)
I20260709 13:04:24.140383 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:24.143200 15244 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:24.113992 20136 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
I20260709 13:04:23.925137 20009 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.018740 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2776) took 1417 ms. Trace:
W20260709 13:04:24.019353 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 304323us
I20260709 13:04:24.113376 19944 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:24.164148 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:24.165319 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:24.054809 15248 rpcz_store.cc:276] 0709 13:04:22.332041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.334317 (+  2276us) service_pool.cc:224] Handling call
0709 13:04:22.358321 (+ 24004us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.446606 (+ 88285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.446637 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.447102 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:04:23.020487 (+573385us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:23.020546 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.712433 (+691887us) spinlock_profiling.cc:243] Waited 88 ms on lock 0x7b540010c554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:23.712507 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:23.930874 (+218367us) raft_consensus.cc:1685] finished
0709 13:04:23.930894 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.939984 (+  9090us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202402688,"thread_start_us":572966,"threads_started":1,"wal-append.queue_time_us":764390}
I20260709 13:04:23.935799 20150 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:23.994655 15324 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:24.161172 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:24.020583 19177 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.175765 15244 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:24.151540 15362 leader_election.cc:336] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.710s (SENT)
W20260709 13:04:24.179701 15362 leader_election.cc:336] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.697s (SENT)
I20260709 13:04:24.180524 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:24.164233 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:24.042693 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 277870us
I20260709 13:04:24.054577 19984 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.168812 20149 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:24.041975 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:24.173682 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:24.228520 20128 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:24.172919 19708 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:04:24.259071 20128 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:24.258355 15321 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:24.259665 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.171034 19944 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:24.238631 20154 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.178174 20044 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.220229 20058 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.261327 20044 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:24.228272 20136 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:24.262017 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.263521 20044 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:24.238322 20169 log.cc:927] Time spent T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:04:24.263857 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.174909 19916 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:04:24.259711 20128 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:24.265141 20128 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.265965 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.267040 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.213874 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:24.267302 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 568) took 2067 ms. Trace:
I20260709 13:04:24.279721 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:24.280423 16024 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:24.281972 15242 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:24.193769 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:24.283814 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 90132.9us
I20260709 13:04:24.284637 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:24.275978 15325 rpcz_store.cc:276] 0709 13:04:22.601367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.601522 (+   155us) service_pool.cc:224] Handling call
0709 13:04:22.658468 (+ 56946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.370296 (+711828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.018472 (+648176us) spinlock_profiling.cc:243] Waited 707 ms on lock 0x7b54001e50d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:24.018677 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1625596800}
W20260709 13:04:24.288478 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:24.289072 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.290264 19916 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:24.290361 20044 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:24.291011 20044 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:24.291446 20044 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:24.153934 20172 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:24.280081 15243 rpcz_store.cc:276] 0709 13:04:22.200258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.204341 (+  4083us) service_pool.cc:224] Handling call
0709 13:04:22.204692 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:22.214594 (+  9902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.214629 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:22.215396 (+   767us) log.cc:844] Serialized 52 byte log entry
0709 13:04:22.468745 (+253349us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b18002bbca0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:04:23.129907 (+661162us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:23.418357 (+288450us) log.cc:844] Serialized 14 byte log entry
0709 13:04:23.418893 (+   536us) log.cc:844] Serialized 14 byte log entry
0709 13:04:23.419073 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.419172 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.267006 (+847834us) raft_consensus.cc:1685] finished
0709 13:04:24.267040 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.267241 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15869,"prepare.queue_time_us":1142639,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":104,"raft.queue_time_us":30958,"raft.run_cpu_time_us":479,"raft.run_wall_time_us":142938,"spinlock_wait_cycles":8174848,"thread_start_us":931136,"threads_started":2,"wal-append.queue_time_us":1131978}
I20260709 13:04:24.212317 20145 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:04:24.267153 20168 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.401s	user 0.000s	sys 0.001s
W20260709 13:04:24.238135 20171 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:04:24.225999 20165 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.307144 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.308264 19916 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:24.309257 20149 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.219278 20088 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:24.233750 20160 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:04:24.301940 19984 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.327303 20182 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:24.328372 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.358875 15399 raft_consensus.cc:2368] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14.
I20260709 13:04:24.322665 20145 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.330467 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.363281 15390 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:04:24.332890 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 153217us
I20260709 13:04:24.333335 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:24.309826 20150 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.310350 19708 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:04:24.346215 20172 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.346154 15242 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:24.348184 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.368986 15396 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:24.349342 15398 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:24.350538 20183 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:24.350994 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 61174.1us
I20260709 13:04:24.354020 20181 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:24.356556 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.383991 15395 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:24.360146 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.329272 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.366110 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.375437 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:24.391326 20128 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.348623 20165 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:24.396817 20157 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.962s	user 0.000s	sys 0.010s
I20260709 13:04:24.397331 20165 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.398367 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2819) took 2208 ms. Trace:
I20260709 13:04:24.398767 15394 rpcz_store.cc:276] 0709 13:04:22.190048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.449856 (+259808us) service_pool.cc:224] Handling call
0709 13:04:22.450215 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.455418 (+  5203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.455457 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.642507 (+187050us) log.cc:844] Serialized 26 byte log entry
0709 13:04:23.209941 (+567434us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:23.209982 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.210068 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.396230 (+1186162us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:24.398042 (+  1812us) raft_consensus.cc:1685] finished
0709 13:04:24.398066 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.398297 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4146,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":100,"spinlock_wait_cycles":249091328,"thread_start_us":481192,"threads_started":1,"wal-append.queue_time_us":656837}
I20260709 13:04:24.400830 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.401396 15394 raft_consensus.cc:2376] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10. Re-sending same reply.
I20260709 13:04:24.363621 20145 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.402210 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.402909 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 685) took 1454 ms. Trace:
I20260709 13:04:24.411556 15394 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:24.409034 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.412984 15396 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:24.411689 16030 rpcz_store.cc:276] 0709 13:04:22.948207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.948423 (+   216us) service_pool.cc:224] Handling call
0709 13:04:22.948837 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.959670 (+ 10833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.959720 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.960346 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:04:23.362634 (+402288us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:23.362680 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.362749 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.402576 (+1039827us) raft_consensus.cc:1685] finished
0709 13:04:24.402608 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.402829 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25690,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":316560,"threads_started":1,"wal-append.queue_time_us":743403}
I20260709 13:04:24.416581 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.416886 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:24.409526 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.420658 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.421648 15391 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:24.423128 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.423812 15395 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:24.385313 20182 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:24.359231 20088 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.429669 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.435480 15394 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.359495 20149 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.431969 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:24.432101 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.436812 15397 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:24.407764 19430 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:24.445415 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.446134 15395 raft_consensus.cc:2376] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12. Re-sending same reply.
I20260709 13:04:24.441707 15396 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:24.443666 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.447724 15398 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:24.415570 20115 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:24.451004 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.452493 15391 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:24.450066 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.453725 15391 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:04:24.454155 15396 raft_consensus.cc:2410] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:04:24.457481 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.460889 15394 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:04:24.384830 20172 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:24.464625 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 131378us
I20260709 13:04:24.449388 20115 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.468127 20049 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.472180 20049 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.473661 15397 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:24.407196 20183 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.442544 20182 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.543987 20172 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:24.544982 20049 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:24.547768 20183 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.549016 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:24.549794 16029 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:24.552668 20088 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:24.553966 20150 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:24.555903 20149 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:24.559460 20044 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:24.563941 20163 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.001s
I20260709 13:04:24.564534 20163 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.566057 15320 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:24.469290 20115 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.567328 15390 raft_consensus.cc:2368] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
I20260709 13:04:24.597822 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:24.599992 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1682) took 1130 ms. Trace:
I20260709 13:04:24.599882 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:24.600618 15250 rpcz_store.cc:276] 0709 13:04:23.471404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.471879 (+   475us) service_pool.cc:224] Handling call
0709 13:04:24.599790 (+1127911us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b540001f754. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:24.599927 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942753024}
W20260709 13:04:24.471299 20132 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.003s
I20260709 13:04:24.612911 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.601446 15248 pending_rounds.cc:85] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 4
I20260709 13:04:24.613824 15248 pending_rounds.cc:107] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:04:24.614133 15248 raft_consensus.cc:2889] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:24.614838 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.613543 15325 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:24.617209 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.618676 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.619434 15397 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 8.
I20260709 13:04:24.620287 15325 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:24.621342 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.621345 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.623106 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:24.624511 16025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 834) took 1607 ms (client timeout 1875 ms). Trace:
I20260709 13:04:24.622187 15321 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
W20260709 13:04:24.624949 16025 rpcz_store.cc:269] 0709 13:04:23.017551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.017746 (+   195us) service_pool.cc:224] Handling call
0709 13:04:24.624336 (+1606590us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b540067dc54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:24.624450 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474054016}
I20260709 13:04:24.594636 20182 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.630059 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.631294 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.631878 15396 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:24.636260 20123 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:24.617455 20183 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:24.520186 19988 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.636778 20123 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:24.638864 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.639313 19832 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:24.641037 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.644796 15396 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:24.667869 15320 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:24.668322 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:24.612805 20044 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.616811 19981 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.648126 20183 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:24.661945 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.671875 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.678648 15325 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:24.615866 20132 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.645723 19944 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.686021 20181 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:24.686509 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:24.682266 19981 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.720486 20062 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:24.683653 20183 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:24.721925 20112 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:24.731127 20123 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.734586 20123 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:24.746408 15399 raft_consensus.cc:2368] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16.
I20260709 13:04:24.688520 20172 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:04:24.689016 19832 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:04:24.752418 20163 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.755695 20132 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:23.238978 15393 rpcz_store.cc:276] 0709 13:04:22.201126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.472110 (+270984us) service_pool.cc:224] Handling call
0709 13:04:22.561934 (+ 89824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:22.562145 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:22.658737 (+ 96592us) log.cc:844] Serialized 14 byte log entry
0709 13:04:23.237870 (+579133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:23.237928 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:23.237979 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.238045 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.238335 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42224,"prepare.queue_time_us":127163,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":4504,"raft.queue_time_us":848,"thread_start_us":578729,"threads_started":1}
I20260709 13:04:24.757201 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.759997 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:24.649459 20190 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:24.790848 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.792456 15317 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:24.792387 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 620) took 1127 ms. Trace:
W20260709 13:04:24.800061 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.729288 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.802338 15324 rpcz_store.cc:276] 0709 13:04:23.664465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.674935 (+ 10470us) service_pool.cc:224] Handling call
0709 13:04:24.792106 (+1117171us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54002ee0d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:24.792309 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81988480}
I20260709 13:04:24.802899 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:24.803637 16027 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:24.805605 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:24.806493 16025 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 9.
I20260709 13:04:24.807718 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:24.812419 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 125992us
I20260709 13:04:24.814273 16030 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:24.814571 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:24.815845 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:24.816588 16029 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.819557 20132 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:24.820026 20132 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.820395 20132 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:24.821165 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:24.826350 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.831528 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.832321 15316 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:04:24.833123 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 145328us
I20260709 13:04:24.834445 15289 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:24.840889 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.817359 20060 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.813977 19749 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:24.839448 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:24.851333 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.849099 16029 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:24.854211 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:24.855731 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.857290 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.858063 15316 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:24.859557 20115 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.860934 15396 raft_consensus.cc:2368] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:24.837323 20172 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:24.862262 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:24.856666 19749 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.869762 20055 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:24.870923 19749 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:24.851907 19430 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:24.815744 20190 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.862854 20088 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:24.865176 20172 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:24.874723 19981 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.884172 20115 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.887671 20088 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:24.883162 20172 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:24.854844 20060 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.889408 20174 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:24.894747 20174 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:24.895916 20060 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:24.895694 20174 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:24.896483 20155 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.524s	user 0.008s	sys 0.023s
I20260709 13:04:24.896871 20174 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:24.900171 20183 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:24.902354 20191 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.291s	user 0.000s	sys 0.003s
I20260709 13:04:24.902666 20183 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:24.904210 20088 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:24.892321 20190 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:24.907306 20161 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.982s	user 0.002s	sys 0.008s
I20260709 13:04:24.910030 20132 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:24.918678 20193 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.225s	user 0.003s	sys 0.000s
W20260709 13:04:24.921644 20158 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.750s	user 0.002s	sys 0.003s
I20260709 13:04:24.922314 20172 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:24.979498 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2471) took 1252 ms. Trace:
I20260709 13:04:24.980058 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:24.983809 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:24.986219 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.987728 15316 raft_consensus.cc:2410] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:04:24.989044 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.990126 15316 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 8: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:24.991392 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.993347 15318 raft_consensus.cc:2368] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:24.993508 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.994766 15324 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:24.994836 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.996217 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:24.991384 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1673) took 2344 ms. Trace:
I20260709 13:04:24.997004 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.997198 15324 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:24.997203 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:24.999044 15319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2771) took 2434 ms (client timeout 1644 ms). Trace:
I20260709 13:04:24.999341 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:24.999657 15319 rpcz_store.cc:269] 0709 13:04:22.564359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.564515 (+   156us) service_pool.cc:224] Handling call
0709 13:04:24.998516 (+2434001us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54002a6cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:24.998776 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1543123840}
I20260709 13:04:25.000490 15320 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:25.001291 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.001624 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:24.994930 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:24.980427 15243 rpcz_store.cc:276] 0709 13:04:23.726853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.335586 (+608733us) service_pool.cc:224] Handling call
0709 13:04:24.335887 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:24.336260 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:24.336289 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:24.362450 (+ 26161us) log.cc:844] Serialized 52 byte log entry
0709 13:04:24.610797 (+248347us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:24.610842 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.610913 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.901559 (+290646us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:24.978652 (+ 77093us) raft_consensus.cc:1685] finished
0709 13:04:24.978724 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.979199 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":11326,"spinlock_wait_cycles":260741376,"thread_start_us":202407,"threads_started":1,"wal-append.queue_time_us":242183}
I20260709 13:04:25.004452 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.005595 15321 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:24.997046 15247 rpcz_store.cc:276] 0709 13:04:22.647195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.692537 (+ 45342us) service_pool.cc:224] Handling call
0709 13:04:22.692813 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.064874 (+372061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.990779 (+1925905us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54000ad554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:24.991152 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718390144}
I20260709 13:04:25.008462 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.009464 15321 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:25.010780 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:25.012046 15249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1676) took 2355 ms (client timeout 2100 ms). Trace:
W20260709 13:04:25.012571 15249 rpcz_store.cc:269] 0709 13:04:22.656853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.686436 (+ 29583us) service_pool.cc:224] Handling call
0709 13:04:25.011483 (+2325047us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540023aad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:25.011808 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3560083712}
I20260709 13:04:25.012028 15321 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:24.887799 19973 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:24.884955 20039 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:25.059201 20039 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:25.060417 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.061446 15246 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:24.885799 20145 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.063376 15241 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:25.022650 15319 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:25.025771 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.062542 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:24.875384 19430 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.066287 19430 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:25.068753 15291 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:25.026889 20040 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.027381 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:25.041882 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:25.070684 20040 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.046316 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.071545 15246 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:04:25.054291 15996 leader_election.cc:336] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.175s (SENT)
I20260709 13:04:25.051501 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.069936 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:25.064638 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.073454 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.072042 15250 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:25.074206 15245 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:25.073886 15241 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:25.075243 20208 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.075959 20208 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.071591 15321 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:25.061088 20039 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.082602 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:25.084702 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 230418us
I20260709 13:04:25.085075 15324 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:25.087788 20172 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:25.089135 15323 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:25.091019 19988 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.095041 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:25.096596 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:25.097080 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:25.099246 15999 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.959s (SENT)
I20260709 13:04:25.100633 20164 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:25.103399 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:25.073881 20040 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.080124 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.123855 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:25.124799 16029 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:25.135816 15214 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:25.135850 20206 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:25.137909 20206 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.138512 15249 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:25.140005 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.140692 20206 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.140920 15249 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:25.141383 20206 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.912432 20132 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:25.124135 16027 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:25.123905 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:25.147222 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.159315 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:25.119505 20038 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:25.173872 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 105518us
I20260709 13:04:25.142088 20206 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.119486 19973 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:25.189224 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.189455 16030 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:25.172610 20040 raft_consensus.cc:2764] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:04:25.193917 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.194566 15241 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:25.192447 15242 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
W20260709 13:04:25.212304 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.212656 20208 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:25.213124 15213 connection.cc:256] RPC call timeout handler was delayed by -1.1785730029999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 13:04:25.213666 15213 connection.cc:256] RPC call timeout handler was delayed by -1.012073002999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 13:04:25.214116 19709 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.215260 19830 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:25.215787 19830 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:25.216439 19973 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:25.218654 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 69951.6us
I20260709 13:04:25.221380 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:25.222590 19860 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.222919 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:25.223899 20206 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.226758 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 760) took 3247 ms. Trace:
I20260709 13:04:25.227388 20132 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.227185 16028 rpcz_store.cc:276] 0709 13:04:21.979447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.979557 (+   110us) service_pool.cc:224] Handling call
0709 13:04:21.979864 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:22.984823 (+1004959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.195450 (+2210627us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54004844d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:25.226514 (+ 31064us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309835136}
I20260709 13:04:25.228555 20164 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:25.230006 20164 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.230675 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:25.232066 19832 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:25.232559 19832 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:25.232992 19832 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:25.228209 20132 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.215322 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:25.200753 20154 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.222641 20039 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:25.275358 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44899us
I20260709 13:04:25.274616 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:25.237888 19973 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:25.280026 16025 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:25.280871 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 107501us
I20260709 13:04:25.281463 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:25.284442 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49969.8us
I20260709 13:04:25.217470 19830 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.290602 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:25.288259 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 189291us
I20260709 13:04:25.293156 20207 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:25.227121 19708 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:25.283737 19992 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:04:25.300572 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.302351 20172 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:25.302898 20172 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.303390 15399 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:25.306360 19863 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:25.307264 19830 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:25.310143 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.310847 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.311692 15324 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:25.313342 19992 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:25.278872 20038 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.303226 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:25.315632 16028 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:25.289007 19988 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:25.313263 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.306531 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2465) took 1636 ms. Trace:
I20260709 13:04:25.333349 16027 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:25.333657 15244 rpcz_store.cc:276] 0709 13:04:23.669969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.202714 (+532745us) service_pool.cc:224] Handling call
0709 13:04:24.319326 (+116612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.319600 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:24.354802 (+ 35202us) log.cc:844] Serialized 14 byte log entry
0709 13:04:25.009733 (+654931us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b180038d820. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a
0709 13:04:25.199364 (+189631us) log.cc:844] Serialized 14 byte log entry
0709 13:04:25.244464 (+ 45100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:25.266001 (+ 21537us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:25.277664 (+ 11663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.285787 (+  8123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:25.306351 (+ 20564us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25593,"prepare.queue_time_us":72486,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":90,"raft.queue_time_us":121710,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":31476,"spinlock_wait_cycles":16942336,"thread_start_us":274901,"threads_started":4,"wal-append.queue_time_us":113704}
I20260709 13:04:25.323199 15393 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:25.314141 20209 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:25.320273 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 43979.8us
I20260709 13:04:25.343796 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:25.290393 19860 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:25.328356 20038 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.329021 19832 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.349489 19832 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:25.329730 16029 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:25.283739 19982 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:25.314806 19992 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.351686 19992 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:25.358479 19708 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.359349 19708 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:25.362588 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49491.3us
I20260709 13:04:25.363794 16025 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:25.364372 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:25.365748 20123 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:25.366618 20123 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:25.366366 20038 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:25.367210 20123 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:25.367812 20132 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.368274 20123 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:25.362591 20219 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:04:25.372329 20206 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:25.375217 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:25.362140 19708 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.376345 20213 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:25.382167 15318 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:25.378268 20067 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:25.385074 20067 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:25.385848 19944 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:25.385977 20067 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:25.371104 20058 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:25.388042 20067 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.392110 20067 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:25.379871 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:25.380110 20009 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.396016 20145 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.397145 20213 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:25.397493 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2444) took 1039 ms. Trace:
I20260709 13:04:25.412101 15321 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:25.303258 20172 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:25.333282 19988 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.397930 15391 rpcz_store.cc:276] 0709 13:04:24.361037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.454490 (+ 93453us) service_pool.cc:224] Handling call
0709 13:04:24.454775 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:24.462170 (+  7395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:24.462203 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:24.467146 (+  4943us) log.cc:844] Serialized 26 byte log entry
0709 13:04:25.040616 (+573470us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b180024eec0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:04:25.323479 (+282863us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:25.361524 (+ 38045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.361625 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:25.397008 (+ 35383us) raft_consensus.cc:1685] finished
0709 13:04:25.397027 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:25.397327 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6998,"raft.queue_time_us":13255,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7553,"spinlock_wait_cycles":78793600,"thread_start_us":233519,"threads_started":1,"wal-append.queue_time_us":924217}
I20260709 13:04:25.291774 20040 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:04:25.429198 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:25.431085 16030 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:25.291296 20154 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.434031 19974 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:25.439378 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:25.445798 19708 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:25.446871 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.446620 19708 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:25.448329 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 159722us
I20260709 13:04:25.449183 19708 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.452139 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:25.453179 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:25.453459 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:25.454656 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.455564 15320 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:25.456252 20012 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.456764 15247 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:25.457253 20183 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:25.454842 19973 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:25.457835 20183 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:25.314669 20208 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:04:25.457855 19973 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.458732 19973 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:25.459199 20183 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.463598 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:25.465417 19832 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:25.466056 19832 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:25.467242 19832 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.470813 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.471721 15320 raft_consensus.cc:2368] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:25.454176 15321 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:25.472726 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.473102 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:25.422899 19988 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:25.476997 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:25.480693 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 136992us
I20260709 13:04:25.486215 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.483850 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:25.488984 15318 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:25.490175 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:25.492118 15320 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:25.495766 20009 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:25.496515 20009 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:25.500864 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 86832us
I20260709 13:04:25.421855 20207 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.508818 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.513407 15318 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:25.514732 19992 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:25.515467 19992 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:25.515863 20009 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.516764 19992 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:25.521289 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.523001 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.526400 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:25.523658 15244 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:25.532624 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:25.486783 19430 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.549053 20206 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:25.550832 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.524143 19973 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.560359 15290 leader_election.cc:400] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14.
I20260709 13:04:25.561470 20088 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.536690 19944 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:04:25.568141 15316 raft_consensus.cc:2368] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10.
W20260709 13:04:25.572377 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 64294.8us
I20260709 13:04:25.553372 20040 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:04:25.562182 20088 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.566247 20132 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:25.583668 15391 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:25.586444 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:25.598268 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.611131 15399 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:25.623239 15291 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:25.609791 20118 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:04:25.630801 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:25.633314 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:25.634146 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.627524 15321 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
W20260709 13:04:25.640343 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 219879us
I20260709 13:04:25.637190 20156 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:25.640730 15318 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:25.642766 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.651499 15321 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:04:25.616192 20123 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.614162 20044 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:04:25.644696 20118 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.658708 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:25.658155 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:25.659147 15391 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:25.656144 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:25.669291 15395 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:25.673208 20132 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:25.673707 20222 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:04:25.674067 20132 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.679466 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:25.663671 15999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.041s (SENT) [suppressed 43 similar messages]
I20260709 13:04:25.661434 20118 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:25.686412 20123 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:25.687631 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 81717.7us
I20260709 13:04:25.688712 20062 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:25.682011 19430 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.695592 20154 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:25.696799 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54106.6us
I20260709 13:04:25.699239 20088 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.689220 20062 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:25.700174 20062 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:25.723397 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66347.7us
I20260709 13:04:25.725648 15399 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:25.737352 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:25.737879 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:25.738664 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:25.739089 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.740330 15398 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:25.740993 20206 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:25.742522 20201 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:25.743162 20201 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.743655 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:25.744444 15247 raft_consensus.cc:2368] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15.
I20260709 13:04:25.745438 20201 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.746513 15321 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:04:25.746272 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:25.741732 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:25.747165 15247 raft_consensus.cc:2376] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13. Re-sending same reply.
I20260709 13:04:25.741721 20206 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.748622 20088 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:25.749018 20088 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.749414 20088 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:25.752941 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:25.753924 15247 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:25.754083 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.750011 20206 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.756794 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:25.746049 20201 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.757694 20207 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.757822 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:25.758770 15249 raft_consensus.cc:2368] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14.
I20260709 13:04:25.758546 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:25.754604 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:25.759542 15391 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:25.760481 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:25.761132 15249 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:25.757668 20201 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.678915 19944 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:25.702198 20118 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.791916 15320 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:25.766727 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.767757 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.768428 15241 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:25.774863 15390 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:04:25.775774 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.761191 15391 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 13:04:25.767962 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2454) took 1136 ms. Trace:
I20260709 13:04:25.777665 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.783915 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:25.808609 19988 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.809202 16033 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:25.809897 15397 raft_consensus.cc:2368] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13.
I20260709 13:04:25.780722 20118 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.780968 20201 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.810693 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.812155 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.813124 20207 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.813351 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.813737 20207 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.814393 19916 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:25.815276 19177 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:25.816376 20207 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.816979 20207 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.817387 19944 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:25.818071 19944 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.818583 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.818758 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.780745 20123 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.819636 19430 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:25.819857 20201 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:25.758348 19973 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:25.783607 20218 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.459s	user 0.001s	sys 0.003s
I20260709 13:04:25.814101 15241 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:25.823478 15249 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:25.821736 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.801168 15396 rpcz_store.cc:276] 0709 13:04:24.631616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.668063 (+ 36447us) service_pool.cc:224] Handling call
0709 13:04:25.767562 (+1099499us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400154fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:25.767759 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441015680}
I20260709 13:04:25.817416 20207 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.767104 20154 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:25.765787 20012 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:25.832712 15244 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:04:25.849948 15249 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:04:25.822580 15999 leader_election.cc:336] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.244s (SENT)
I20260709 13:04:25.837414 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.787081 19832 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:25.845726 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.774550 20183 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:25.854743 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.855371 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.856315 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:25.858211 15244 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:25.861869 15391 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:25.843815 20123 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:25.864493 15242 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:25.847540 20154 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:25.859105 20039 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.002s
I20260709 13:04:25.871445 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.873889 16033 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:25.877359 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:25.866220 20009 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:25.878597 15247 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:25.879681 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:25.880298 16025 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:25.866847 20067 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:25.871721 20154 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:25.883857 15250 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:25.882922 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:25.890856 20174 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.870746 19944 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:25.894163 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 169135us
W20260709 13:04:25.894485 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.887415 20206 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:25.880908 19988 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:25.866291 20012 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:25.917385 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 99026.2us
I20260709 13:04:25.875243 20062 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:25.902887 20174 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.875919 19832 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:25.925752 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 103203us
I20260709 13:04:25.929768 16025 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:25.930624 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:25.898684 19992 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:25.932389 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:25.938040 20174 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.936257 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.943439 19992 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:25.938055 20012 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:25.949229 19992 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:25.951022 20039 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:04:25.952039 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.953223 20039 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:04:25.956324 20227 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
W20260709 13:04:25.958258 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 43913.9us
I20260709 13:04:25.958532 20208 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:25.959511 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:25.960768 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:25.963498 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:25.964341 20191 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:04:25.936523 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:25.983763 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.981547 20039 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 13:04:25.986572 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 50172.5us
I20260709 13:04:25.988831 15321 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:25.988900 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.940557 20062 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:25.993851 15398 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:25.975822 20206 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:26.000295 20231 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:04:26.000733 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:26.003958 20156 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:26.004758 20156 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:25.960758 20040 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:26.005800 20040 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:26.007339 20040 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.008390 19882 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:26.009155 20040 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:26.016028 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:25.992987 19988 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:25.992481 20132 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:26.027333 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:26.028304 16025 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:26.029955 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:26.038539 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 60416.7us
W20260709 13:04:26.043663 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 55652us
I20260709 13:04:26.046322 15320 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:26.035239 19988 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:26.041033 19882 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:26.056011 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:26.056941 15320 raft_consensus.cc:2410] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:04:26.052050 20164 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.004s	sys 0.008s
I20260709 13:04:26.042879 20207 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:26.060873 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 93026.7us
W20260709 13:04:26.065063 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.052500 20067 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:04:26.059257 20164 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.004s	sys 0.009s
I20260709 13:04:26.069948 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:26.074891 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.075874 15243 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:26.077122 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:26.077937 15243 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:26.078346 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.078778 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:26.078660 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.058401 19882 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.079458 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:26.080603 15320 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:26.075866 20230 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:04:26.085901 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.088454 19708 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.092041 19708 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.092547 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.093253 15243 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:26.095275 19832 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:26.097031 15322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 623) took 2403 ms (client timeout 2175 ms). Trace:
W20260709 13:04:26.097573 15322 rpcz_store.cc:269] 0709 13:04:23.693867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.694545 (+   678us) service_pool.cc:224] Handling call
0709 13:04:26.096663 (+2402118us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b54001c57d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:26.096826 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4846422784}
W20260709 13:04:26.098908 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.100162 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:26.101068 16025 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:04:26.102569 20172 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.665s	user 0.012s	sys 0.000s
I20260709 13:04:26.103003 20172 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.105069 20172 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:26.105967 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 52200.7us
I20260709 13:04:26.106930 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:26.107853 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2466) took 2437 ms. Trace:
I20260709 13:04:26.108476 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:26.068576 20208 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:04:26.112133 15316 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:04:26.112728 20208 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:26.113149 20208 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:26.114753 19988 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.082288 19882 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.116539 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:26.118676 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47864.7us
I20260709 13:04:26.120362 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:26.121301 19916 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:26.121925 19916 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:26.122897 19916 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.124429 20173 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:26.125142 20123 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.125473 20118 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:26.126049 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.112000 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1725) took 1498 ms. Trace:
I20260709 13:04:26.127437 15999 leader_election.cc:400] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14.
I20260709 13:04:26.127712 20012 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.100569 20088 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.061932 20062 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:04:26.110131 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:26.151081 15999 leader_election.cc:403] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:04:26.108325 15248 rpcz_store.cc:276] 0709 13:04:23.670341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.296239 (+625898us) service_pool.cc:224] Handling call
0709 13:04:24.601145 (+304906us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:24.618665 (+ 17520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:24.618697 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:04:24.619309 (+   612us) log.cc:844] Serialized 78 byte log entry
0709 13:04:24.983146 (+363837us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:24.983943 (+   797us) log.cc:844] Serialized 14 byte log entry
0709 13:04:24.984552 (+   609us) log.cc:844] Serialized 14 byte log entry
0709 13:04:25.708485 (+723933us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b180038d8e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287
0709 13:04:25.708658 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.737363 (+ 28705us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:25.737552 (+   189us) raft_consensus.cc:1685] finished
0709 13:04:25.737573 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:25.967390 (+229817us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b180038d8e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:26.107483 (+140093us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540001f750. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:26.107654 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":158119,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":102,"raft.queue_time_us":143678,"raft.run_cpu_time_us":537,"raft.run_wall_time_us":9494,"spinlock_wait_cycles":683553792,"thread_start_us":376813,"threads_started":2,"wal-append.queue_time_us":280807}
I20260709 13:04:26.158313 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.149591 15323 rpcz_store.cc:276] 0709 13:04:24.613974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.614593 (+   619us) service_pool.cc:224] Handling call
0709 13:04:26.111711 (+1497118us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400412654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:26.111917 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062081792}
I20260709 13:04:26.161827 15395 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:26.144451 19832 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:26.142808 20172 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:26.164212 20012 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.174154 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:26.142974 20173 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:26.187040 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 59832.1us
I20260709 13:04:26.162756 19708 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:26.202610 20229 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.203629 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 605) took 3629 ms. Trace:
W20260709 13:04:26.216408 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 106405us
I20260709 13:04:26.155731 20123 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.194439 19916 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:26.174938 20009 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:04:26.207922 20150 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:26.208184 20174 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:26.204939 20132 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:26.183302 20118 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.209851 20229 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:26.215441 19973 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:26.247351 15323 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:04:26.245909 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:26.252525 16025 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:26.254000 16033 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:26.194687 20058 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:04:26.210121 15392 rpcz_store.cc:276] 0709 13:04:22.574202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.574356 (+   154us) service_pool.cc:224] Handling call
0709 13:04:22.574736 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:22.574983 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:04:23.147125 (+572142us) log.cc:844] Serialized 14 byte log entry
0709 13:04:23.430452 (+283327us) log.cc:844] Serialized 14 byte log entry
0709 13:04:25.398350 (+1967898us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b18002e9f60. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:04:26.042641 (+644291us) log.cc:844] Serialized 14 byte log entry
0709 13:04:26.169015 (+126374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:26.182064 (+ 13049us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:26.189855 (+  7791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.203156 (+ 13301us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:26.203434 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126108,"prepare.queue_time_us":405906,"prepare.run_cpu_time_us":184,"prepare.run_wall_time_us":3038,"raft.queue_time_us":159990,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":57588,"spinlock_wait_cycles":12190336,"thread_start_us":1400501,"threads_started":5,"wal-append.queue_time_us":605072,"wal-append.run_cpu_time_us":1784,"wal-append.run_wall_time_us":1005954}
I20260709 13:04:26.236382 19916 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:26.277505 20118 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:26.268537 20229 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.279488 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:26.280097 19832 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.294587 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:26.297756 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 93055.6us
I20260709 13:04:26.195482 20173 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.312397 15322 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:04:26.313854 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 139910us
I20260709 13:04:26.289736 19832 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:26.315968 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:26.330895 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 153630us
W20260709 13:04:26.331967 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 57535.6us
I20260709 13:04:26.333254 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:26.307866 20252 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.303143 19992 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:26.336863 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:26.327698 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.286543 19882 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.289165 19973 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:26.344262 20237 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:04:26.324180 19830 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:26.300128 20213 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:26.335347 19832 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:26.346899 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67524.2us
I20260709 13:04:26.299209 20150 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.303261 20172 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:04:26.353734 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.336396 20252 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:26.356375 15323 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:26.357146 15244 raft_consensus.cc:2410] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:04:26.307001 20183 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:04:26.362017 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.363195 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.363934 15250 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 8.
I20260709 13:04:26.364295 20096 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:04:26.364627 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58266.4us
I20260709 13:04:26.368001 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:26.369920 20250 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:04:26.346513 20257 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.366118 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:26.353953 20009 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:26.380999 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:26.353585 20088 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:26.376600 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:26.381244 20009 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:26.391426 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:26.391970 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.393151 15397 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:26.384366 15399 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:26.363476 20173 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:26.360486 20252 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.421418 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:26.448388 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.451236 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.449740 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:26.447990 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 132098us
I20260709 13:04:26.455595 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.392429 19708 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:26.381692 20058 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:26.449339 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.464569 15396 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:26.457433 15392 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:26.392068 20150 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:26.381091 20096 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:26.473616 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.474411 15391 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:26.459905 15324 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:26.460903 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 221950us
I20260709 13:04:26.475597 15390 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:26.475844 15391 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:26.476500 20067 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:26.476997 20067 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:26.477150 15391 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:26.459126 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.478996 15395 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:26.461177 15244 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:26.481283 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:26.481920 15320 raft_consensus.cc:2376] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12. Re-sending same reply.
I20260709 13:04:26.422919 20012 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:26.483513 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:26.486053 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:26.489488 20229 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.452981 19992 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:26.491200 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:26.492414 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 133911us
W20260709 13:04:26.493198 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 101876us
W20260709 13:04:26.507364 20247 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:04:26.507637 19992 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.508527 20258 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:26.509369 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.423290 20257 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.489418 19973 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:26.455814 19916 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.512138 20208 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.513355 20208 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:26.494328 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.514418 20153 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:26.514642 15243 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:26.515403 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.462191 15393 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:26.391543 20009 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.473924 20096 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.517063 20259 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:26.517529 20259 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:26.517732 20009 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.499261 20262 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:26.499190 15397 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:26.516991 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:26.514642 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:26.503456 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 150174us
I20260709 13:04:26.504220 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.507998 20255 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:26.471589 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:26.496749 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.521909 15241 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.507377 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:26.523299 15247 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:04:26.510087 15242 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:26.459790 20123 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:26.531692 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.534415 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.538662 15391 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:26.521751 15998 leader_election.cc:400] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13.
I20260709 13:04:26.543896 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:26.544162 15998 leader_election.cc:403] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:26.544844 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:26.532186 20258 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:26.547772 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:26.548722 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47387.5us
I20260709 13:04:26.543316 15397 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:26.558048 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:26.558835 15394 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:26.558883 15395 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:26.575109 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:26.575137 20156 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.570s	user 0.002s	sys 0.012s
I20260709 13:04:26.576006 15397 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:26.576085 20260 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.576711 20260 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.572536 20062 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:26.578756 20062 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:26.579731 20062 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.581624 15393 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:26.583066 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:26.584059 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:26.584957 15247 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:26.576089 20156 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.587554 20156 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:26.592002 19990 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:04:26.593021 19990 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:26.593451 19990 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:26.543316 20040 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:26.595897 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88627.3us
I20260709 13:04:26.574406 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:26.591532 20183 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:26.527038 20012 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:04:26.567646 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1389463201b74b128d916816a1d7c24c"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:26.605499 15246 raft_consensus.cc:606] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:26.605912 15246 raft_consensus.cc:614] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:26.567078 20088 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:04:26.603461 20040 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.621533 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:26.641194 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:26.670974 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51025.6us
I20260709 13:04:26.598419 19882 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:26.681277 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:26.670116 15397 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:26.684569 15393 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:26.682076 15241 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:26.699740 15244 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:26.603760 19708 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:26.702045 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:26.702029 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 110791us
I20260709 13:04:26.592002 19832 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.705794 15316 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:26.701647 20262 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:26.713392 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:26.668123 20012 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:26.715131 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 170377us
I20260709 13:04:26.716419 20262 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.718376 20266 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 13:04:26.768469 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:26.706709 19708 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.720289 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:26.732065 19916 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:26.732234 19832 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:26.735805 20249 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.433s	user 0.003s	sys 0.000s
I20260709 13:04:26.736068 15394 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:26.743328 19992 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:26.683825 20154 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.779s	user 0.000s	sys 0.020s
W20260709 13:04:26.766769 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 61878.3us
I20260709 13:04:26.769466 15391 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:26.790031 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:26.793413 15324 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:26.804615 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:26.805109 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:26.787004 20174 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.003s
I20260709 13:04:26.807224 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:26.807796 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.813547 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:26.789587 19708 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:26.824542 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:26.804051 20096 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:26.804483 20257 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:26.828620 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:26.803017 20273 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13.
I20260709 13:04:26.830547 15391 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:26.679900 19990 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:26.835763 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 377065us
I20260709 13:04:26.797170 20012 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:04:26.818481 20174 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14.
I20260709 13:04:26.822365 19832 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:26.841107 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72706.1us
I20260709 13:04:26.828936 20271 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.807026 20154 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.863864 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:26.845320 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:26.836807 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:26.864823 15241 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:26.847754 20229 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:26.867839 20273 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:26.875049 20273 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:26.875571 20265 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:04:26.875929 20264 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.876017 20273 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.876600 20264 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.877395 20040 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:26.877593 20273 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.878432 15325 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:26.796587 20258 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.851198 19992 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:26.892987 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 345955us
I20260709 13:04:26.893959 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:26.899089 16029 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:26.874140 19990 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:26.888231 19832 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:26.927618 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:26.927961 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 126301us
I20260709 13:04:26.928524 15398 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
W20260709 13:04:26.929474 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.936615 15241 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:26.938166 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:26.939949 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:26.943836 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:26.944399 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 88665.5us
I20260709 13:04:26.952478 15250 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:26.930557 20096 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:26.869684 20271 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:26.956980 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:26.968604 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:26.972913 15247 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:26.944085 20260 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:26.979468 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.981705 15398 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:26.982753 15241 raft_consensus.cc:2410] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:04:26.941174 19992 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:26.980805 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:26.969310 20088 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:26.988057 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:26.988756 15241 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:26.957893 20183 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:04:26.985713 20264 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:27.001219 20096 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:27.010370 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:27.015832 15250 raft_consensus.cc:2410] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:04:26.987083 20088 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.990396 20255 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:04:27.019150 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.986752 20268 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:27.016007 20283 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:04:27.050221 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:27.051066 15324 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:27.053478 15245 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:27.055241 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:27.033620 20088 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:27.023166 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:27.049333 19992 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:27.058116 20213 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.061357 20280 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:27.043038 20268 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:27.042960 20255 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:27.107964 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:27.109788 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:27.110545 15250 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:27.020048 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:27.032475 20154 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:27.049611 20270 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:04:27.082536 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:27.062156 20281 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:04:27.118712 15241 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:27.125005 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:27.126016 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:27.108623 20252 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.000s
I20260709 13:04:27.158277 15248 raft_consensus.cc:2368] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
W20260709 13:04:27.121670 20272 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:04:27.090392 20213 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:27.160074 15241 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:04:27.173069 20288 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:04:27.196931 15245 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:27.174216 20277 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:04:27.197497 15245 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:27.210139 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 120282us
W20260709 13:04:27.212126 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 161234us
W20260709 13:04:27.212718 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.219162 15362 leader_election.cc:400] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:27.219697 15362 leader_election.cc:403] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:27.158697 20252 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:27.169417 20154 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:04:27.251451 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 267411us
I20260709 13:04:27.247972 15245 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:27.262197 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:27.270047 16030 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:27.275136 15245 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:27.276911 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 608416us
W20260709 13:04:27.278187 15365 leader_election.cc:336] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.571s (SENT)
I20260709 13:04:27.252713 15250 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
W20260709 13:04:27.306634 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.262672 19992 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
W20260709 13:04:27.334990 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72883us
I20260709 13:04:27.280947 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:27.280195 20009 consensus_meta.cc:287] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.762s	user 0.014s	sys 0.000s
I20260709 13:04:27.279430 19988 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:27.345794 15362 leader_election.cc:400] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10.
I20260709 13:04:27.347966 15362 leader_election.cc:403] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:27.351364 16030 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:27.353519 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:27.353879 20257 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:27.354382 20257 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.354719 20257 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:27.355008 16027 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:27.355768 20132 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 9. Current term is 10.
I20260709 13:04:27.356416 20213 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:27.356487 20132 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:27.357136 20132 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:27.358140 20132 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:27.358968 20067 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.881s	user 0.013s	sys 0.000s
I20260709 13:04:27.359431 20067 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:27.361498 20067 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:27.361722 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:27.343346 20268 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:27.363363 20012 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:27.363546 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 469648us
W20260709 13:04:27.364060 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 392350us
W20260709 13:04:27.364521 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 356887us
W20260709 13:04:27.367367 20292 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
W20260709 13:04:27.373449 20276 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.483s	user 0.003s	sys 0.000s
W20260709 13:04:27.398699 20269 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.593s	user 0.000s	sys 0.003s
W20260709 13:04:27.400789 19708 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.001s
I20260709 13:04:27.401003 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:27.401263 19708 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:27.403507 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 125347us
I20260709 13:04:27.380990 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:27.383121 15247 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
W20260709 13:04:27.347044 20288 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:04:27.388535 15245 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:27.396304 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:27.384335 20213 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:27.350019 19988 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:27.243016 20255 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:27.427258 15324 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:27.384667 19992 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:27.431139 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:27.452035 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:27.423628 20067 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:27.431875 19988 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:27.476619 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:27.476974 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.424732 20268 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 13:04:27.481575 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 133512us
I20260709 13:04:27.482685 20268 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:27.483460 20268 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:27.433812 20271 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:27.391126 19973 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:04:27.473816 20067 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:27.498723 20067 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.426452 20206 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:04:27.504048 20206 consensus_queue.cc:1243] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:04:27.504642 20206 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:27.504956 20206 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:27.506924 20252 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:27.510545 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 135899us
W20260709 13:04:27.488740 20173 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.041s	user 0.007s	sys 0.006s
I20260709 13:04:27.533255 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:27.541262 15362 connection.cc:256] RPC call timeout handler was delayed by -1.0337832330000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:04:27.426899 20259 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:27.523258 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 130865us
W20260709 13:04:27.539902 20208 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.026s	user 0.017s	sys 0.000s
I20260709 13:04:27.505820 20206 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:27.547369 19916 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.750s	user 0.013s	sys 0.000s
I20260709 13:04:27.540184 20280 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:27.562964 15246 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
W20260709 13:04:27.548561 19882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.013s
I20260709 13:04:27.567314 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:27.554785 20279 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:27.562184 20259 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:27.583560 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 51420.3us
I20260709 13:04:27.585569 20257 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:27.588055 20257 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:27.582406 19708 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:27.601873 20273 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.000s
I20260709 13:04:27.602391 20206 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:27.602484 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.603744 15290 leader_election.cc:400] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 9 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 9. Current term is 10.
W20260709 13:04:27.608064 19990 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.693s	user 0.005s	sys 0.006s
I20260709 13:04:27.612121 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:27.576081 20260 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:27.613804 15325 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:27.616014 15324 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:04:27.564690 20088 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:27.623474 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 146928us
I20260709 13:04:27.625890 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:27.565146 19882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.004s	sys 0.013s
I20260709 13:04:27.632872 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:27.618614 20279 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:27.630920 19708 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:27.631522 20316 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:27.634295 20173 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:27.804235 20279 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:27.798722 20309 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260709 13:04:27.800796 20304 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:04:27.650578 19708 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:27.638178 20208 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:04:27.832154 15362 leader_election.cc:336] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.348s (SENT)
I20260709 13:04:27.829082 20183 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:27.843902 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:27.845512 19832 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:27.846802 20302 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260709 13:04:27.844288 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 276473us
I20260709 13:04:27.852178 20088 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:27.852653 20067 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:27.854736 19988 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:27.865677 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:27.865594 20173 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.648833 20280 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:27.893520 20088 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:27.895293 20322 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:27.885277 20319 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:27.896523 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 264497us
I20260709 13:04:27.905453 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:27.907545 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.002305 15215 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:28.003196 20213 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:27.909044 19973 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.003801 20213 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:27.910285 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:27.921687 20260 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.005021 15396 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:27.910578 20040 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:27.911955 20314 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:04:27.831229 20315 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260709 13:04:27.918371 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 115558us
I20260709 13:04:27.922483 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1705) took 1295 ms. Trace:
I20260709 13:04:27.924836 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:27.925004 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.014104 15398 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
W20260709 13:04:27.928925 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:27.985060 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.988570 19708 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:27.988003 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 156076us
I20260709 13:04:28.009831 20183 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:28.011046 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 155510us
I20260709 13:04:28.000021 20173 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.012918 15246 rpcz_store.cc:276] 0709 13:04:26.622955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.684180 (+ 61225us) service_pool.cc:224] Handling call
0709 13:04:27.918396 (+1234216us) spinlock_profiling.cc:243] Waited 855 ms on lock 0x7b5400398ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:27.918540 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1967300352}
I20260709 13:04:28.025955 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 713) took 1206 ms. Trace:
I20260709 13:04:28.006457 20260 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:28.026413 16030 rpcz_store.cc:276] 0709 13:04:26.811306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.811527 (+   221us) service_pool.cc:224] Handling call
0709 13:04:28.017332 (+1205805us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b540067edd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:28.017458 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022515456}
I20260709 13:04:28.007910 20208 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:28.007853 20328 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:28.033202 15290 leader_election.cc:400] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16.
I20260709 13:04:28.035209 15290 leader_election.cc:403] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:04:28.004370 19973 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.037966 20067 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.038908 19973 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.039659 15390 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:28.041432 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.046852 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:28.017187 20321 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:04:28.024286 20183 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.833612 20316 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.040136 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.057905 15322 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:28.006515 20088 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:28.065296 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 61019.6us
I20260709 13:04:28.066776 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:28.035995 20208 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.023485 20040 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.069347 15391 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 9.
W20260709 13:04:28.077135 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.064361 20321 consensus_queue.cc:1243] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:28.076761 20229 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.078096 20290 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.068408 19990 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16.
I20260709 13:04:28.067224 20213 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:28.076911 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72928us
I20260709 13:04:28.068171 20208 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:28.080922 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52372.6us
I20260709 13:04:28.070009 20279 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.091764 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:28.101130 20328 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.087819 20229 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.104852 20229 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.101163 19876 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:28.105902 19876 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.108786 19876 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.096496 20279 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.121089 20279 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.123649 20337 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.124349 20337 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.098654 20335 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:28.117107 20206 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.126734 20335 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.127137 20335 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.127077 20206 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.088444 20321 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:28.128446 20321 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:28.111526 20040 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:28.117038 20325 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:04:28.146623 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.147346 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:28.095199 20319 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:28.145985 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 760919us
I20260709 13:04:28.170871 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 718) took 1064 ms. Trace:
I20260709 13:04:28.099022 20282 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:04:28.178360 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.173950 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:28.171525 16033 rpcz_store.cc:276] 0709 13:04:27.081595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.081772 (+   177us) service_pool.cc:224] Handling call
0709 13:04:27.082063 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:27.082287 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:04:27.340814 (+258527us) log.cc:844] Serialized 14 byte log entry
0709 13:04:27.376133 (+ 35319us) log.cc:844] Serialized 14 byte log entry
0709 13:04:27.902457 (+526324us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b1800489f40. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:28.145351 (+242894us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b1800489f40. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:04:28.145515 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:28.145569 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:28.145616 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:28.145690 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:28.145814 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":794065,"prepare.queue_time_us":263522,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":814168,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6994,"spinlock_wait_cycles":16190464,"thread_start_us":243261,"threads_started":1}
I20260709 13:04:28.193363 15290 leader_election.cc:400] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:28.193948 15290 leader_election.cc:403] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:04:28.169442 20322 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:28.198777 20322 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.201211 20252 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:28.202359 20258 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:28.202795 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.202979 20258 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.205379 20258 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.101926 20328 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.217116 20264 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:28.217705 20264 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:28.219238 20328 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.219873 15365 leader_election.cc:400] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:28.219947 20328 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:28.220311 15998 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:28.206204 20088 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:28.212764 16029 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:28.190893 19988 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.221596 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:28.216259 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68987.6us
I20260709 13:04:28.226854 15322 pending_rounds.cc:85] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 10
I20260709 13:04:28.226354 20321 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.227216 15322 pending_rounds.cc:107] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:04:28.227566 15322 raft_consensus.cc:2889] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:28.227927 20321 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:28.229400 19876 consensus_queue.cc:1175] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" responder_term: 13 status { last_received { term: 13 index: 7 } last_committed_idx: 6 last_received_current_leader { term: 13 index: 7 } }
I20260709 13:04:28.230455 20337 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.230656 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.220336 15365 leader_election.cc:403] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:28.233008 20319 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.169806 20229 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:28.216902 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 815923us
I20260709 13:04:28.234606 20229 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.234956 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:28.216290 20183 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.237161 20229 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:28.238440 20040 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:28.238952 20040 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.239349 20040 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:28.240221 20258 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:28.240700 20258 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.241076 20258 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:28.218770 20264 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.244414 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.188464 20282 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:28.177068 20316 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:28.087052 20290 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.238674 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:28.255160 16029 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:28.257217 15245 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:28.263538 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.263803 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.264519 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.263538 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:28.192523 19973 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.271930 15319 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:04:28.288232 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.296399 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.295176 15363 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:28.289611 19973 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.308612 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.309808 19973 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:28.310779 20150 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:28.311450 20150 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:28.313162 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 67819.9us
I20260709 13:04:28.313854 20150 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.314843 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.271798 20263 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.270107 20259 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.273520 19916 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:28.276317 20271 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:28.326506 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.275887 20257 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:28.299288 20229 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:28.349167 16029 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:28.296409 20132 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.351788 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:28.352540 15246 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.301803 20336 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.322710 20328 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:28.354931 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 172427us
I20260709 13:04:28.358166 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:28.359777 15249 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:28.299472 20318 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:04:28.336146 20323 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.370468 20338 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.374759 20088 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:28.376237 19882 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.349148 20183 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:28.371711 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 302658us
I20260709 13:04:28.390928 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:28.394099 15249 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:28.356637 20328 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:28.373010 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:28.347954 20259 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.349562 19992 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:04:28.397110 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:28.396471 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 104614us
W20260709 13:04:28.404165 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46079.5us
I20260709 13:04:28.401772 15243 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:28.407894 15247 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.397994 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:28.410164 15250 raft_consensus.cc:2410] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:28.411754 15215 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:28.412753 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 191218us
I20260709 13:04:28.337144 20263 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.378473 20229 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:28.443799 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.355412 20132 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.409004 20328 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:28.466090 16027 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:28.466369 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.356355 20336 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.459903 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.460610 15249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:28.460728 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:28.468273 15249 raft_consensus.cc:606] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:28.468395 15390 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:28.468703 15249 raft_consensus.cc:614] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:28.463125 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:28.353611 20282 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.464305 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:28.470484 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.472167 15395 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:28.473924 15398 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:28.442193 19876 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:28.472306 15399 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 10: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:28.478091 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.479558 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:28.448679 20339 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.445958 20183 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:28.459249 20062 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.462106 20337 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.502260 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:28.502986 15397 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:28.500895 15247 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:28.387909 20338 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.454435 19882 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.478799 19876 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.384795 20323 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.453853 20088 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:04:28.465574 20154 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:04:28.511281 16028 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:28.486037 20282 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.533397 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.536774 15399 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:28.545163 15396 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:28.554410 15398 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:28.510495 20290 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:28.513181 19876 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.488065 20208 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.496537 20183 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.507679 20260 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.538050 20347 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.508035 20337 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.605862 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.582170 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:28.490167 20339 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.505990 20062 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.551532 20012 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.613580 19924 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.179s
I20260709 13:04:28.609179 19990 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.612028 20262 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:28.667454 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.612317 20347 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:28.669698 20344 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
W20260709 13:04:28.670940 20352 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:04:28.671233 20347 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:28.486948 19916 consensus_queue.cc:1175] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "89940175e5444593aab6b3a025624b5b" responder_term: 13 status { last_received { term: 12 index: 7 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:28.645128 20012 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.648208 20280 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:04:28.648522 20326 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:28.674904 20326 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.677455 20326 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:28.674114 20012 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.678818 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.679598 20337 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:28.610399 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.610872 15241 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:28.687825 20343 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:04:28.608680 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.689146 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.689419 16028 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:28.689319 20132 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.692924 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.693248 20040 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.696951 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.697610 15322 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:28.698462 20263 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.699338 20323 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.699556 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:28.687831 20260 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.702730 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.703722 16031 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:28.704474 20342 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 13:04:28.644920 20255 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.705884 20255 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:28.707315 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.708197 20255 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.709805 20319 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:28.712906 20260 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.713711 20260 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.715188 20208 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.715906 20260 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:28.716885 19882 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.716881 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.716928 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:28.722437 20259 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.723062 20338 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.723241 20262 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.725549 20262 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.645967 20346 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:28.739614 20321 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.006s
W20260709 13:04:28.739810 20173 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.004s
I20260709 13:04:28.740303 20062 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:28.740451 20335 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 13:04:28.778123 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:28.743727 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:28.617944 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 179368us
I20260709 13:04:28.749189 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.779937 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:28.781401 15325 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:04:28.780614 15391 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:28.782552 16029 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:28.754031 15390 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:28.552235 20229 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.741717 20183 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.786553 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.793664 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:28.794026 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.796532 15246 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:28.796772 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:28.797462 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 286991us
I20260709 13:04:28.752331 20040 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.799852 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.801079 15390 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:28.803090 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.807672 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:28.652842 19990 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.818576 20290 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:28.819125 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:28.820004 20290 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:28.820492 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:28.821306 20290 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:28.821681 20290 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:28.821730 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:28.800292 20258 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.558s	user 0.015s	sys 0.001s
I20260709 13:04:28.858726 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.867534 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:28.868371 15391 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:28.867631 15390 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:28.779831 20335 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.872534 20335 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.822407 20356 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:28.875167 20356 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:28.874616 20255 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.875573 20258 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.875850 20255 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.875584 20356 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.780499 20173 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.880550 20173 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:28.883038 20349 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:04:28.884544 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.885242 16030 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:28.885263 15245 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:28.891382 15363 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:28.831298 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:28.893756 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 62550.8us
I20260709 13:04:28.894661 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.895375 16033 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:28.823190 20040 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.896754 20183 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:28.888581 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:28.899628 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:28.900231 15394 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:28.898725 20183 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.902151 20183 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.904793 20336 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.877995 20258 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.822176 20290 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.912317 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.897395 20173 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:28.913688 20173 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:28.914112 20173 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.915158 20280 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:28.915732 20280 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:28.916699 20280 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.919828 20206 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.920859 20328 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.921696 20257 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.922160 20257 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:28.896966 20040 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.928028 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.928802 16027 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:28.929733 15397 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:04:28.931984 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:28.887105 20282 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:04:28.897779 20351 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:04:28.933928 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:28.934361 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41098c861400432692b47f484ad4dd2d"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:28.935114 16033 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:28.936869 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:28.937613 15397 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:28.940912 15390 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:28.936700 20282 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:28.943302 20088 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:04:28.943638 20282 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:28.950738 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.954777 20040 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.956503 19990 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.957908 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.958662 15398 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:04:28.959582 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:28.960739 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:28.961272 15398 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:28.963878 20255 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:28.960938 19876 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.964627 20282 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:28.966794 20282 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:28.967747 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:28.968379 15396 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:28.970706 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:28.973371 20282 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:28.974251 20346 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:28.974068 20282 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.973294 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:28.976290 20282 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:28.976605 15322 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.977785 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:28.979091 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:28.979704 15247 raft_consensus.cc:2376] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14. Re-sending same reply.
I20260709 13:04:28.982352 19924 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:28.982796 19924 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:28.983755 19924 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:28.984722 19924 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:28.985343 15325 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:28.971303 15399 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:28.990549 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:28.991412 15249 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:28.992787 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:28.993513 15321 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:28.995611 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:28.995958 15247 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:04:28.996424 15247 pending_rounds.cc:85] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 9
I20260709 13:04:28.996652 15247 pending_rounds.cc:107] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:04:28.996903 15247 raft_consensus.cc:2889] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:28.999761 15391 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:29.000141 15998 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:29.005333 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:29.005451 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:29.007853 15322 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:29.008204 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.008863 15390 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:29.003364 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:29.009374 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:29.010167 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:29.011240 15250 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:29.011795 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.012269 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.013058 15250 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:29.014679 15248 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:29.015043 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.015612 15245 raft_consensus.cc:2376] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13. Re-sending same reply.
I20260709 13:04:29.016688 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.017201 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.010787 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:29.017947 15398 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:29.019516 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:29.019625 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.019690 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:29.020541 15243 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:29.021687 15244 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:29.022457 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.024091 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.024250 20273 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:29.024888 20273 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:29.021575 20346 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:29.025816 20273 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.026618 20346 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.027083 20346 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:29.019654 20264 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:29.030164 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:29.030519 20040 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:29.031067 20040 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:29.031559 20040 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:29.031633 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:29.030464 20259 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:29.032780 20259 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.033157 20259 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:29.014375 20322 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.035135 20260 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:29.035693 20260 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.036067 20260 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.038758 20067 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:29.038946 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:29.039294 20067 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.039736 20067 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:29.039988 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:29.034422 20338 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:29.029522 20336 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:29.043751 15249 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 10: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:29.044509 15215 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:29.045024 15394 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:29.045737 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.047922 20208 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:29.048388 20208 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.048754 20208 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:29.051002 15242 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:04:29.051414 15242 pending_rounds.cc:85] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 7
I20260709 13:04:29.051673 15242 pending_rounds.cc:107] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:04:29.051911 15242 raft_consensus.cc:2889] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:29.052899 20339 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.053045 16033 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:29.062569 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:29.063275 15322 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:29.067118 20206 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:29.067754 20206 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:29.068356 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.068707 20206 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.074551 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.054456 20357 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:29.077316 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.076498 20357 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:29.045861 20338 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:29.062016 20336 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:29.091982 15397 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:29.023146 20173 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.111241 16027 raft_consensus.cc:1217] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Deduplicated request from leader. Original: 11.10->[13.11-13.11]   Dedup: 13.11->[]
I20260709 13:04:29.112417 16027 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:04:29.086949 20357 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:29.124636 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.124405 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 54559.4us
I20260709 13:04:29.131708 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:29.136320 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:29.148201 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.043293 20346 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.124383 20328 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:29.159909 20366 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:04:29.163439 20356 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.157495 20280 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:29.183761 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 130095us
I20260709 13:04:29.171443 19876 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:29.199208 16030 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:29.162824 20183 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.205915 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:29.216714 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:29.222100 15399 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:29.226454 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.187243 20280 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.177095 20338 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.203766 20229 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.223248 20213 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:29.179633 20336 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.241362 20173 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:29.261045 20363 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.386s	user 0.003s	sys 0.000s
I20260709 13:04:29.267345 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:29.269225 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.267376 20362 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:04:29.276298 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:29.280123 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.280830 15249 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:29.281998 15249 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:29.247388 20213 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:29.286497 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.288908 16029 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:29.275728 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.284188 19924 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:29.294193 20356 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.302045 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.302929 16028 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:29.303475 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.304018 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.305279 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:29.306694 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:29.307613 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.308157 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.308794 16029 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:29.309744 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:29.310355 16024 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:29.314919 20368 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:04:29.316290 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.317003 15245 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:29.319382 20260 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.320581 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.320785 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:29.322582 20367 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:04:29.324622 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.322108 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.327004 20346 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.327414 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:29.272751 20040 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.329595 15245 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:29.329798 15399 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:04:29.330071 20040 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.332042 20213 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.333340 15322 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:04:29.333729 15322 pending_rounds.cc:85] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 10
I20260709 13:04:29.333856 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:29.334276 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.334632 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:29.335134 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:29.335405 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:29.294433 19924 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:29.336242 15322 pending_rounds.cc:107] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:04:29.336544 15322 raft_consensus.cc:2889] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:29.336690 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.336807 19924 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:29.338368 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.340909 15392 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [11.10-12.11]
I20260709 13:04:29.340977 20040 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.341656 20040 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.245018 20229 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.343662 20183 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:29.343976 20229 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:29.345314 20280 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.287786 20298 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:29.334650 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:29.348862 15244 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:29.293074 19990 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 13:04:29.356844 15999 connection.cc:256] RPC call timeout handler was delayed by -2.86673715500001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:04:29.358700 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.360538 20208 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.360486 20322 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:29.360466 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:29.362406 15246 raft_consensus.cc:606] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:29.362823 15246 raft_consensus.cc:614] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:29.362967 20208 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.363534 20208 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:29.363634 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:29.364360 20259 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.365007 15214 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:29.366025 20335 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:29.366422 20335 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.366580 20259 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.366762 15249 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:29.367853 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.360869 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:29.368273 15362 leader_election.cc:336] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.513s (SENT)
I20260709 13:04:29.366775 20335 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.369709 20067 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.370862 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.371498 15247 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:29.367633 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:29.355408 16024 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:29.374390 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:29.361636 20357 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:29.375560 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 158877us
I20260709 13:04:29.378033 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:29.378590 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.379096 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:29.379384 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.377504 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.381266 16028 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:29.382658 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.381383 20259 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:29.384996 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.385986 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:29.382054 20208 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:29.386970 16033 raft_consensus.cc:2368] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13.
I20260709 13:04:29.387355 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.387516 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.351794 16031 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:29.393133 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.393601 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.389425 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:29.381806 20298 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:29.396039 20301 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:29.396667 20298 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.397853 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.372258 19882 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.398710 16032 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:29.398625 19882 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.399215 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:29.398526 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:29.399792 16024 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.384696 20280 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:29.400269 15399 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:29.400527 20280 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:29.321887 20260 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.401116 19882 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:29.401398 20280 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.398535 20208 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:29.402701 20280 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:29.402817 20208 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:29.403791 15398 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:29.404371 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.405128 15392 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:29.406759 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2525) took 1129 ms. Trace:
W20260709 13:04:29.407249 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.355123 20040 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:29.409274 15390 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:29.409804 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:29.390528 20363 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:04:29.407126 15241 rpcz_store.cc:276] 0709 13:04:28.277149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.277287 (+   138us) service_pool.cc:224] Handling call
0709 13:04:28.277587 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:28.688106 (+410519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:29.406512 (+718406us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54001397d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:29.406696 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766057856}
I20260709 13:04:29.409756 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:29.417529 16024 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:29.421844 15242 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:29.419196 15998 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:29.423664 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:29.411414 15397 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:29.427064 15390 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.427686 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:29.428525 15397 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:29.286634 20290 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.432263 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:29.433436 15399 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:29.434824 15396 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:29.393950 20259 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.440260 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:29.441808 15395 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:29.442318 15214 leader_election.cc:400] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13.
I20260709 13:04:29.442786 15214 leader_election.cc:403] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:29.434418 20278 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:29.444373 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.421676 20260 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:29.453091 15390 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:29.377562 20257 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.454502 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:29.456081 15390 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.445982 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:29.377874 20358 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:04:29.461833 15321 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:04:29.459635 15397 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:29.463349 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.463423 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.464031 15321 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:29.464178 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:29.464929 15393 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:29.469487 15390 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 9.
I20260709 13:04:29.463788 20206 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:29.459142 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:29.471397 15390 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:04:29.439721 20259 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:29.439056 20340 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:29.439419 20012 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:29.487783 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.476341 15397 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:29.489858 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.450201 20067 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.476660 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.476390 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.503088 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.503955 15316 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:29.449712 20040 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:29.479231 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:29.506150 15214 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:29.481413 16027 raft_consensus.cc:2368] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11.
I20260709 13:04:29.454870 20173 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13.
I20260709 13:04:29.509323 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.512581 15390 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:29.514111 15390 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:29.519276 20347 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:29.520614 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:29.522413 20347 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:29.502772 20377 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:29.513072 20339 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:29.523587 20347 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.524339 15248 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:29.502686 20260 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:04:29.526618 15248 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:29.511839 20012 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:29.528420 20012 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.531319 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:29.538362 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:29.550592 15247 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 13. Ops: []
I20260709 13:04:29.547972 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:29.553144 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:29.558696 15246 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:29.555745 15244 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:29.573547 15393 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:29.575022 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:29.537355 19876 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:29.576113 15397 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:29.576648 15241 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:29.580533 15321 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
W20260709 13:04:29.679173 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 101866us
I20260709 13:04:29.693686 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.694444 15398 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:29.691910 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.565331 20173 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.697196 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:29.697789 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.698674 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.704136 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:29.714968 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.715587 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.716192 15325 raft_consensus.cc:2368] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:29.583693 20229 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:29.729235 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:29.731873 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:29.727140 20344 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.146s	user 0.006s	sys 0.004s
I20260709 13:04:29.556444 19882 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.138s
I20260709 13:04:29.732434 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:29.736307 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.741735 15325 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:29.752115 15323 raft_consensus.cc:2368] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:29.757362 15397 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:04:29.790668 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.715142 20328 raft_consensus.cc:2764] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:04:29.820233 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.821388 15318 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.829669 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:29.731117 20337 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:29.831257 15398 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:29.581545 20208 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:29.837134 15394 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:29.833966 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.838685 15323 raft_consensus.cc:2376] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13. Re-sending same reply.
I20260709 13:04:29.843648 15391 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:29.714679 20316 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 13:04:29.741779 20357 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.717895 20173 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:29.862984 15398 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:04:29.863653 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:29.866472 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:29.867652 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.868064 20208 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:29.835529 15397 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: [14.8-15.9]
I20260709 13:04:29.906298 15394 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:04:29.871333 15318 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:29.945494 15316 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:29.819734 20229 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:29.956357 15318 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:29.962146 15316 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:29.967104 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:29.852483 20290 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:29.986361 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:29.985647 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 281508us
I20260709 13:04:29.986708 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:29.992300 15325 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:29.986876 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:29.997874 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:29.993127 15319 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:29.998063 15318 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:30.002785 15322 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:30.016587 15324 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:30.017560 15316 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:29.987454 20257 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:30.016072 20335 consensus_meta.cc:287] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.003s
I20260709 13:04:30.033529 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.049839 15318 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:30.055377 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:30.057533 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:30.058744 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:30.071892 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:30.075757 15316 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:30.080096 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.078222 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:30.084976 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.086095 15322 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 16: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:30.090955 15248 raft_consensus.cc:2368] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12.
I20260709 13:04:30.093541 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:30.043023 20335 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:30.062315 20213 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:30.062290 20208 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:30.062526 20357 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:30.112564 20357 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:30.112864 20388 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:04:30.113631 20357 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:30.117683 15999 leader_election.cc:400] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12.
I20260709 13:04:30.118124 15999 leader_election.cc:403] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:30.062736 20328 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:04:30.118932 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 122391us
I20260709 13:04:30.119686 15249 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:30.121519 20264 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12.
I20260709 13:04:30.118842 15316 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:30.121945 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.123420 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.123796 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.083783 20257 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:04:30.124331 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.125290 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.125922 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:30.128592 20380 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:04:30.129295 20391 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:04:30.134572 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:30.136996 20382 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
I20260709 13:04:30.142095 20316 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:30.088052 20229 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:30.150146 15243 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:30.111083 20213 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:30.154176 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:30.158938 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:30.119586 20208 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:30.162164 15324 raft_consensus.cc:2376] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11. Re-sending same reply.
I20260709 13:04:30.164731 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.165627 15316 raft_consensus.cc:2368] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:30.166007 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:30.158780 20259 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.650s	user 0.010s	sys 0.001s
I20260709 13:04:30.169674 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:30.170663 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.175043 15324 raft_consensus.cc:2410] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 14 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:04:30.184856 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:30.185968 15244 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:30.164768 20213 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:30.200728 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:30.200906 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.201723 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:30.202275 15316 raft_consensus.cc:2368] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:30.202704 15325 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:30.158610 15148 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 8 to 9, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 9 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:30.222537 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.221963 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.175802 20173 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:30.224632 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.230376 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:30.233800 20393 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:30.234378 15148 catalog_manager.cc:5697] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.235050 20393 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:30.236454 20393 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:30.236040 15148 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 8 to 12, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 12 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.236858 20393 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:30.239581 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:30.241365 20399 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:30.242643 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:30.243644 15244 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:30.243754 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:30.244726 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:30.245338 15250 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:30.247129 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:30.247691 16024 raft_consensus.cc:2376] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12. Re-sending same reply.
W20260709 13:04:30.233891 15147 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49174 (request call id 240) took 51175 ms (client timeout 15000 ms). Trace:
I20260709 13:04:30.246107 15244 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:30.175779 20259 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:30.237735 15148 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 9 to 12, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 12 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.225354 19876 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.251289 20316 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:04:30.259527 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 734) took 1136 ms. Trace:
I20260709 13:04:30.237723 20393 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:30.259932 16027 rpcz_store.cc:276] 0709 13:04:29.123515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.123693 (+   178us) service_pool.cc:224] Handling call
0709 13:04:30.258180 (+1134487us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b540067eb54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:30.259463 (+  1283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802112896}
I20260709 13:04:30.256668 15250 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:04:30.248847 15147 rpcz_store.cc:269] 0709 13:03:38.981770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.981952 (+   182us) service_pool.cc:224] Handling call
0709 13:04:30.150613 (+51168661us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:17.290607 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:17.291557 (+   950us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:17.291630 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:04:17.291673 (+    43us) tablet.cc:662] Decoding operations
0709 13:04:17.312253 (+ 20580us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:17.312392 (+   139us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:17.312436 (+    44us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:04:17.358696 (+ 46260us) tablet.cc:701] Row locks acquired
0709 13:04:17.358747 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:04:17.359009 (+   262us) write_op.cc:270] Start()
0709 13:04:17.359179 (+   170us) write_op.cc:276] Timestamp: P: 1783602257358909 usec, L: 0
0709 13:04:17.359216 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:04:17.372221 (+ 13005us) log.cc:844] Serialized 8345 byte log entry
0709 13:04:18.598497 (+1226276us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b1800008200. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:19.053698 (+455201us) op_driver.cc:464] REPLICATION: finished
0709 13:04:19.715525 (+661827us) write_op.cc:301] APPLY: starting
0709 13:04:19.715638 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:21.186055 (+1470417us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:21.198984 (+ 12929us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:22.279644 (+1080660us) spinlock_profiling.cc:243] Waited 7.63 ms on lock 0x7b5c000a678c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366fdec331 00007f366fdec221 00007f366fde6f6c 00007f366d54730b 00007f366d546fd3 00007f366d645e34 00007f366d63197c 00007f366d635d61 00007f366d635d19 00007f366d635ca9 00007f366d635c71
0709 13:04:23.164114 (+884470us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:23.164599 (+   485us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:04:23.164652 (+    53us) write_op.cc:312] APPLY: finished
0709 13:04:23.165205 (+   553us) log.cc:844] Serialized 188 byte log entry
0709 13:04:24.032131 (+866926us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:24.032418 (+   287us) write_op.cc:454] Released schema lock
0709 13:04:24.032525 (+   107us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:24.033072 (+   547us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:24.033120 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":443822,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":647702,"apply.run_cpu_time_us":131495,"apply.run_wall_time_us":4317502,"cfile_cache_hit":82,"cfile_cache_hit_bytes":85649,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":2,"lbm_read_time_us":6866,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":21,"prepare.queue_time_us":425208,"prepare.run_cpu_time_us":22577,"prepare.run_wall_time_us":251204,"raft.queue_time_us":431553,"raft.run_cpu_time_us":60790,"raft.run_wall_time_us":534286,"replication_time_us":1676391,"spinlock_wait_cycles":30312448,"thread_start_us":2146258,"threads_started":5,"wal-append.queue_time_us":1020585,"wal-append.run_cpu_time_us":33955,"wal-append.run_wall_time_us":2620702}]]}
I20260709 13:04:30.272537 15148 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.275246 20282 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:30.275741 20282 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:30.275094 15148 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.276614 20282 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:30.277300 15148 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 6 to 9, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 9 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:30.271569 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45690.8us
W20260709 13:04:30.281487 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.281487 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:30.287259 15324 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:30.288455 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:30.288878 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.289546 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.289835 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:30.290179 15324 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:30.291308 15324 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:30.292572 15316 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:30.292912 20336 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.293459 20336 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:30.279721 15148 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.296633 15148 catalog_manager.cc:5697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.298491 20396 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:30.299042 15148 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 6 to 9, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 9 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.273859 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:30.300019 20396 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:30.306181 15363 leader_election.cc:400] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11.
I20260709 13:04:30.307421 15363 leader_election.cc:403] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:04:30.307579 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:30.315227 15324 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:04:30.313687 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72681.1us
I20260709 13:04:30.317515 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:30.318074 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 48487.1us
I20260709 13:04:30.320960 15316 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:30.321399 15316 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:30.277997 20282 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:30.328356 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:30.333279 16027 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:04:30.327138 15316 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:30.267529 20402 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:30.335435 15148 catalog_manager.cc:5697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 4 to 11, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 11 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.334545 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:30.252372 20208 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:30.325278 20393 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:30.262923 19876 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:30.326171 20399 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:30.329500 20280 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:30.351483 15316 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:30.306955 20312 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.330300 19924 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:30.354914 15148 catalog_manager.cc:5697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.362457 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:30.356271 20301 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:30.369344 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:30.383184 20259 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:30.361799 20402 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:30.401582 15316 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:30.402885 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:30.403573 15321 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:30.404445 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 729) took 1915 ms. Trace:
I20260709 13:04:30.402753 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:30.370002 20322 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:30.438036 15243 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:04:30.447978 15243 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:04:30.352614 20338 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:04:30.440096 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:30.405038 16025 rpcz_store.cc:276] 0709 13:04:28.489171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.489425 (+   254us) service_pool.cc:224] Handling call
0709 13:04:28.507502 (+ 18077us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:29.265519 (+758017us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b1800489d60. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f3669bf2060 00007f3669bf2bfb 00007f3669bfd64b
0709 13:04:29.265649 (+   130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:29.265674 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:29.268549 (+  2875us) log.cc:844] Serialized 52 byte log entry
0709 13:04:29.734533 (+465984us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:29.833107 (+ 98574us) log.cc:844] Serialized 14 byte log entry
0709 13:04:30.297510 (+464403us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b1800489d60. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:04:30.404017 (+106507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:30.404128 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:30.404190 (+    62us) raft_consensus.cc:1685] finished
0709 13:04:30.404211 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:30.404372 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":98213,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":245647,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":15981,"spinlock_wait_cycles":121979008,"thread_start_us":746357,"threads_started":3,"wal-append.queue_time_us":750692}
I20260709 13:04:30.450662 15393 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:30.444633 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:30.386431 20399 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:30.437192 20257 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:30.370179 20358 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:04:30.457783 15321 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
W20260709 13:04:30.466545 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 113366us
I20260709 13:04:30.436718 20262 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:30.458689 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 124228us
I20260709 13:04:30.438657 20396 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:30.458478 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 130290us
I20260709 13:04:30.499387 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:30.368096 20312 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:30.470723 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:30.451390 20259 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:30.502610 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:30.435895 20213 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:30.515640 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1746) took 1456 ms. Trace:
W20260709 13:04:30.525851 20390 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
W20260709 13:04:30.527568 20398 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 13:04:30.528659 20312 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:30.506366 20387 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:30.529699 20335 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:30.516244 15242 rpcz_store.cc:276] 0709 13:04:29.058907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.059069 (+   162us) service_pool.cc:224] Handling call
0709 13:04:30.515361 (+1456292us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540010c554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:30.515560 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788241792}
I20260709 13:04:30.459218 20399 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:30.556901 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.516353 20301 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:04:30.459374 20406 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 13:04:30.538991 20280 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:04:30.571203 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 100558us
W20260709 13:04:30.572773 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 244485us
W20260709 13:04:30.572774 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 203080us
I20260709 13:04:30.558171 20387 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.578033 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 590) took 1248 ms. Trace:
I20260709 13:04:30.578567 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:30.578099 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:30.615927 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:30.646409 15247 rpcz_store.cc:276] 0709 13:04:29.329362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.523633 (+194271us) service_pool.cc:224] Handling call
0709 13:04:29.523981 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:29.558001 (+ 34020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:30.577764 (+1019763us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b5400316854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:30.577965 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60568832}
W20260709 13:04:30.647042 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 68578.4us
W20260709 13:04:30.660485 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56726.8us
I20260709 13:04:30.514918 20262 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:30.695266 15398 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:30.560930 19924 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:04:30.575348 20280 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.575448 20336 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:30.656623 20259 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:30.735394 15391 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:04:30.752314 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 281953us
I20260709 13:04:30.566124 20312 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:04:30.658445 20387 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:30.668619 20358 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:30.669354 20408 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:30.788606 20337 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:30.656740 19708 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 13:04:30.650918 20410 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.215s
I20260709 13:04:30.851255 20408 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:30.782922 20357 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.001s	sys 0.014s
I20260709 13:04:30.844144 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:30.839493 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:30.782009 20280 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:30.861167 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:30.864904 15395 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:30.841753 20417 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:30.850867 20337 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:30.826897 20322 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:30.896011 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 336209us
I20260709 13:04:30.913337 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.914381 15321 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:30.779493 20416 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:04:30.841913 20425 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:30.846133 20336 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:04:30.917343 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:30.915809 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:30.862285 20357 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.001s	sys 0.015s
I20260709 13:04:30.865537 19876 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:30.864323 20271 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:30.888672 20301 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:30.939960 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:30.929806 15398 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:04:30.941170 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 292999us
I20260709 13:04:30.942776 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:30.951253 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:30.960188 15390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.006s	sys 0.016s
W20260709 13:04:30.961479 15390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.006s	sys 0.016s
I20260709 13:04:30.848973 20358 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:30.974771 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.834777 20399 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:30.994626 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 416655us
I20260709 13:04:30.995494 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:30.913555 20257 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:04:30.944757 20423 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.104940 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:30.930897 20346 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:04:30.949836 19876 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:31.032898 15394 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:30.990144 20406 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:31.045414 20386 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.051s	user 0.000s	sys 0.010s
I20260709 13:04:31.047442 20395 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:31.049325 20405 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:31.051796 20290 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:31.066723 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2546) took 1781 ms. Trace:
W20260709 13:04:31.068796 15999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.723s (SENT) [suppressed 29 similar messages]
I20260709 13:04:31.070781 20335 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:04:31.076884 20400 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.940s	user 0.016s	sys 0.020s
I20260709 13:04:31.084645 20262 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:31.087400 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:31.158108 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.089143 20088 raft_consensus.cc:2764] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:04:31.092612 15393 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:04:31.095273 20389 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.958s	user 0.010s	sys 0.002s
I20260709 13:04:31.102029 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:31.108443 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.971920 20213 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:31.113698 15249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 591) took 1774 ms (client timeout 1723 ms). Trace:
W20260709 13:04:31.114784 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 199067us
I20260709 13:04:30.862515 20338 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
I20260709 13:04:30.916625 20417 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.126498 20396 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.126772 20407 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:31.128620 15391 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:30.927487 20259 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.135352 15241 rpcz_store.cc:276] 0709 13:04:29.285705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.431276 (+145571us) service_pool.cc:224] Handling call
0709 13:04:29.431644 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:29.579351 (+147707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.066340 (+1486989us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400119ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:31.066629 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332989184}
I20260709 13:04:30.963636 20271 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.164553 15398 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:31.123332 20395 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:31.173341 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1794) took 1058 ms. Trace:
I20260709 13:04:31.175494 15316 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:31.139607 20335 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:31.178279 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 182778us
I20260709 13:04:31.179132 15323 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:31.192291 15319 rpcz_store.cc:276] 0709 13:04:30.114785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.115482 (+   697us) service_pool.cc:224] Handling call
0709 13:04:31.101824 (+986342us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5e9c 00007f3666ad5a5b 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:04:31.173276 (+ 71452us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7271680}
I20260709 13:04:31.198906 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:31.181515 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2484) took 1662 ms. Trace:
I20260709 13:04:31.138793 20290 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:31.134485 20406 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:31.131796 20405 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:31.130479 20434 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:31.167755 15249 rpcz_store.cc:269] 0709 13:04:29.339274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.367584 (+ 28310us) service_pool.cc:224] Handling call
0709 13:04:31.112189 (+1744605us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b5400139cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:31.113582 (+  1393us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727231872}
I20260709 13:04:31.202064 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:31.202838 15316 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
W20260709 13:04:31.180251 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 228916us
W20260709 13:04:31.161825 20229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.000s	sys 0.021s
I20260709 13:04:31.202749 15390 rpcz_store.cc:276] 0709 13:04:29.512202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.517128 (+  4926us) service_pool.cc:224] Handling call
0709 13:04:29.517417 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:29.517692 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:29.542901 (+ 25209us) log.cc:844] Serialized 14 byte log entry
0709 13:04:30.300992 (+758091us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b18002ff5c0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:04:31.174700 (+873708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:31.174750 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:31.174804 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.174868 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.174982 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64475,"prepare.queue_time_us":25175,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":4283,"raft.queue_time_us":166797,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":24411,"spinlock_wait_cycles":9801088,"thread_start_us":828040,"threads_started":2,"wal-append.queue_time_us":1646995}
W20260709 13:04:31.231251 20229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.000s	sys 0.021s
I20260709 13:04:31.231329 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:31.232896 20301 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:31.233367 20301 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:31.233631 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:31.234218 20301 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.235380 20301 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:31.235241 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:31.237385 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.124114 19876 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:31.183364 20415 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.436s	user 0.001s	sys 0.000s
I20260709 13:04:31.117404 20423 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.277050 15318 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:31.192864 20258 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:31.283000 15243 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.010s	sys 0.013s
W20260709 13:04:31.286491 15243 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.011s	sys 0.013s
I20260709 13:04:31.200675 20262 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:31.228673 20418 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.444s	user 0.001s	sys 0.000s
I20260709 13:04:31.184055 20396 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:31.288142 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 115915us
I20260709 13:04:31.315171 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:31.317523 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 115554us
I20260709 13:04:31.323973 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:31.323757 20444 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:31.173368 20322 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:31.302275 16058 heartbeater.cc:646] Failed to heartbeat to 127.13.206.254:45539 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.206.254:45539 timed out after 15.000s (SENT)
I20260709 13:04:31.288789 20434 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:31.336994 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:31.227734 20422 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
W20260709 13:04:31.332223 20428 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:04:31.312950 20435 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:31.347792 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 111055us
I20260709 13:04:31.349830 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1754) took 1213 ms. Trace:
I20260709 13:04:31.321820 20183 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:31.308614 20441 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:31.376008 15250 rpcz_store.cc:276] 0709 13:04:30.136600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.270786 (+134186us) service_pool.cc:224] Handling call
0709 13:04:30.314604 (+ 43818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:30.331323 (+ 16719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:30.331365 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:30.348592 (+ 17227us) log.cc:844] Serialized 26 byte log entry
0709 13:04:30.459761 (+111169us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:30.784956 (+325195us) log.cc:844] Serialized 14 byte log entry
0709 13:04:30.791344 (+  6388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:30.791458 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:31.330120 (+538662us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b1800222880. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f366dace58f 00007f3666b0d571 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd
0709 13:04:31.333991 (+  3871us) raft_consensus.cc:1685] finished
0709 13:04:31.349561 (+ 15570us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.349740 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90598,"prepare.queue_time_us":499433,"raft.queue_time_us":147384,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":23601,"spinlock_wait_cycles":65389824,"thread_start_us":323043,"threads_started":2,"wal-append.queue_time_us":200469}
I20260709 13:04:31.377395 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2867) took 1077 ms. Trace:
I20260709 13:04:31.389178 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:31.378321 15241 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:31.379309 20336 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.380385 19876 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:31.381170 20252 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:31.392614 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:31.383569 20213 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:31.356138 20393 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.001s	user 0.008s	sys 0.004s
I20260709 13:04:31.332475 20396 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:31.393932 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.000s	sys 0.019s
I20260709 13:04:31.296675 20258 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.431751 20258 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:31.431895 15250 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:31.382512 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:31.432703 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.001s	sys 0.019s
I20260709 13:04:31.389454 15325 rpcz_store.cc:276] 0709 13:04:30.287269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.293435 (+  6166us) service_pool.cc:224] Handling call
0709 13:04:30.293750 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:30.322319 (+ 28569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:30.322350 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:30.329420 (+  7070us) log.cc:844] Serialized 26 byte log entry
0709 13:04:30.456825 (+127405us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:30.456888 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:30.456996 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:31.062372 (+605376us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b2c000ac778. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3667eaa291 00007f3667ec50ca 00007f3669bf34ad 00007f3669bfaf8e 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:04:31.348637 (+286265us) raft_consensus.cc:1685] finished
0709 13:04:31.348659 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.365104 (+ 16445us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28178,"raft.queue_time_us":33884,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5209,"spinlock_wait_cycles":15526784,"thread_start_us":101432,"threads_started":1,"wal-append.queue_time_us":193209}
W20260709 13:04:31.433591 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 764345us
W20260709 13:04:31.404642 15395 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.001s
I20260709 13:04:31.407009 15244 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:31.406963 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:31.408541 15248 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:31.410813 15247 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:31.413370 15242 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:31.439106 20417 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:31.439847 20417 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:31.440727 15395 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:31.440487 20417 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.294534 20442 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:04:31.417824 20440 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:04:31.350080 19924 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.399380 20183 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.339104 20407 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:31.337781 20405 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.422556 20088 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:31.333896 20395 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.369036 20436 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:31.423866 20336 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.427131 20435 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:31.367728 20290 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.303521 20262 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.433655 15246 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:31.347462 20448 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:31.401449 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:31.460053 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 391278us
I20260709 13:04:31.464112 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:31.403815 20252 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:31.509011 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 113135us
W20260709 13:04:31.510246 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 108965us
W20260709 13:04:31.453523 19708 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.005s	sys 0.006s
I20260709 13:04:31.365805 20174 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:04:31.402501 20213 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:31.492264 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 116177us
I20260709 13:04:31.449654 20358 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:31.493120 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 169228us
I20260709 13:04:31.533648 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:31.453372 20416 consensus_queue.cc:1243] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:31.461045 20447 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.511551 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:31.492527 19882 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.509102 20411 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:31.516469 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 179611us
W20260709 13:04:31.518869 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.512143 20328 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.499941 20405 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:31.535712 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:31.535887 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 71888.9us
I20260709 13:04:31.459728 19924 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.498267 20435 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:31.536746 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:31.442392 20335 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.492271 20436 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:31.539212 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:31.510083 20273 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:31.512892 20088 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:31.398772 20406 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.548719 20447 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.553862 20174 consensus_queue.cc:1243] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:04:31.554977 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:31.528652 19708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.005s	sys 0.006s
W20260709 13:04:31.555528 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45699.5us
I20260709 13:04:31.559743 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:31.561441 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:31.541502 20301 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:31.563578 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:31.513770 20395 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:31.510107 20408 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:31.564276 20435 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:31.564339 20328 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.563225 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:31.579171 16033 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:31.582589 16031 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:31.593308 16032 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:31.593369 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:31.573520 20282 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.244s	user 0.006s	sys 0.006s
W20260709 13:04:31.661826 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 73551.6us
W20260709 13:04:31.668717 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 109054us
I20260709 13:04:31.564872 20426 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:04:31.667778 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 83917.3us
W20260709 13:04:31.673578 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 134464us
I20260709 13:04:31.691386 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:31.574540 20337 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.651s	user 0.004s	sys 0.007s
W20260709 13:04:31.663311 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 67448.9us
W20260709 13:04:31.674193 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 87774.8us
W20260709 13:04:31.575925 20387 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.730s	user 0.008s	sys 0.003s
I20260709 13:04:31.677855 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:31.669173 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:31.679250 20457 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:31.679148 20436 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.680768 20423 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:31.682463 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.682113 20301 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:31.669339 20411 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:31.683205 20259 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:31.683804 20420 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:31.686586 20460 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:04:31.692948 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:31.700088 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:31.767307 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67303.5us
I20260709 13:04:31.768555 15362 leader_election.cc:400] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:31.768972 15362 leader_election.cc:403] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:31.669153 20402 consensus_meta.cc:287] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.225s	user 0.007s	sys 0.004s
I20260709 13:04:31.574069 20447 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:31.553412 19882 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:31.573881 20454 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:04:31.713325 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:31.570528 20446 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:31.569109 20433 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.571450 19924 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:31.576462 20417 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:31.662783 20328 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:31.585726 20173 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:31.775689 20406 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:31.699292 20357 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:31.570211 20440 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:31.772123 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 55111.1us
I20260709 13:04:31.700609 20442 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:31.595191 20410 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.133s
W20260709 13:04:31.770860 20280 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.872s	user 0.009s	sys 0.003s
W20260709 13:04:31.778757 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 69848.5us
I20260709 13:04:31.773762 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:31.573624 20213 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.578673 20441 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:31.670264 20336 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:31.778326 20402 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11.
I20260709 13:04:31.720185 20088 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:04:31.514217 20448 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.676348 20252 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:31.838424 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 145559us
I20260709 13:04:31.778469 20259 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:31.775537 20396 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:31.832501 19924 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:04:31.705241 20416 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 13:04:31.777908 20457 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:04:31.701515 20337 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:31.882889 20438 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
W20260709 13:04:31.873139 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 102898us
I20260709 13:04:31.863957 20183 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:31.872715 20442 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:31.883807 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:31.886129 15244 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:31.856695 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 143472us
I20260709 13:04:31.888324 15250 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:31.888501 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:31.890081 20441 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:04:31.891124 20455 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:04:31.891664 20451 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:31.892599 20430 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:31.931632 20441 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:31.932169 20441 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:31.933024 20441 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.934273 20430 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:31.935037 20416 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:31.894254 20477 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:31.863603 20407 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:31.935575 20416 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:31.830999 20433 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.936508 20416 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.937685 20433 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:31.773829 20456 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:04:31.863962 20280 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.938339 20337 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:31.864012 20357 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:04:31.890019 20465 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:31.837281 20417 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.839537 20173 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.879083 20446 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:31.706277 20387 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.913163 15397 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:31.913952 15362 leader_election.cc:400] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
W20260709 13:04:31.924230 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.925191 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:31.953838 15362 leader_election.cc:403] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:04:31.934981 20430 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:31.893479 20421 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:04:31.888818 20259 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.888598 20478 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.152s
I20260709 13:04:31.907166 20262 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:31.859469 20440 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:31.989336 20440 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:31.990579 20478 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:31.991055 20478 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:31.938081 20416 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:31.954660 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44628.9us
I20260709 13:04:31.963243 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:31.999948 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:32.000797 20399 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:31.965937 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:31.945632 20357 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.938977 20477 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:31.968849 19882 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:31.969523 20476 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:04:31.872373 20426 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:31.991976 20478 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:32.012609 20425 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.064s	user 0.012s	sys 0.000s
I20260709 13:04:32.012984 20478 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:32.013134 20425 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:32.012844 20426 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.955386 20183 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
W20260709 13:04:32.013712 20282 consensus_queue.cc:1175] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ee9654803379434388de45d4693e6b16" responder_term: 13 status { last_received { term: 13 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 13 index: 8 } }
I20260709 13:04:32.014345 15391 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:31.974246 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:31.976178 20486 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:32.015390 20173 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:32.015476 20486 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:32.015347 15398 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:32.016724 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:32.016567 20486 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.017314 15398 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.019362 20271 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:31.976886 20456 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:32.020120 20456 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:32.021023 20456 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.958878 20417 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:31.977762 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:32.023159 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:32.023830 20417 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:32.024190 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:32.025306 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:31.973253 20442 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:32.007239 20357 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:31.978924 20387 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:31.978832 20448 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:31.980785 20280 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:31.982177 15321 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:31.951928 20441 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:31.982805 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1757) took 1728 ms. Trace:
W20260709 13:04:31.982295 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.000763 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:32.040174 15395 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:31.963660 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:32.001870 15393 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:32.001317 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:32.036654 15243 rpcz_store.cc:276] 0709 13:04:30.254266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.448719 (+194453us) service_pool.cc:224] Handling call
0709 13:04:30.449043 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:30.449352 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:31.293617 (+844265us) log.cc:844] Serialized 14 byte log entry
0709 13:04:31.537426 (+243809us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:31.549239 (+ 11813us) log.cc:844] Serialized 26 byte log entry
0709 13:04:31.549448 (+   209us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:31.549496 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.549592 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:31.982581 (+432989us) raft_consensus.cc:1685] finished
0709 13:04:31.982605 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.982740 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50381,"prepare.queue_time_us":409611,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":259823,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":70575,"thread_start_us":958907,"threads_started":2,"wal-append.queue_time_us":369463}
W20260709 13:04:32.046093 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44847.9us
I20260709 13:04:32.047323 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:32.053274 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:32.056474 15398 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
W20260709 13:04:32.058636 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 198151us
I20260709 13:04:32.060067 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:32.062302 15399 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:32.070533 15246 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:32.075261 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.075891 15248 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:32.075304 15399 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:32.077500 15243 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:32.078912 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.079260 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:32.079977 15243 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:32.082333 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.082294 20477 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.083289 15247 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:32.084362 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.085134 15247 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:32.086377 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.087021 15248 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 8.
I20260709 13:04:32.080137 15246 raft_consensus.cc:2376] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17. Re-sending same reply.
I20260709 13:04:32.094687 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:32.096457 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.097134 15241 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:32.074586 19876 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:32.066083 20448 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:32.100983 15321 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:04:32.087728 20417 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.119352 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:32.087695 20405 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:32.124171 15321 pending_rounds.cc:85] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 7
W20260709 13:04:32.132169 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 72263us
I20260709 13:04:32.132586 15321 pending_rounds.cc:107] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:04:32.133031 15321 raft_consensus.cc:2889] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:32.116487 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.093145 19916 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:32.126946 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.125684 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.129710 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.076213 20347 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:32.107860 20475 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:04:32.138304 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:32.141381 15241 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:32.144776 15245 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:32.147162 15325 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:32.145066 20088 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:32.150689 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:32.159025 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:32.159708 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:32.161046 15290 connection.cc:256] RPC call timeout handler was delayed by -1.323982491000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
I20260709 13:04:32.161863 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:32.139317 19916 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:32.155155 20322 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:32.124235 19876 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.163951 20486 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:32.165256 20088 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.140478 20417 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:32.198666 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:32.197162 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 149952us
I20260709 13:04:32.096299 20451 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:04:32.219147 15316 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:32.153127 20347 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:32.220382 15249 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:32.220805 15319 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:32.209015 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.209129 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.210033 15318 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:04:32.211182 15320 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
W20260709 13:04:32.213487 15362 connection.cc:256] RPC call timeout handler was delayed by -1.785680358000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
I20260709 13:04:32.210100 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.230108 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.230986 15318 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:04:32.189162 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 264862us
I20260709 13:04:32.228761 15317 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:32.233533 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.234009 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.234200 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.234792 15317 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:32.235371 15316 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:32.230487 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:32.237802 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:32.165975 20173 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:04:32.200029 20486 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:32.241765 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:32.246871 15317 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:32.248485 20464 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:32.249394 20464 consensus_queue.cc:1243] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:04:32.250106 20258 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:04:32.244277 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:32.298945 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49916.1us
I20260709 13:04:32.300824 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:32.302907 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58685.9us
I20260709 13:04:32.245386 20448 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:32.241360 20416 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.304585 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:32.251915 20486 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.262143 20271 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:04:32.238562 20208 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:04:32.241773 20322 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:04:32.263829 20399 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:32.220046 20088 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:32.314945 16028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:51484
I20260709 13:04:32.317049 16028 raft_consensus.cc:606] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:32.315122 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:32.263466 20257 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:32.322546 20492 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:32.323726 20436 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.323946 20488 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:32.310657 20337 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:32.238546 19916 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.328547 20485 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:32.313812 20483 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:32.310130 20258 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:04:32.325347 20476 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.311455 20416 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:32.345206 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.325618 20257 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:32.326261 20479 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.339504 19916 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:32.327080 20337 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:32.329171 20485 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:32.356633 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:32.317683 20484 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.157s
I20260709 13:04:32.346452 20488 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:32.349640 20258 consensus_queue.cc:1243] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:04:32.369558 20503 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.001s
I20260709 13:04:32.358971 20337 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:32.339994 20357 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:32.406698 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:32.407486 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:32.411571 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.323276 20492 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.353827 20479 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.352581 20476 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.406646 19876 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:32.419013 20495 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.177s	user 0.001s	sys 0.001s
W20260709 13:04:32.421232 20502 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:04:32.386590 20482 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.170s
I20260709 13:04:32.434013 15324 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:04:32.435295 20500 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:04:32.427639 20417 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:32.448585 20088 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:32.450139 20476 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:32.450984 20469 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.614s	user 0.005s	sys 0.000s
I20260709 13:04:32.451256 20479 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:32.421682 20257 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:32.453049 20257 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:32.433925 20488 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.458560 19882 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:32.459995 20399 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:32.460180 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 145109us
I20260709 13:04:32.460376 20442 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.460974 20442 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.461568 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:32.461433 20422 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:32.463174 20442 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:32.460219 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.423444 20485 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:32.469573 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.473210 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:32.477834 20405 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:32.480321 20273 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:32.483222 15322 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:32.484419 20273 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:32.487524 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2555) took 1082 ms. Trace:
W20260709 13:04:32.487839 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:32.488513 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.492383 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:32.492831 20312 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:32.493026 16029 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 8.
I20260709 13:04:32.493525 20312 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:32.493782 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:32.494416 16030 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:32.494458 20312 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.495738 20312 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:32.497607 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:32.500839 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:32.503207 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:32.503502 15318 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:32.506588 16031 raft_consensus.cc:2410] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:32.488128 15249 rpcz_store.cc:276] 0709 13:04:31.405338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.409063 (+  3725us) service_pool.cc:224] Handling call
0709 13:04:31.409466 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:32.227977 (+818511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.487209 (+259232us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b540023a5d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:32.487442 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844782464}
W20260709 13:04:32.509320 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.514997 16024 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:32.514889 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:32.512279 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.518714 15249 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:32.522383 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:32.523522 15249 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:32.498507 20290 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:32.513358 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.526506 15242 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:32.527827 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 646) took 1905 ms. Trace:
I20260709 13:04:32.530897 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:32.561707 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.562798 15241 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:32.561913 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:32.482600 20434 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.484174 20405 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.482101 20442 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:32.590365 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:32.592262 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.528349 15396 rpcz_store.cc:276] 0709 13:04:30.622643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.918923 (+296280us) service_pool.cc:224] Handling call
0709 13:04:30.946547 (+ 27624us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:31.457110 (+510563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:31.457158 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:31.481092 (+ 23934us) log.cc:844] Serialized 52 byte log entry
0709 13:04:31.554877 (+ 73785us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:31.555087 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.555344 (+   257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:32.021542 (+466198us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b48002001d8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366eb23aa1 00007f366eb1ab37 00007f366eb1a9ca 00007f366ec1226f 00007f366ec11f37 00007f366ec2655c 00007f366ec26508 00007f366ec26488 00007f366ec26443 00007f366ec256ec 00007f366db4fa96
0709 13:04:32.450402 (+428860us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:32.527518 (+ 77116us) raft_consensus.cc:1685] finished
0709 13:04:32.527550 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:32.527754 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77851,"raft.queue_time_us":181881,"raft.run_cpu_time_us":3817,"raft.run_wall_time_us":892801,"spinlock_wait_cycles":29725824,"thread_start_us":489190,"threads_started":2,"wal-append.queue_time_us":274941}
I20260709 13:04:32.482393 20399 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:04:32.614600 15394 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:32.656775 15241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:32.547072 20258 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:32.660079 20258 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:32.660595 20258 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:32.663033 20510 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:04:32.663902 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:32.664634 15396 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:32.568099 20481 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:32.674883 20481 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.677652 20481 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:32.678943 20506 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260709 13:04:32.681854 20511 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 13:04:32.684037 20435 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.985s	user 0.010s	sys 0.002s
I20260709 13:04:32.684562 20435 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:32.685729 15317 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:32.590363 20434 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.688282 20434 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:32.689646 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2564) took 1272 ms. Trace:
W20260709 13:04:32.690796 20504 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:04:32.565732 20505 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:32.574976 20358 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:32.571441 20252 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:32.690665 20357 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:32.590613 20405 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:32.553866 20440 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 13:04:32.525384 20464 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:04:32.658757 15241 raft_consensus.cc:606] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:32.690152 15245 rpcz_store.cc:276] 0709 13:04:31.417081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.437123 (+ 20042us) service_pool.cc:224] Handling call
0709 13:04:31.437433 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:32.145272 (+707839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.689308 (+544036us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54001a77d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:32.689566 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1621625216}
W20260709 13:04:32.706629 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 344163us
I20260709 13:04:32.709652 15241 raft_consensus.cc:614] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:32.583453 20255 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:04:32.639003 20509 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:04:32.717326 15319 raft_consensus.cc:2410] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:32.699887 20358 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:32.699065 20505 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:32.720975 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:32.718279 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 404839us
W20260709 13:04:32.731828 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 201006us
I20260709 13:04:32.720136 20478 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.712435 20255 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:32.734869 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:32.768712 15398 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:32.704461 20337 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.723729 20464 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:32.725103 20505 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.784672 15241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:32.785358 15241 raft_consensus.cc:606] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:32.790449 20358 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:32.783161 20464 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:32.792410 20358 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.724251 20486 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.792467 20464 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:32.805600 20435 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:32.806910 20255 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.808856 20255 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:32.812343 20337 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:32.772424 15996 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:32.791303 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:32.815869 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:32.816586 15398 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:32.817643 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45383us
I20260709 13:04:32.819381 20492 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:32.820138 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:32.774627 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:32.822790 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48264.1us
W20260709 13:04:32.824057 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 176255us
I20260709 13:04:32.827124 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:04:32.831717 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.834789 15245 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:32.835774 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:32.836710 15249 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:32.839169 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:32.840029 15243 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:32.856258 20440 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:32.856755 20440 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:32.857148 20440 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:32.860378 15249 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:32.776968 20478 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.862993 20449 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:32.798043 20486 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:32.870860 15392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2495) took 3332 ms (client timeout 2102 ms). Trace:
W20260709 13:04:32.883615 15392 rpcz_store.cc:269] 0709 13:04:29.538757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.678453 (+139696us) service_pool.cc:224] Handling call
0709 13:04:32.870607 (+3192154us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54001dae54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:32.870745 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5009422720}
I20260709 13:04:32.869915 20271 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:32.888149 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:32.891793 15395 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.892714 15398 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:32.877802 20429 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:32.894621 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.898998 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.900676 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:32.902637 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:32.895290 15398 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:32.882361 20449 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:32.924085 20456 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.894001 20271 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:32.932984 15395 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:32.935431 15392 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:32.901437 20258 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:32.910943 20522 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:32.950484 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 649) took 1635 ms. Trace:
I20260709 13:04:32.951048 15391 rpcz_store.cc:276] 0709 13:04:31.314983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.318264 (+  3281us) service_pool.cc:224] Handling call
0709 13:04:31.318708 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:32.014719 (+696011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.950159 (+935440us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54001d9554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:32.950406 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599306112}
I20260709 13:04:32.897199 20429 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:32.947685 20271 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:32.965893 15391 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:32.895282 20464 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:32.947407 20522 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:32.953720 20273 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:32.953241 20521 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:04:32.975485 20213 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.000856 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:33.003858 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:33.000723 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:33.002029 15248 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:04:33.051707 20451 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.059705 20446 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:33.059739 20273 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.055068 20399 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.034663 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:33.098819 20335 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:33.098587 20399 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:32.975984 20522 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:33.048310 20425 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.994946 20523 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:32.982438 20429 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:33.031339 20520 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:04:33.053875 20258 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:33.077653 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.067770 20464 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.118697 15395 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:33.119863 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:33.120007 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:33.120971 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:33.121248 15395 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:04:33.079945 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 252932us
I20260709 13:04:33.087283 15392 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:33.091822 20282 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.122833 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:33.082950 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:33.124128 15395 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:04:33.090020 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:33.099087 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:33.132411 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.062165 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:33.106504 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 278026us
I20260709 13:04:33.133674 15395 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:32.967978 20505 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.124143 15392 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:04:33.114408 20425 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.127524 20271 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.117808 20523 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.130585 15249 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:33.124562 15245 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
W20260709 13:04:33.115279 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.135797 15395 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:33.133554 15399 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:33.138633 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.102725 19924 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.144634 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:33.149185 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.153671 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:33.154600 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:33.156136 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:33.155426 15321 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:33.154546 15323 raft_consensus.cc:2376] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14. Re-sending same reply.
I20260709 13:04:33.169281 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:33.118548 20453 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.174731 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:33.176038 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:33.096683 20451 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.189697 15320 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:33.104696 20440 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.148607 20429 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:33.195207 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:33.205832 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:33.096887 20446 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.167047 20436 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.166254 20492 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.212301 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.215981 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.216902 15395 raft_consensus.cc:2410] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:04:33.136194 20282 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.217583 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.177553 20456 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:33.215713 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:33.222997 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:33.223743 15320 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:33.228353 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:33.195492 20358 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:33.229358 16031 raft_consensus.cc:2410] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:04:33.229602 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.233378 16026 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:33.233584 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:33.236225 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.236528 20255 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:33.240263 20449 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.243003 20488 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:33.243636 20488 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.245913 20488 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.254328 15318 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:04:33.255486 20505 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:33.266424 15318 pending_rounds.cc:85] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 4
I20260709 13:04:33.266774 15318 pending_rounds.cc:107] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:04:33.267089 15318 raft_consensus.cc:2889] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:33.268591 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:33.256659 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.228924 20532 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:33.259418 20399 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:33.195142 20312 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:04:33.178020 20434 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:04:33.198346 20529 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:33.264865 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:33.265496 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1808) took 1059 ms. Trace:
I20260709 13:04:33.192356 19916 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:04:33.282256 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:33.175513 19924 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.284569 15323 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:33.334661 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:33.336527 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:33.340570 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:33.347851 15397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 643) took 2734 ms (client timeout 1782 ms). Trace:
I20260709 13:04:33.241778 20449 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:33.313326 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.229174 20436 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.313640 15325 rpcz_store.cc:276] 0709 13:04:32.206534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.211106 (+  4572us) service_pool.cc:224] Handling call
0709 13:04:32.211396 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:32.221465 (+ 10069us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:32.243121 (+ 21656us) log.cc:844] Serialized 14 byte log entry
0709 13:04:32.564691 (+321570us) log.cc:844] Serialized 14 byte log entry
0709 13:04:32.588033 (+ 23342us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b180035c920. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:33.012928 (+424895us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b180035c920. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:04:33.088775 (+ 75847us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:33.096163 (+  7388us) log.cc:844] Serialized 26 byte log entry
0709 13:04:33.096919 (+   756us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:33.096965 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.097043 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:33.265272 (+168229us) raft_consensus.cc:1685] finished
0709 13:04:33.265295 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:33.265414 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":561330,"prepare.queue_time_us":24092,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":2345,"raft.queue_time_us":558322,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":9632,"spinlock_wait_cycles":48236160,"thread_start_us":235511,"threads_started":1,"wal-append.queue_time_us":416922}
I20260709 13:04:33.358311 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:33.358517 20436 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:33.358705 20446 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:33.359123 20436 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.359654 20436 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.361693 20436 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:33.316164 20405 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.601s	user 0.002s	sys 0.010s
I20260709 13:04:33.311177 19990 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:33.362519 20405 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:33.317435 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52661.5us
I20260709 13:04:33.364095 15215 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:33.365025 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:33.365376 20405 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:33.259428 20523 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.366711 20213 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:33.367184 20213 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:33.367573 20521 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.367729 20421 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:33.368360 20421 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:33.368129 20521 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.318048 20488 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:33.322820 16026 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:04:33.323469 20271 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.323676 16031 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:33.198422 20453 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.324247 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:33.324937 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:33.325197 20282 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.325649 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:33.348469 15397 rpcz_store.cc:269] 0709 13:04:30.613762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.615601 (+  1839us) service_pool.cc:224] Handling call
0709 13:04:33.338215 (+2722614us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540034ba54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:33.347760 (+  9545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2842303232}
I20260709 13:04:33.337400 15318 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:33.389802 16033 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:33.354254 15320 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:33.362645 19990 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.313071 20529 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:33.219460 20492 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.369637 15391 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:04:33.262403 20531 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:33.406383 16032 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:33.374430 20528 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.390501 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:33.391422 16026 pending_rounds.cc:85] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 10
I20260709 13:04:33.409154 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:33.272913 20420 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:04:33.401381 16029 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:33.374505 20488 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.403687 16027 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:33.424439 20488 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:33.263787 20456 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.426932 20456 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:33.427117 20492 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:33.427506 20456 raft_consensus.cc:993] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:33.428036 20456 raft_consensus.cc:1081] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
W20260709 13:04:33.429107 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.367784 20208 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:04:33.415589 20453 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.376066 15325 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:33.367570 20213 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:33.361579 20435 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.446945 20435 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.449574 20435 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.409389 16026 pending_rounds.cc:107] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:04:33.450443 16026 raft_consensus.cc:2889] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:33.398023 15316 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:33.374691 20523 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:33.403237 16033 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:33.410595 20531 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.413271 20421 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.462291 20442 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:33.462872 20442 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:33.463726 15321 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:33.414521 20478 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.415547 16029 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:33.415977 20440 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:33.416714 20335 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.417315 15241 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:33.419718 19924 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.423677 19990 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.404940 20529 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:33.407330 20431 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.123s	user 0.020s	sys 0.031s
I20260709 13:04:33.460865 20523 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.414589 15318 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:33.463900 20442 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.465454 20531 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:33.465857 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1815) took 1257 ms. Trace:
I20260709 13:04:33.466881 15322 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:04:33.505813 15322 pending_rounds.cc:85] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 8
I20260709 13:04:33.506047 15322 pending_rounds.cc:107] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:04:33.506299 15322 raft_consensus.cc:2889] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:33.480825 15325 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:33.451241 20528 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.499214 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.507614 15397 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:33.501129 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:33.505053 15324 rpcz_store.cc:276] 0709 13:04:32.208638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.208750 (+   112us) service_pool.cc:224] Handling call
0709 13:04:33.465632 (+1256882us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b540021a2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:33.465792 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470814976}
I20260709 13:04:33.453490 20522 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.510653 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:33.505604 20431 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.233s	user 0.020s	sys 0.031s
I20260709 13:04:33.501915 20357 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.501816 20335 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:33.502731 20521 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.534430 20393 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:33.551698 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:33.539952 20449 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:33.545729 20335 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.566329 20393 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:33.587170 20533 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:04:33.599328 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.605240 20405 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:33.608688 20528 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.623073 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.632947 15394 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:33.625782 15246 raft_consensus.cc:1217] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Deduplicated request from leader. Original: 10.7->[12.8-14.9]   Dedup: 12.8->[14.9-14.9]
I20260709 13:04:33.636560 15246 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:04:33.568964 20446 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:33.545315 20357 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.572324 20449 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.635807 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:33.641640 19990 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:33.623788 20213 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.627449 20393 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.648452 15324 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:33.648761 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:33.649420 15316 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:33.688459 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.648324 20449 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:33.731923 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 496497us
I20260709 13:04:33.734274 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:33.739615 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2936) took 1097 ms. Trace:
W20260709 13:04:33.740187 15363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.017s	sys 0.025s
W20260709 13:04:33.740724 15363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.017s	sys 0.025s
I20260709 13:04:33.670111 19924 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:33.742699 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:33.740067 15398 rpcz_store.cc:276] 0709 13:04:32.642401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.910016 (+267615us) service_pool.cc:224] Handling call
0709 13:04:32.948554 (+ 38538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:32.949038 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:32.949079 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:32.949637 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:04:33.218498 (+268861us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:33.218536 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.218601 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:33.739412 (+520811us) raft_consensus.cc:1685] finished
0709 13:04:33.739430 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:33.739556 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4186,"thread_start_us":210993,"threads_started":1,"wal-append.queue_time_us":476443}
I20260709 13:04:33.744540 15316 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:33.744449 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:33.657845 20528 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:33.727216 20488 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:33.767791 15291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.013s	sys 0.025s
I20260709 13:04:33.675635 20523 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.663983 20532 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:33.638715 20405 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.670511 20522 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:33.768188 15291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.013s	sys 0.025s
W20260709 13:04:33.769726 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 440781us
W20260709 13:04:33.777259 15243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.004s	sys 0.030s
W20260709 13:04:33.777704 15243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.004s	sys 0.030s
I20260709 13:04:33.656919 19990 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.779677 16028 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:33.773097 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:33.777294 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 594121us
W20260709 13:04:33.773806 15216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.016s	sys 0.022s
I20260709 13:04:33.780974 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:33.781386 15216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.016s	sys 0.022s
W20260709 13:04:33.782969 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 410815us
I20260709 13:04:33.784355 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.785699 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.788275 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.769009 20528 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.760941 20453 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:33.788956 15396 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:33.829578 20443 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.790953 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:33.791337 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.830862 15395 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:33.832957 20481 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:33.836061 15213 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:33.840850 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:33.841598 16026 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:33.844745 20298 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:04:33.793298 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 467703us
I20260709 13:04:33.845317 20298 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:33.845422 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:33.845619 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:33.805023 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.793354 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:33.809347 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:33.812201 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.812331 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.813755 19990 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:33.819506 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.834125 20481 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:04:33.760885 19924 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.830183 20443 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:33.819583 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1819) took 1609 ms. Trace:
I20260709 13:04:33.846220 20298 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.847687 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:33.847941 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54673us
I20260709 13:04:33.859814 20488 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.848376 20529 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.861163 20442 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:33.780295 20448 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.789635 20416 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.862166 16024 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:33.849452 15393 raft_consensus.cc:2410] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:04:33.807849 20528 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:33.844297 20492 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:33.761269 20435 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:04:33.846813 20485 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.847004 20484 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:04:33.847615 20486 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:33.878870 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:33.859068 20451 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.860461 20488 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:33.786773 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:33.820019 15317 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:33.820737 20453 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:33.821705 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.850282 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:33.855269 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:33.853168 15319 rpcz_store.cc:276] 0709 13:04:32.209683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.233792 (+ 24109us) service_pool.cc:224] Handling call
0709 13:04:33.819363 (+1585571us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54001c6bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:33.819524 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109542656}
I20260709 13:04:33.854887 20213 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:33.895602 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:33.854419 15321 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:33.867856 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.868352 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.851822 20481 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:33.905793 15323 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:33.906397 15394 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:33.907258 15323 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:33.870923 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.849874 20405 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:33.850627 19990 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:33.853026 19924 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:33.872053 20543 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:33.873117 20347 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:33.874707 16026 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:33.868359 20282 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:33.884979 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 98282.5us
I20260709 13:04:33.848539 20399 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.885409 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.887339 20435 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:33.928495 15323 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:04:33.887512 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:33.853911 20443 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:33.904422 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:33.897670 15393 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:33.874716 20485 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:33.920085 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 69893.7us
W20260709 13:04:33.885977 20312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.014s	sys 0.022s
I20260709 13:04:33.921701 20213 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:04:33.990608 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 54122us
I20260709 13:04:33.879806 20486 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.923264 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:33.998735 15321 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
W20260709 13:04:33.921008 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65810.9us
W20260709 13:04:33.899688 19916 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.014s	sys 0.023s
I20260709 13:04:33.876356 20531 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.983501 15325 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:33.984845 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:33.919754 20478 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:33.874761 20448 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:33.988253 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47512.3us
I20260709 13:04:33.988137 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:33.989074 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 101674us
I20260709 13:04:33.922451 20337 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:33.879395 20335 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:33.985534 15324 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:04:33.919726 19990 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:34.000032 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:33.906170 20481 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:33.994133 20312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.014s	sys 0.022s
I20260709 13:04:33.926115 20456 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:34.040774 15325 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:33.991789 20485 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:34.043506 20542 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 13:04:34.004945 19916 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.014s	sys 0.023s
W20260709 13:04:34.047295 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 62505.7us
I20260709 13:04:33.927958 20484 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:34.074299 20434 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.006616 20486 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:34.062706 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 74659.2us
I20260709 13:04:33.994484 19924 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:33.928272 20405 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:34.069082 15324 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:33.937629 20282 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:34.072134 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72155.5us
I20260709 13:04:34.064671 20516 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:04:33.910410 20208 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.141s
I20260709 13:04:34.130071 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.100035 20488 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:33.982209 20399 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.061229 20547 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:33.990135 20443 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:04:34.102573 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:34.108625 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:34.101195 20431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.027s	sys 0.035s
I20260709 13:04:34.111843 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:34.121556 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:34.094353 20337 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:34.127166 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.128340 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.150303 16026 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:04:34.080138 15318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.003s	sys 0.018s
W20260709 13:04:34.152202 15318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.003s	sys 0.018s
I20260709 13:04:34.152405 15246 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:34.073253 20492 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 13:04:34.101640 20529 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:34.132740 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.135805 15245 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:34.084470 20548 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:04:34.146690 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.104609 20484 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:34.115691 19924 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.098922 20457 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:04:34.155768 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.145928 15241 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:34.144929 20537 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:34.179914 20537 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.158221 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.160792 20456 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:34.180353 20537 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:34.107558 20539 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:04:34.162639 15392 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:34.134318 20405 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:34.137264 20547 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:34.145049 20431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.027s	sys 0.035s
I20260709 13:04:34.147634 20481 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.177222 20529 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.124158 20434 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.195315 20393 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.177233 20488 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:04:34.198376 19924 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.161813 20538 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:04:34.216157 20484 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.216658 20335 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:34.104821 20540 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:04:34.201987 20456 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:34.218462 20282 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:34.252971 20213 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:34.136524 20451 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:04:34.219636 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2577) took 1376 ms. Trace:
I20260709 13:04:34.263178 20262 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.166056 20421 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:04:34.309556 15243 rpcz_store.cc:276] 0709 13:04:32.843493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.843633 (+   140us) service_pool.cc:224] Handling call
0709 13:04:32.844031 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:32.844554 (+   523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:32.844599 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:32.845399 (+   800us) log.cc:844] Serialized 52 byte log entry
0709 13:04:33.260949 (+415550us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18002bde00. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:04:33.778062 (+517113us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:34.079413 (+301351us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.079673 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.079770 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:34.219347 (+139577us) raft_consensus.cc:1685] finished
0709 13:04:34.219441 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.219580 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12119,"prepare.queue_time_us":30867,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":26300,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":7638,"spinlock_wait_cycles":25480064,"thread_start_us":779503,"threads_started":2,"wal-append.queue_time_us":1354915}
W20260709 13:04:34.219937 20545 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:04:34.161064 20541 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:34.244297 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 453382us
W20260709 13:04:34.254335 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 146808us
I20260709 13:04:34.304459 20481 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:34.261803 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.221751 20492 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:34.221552 20516 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:34.233930 20547 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:34.252876 20273 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:34.256335 20431 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:34.220666 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65022.8us
W20260709 13:04:34.221012 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 62887.2us
I20260709 13:04:34.237500 20449 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:34.234298 20544 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:04:34.347374 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 188128us
W20260709 13:04:34.328024 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 287215us
I20260709 13:04:34.348556 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.257200 20529 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:34.331840 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 187789us
I20260709 13:04:34.346017 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:34.345995 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.350636 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:34.326902 15291 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.350701 16026 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 9: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:34.326442 20484 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:34.352428 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.354555 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.354090 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:34.361900 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.365840 16032 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:34.369511 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:34.322075 20262 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.375504 20529 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:34.378194 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:34.387147 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:34.346262 20559 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:04:34.347939 20213 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.359599 20548 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:34.389078 20425 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:34.390552 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 810) took 1163 ms. Trace:
I20260709 13:04:34.390842 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:34.391031 16025 rpcz_store.cc:276] 0709 13:04:33.226898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.227059 (+   161us) service_pool.cc:224] Handling call
0709 13:04:33.273734 (+ 46675us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:33.274187 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:33.274252 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:33.274822 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 13:04:33.775796 (+500974us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:33.775848 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.775941 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:34.390334 (+614393us) raft_consensus.cc:1685] finished
0709 13:04:34.390361 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.390491 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9863,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":4781,"thread_start_us":458127,"threads_started":1,"wal-append.queue_time_us":695104}
I20260709 13:04:34.358640 20492 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:34.319283 20405 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.358034 20282 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:34.359383 20453 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:34.340775 20443 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:04:34.343456 20558 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:04:34.366503 20416 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:34.346617 20273 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.370499 20540 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:34.352535 20255 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:04:34.430088 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 72189.2us
I20260709 13:04:34.336791 20541 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.393354 20448 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:34.393177 20492 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:34.443037 20557 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:04:34.443704 20357 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:34.444519 20560 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:04:34.431448 20559 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.437542 20416 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.455392 20529 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:34.456976 20449 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:34.458820 20556 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:04:34.460503 20262 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:34.440891 20567 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:04:34.464737 20531 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:34.465343 20574 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:34.364531 20337 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:04:34.430115 20399 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:34.471120 20282 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.475205 15323 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:04:34.476986 20478 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:34.477855 20312 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:34.478395 20549 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.478569 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:34.479362 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:34.627206 15398 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:34.355346 20431 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.483616 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:34.485157 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 154425us
I20260709 13:04:34.630509 15390 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:34.629537 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 190973us
I20260709 13:04:34.366891 20538 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:04:34.494729 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 132952us
I20260709 13:04:34.495896 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1821) took 1235 ms. Trace:
I20260709 13:04:34.436138 20420 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:34.638779 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 258229us
I20260709 13:04:34.539484 16024 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:34.486557 20442 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.004s
W20260709 13:04:34.490720 20528 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
I20260709 13:04:34.538650 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:34.443734 20393 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:34.444561 20434 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:34.654042 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:34.555116 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.555217 20559 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.558045 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.558424 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.662339 15249 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:34.663269 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.560866 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.664970 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.494465 20443 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.557147 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.563164 16025 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:04:34.497941 20573 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:34.565382 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.581594 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.542352 20446 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:34.454033 20485 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.587234 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.553798 20416 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:34.552520 19916 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:04:34.597260 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 235928us
I20260709 13:04:34.558990 20492 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.633450 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1825) took 1372 ms. Trace:
I20260709 13:04:34.497187 20486 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.637826 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:34.666393 20558 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:34.641618 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2898) took 1421 ms. Trace:
W20260709 13:04:34.642488 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 279966us
I20260709 13:04:34.646047 16026 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:34.582417 20575 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:34.648030 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:34.650681 15397 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:34.652475 15390 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:34.626129 20478 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:34.743950 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1830) took 1137 ms. Trace:
I20260709 13:04:34.661335 15248 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:34.667320 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:34.745645 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 97736.7us
I20260709 13:04:34.626773 20312 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:34.681596 15245 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:34.639808 20213 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:34.744411 15321 rpcz_store.cc:276] 0709 13:04:33.606906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.056347 (+449441us) service_pool.cc:224] Handling call
0709 13:04:34.082635 (+ 26288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.082928 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:34.434202 (+351274us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.743601 (+309399us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.743662 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:34.743710 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.743773 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.743891 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57810,"prepare.queue_time_us":131716,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"thread_start_us":580109,"threads_started":2}
I20260709 13:04:34.702476 20442 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:34.706324 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:34.763586 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:34.765079 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:34.715123 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.766731 15249 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:34.629225 20282 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.717583 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:34.636279 15322 rpcz_store.cc:276] 0709 13:04:33.260220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.851329 (+591109us) service_pool.cc:224] Handling call
0709 13:04:33.851649 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:33.851857 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:34.124750 (+272893us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.495417 (+370667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.495493 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:34.495564 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.495654 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.495823 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6044,"prepare.queue_time_us":277600,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":6110,"raft.queue_time_us":9685,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":46865,"thread_start_us":588072,"threads_started":2}
I20260709 13:04:34.592741 20574 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.734202 15398 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:34.713644 15319 rpcz_store.cc:276] 0709 13:04:33.261305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.905311 (+644006us) service_pool.cc:224] Handling call
0709 13:04:33.905696 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:33.905947 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:04:34.393291 (+487344us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.632977 (+239686us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.633054 (+    77us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:34.633124 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.633218 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.633374 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":259499,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":29037,"thread_start_us":699873,"threads_started":2}
I20260709 13:04:34.723584 15316 rpcz_store.cc:276] 0709 13:04:33.220104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.762122 (+542018us) service_pool.cc:224] Handling call
0709 13:04:33.762594 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:33.771853 (+  9259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:33.771894 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:33.772447 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:04:34.007320 (+234873us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:34.007372 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.007458 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:34.641389 (+633931us) raft_consensus.cc:1685] finished
0709 13:04:34.641409 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.641560 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8938,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3342,"thread_start_us":214063,"threads_started":1,"wal-append.queue_time_us":477881}
I20260709 13:04:34.677464 20446 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:34.742965 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:34.785475 15390 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:34.686421 15241 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:34.692935 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:34.662923 20528 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.733770 20550 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.636343 20549 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.669013 20578 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:04:34.716333 15394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:04:34.804486 15394 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:34.804908 15394 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.743270 20579 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:34.778221 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:34.779417 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.780757 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:34.717796 20451 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:04:34.720831 20453 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.783156 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:34.783505 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:34.784153 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:34.720513 20357 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:34.688390 20443 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.795966 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:34.773849 15250 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:04:34.769966 20282 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:34.697683 19916 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:34.826551 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:34.762849 20531 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:34.762513 20442 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:34.815893 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 79358.9us
I20260709 13:04:34.841540 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:34.843062 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:34.844237 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:34.723042 20492 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:34.820930 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 178689us
I20260709 13:04:34.842541 15322 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:34.849650 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:34.850168 15322 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:34.852267 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:34.823554 15390 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:34.824581 15398 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:34.827090 15291 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.785701 20584 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.827850 16029 raft_consensus.cc:2368] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:34.847048 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:34.743254 20558 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.845086 15394 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:34.835434 19924 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.002s
I20260709 13:04:34.859215 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.822502 20538 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.776091 20213 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.866315 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:34.901523 20538 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.902467 20446 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.946689 20446 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:34.947651 20538 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:34.948284 20538 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:34.948776 20552 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.948896 20538 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.837208 20357 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.951690 20357 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:34.836906 20531 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.952584 20531 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:34.953756 20538 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:34.959247 20213 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:34.849953 20442 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:34.855582 20481 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.001s
I20260709 13:04:34.909591 19924 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:34.825006 20273 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:34.911660 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:34.992661 15321 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:34.912215 20605 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:34.803814 20562 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:04:34.868160 20584 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.918454 15394 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:34.854521 20434 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:34.920522 19990 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.013724 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:34.939484 20582 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:34.921784 20436 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:04:34.923072 20594 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:34.923894 20540 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:34.924890 20574 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:34.925400 20429 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:34.926024 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:34.931447 20258 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:34.931989 20443 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:34.932896 20568 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260709 13:04:34.996035 20605 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:34.866056 15390 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:04:34.751292 20575 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.949394 20552 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:34.909118 20484 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.002s
I20260709 13:04:34.965097 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2904) took 1637 ms. Trace:
I20260709 13:04:34.965181 16030 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:34.967782 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:34.969237 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.059998 15246 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:34.969463 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:35.061311 15245 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:34.969781 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:34.871667 20516 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260709 13:04:35.066439 20516 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:34.982379 15393 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:35.067097 15241 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:35.068601 15393 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:34.993865 15323 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:35.070279 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:34.996816 15322 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:34.805229 20550 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.857873 20604 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:35.073634 20604 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.828442 20453 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:35.008984 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 142762us
I20260709 13:04:35.078099 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:34.970892 20571 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:04:34.820479 20579 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.014963 15325 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:34.942929 20435 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:35.080175 20435 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:35.022789 15319 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:04:34.970242 20578 consensus_queue.cc:1175] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "89940175e5444593aab6b3a025624b5b" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
W20260709 13:04:35.004464 20572 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 13:04:34.992566 20549 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.033829 15244 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:35.034098 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:35.085001 15321 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:34.862998 20282 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.147s
I20260709 13:04:35.090879 20282 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:34.867838 16025 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:04:35.037544 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 189521us
I20260709 13:04:35.016908 20436 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:35.091991 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:35.045305 15390 pending_rounds.cc:85] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 7
I20260709 13:04:35.093156 15390 pending_rounds.cc:107] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:04:35.023094 20405 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.012708 20434 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.027613 20258 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:35.036067 20537 consensus_meta.cc:287] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.003s
I20260709 13:04:35.070523 20298 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:35.093467 15390 raft_consensus.cc:2889] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:35.045955 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 185326us
I20260709 13:04:35.093946 15249 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 9: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:35.152858 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:35.153666 15249 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:35.043017 20255 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.007s	sys 0.003s
I20260709 13:04:35.158313 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 824) took 1094 ms. Trace:
I20260709 13:04:35.017060 20602 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:35.027354 20429 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:35.128990 15321 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:35.016433 20587 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:35.057982 15317 rpcz_store.cc:276] 0709 13:04:33.327948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.981048 (+653100us) service_pool.cc:224] Handling call
0709 13:04:33.981380 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:33.981593 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:34.364402 (+382809us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.964654 (+600252us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:34.964724 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:34.964788 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.964875 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.965024 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68937,"prepare.queue_time_us":232775,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":145322,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4936,"thread_start_us":861930,"threads_started":3}
I20260709 13:04:35.137959 20434 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:35.145992 20574 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:04:35.148617 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 70614.9us
I20260709 13:04:35.185024 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:35.185345 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:35.157972 20255 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.007s	sys 0.004s
I20260709 13:04:35.148435 15393 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:35.155782 15241 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:35.155877 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:35.156435 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:35.166746 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:35.155016 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:35.043649 20431 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:35.173290 15245 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:35.174998 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.174998 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.106951 20393 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:35.106357 20282 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:35.158820 16028 rpcz_store.cc:276] 0709 13:04:34.063496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.063699 (+   203us) service_pool.cc:224] Handling call
0709 13:04:34.064152 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.064626 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.064667 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:34.071446 (+  6779us) log.cc:844] Serialized 26 byte log entry
0709 13:04:34.476212 (+404766us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b1800483fa0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:04:34.717901 (+241689us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:34.717943 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.718010 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.147903 (+429893us) raft_consensus.cc:1685] finished
0709 13:04:35.147928 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.158222 (+ 10294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5049,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7090,"spinlock_wait_cycles":5277952,"thread_start_us":241500,"threads_started":1,"wal-append.queue_time_us":732762}
I20260709 13:04:35.184355 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:35.149350 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:35.158363 20541 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:35.213907 16027 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:35.157132 20579 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:35.219702 20416 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.000s
I20260709 13:04:35.218441 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:35.220865 16030 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:35.216187 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:35.301048 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 84959.1us
I20260709 13:04:35.184433 20574 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:35.232764 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 78285.3us
I20260709 13:04:35.305958 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:35.235651 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:35.237306 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.239473 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.148373 20485 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.178604 19990 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:35.241676 16025 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:35.242769 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:35.138634 20405 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.055011 20213 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:04:35.343565 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:35.254262 16033 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:35.254760 20552 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.257529 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2895) took 2097 ms. Trace:
I20260709 13:04:35.257499 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:35.258278 20588 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 13:04:35.259110 20570 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:04:35.258481 20429 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.244385 20528 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.257898 20425 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:04:35.274264 20596 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 13:04:35.279212 20298 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.388006 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.182109 20602 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.391696 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:35.341743 20616 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.284171 20575 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:35.288362 20420 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.000s
I20260709 13:04:35.289623 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2896) took 2121 ms. Trace:
I20260709 13:04:35.294569 20558 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:35.182340 20559 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:35.392136 20298 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:35.215322 20435 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:35.318401 20548 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:35.304212 20550 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.319191 15393 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:35.320003 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:35.321396 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:35.321594 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:35.298571 20258 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.424059 16031 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:35.304236 20443 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.219936 20605 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.161033 20537 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.319010 20581 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:04:35.319802 20416 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.246408 20540 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:04:35.428831 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:35.332196 20604 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.434199 20595 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.435200 20595 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.233777 20357 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:35.438616 20357 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.235742 20486 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:35.249595 20431 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:35.440657 20431 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:35.441223 20431 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:35.249019 20453 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:35.260110 20585 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:04:35.257489 20478 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.445024 20537 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:35.298359 20583 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:35.447209 20583 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.447883 20416 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.323211 20574 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:35.355602 20591 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:35.304773 20541 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:35.280468 20449 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:35.231105 20436 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.385430 20425 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:35.391285 20429 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:35.464018 20595 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:35.467119 20591 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:35.463838 20478 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.467499 19916 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.468748 19916 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:35.469274 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:35.229064 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2536) took 1288 ms. Trace:
I20260709 13:04:35.470650 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:35.215682 20603 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.146s
I20260709 13:04:35.472158 20405 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:35.472507 20603 consensus_queue.cc:1243] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:04:35.470407 15399 rpcz_store.cc:276] 0709 13:04:33.941038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.941187 (+   149us) service_pool.cc:224] Handling call
0709 13:04:33.941517 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:33.989004 (+ 47487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:33.989040 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:34.006914 (+ 17874us) log.cc:844] Serialized 26 byte log entry
0709 13:04:34.358209 (+351295us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:34.358267 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.358331 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.228846 (+870515us) raft_consensus.cc:1685] finished
0709 13:04:35.228868 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.229003 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61406,"raft.queue_time_us":94566,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":29288,"thread_start_us":285236,"threads_started":1,"wal-append.queue_time_us":491538}
I20260709 13:04:35.464740 20312 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.381454 20531 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.475211 20312 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:35.476644 20531 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:35.477097 16029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 760) took 1734 ms (client timeout 2096 ms). Trace:
I20260709 13:04:35.331117 20584 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.478281 16024 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:35.478749 20449 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:35.471944 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:35.480039 15394 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:35.479727 20449 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.480320 20591 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:35.480937 20449 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:35.483583 20541 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.483995 20602 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.404217 20616 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.485885 15399 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:35.486935 20616 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:35.452468 20443 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.471895 20436 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:35.509582 20443 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:35.511212 20357 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:35.485949 20541 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:35.512667 15397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2522) took 1727 ms (client timeout 2102 ms). Trace:
W20260709 13:04:35.513123 15397 rpcz_store.cc:269] 0709 13:04:33.785236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.785393 (+   157us) service_pool.cc:224] Handling call
0709 13:04:35.512459 (+1727066us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54001dae54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:35.512606 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1986653568}
I20260709 13:04:35.490474 19924 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:35.428988 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 107662us
W20260709 13:04:35.477550 16029 rpcz_store.cc:269] 0709 13:04:33.742221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.742423 (+   202us) service_pool.cc:224] Handling call
0709 13:04:35.476887 (+1734464us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54004759d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:35.477037 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2493730688}
I20260709 13:04:35.412706 20420 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:35.431524 20528 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:35.521893 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:35.420426 20539 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:35.517030 20448 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:35.519992 20393 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.519475 20492 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:35.514156 20442 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.002s
W20260709 13:04:35.515511 20547 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.168s	user 0.006s	sys 0.007s
I20260709 13:04:35.529621 20448 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:35.531594 20393 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:35.535352 20442 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.536448 20547 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.292387 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.588577 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.591934 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.593097 15242 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:35.356105 15245 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:35.307479 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:35.599329 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 291759us
I20260709 13:04:35.316130 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:35.604605 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 288409us
I20260709 13:04:35.318887 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.607650 15241 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:35.335999 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:35.334405 15249 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:35.610147 15246 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:35.346771 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 222031us
W20260709 13:04:35.623656 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:35.624145 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.302789 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:35.628861 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 326009us
I20260709 13:04:35.631261 15316 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:35.634358 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.635432 15248 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:35.635676 15249 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:35.405599 15318 rpcz_store.cc:276] 0709 13:04:33.168283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.505843 (+337560us) service_pool.cc:224] Handling call
0709 13:04:33.506255 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:33.506488 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:33.506513 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:33.506960 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:04:34.152718 (+645758us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:34.152773 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.152864 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.285052 (+1132188us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b2400176738. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f36669939c4 00007f3666991acb 00007f3666b4cdc9 00007f3666b4ca55 00007f3666b4bfb0 00007f36697c2488 00007f36697c2be8 00007f366979a398 00007f366979576a 00007f3669794bb6
0709 13:04:35.289269 (+  4217us) raft_consensus.cc:1685] finished
0709 13:04:35.289293 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.289555 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9157376,"thread_start_us":605602,"threads_started":1,"wal-append.queue_time_us":725655}
I20260709 13:04:35.670003 15396 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:35.669894 20213 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:35.356456 15320 rpcz_store.cc:276] 0709 13:04:33.160443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.419212 (+258769us) service_pool.cc:224] Handling call
0709 13:04:33.419531 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:33.420448 (+   917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:33.420485 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:33.421131 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:04:33.906282 (+485151us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:33.906329 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.906431 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.256215 (+1349784us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b24001767c8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f36669939c4 00007f3666991acb 00007f3666b4cdc9 00007f3666b4ca55 00007f3666b4bfb0 00007f36697c2488 00007f36697c2be8 00007f366979a398 00007f366979576a 00007f3669794bb6
0709 13:04:35.257202 (+   987us) raft_consensus.cc:1685] finished
0709 13:04:35.257228 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.257465 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":414,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":3829632,"thread_start_us":484798,"threads_started":1,"wal-append.queue_time_us":794720}
I20260709 13:04:35.671129 20213 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.671661 20213 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:35.672020 20399 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:35.672598 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.672861 20399 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.356715 15321 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:35.393411 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.675299 15324 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:35.675697 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:35.381466 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 301742us
I20260709 13:04:35.676782 15321 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:35.678017 20258 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:35.384406 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:35.395437 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 303525us
W20260709 13:04:35.683368 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 151317us
I20260709 13:04:35.423795 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:35.650928 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.655475 19924 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:35.685866 15390 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:35.657486 20290 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:35.686003 19924 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.686923 20290 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.687608 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.688687 15318 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:35.689234 19924 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:35.693181 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:35.693393 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:35.676682 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.694559 16028 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:35.695334 15324 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:35.696200 20273 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:35.696689 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.696982 20273 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.692185 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:35.703728 20442 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:35.703943 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.703984 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.705108 15247 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:35.530196 20262 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:35.706796 20262 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:35.691977 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:35.708600 20262 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.668771 20312 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:35.709573 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:35.669298 15249 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:35.669905 20420 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:35.733314 20448 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.690044 20290 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.741020 20448 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:35.555224 20574 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.454361 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:35.747854 20539 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:35.710304 20312 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.714624 20298 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:35.715845 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.749140 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.661378 20436 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:35.690078 20282 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.720491 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:35.720474 15363 leader_election.cc:400] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
W20260709 13:04:35.721580 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 115624us
I20260709 13:04:35.722558 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.724848 15324 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:35.768252 15363 leader_election.cc:403] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:35.283275 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.773676 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 676) took 1291 ms. Trace:
I20260709 13:04:35.774138 15319 rpcz_store.cc:276] 0709 13:04:34.481627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.282985 (+801358us) service_pool.cc:224] Handling call
0709 13:04:35.773438 (+490453us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.742872 20528 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:35.713366 16029 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:35.719475 20442 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:35.689831 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.772017 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:35.746068 20574 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.795038 20282 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:35.795652 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.802947 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:35.701987 20405 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:35.768205 20436 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.798727 20312 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.803258 15321 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:04:35.806623 15322 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:35.807344 15319 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:35.806783 20436 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:35.808954 20420 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.809723 20420 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.812300 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 675) took 1331 ms. Trace:
I20260709 13:04:35.812883 15318 rpcz_store.cc:276] 0709 13:04:34.481323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.810787 (+1329464us) service_pool.cc:224] Handling call
0709 13:04:35.811419 (+   632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.811837 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:35.811864 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:35.811949 (+    85us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:35.812001 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.812073 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.812211 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.806664 20405 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.816694 20626 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:35.821424 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:35.822595 20539 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:35.823073 20538 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:35.824187 20539 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:34.007548 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:35.829557 20298 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:35.803126 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:35.832651 15324 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:35.747900 20547 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:35.835851 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 115528us
I20260709 13:04:35.836128 15320 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:35.836288 20626 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:35.819867 20442 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:04:35.820456 15323 raft_consensus.cc:2368] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15.
I20260709 13:04:35.847234 20420 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:35.848759 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 128707us
I20260709 13:04:35.851676 20574 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:35.852734 15363 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:35.854111 20623 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:35.854619 20623 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.854979 20623 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:35.855154 20399 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:35.855520 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:35.856753 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2910) took 1007 ms. Trace:
I20260709 13:04:35.857514 20538 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:35.858091 20538 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:35.859519 20405 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:35.859365 20538 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:35.861869 20434 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.639s	user 0.016s	sys 0.001s
I20260709 13:04:35.862434 20434 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:35.863976 15317 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:35.866101 15317 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:04:35.866433 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 157235us
I20260709 13:04:35.866868 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1834) took 1069 ms. Trace:
I20260709 13:04:35.867249 15317 rpcz_store.cc:276] 0709 13:04:34.797684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.865384 (+1067700us) service_pool.cc:224] Handling call
0709 13:04:35.865805 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:35.866591 (+   786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.866810 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.869058 15317 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:04:35.869707 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1836) took 1071 ms. Trace:
W20260709 13:04:35.859381 15290 leader_election.cc:336] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 2.102s (SENT)
I20260709 13:04:35.848819 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:35.873219 16028 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:35.873647 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:35.817052 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2948) took 1113 ms. Trace:
I20260709 13:04:35.869973 20626 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.874768 20626 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:35.875504 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:35.878281 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.880610 20273 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:35.881623 15214 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:35.838100 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:35.882773 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2597) took 1190 ms. Trace:
I20260709 13:04:35.883081 20574 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:35.883260 15244 rpcz_store.cc:276] 0709 13:04:34.692408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.692590 (+   182us) service_pool.cc:224] Handling call
0709 13:04:35.882370 (+1189780us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b540010c554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:35.882600 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567480192}
I20260709 13:04:35.883719 20574 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.885879 16026 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:35.886418 15318 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:35.887107 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2912) took 1037 ms. Trace:
I20260709 13:04:35.887519 15318 rpcz_store.cc:276] 0709 13:04:34.850005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.869776 (+1019771us) service_pool.cc:224] Handling call
0709 13:04:35.870176 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.886805 (+ 16629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.887022 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.888154 15245 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:35.884704 20574 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:35.889300 15317 rpcz_store.cc:276] 0709 13:04:34.798204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.868163 (+1069959us) service_pool.cc:224] Handling call
0709 13:04:35.868642 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:35.869418 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.869647 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.892247 15246 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:35.857201 15323 rpcz_store.cc:276] 0709 13:04:34.849480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.069978 (+220498us) service_pool.cc:224] Handling call
0709 13:04:35.856487 (+786509us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b5400374e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:35.856668 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558432640}
I20260709 13:04:35.809105 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.888746 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:35.906561 15318 raft_consensus.cc:2368] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15.
I20260709 13:04:35.874459 15392 rpcz_store.cc:276] 0709 13:04:34.704031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.705274 (+  1243us) service_pool.cc:224] Handling call
0709 13:04:34.705666 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.750658 (+ 44992us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:34.937837 (+187179us) log.cc:844] Serialized 14 byte log entry
0709 13:04:35.072304 (+134467us) log.cc:844] Serialized 14 byte log entry
0709 13:04:35.073404 (+  1100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:35.073683 (+   279us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:35.073912 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.527806 (+453894us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18003b73a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:35.816555 (+288749us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b54004128d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:35.816640 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.816861 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13268,"prepare.queue_time_us":537356,"prepare.run_cpu_time_us":170,"prepare.run_wall_time_us":345,"raft.queue_time_us":290269,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":14007,"spinlock_wait_cycles":133946496,"thread_start_us":302149,"threads_started":2,"wal-append.queue_time_us":396385}
I20260709 13:04:35.909685 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:35.912988 20586 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:35.944568 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 106637us
I20260709 13:04:35.948853 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:35.949618 15215 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:35.950706 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:35.951506 15323 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:35.952836 15321 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 16 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:35.952574 20591 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.953969 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:35.954833 15321 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:35.956291 15321 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:35.956808 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2913) took 1106 ms. Trace:
I20260709 13:04:35.956499 20425 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:35.957172 15321 rpcz_store.cc:276] 0709 13:04:34.850278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.955522 (+1105244us) service_pool.cc:224] Handling call
0709 13:04:35.955899 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.956554 (+   655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.956759 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.957849 20425 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:35.962604 20573 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:35.959537 20405 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:35.961452 20541 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:35.950497 20420 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:35.970973 16025 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:35.976454 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:35.979804 15317 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:35.988837 15319 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:04:36.001514 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:35.980909 20541 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.890290 20431 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.004627 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:36.018708 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:36.022008 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.022488 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:36.025593 20273 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:36.026005 20347 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:36.026345 20273 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.028288 20347 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:36.028842 20273 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:36.030664 20604 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:36.029795 20357 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:04:36.031433 20604 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:36.034443 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 85747.6us
I20260709 13:04:36.034881 20589 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:36.035398 20589 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:36.035786 20589 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:36.037330 20405 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:36.037751 20405 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:36.002315 20547 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:36.035719 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.039275 20547 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.041697 20547 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.041486 20393 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.042455 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:36.035610 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 131588us
I20260709 13:04:36.035413 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:36.045580 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.038780 20405 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.048715 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.051395 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:36.052450 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:36.053277 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.057119 20623 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.058831 16028 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:36.059531 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2590) took 1442 ms. Trace:
W20260709 13:04:36.063174 20449 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.008s
W20260709 13:04:36.070528 15999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.511s (SENT) [suppressed 22 similar messages]
I20260709 13:04:36.064988 20573 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.123919 20573 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.066211 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.125487 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.126641 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.067051 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.069626 20591 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:36.071103 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:36.070454 15996 leader_election.cc:400] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15.
I20260709 13:04:35.908361 20630 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.170s
I20260709 13:04:36.080972 20431 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:36.081521 20583 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:36.084923 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2953) took 1364 ms. Trace:
I20260709 13:04:36.131506 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:36.131814 15396 rpcz_store.cc:276] 0709 13:04:34.720686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.723133 (+  2447us) service_pool.cc:224] Handling call
0709 13:04:34.772404 (+ 49271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.670802 (+898398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.084571 (+413769us) spinlock_profiling.cc:243] Waited 897 ms on lock 0x7b5400154ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:36.084847 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2062865792}
I20260709 13:04:36.133296 15996 leader_election.cc:403] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:04:36.133951 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 63669.4us
I20260709 13:04:36.009593 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:36.136211 19916 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.011s
I20260709 13:04:36.136376 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.137787 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.098371 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:36.103432 15317 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:36.141423 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2602) took 1387 ms. Trace:
I20260709 13:04:36.064455 20434 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:36.142737 15244 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
W20260709 13:04:36.143013 15325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 671) took 1666 ms (client timeout 2032 ms). Trace:
I20260709 13:04:36.143437 16031 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:04:36.143867 16031 pending_rounds.cc:85] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 7
I20260709 13:04:36.144174 16031 pending_rounds.cc:107] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:04:36.144035 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:36.144562 16031 raft_consensus.cc:2889] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:36.145495 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.032852 20604 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:36.158490 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 123228us
I20260709 13:04:36.159452 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:36.160616 15324 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:36.104789 15250 rpcz_store.cc:276] 0709 13:04:34.559260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.559416 (+   156us) service_pool.cc:224] Handling call
0709 13:04:34.559812 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.821448 (+261636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.962013 (+1140565us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400316854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:36.001607 (+ 39594us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491418368}
I20260709 13:04:36.118306 20623 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.134095 20591 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:36.134760 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.137962 20528 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:36.143477 15325 rpcz_store.cc:269] 0709 13:04:34.476197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.479050 (+  2853us) service_pool.cc:224] Handling call
0709 13:04:36.142688 (+1663638us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540016dd54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:36.142831 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836898176}
I20260709 13:04:36.086755 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.147446 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.147802 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 2924) took 1155 ms. Trace:
I20260709 13:04:36.148108 15241 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
W20260709 13:04:36.149263 20632 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.595s	user 0.002s	sys 0.005s
I20260709 13:04:36.149688 20393 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:36.153267 15319 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:36.154220 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:36.030053 20347 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:36.161510 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:36.158525 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:36.197219 16028 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:36.107168 15323 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:04:36.141831 15243 rpcz_store.cc:276] 0709 13:04:34.754010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.754202 (+   192us) service_pool.cc:224] Handling call
0709 13:04:36.140399 (+1386197us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b5800132698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:04:36.140726 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.141006 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.141030 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.141083 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:36.141110 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.141158 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.141259 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13720320}
I20260709 13:04:36.098106 20541 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:36.190341 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 119825us
I20260709 13:04:36.188648 15322 rpcz_store.cc:276] 0709 13:04:34.991983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.239204 (+247221us) service_pool.cc:224] Handling call
0709 13:04:36.147574 (+908370us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b5400375354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:36.147728 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147826048}
W20260709 13:04:36.201057 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.117776 20213 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.206912 20213 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.207692 20485 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:36.209126 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 157867us
I20260709 13:04:36.210376 20420 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:36.211103 20630 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:36.211637 20630 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.212004 20630 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:36.212742 20420 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:36.213438 20420 consensus_queue.cc:1243] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:36.196404 20347 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:36.215219 20347 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.216384 20357 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.216626 20431 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:36.217324 20357 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.222646 16032 pending_rounds.cc:85] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 11
I20260709 13:04:36.223001 15323 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:04:36.223284 16032 pending_rounds.cc:107] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:04:36.223568 16032 raft_consensus.cc:2889] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:36.223726 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2921) took 1250 ms. Trace:
I20260709 13:04:36.224123 15323 rpcz_store.cc:276] 0709 13:04:34.973747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.222296 (+1248549us) service_pool.cc:224] Handling call
0709 13:04:36.222697 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.223456 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.223672 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.222661 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:36.225515 16029 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:36.225868 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:36.226159 20434 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.226840 20434 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.227835 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:36.229205 20434 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:36.229604 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68210.5us
I20260709 13:04:36.230340 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:36.230639 15395 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:04:36.231434 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:36.231882 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:36.232136 15392 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:36.233980 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:36.216562 20347 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:36.235167 20258 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:36.222774 20591 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15.
I20260709 13:04:36.235630 20258 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.236074 20258 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:36.230435 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 76358.7us
I20260709 13:04:36.216542 15242 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:36.237643 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.247079 15245 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:04:36.217362 20431 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:36.251333 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.258004 16033 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:36.260051 20623 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:36.261029 15322 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:36.260800 20623 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.261744 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2923) took 1286 ms. Trace:
I20260709 13:04:36.158525 20626 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.262105 15322 rpcz_store.cc:276] 0709 13:04:34.975290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.245014 (+1269724us) service_pool.cc:224] Handling call
0709 13:04:36.260634 (+ 15620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.261462 (+   828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.261685 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.263453 15322 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:36.263933 20626 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:36.264034 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2925) took 1268 ms. Trace:
I20260709 13:04:36.264456 15322 rpcz_store.cc:276] 0709 13:04:34.995750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.262923 (+1267173us) service_pool.cc:224] Handling call
0709 13:04:36.263270 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.263784 (+   514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.263980 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.265132 16029 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:04:36.265905 15322 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:36.266525 20255 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:36.260093 20446 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:04:36.267441 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 262358us
W20260709 13:04:36.267732 15316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 680) took 1632 ms (client timeout 1724 ms). Trace:
I20260709 13:04:36.267908 20429 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:36.270135 19916 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:36.271184 20436 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:36.274989 20448 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.012s
I20260709 13:04:36.275583 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:36.276316 20573 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:36.245028 20442 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:36.278983 19924 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:36.280476 15247 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:36.282439 20357 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:36.287101 20589 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.289919 15363 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:36.295341 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:36.295923 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:36.296164 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.296723 20405 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:36.298636 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:36.307732 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:36.309671 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:36.307112 15316 rpcz_store.cc:269] 0709 13:04:34.635722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.777921 (+142199us) service_pool.cc:224] Handling call
0709 13:04:36.267502 (+1489581us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54004033d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:36.267670 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890485120}
I20260709 13:04:36.306905 20446 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.315644 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2931) took 1095 ms. Trace:
I20260709 13:04:36.328306 15322 rpcz_store.cc:276] 0709 13:04:35.216214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.265192 (+1048978us) service_pool.cc:224] Handling call
0709 13:04:36.265541 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.288882 (+ 23341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.311739 (+ 22857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.328743 16025 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 16: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:36.314628 16028 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:36.319386 19924 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.307307 20255 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.318282 15320 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:04:36.318154 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.331827 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:36.307089 20399 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:04:36.313915 19916 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:36.329490 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84751.3us
I20260709 13:04:36.323491 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:36.335518 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.336452 16029 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:36.337646 19916 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:36.341915 20357 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:36.315404 20434 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:36.343036 20434 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.343734 20574 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.345460 20434 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:36.331503 19924 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:36.334045 20255 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:36.330492 20446 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:36.350368 15244 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:36.347921 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:36.355926 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 98120.9us
I20260709 13:04:36.352056 20449 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.362583 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:36.346594 20528 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:36.334061 20539 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:36.365888 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:36.349566 20442 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:36.363039 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:36.371713 15363 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:36.359900 20449 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.360109 20573 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:36.362442 20448 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:36.373040 20539 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:36.389289 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 93486.8us
I20260709 13:04:36.382915 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.386919 20448 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:36.397863 20434 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.398089 20448 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:36.398622 20434 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.400804 20434 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.401520 20548 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:36.388232 20399 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:36.382615 20443 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:04:36.388113 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:36.390447 15322 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:36.402007 20548 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.351600 20574 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.413348 16031 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
W20260709 13:04:36.415951 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65123.5us
I20260709 13:04:36.377895 20528 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:36.381899 20573 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:36.424247 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.378252 20623 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.381671 20449 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:36.427716 20431 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.401773 19916 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.373818 20626 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:04:36.413138 20357 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:36.407624 20442 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:36.418094 20548 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:36.412823 20399 raft_consensus.cc:697] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:36.439586 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.428627 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:36.453980 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 98205.2us
I20260709 13:04:36.463968 15316 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:36.431113 20443 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:36.471350 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:36.462258 16027 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:36.387863 20539 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:36.496775 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 65723.9us
I20260709 13:04:36.433547 20393 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:36.503988 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:36.507730 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:36.539610 15250 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:36.547400 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 45727us
I20260709 13:04:36.556799 15246 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:36.509521 20443 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:36.558822 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49681.9us
I20260709 13:04:36.571800 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:36.575351 15245 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:36.549991 20626 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:36.585415 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 81988.1us
I20260709 13:04:36.539386 20446 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.590041 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:36.591711 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:36.553095 20393 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.550760 20258 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.562880 19924 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.589666 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:36.606112 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:36.562143 20442 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.616523 16028 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:36.603011 20547 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:36.628263 15213 leader_election.cc:400] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15.
I20260709 13:04:36.633955 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:36.576100 20528 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.635010 15245 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:36.584817 20573 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.621133 20538 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:04:36.643059 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57714.7us
I20260709 13:04:36.599496 20399 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.649976 19916 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:36.612507 20626 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:36.655954 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:36.662922 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55564.8us
I20260709 13:04:36.642436 20591 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:36.638330 20547 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:36.669132 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.620075 20448 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:36.679976 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 78047.7us
I20260709 13:04:36.676147 15246 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:36.647457 20616 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.685295 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:36.689113 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:36.689697 20641 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:36.690881 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:36.701020 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 291374us
I20260709 13:04:36.720347 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:36.721027 15246 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:36.721293 15245 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:36.642477 20443 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.733414 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:36.734279 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45340.7us
W20260709 13:04:36.740926 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 70922.2us
I20260709 13:04:36.718559 20273 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:36.754947 20541 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.756569 20420 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:36.757648 20541 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.757741 20347 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:36.759436 20485 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:36.761523 15391 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:36.723062 20357 raft_consensus.cc:2764] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:04:36.763527 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2914) took 1913 ms. Trace:
I20260709 13:04:36.764767 20605 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:36.767012 20639 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:04:36.770423 20357 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:36.771134 20357 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:36.772069 20643 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:04:36.773530 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2916) took 1922 ms. Trace:
I20260709 13:04:36.773638 20357 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.773929 15317 rpcz_store.cc:276] 0709 13:04:34.851032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.138815 (+1287783us) service_pool.cc:224] Handling call
0709 13:04:36.139172 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.139627 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.139660 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:36.140223 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:04:36.469992 (+329769us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:36.470051 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.470149 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.773277 (+303128us) raft_consensus.cc:1685] finished
0709 13:04:36.773296 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.773453 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3211,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":329245,"threads_started":1,"wal-append.queue_time_us":467118}
I20260709 13:04:36.763912 15321 rpcz_store.cc:276] 0709 13:04:34.850537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.958048 (+1107511us) service_pool.cc:224] Handling call
0709 13:04:35.967736 (+  9688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.003204 (+ 35468us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:36.003247 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:36.007899 (+  4652us) log.cc:844] Serialized 26 byte log entry
0709 13:04:36.457219 (+449320us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:36.457281 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.457388 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.763293 (+305905us) raft_consensus.cc:1685] finished
0709 13:04:36.763322 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.763440 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":232259,"raft.queue_time_us":37540,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":167,"thread_start_us":358222,"threads_started":1,"wal-append.queue_time_us":495159}
I20260709 13:04:36.775084 15246 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:36.775954 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.777055 15317 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:36.778195 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:36.779462 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.780057 15317 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:36.776117 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2915) took 1925 ms. Trace:
I20260709 13:04:36.781072 15318 rpcz_store.cc:276] 0709 13:04:34.850775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.019715 (+1168940us) service_pool.cc:224] Handling call
0709 13:04:36.020161 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.247243 (+227082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.247271 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:36.253814 (+  6543us) log.cc:844] Serialized 26 byte log entry
0709 13:04:36.568134 (+314320us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:36.568187 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.568282 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.775899 (+207617us) raft_consensus.cc:1685] finished
0709 13:04:36.775917 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.776062 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":254247,"raft.queue_time_us":288416,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4405,"thread_start_us":301354,"threads_started":1,"wal-append.queue_time_us":457241}
I20260709 13:04:36.776057 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:36.783941 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68691.2us
I20260709 13:04:36.784987 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:36.753582 20630 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.003s
I20260709 13:04:36.694056 20538 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:04:36.790066 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:36.746949 20646 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:04:36.792992 15321 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
W20260709 13:04:36.797958 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 251274us
I20260709 13:04:36.801493 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.806739 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:36.715981 20616 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.814117 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.788162 20273 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:36.822608 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:36.789016 19924 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:36.792313 20446 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:36.791359 20393 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:36.829348 15321 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:36.831558 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.805089 20531 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:36.836905 20645 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.838467 20626 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.812225 20547 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.877458 20645 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.880934 20645 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:36.842374 15317 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:36.844489 20616 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:36.845616 15318 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:36.862128 20605 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.883440 20448 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.884047 20605 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.884541 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:36.885481 15318 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:36.847393 20644 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:04:36.822058 20541 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.850567 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2918) took 1999 ms. Trace:
I20260709 13:04:36.858660 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2922) took 1884 ms. Trace:
I20260709 13:04:36.862341 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1833) took 2065 ms. Trace:
I20260709 13:04:36.892380 15320 rpcz_store.cc:276] 0709 13:04:34.797365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.837265 (+1039900us) service_pool.cc:224] Handling call
0709 13:04:35.837831 (+   566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.331731 (+493900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.862034 (+530303us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54002193d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:36.862277 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104287104}
W20260709 13:04:36.893129 15148 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 137) took 23848 ms (client timeout 15000 ms). Trace:
I20260709 13:04:36.893736 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:36.891958 15323 rpcz_store.cc:276] 0709 13:04:34.974497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.224828 (+1250331us) service_pool.cc:224] Handling call
0709 13:04:36.225209 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.290244 (+ 65035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.290274 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:36.313318 (+ 23044us) log.cc:844] Serialized 26 byte log entry
0709 13:04:36.642443 (+329125us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:36.642497 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.642567 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.853980 (+211413us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b24001767c8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f36669939c4 00007f3666991acb 00007f3666b4cdc9 00007f3666b4ca55 00007f3666b4bfb0 00007f36697c2488 00007f36697c2be8 00007f366979a398 00007f366979576a 00007f3669794bb6
0709 13:04:36.858309 (+  4329us) raft_consensus.cc:1685] finished
0709 13:04:36.858330 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.858583 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77531,"raft.queue_time_us":92382,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":3670,"spinlock_wait_cycles":27203456,"thread_start_us":295549,"threads_started":1,"wal-append.queue_time_us":414396}
I20260709 13:04:36.890866 15324 rpcz_store.cc:276] 0709 13:04:34.851599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.161615 (+1310016us) service_pool.cc:224] Handling call
0709 13:04:36.238170 (+ 76555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.247009 (+  8839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.247040 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:36.261177 (+ 14137us) log.cc:844] Serialized 26 byte log entry
0709 13:04:36.532528 (+271351us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:36.532575 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.532659 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.850313 (+317654us) raft_consensus.cc:1685] finished
0709 13:04:36.850333 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.850493 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":270863,"threads_started":1,"wal-append.queue_time_us":307382}
I20260709 13:04:36.803360 20258 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:36.872517 15390 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.002s
I20260709 13:04:36.901153 15390 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:36.872722 15249 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:36.789484 20630 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.875816 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:36.903658 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:36.848789 20431 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:36.871978 20393 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:36.883008 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.909561 15317 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:36.899070 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.898533 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:36.917780 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:36.891726 20405 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.000s
I20260709 13:04:36.892194 20541 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.830678 20548 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:36.947909 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 683) took 1068 ms. Trace:
I20260709 13:04:36.940151 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:36.952735 15323 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:04:36.931080 20312 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:36.957300 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 689) took 1031 ms. Trace:
I20260709 13:04:36.961452 15323 rpcz_store.cc:276] 0709 13:04:35.925782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.933426 (+1007644us) service_pool.cc:224] Handling call
0709 13:04:36.952441 (+ 19015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.956893 (+  4452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.957219 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.955933 15320 rpcz_store.cc:276] 0709 13:04:35.879387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.894751 (+1015364us) service_pool.cc:224] Handling call
0709 13:04:36.909168 (+ 14417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.934451 (+ 25283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.934493 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.947519 (+ 13026us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:36.947576 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.947661 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.947832 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.958391 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:36.907997 20431 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:36.960675 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:36.930433 20591 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:36.967839 15322 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:36.936563 20626 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.992563 20626 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.995067 20626 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:36.996362 20591 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.877637 20273 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:36.949507 20448 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:36.985085 15250 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:36.985852 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:36.986084 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.986384 20652 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:36.991786 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:36.979748 20431 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.000056 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:37.001845 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 247173us
I20260709 13:04:37.004216 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:36.951898 20258 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:37.011588 15317 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:37.030712 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:37.039851 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.040055 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:36.965056 20393 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.041487 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:37.043115 20393 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:37.043298 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.043606 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.043968 15392 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:37.044329 15395 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:37.044865 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.045233 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.044895 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.045842 15395 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:37.046177 15392 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:37.001452 20312 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:37.046481 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:37.047108 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.047725 15392 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:37.047871 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:37.048703 20357 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:37.049130 20357 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:37.008401 20448 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:37.049567 20357 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:37.049695 20448 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:37.049876 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.050660 15398 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:37.051627 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.051791 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.052416 15398 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:37.052491 15394 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:37.053365 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.054412 20538 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:37.055567 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.056411 15399 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:37.057547 15395 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:37.047279 20312 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:37.029997 20255 consensus_meta.cc:287] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.003s
I20260709 13:04:37.063414 20255 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.064752 15396 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:37.005263 20583 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:37.068239 20539 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:37.071347 20655 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:37.076126 20436 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:37.078493 20589 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:37.081058 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:37.082937 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:37.083528 20605 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:37.084033 16031 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:37.085005 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:37.086592 15317 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:04:37.086835 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:37.087940 15317 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:04:37.088099 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:37.089519 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:37.034907 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:37.027331 20652 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:36.893532 15148 rpcz_store.cc:269] 0709 13:04:13.044597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.046445 (+  1848us) service_pool.cc:224] Handling call
0709 13:04:13.897548 (+851103us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b64090 00007f3669c02f3a 00007f366f9b91cc 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc 00007f366df77392 00007f3667f3548c 00007f3667f348c6
0709 13:04:36.892858 (+22995310us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:31.229937 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:31.329722 (+ 99785us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:31.329771 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:04:31.329789 (+    18us) tablet.cc:662] Decoding operations
0709 13:04:31.423830 (+ 94041us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:31.423926 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:31.423961 (+    35us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:04:31.425030 (+  1069us) tablet.cc:701] Row locks acquired
0709 13:04:31.425074 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:04:31.425238 (+   164us) write_op.cc:270] Start()
0709 13:04:31.425383 (+   145us) write_op.cc:276] Timestamp: P: 1783602271425175 usec, L: 0
0709 13:04:31.425418 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:04:31.426160 (+   742us) log.cc:844] Serialized 4786 byte log entry
0709 13:04:32.110444 (+684284us) op_driver.cc:464] REPLICATION: finished
0709 13:04:32.248077 (+137633us) write_op.cc:301] APPLY: starting
0709 13:04:32.248190 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:32.693919 (+445729us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:32.694042 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:33.060269 (+366227us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:33.060820 (+   551us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:04:33.060895 (+    75us) write_op.cc:312] APPLY: finished
0709 13:04:33.061423 (+   528us) log.cc:844] Serialized 113 byte log entry
0709 13:04:33.454981 (+393558us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:33.474688 (+ 19707us) write_op.cc:454] Released schema lock
0709 13:04:33.477186 (+  2498us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:33.540131 (+ 62945us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:33.546151 (+  6020us) write_op.cc:454] Released schema lock
0709 13:04:33.846966 (+300815us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b180016e5e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
Metrics: {"mutex_wait_us":3357867,"reported_tablets":27,"spinlock_wait_cycles":31795712,"child_traces":[["op",{"apply.queue_time_us":116599,"apply.run_cpu_time_us":103706,"apply.run_wall_time_us":1290058,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54263,"num_ops":12,"prepare.queue_time_us":391087,"prepare.run_cpu_time_us":19350,"prepare.run_wall_time_us":326949,"raft.queue_time_us":459282,"raft.run_cpu_time_us":16566,"raft.run_wall_time_us":150218,"replication_time_us":636318,"spinlock_wait_cycles":5483264,"thread_start_us":740735,"threads_started":5,"wal-append.queue_time_us":580793,"wal-append.run_cpu_time_us":64088,"wal-append.run_wall_time_us":2269398}]]}
I20260709 13:04:37.054003 15398 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:37.090996 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 86902.8us
I20260709 13:04:37.081290 20541 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:37.095431 20429 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:37.096716 20429 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:37.097623 20429 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.099315 15318 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:37.093367 15321 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:04:37.105438 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56253.8us
I20260709 13:04:37.105762 20605 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:37.105746 20652 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.106567 20605 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:37.107066 20605 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:37.106786 20538 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:37.107903 20538 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:37.108494 20538 consensus_queue.cc:1243] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:37.105804 20589 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:37.029421 20258 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:37.111092 20589 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:37.111308 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.111369 20258 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:37.111088 16026 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:37.112305 15399 raft_consensus.cc:2410] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:04:37.113149 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.113967 20548 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:37.114799 20337 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:37.114985 20255 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:37.115064 15321 raft_consensus.cc:1217] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[12.8-15.10]   Dedup: 12.8->[13.9-15.10]
I20260709 13:04:37.115819 15321 pending_rounds.cc:85] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 8
I20260709 13:04:37.115855 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.116657 15321 pending_rounds.cc:107] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:04:37.117096 15321 raft_consensus.cc:2889] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:37.116804 15395 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:37.117419 15323 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:37.110477 20630 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:37.111590 20589 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:37.092521 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.090197 15317 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
W20260709 13:04:37.123297 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 338404us
I20260709 13:04:37.134699 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.135855 15250 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:37.132691 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:37.141748 20541 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:37.142673 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.144822 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:37.146008 20541 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:37.148170 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.115235 20337 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:37.154501 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:37.155583 15317 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:37.173964 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:37.179859 15317 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:37.182137 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2920) took 2209 ms. Trace:
I20260709 13:04:37.182258 20531 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:37.187023 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:37.199520 15323 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:37.147320 20436 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.171552 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:37.208225 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:37.208758 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.197330 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.210042 15395 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:37.197645 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.210165 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:37.191056 15319 rpcz_store.cc:276] 0709 13:04:34.973117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.201094 (+1227977us) service_pool.cc:224] Handling call
0709 13:04:36.259903 (+ 58809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.346871 (+ 86968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.346908 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:36.369302 (+ 22394us) log.cc:844] Serialized 26 byte log entry
0709 13:04:36.683528 (+314226us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:36.953250 (+269722us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.181777 (+228527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.181857 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:37.181913 (+    56us) raft_consensus.cc:1685] finished
0709 13:04:37.181923 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.182073 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121000,"prepare.queue_time_us":412817,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":112832,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":13597,"thread_start_us":759451,"threads_started":3,"wal-append.queue_time_us":429528}
I20260709 13:04:37.221195 15250 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
W20260709 13:04:37.225278 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49898.7us
I20260709 13:04:37.211370 15391 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:37.147114 20255 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:04:37.222941 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:37.231855 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:37.236533 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 682) took 1007 ms. Trace:
I20260709 13:04:37.236994 15390 rpcz_store.cc:276] 0709 13:04:36.228944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.231615 (+  2671us) service_pool.cc:224] Handling call
0709 13:04:37.236366 (+1004751us) spinlock_profiling.cc:243] Waited 95.2 ms on lock 0x7b540026ff54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:37.236470 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219039488}
I20260709 13:04:37.238299 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.239678 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.240334 15390 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:37.248200 20485 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:37.248773 20485 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:37.253048 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 681) took 1024 ms. Trace:
I20260709 13:04:37.253618 15393 rpcz_store.cc:276] 0709 13:04:36.228612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.231593 (+  2981us) service_pool.cc:224] Handling call
0709 13:04:36.231975 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.310694 (+ 78719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.310742 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.314897 (+  4155us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:36.314951 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.252635 (+937684us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b540034b7d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:37.252691 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.252857 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171671808}
I20260709 13:04:37.255498 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.262589 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.211828 19916 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.267654 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:37.272903 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.169569 20665 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.223784 20630 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:37.284421 15395 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:04:37.286968 15316 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:37.286779 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:37.294457 20665 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.295940 20262 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:37.296811 20262 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:37.211874 20357 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.288784 16026 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:37.215963 20436 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:37.332705 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 109846us
I20260709 13:04:37.331557 15390 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:37.376453 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.282974 20630 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.375643 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.302191 20548 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.392500 15398 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:37.388628 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.310292 20558 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:37.410777 15248 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:37.350692 15245 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:04:37.351423 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.424105 15242 raft_consensus.cc:2393] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 12: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:37.352191 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.297679 20665 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:37.413439 15243 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:37.415988 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.280202 19916 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.285943 20443 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.375880 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.431051 15244 raft_consensus.cc:2368] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:37.429167 15243 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:37.423288 20630 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:37.459883 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.463493 16033 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:37.468446 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:37.470732 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.471444 15244 raft_consensus.cc:2368] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15.
I20260709 13:04:37.298136 20262 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.479784 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.312296 20531 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.491185 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.491947 15241 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:37.442076 20443 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.444029 20448 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.306571 20337 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.472266 20541 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:37.521718 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 53353.4us
I20260709 13:04:37.441192 20548 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.524199 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.489534 15248 raft_consensus.cc:2376] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13. Re-sending same reply.
I20260709 13:04:37.458590 20605 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.542989 15244 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:37.531718 15243 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:37.550593 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 70959.5us
W20260709 13:04:37.551985 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.552124 15394 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:37.553196 20357 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:37.553411 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:37.553916 20659 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:04:37.554415 20663 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:04:37.554746 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.555418 15244 raft_consensus.cc:2376] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15. Re-sending same reply.
I20260709 13:04:37.556034 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.556378 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.557264 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.559345 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.554095 15248 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 9.
I20260709 13:04:37.560779 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.560806 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.557330 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.561640 20347 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.562459 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.562279 20347 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.563624 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.564225 15244 raft_consensus.cc:2376] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12. Re-sending same reply.
I20260709 13:04:37.564837 20431 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:37.565128 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.561398 15242 raft_consensus.cc:2376] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14. Re-sending same reply.
I20260709 13:04:37.561648 15248 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:37.567046 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.566193 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:37.570725 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 158177us
I20260709 13:04:37.571534 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:37.572664 15242 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:37.572784 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 229909us
I20260709 13:04:37.576174 15316 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:04:37.553752 20669 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:04:37.597215 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2943) took 1227 ms. Trace:
I20260709 13:04:37.597702 15318 rpcz_store.cc:276] 0709 13:04:36.369724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.100096 (+730372us) service_pool.cc:224] Handling call
0709 13:04:37.100439 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:37.100665 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:37.174365 (+ 73700us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.596823 (+422458us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:37.596903 (+    80us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:37.596963 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.597028 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.597153 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173895,"prepare.queue_time_us":57345,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":4370,"thread_start_us":198587,"threads_started":1,"wal-append.queue_time_us":300311}
I20260709 13:04:37.549903 20604 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:37.603314 15243 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.603772 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:37.605154 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.610890 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.588519 20357 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:37.619608 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:37.620106 20357 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:37.620345 20673 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:04:37.620574 20357 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:37.622649 20425 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:37.623538 20425 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:37.624068 20436 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:37.625730 20695 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:37.627118 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2919) took 2654 ms. Trace:
I20260709 13:04:37.627908 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:37.627516 15325 rpcz_store.cc:276] 0709 13:04:34.972350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.201768 (+1229418us) service_pool.cc:224] Handling call
0709 13:04:36.260554 (+ 58786us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.714407 (+453853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.714448 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:36.726839 (+ 12391us) log.cc:844] Serialized 26 byte log entry
0709 13:04:37.171095 (+444256us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:37.171151 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.171246 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:37.626887 (+455641us) raft_consensus.cc:1685] finished
0709 13:04:37.626906 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.627043 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":125173,"raft.queue_time_us":97402,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6757,"thread_start_us":672640,"threads_started":2,"wal-append.queue_time_us":518504}
I20260709 13:04:37.630075 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.630788 15242 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:37.589013 20547 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.549311 20541 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.629464 20443 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:37.607100 20434 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:04:37.628103 20539 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 13:04:37.622032 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:37.651969 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.631215 20357 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.655588 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:37.637632 20676 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:37.656266 15399 raft_consensus.cc:2410] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:04:37.657038 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:37.659369 15244 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:37.660023 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 185517us
I20260709 13:04:37.662010 15244 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:37.661615 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:37.659555 15393 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
W20260709 13:04:37.653510 20258 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.003s
W20260709 13:04:37.675067 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53127.1us
I20260709 13:04:37.671820 16032 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:37.652073 20434 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:37.682579 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:37.659951 20676 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.656940 20443 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:37.722965 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.652272 20547 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.729308 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:37.681993 20541 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:37.696002 20690 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:04:37.747012 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53524.5us
I20260709 13:04:37.721094 20676 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:37.755055 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 81692.8us
I20260709 13:04:37.755167 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:37.757334 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:37.758282 15393 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:37.762827 20357 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:37.763509 20691 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:04:37.764441 20682 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:04:37.764909 19916 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:37.679783 20258 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.778213 15999 leader_election.cc:400] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15.
I20260709 13:04:37.779495 15393 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:37.775563 20443 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:37.762130 20573 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:37.746132 20539 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:37.789397 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:37.790908 15393 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:37.791911 15243 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:04:37.791855 20347 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:37.792944 15243 pending_rounds.cc:85] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 4
I20260709 13:04:37.793203 15243 pending_rounds.cc:107] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:04:37.793443 15243 raft_consensus.cc:2889] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:37.793905 15363 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:37.794677 20434 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.796504 20425 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:37.796957 20425 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.797310 20425 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.754024 20666 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.175s
I20260709 13:04:37.802515 15393 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:37.804035 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:37.804862 20443 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:37.805238 20443 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.805557 20443 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:37.811430 20442 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:37.812141 20605 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:37.813632 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:37.813763 20485 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.815899 20405 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:37.826282 20405 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:37.826419 20623 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:37.826933 20623 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.827289 20623 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:37.827185 20405 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.818369 20539 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.819880 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 885) took 2048 ms. Trace:
I20260709 13:04:37.820437 20258 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:37.823663 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45586.3us
I20260709 13:04:37.824608 15241 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:37.771947 20690 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:37.827747 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2947) took 1043 ms. Trace:
I20260709 13:04:37.817461 20443 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.851434 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:37.838954 15317 rpcz_store.cc:276] 0709 13:04:36.784188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.195200 (+411012us) service_pool.cc:224] Handling call
0709 13:04:37.195577 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:37.599524 (+403947us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:37.599568 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:37.607685 (+  8117us) log.cc:844] Serialized 26 byte log entry
0709 13:04:37.676410 (+ 68725us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:37.676451 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.827347 (+150896us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54001e69d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:37.827393 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:37.827440 (+    47us) raft_consensus.cc:1685] finished
0709 13:04:37.827454 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.827687 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177033,"raft.queue_time_us":211319,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":442925440,"thread_start_us":29149,"threads_started":1,"wal-append.queue_time_us":122889}
I20260709 13:04:37.826442 20485 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:37.788298 20548 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:37.855348 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66013.2us
I20260709 13:04:37.860285 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:37.834805 16024 rpcz_store.cc:276] 0709 13:04:35.771771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.772067 (+   296us) service_pool.cc:224] Handling call
0709 13:04:36.098314 (+326247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.098681 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:36.452247 (+353566us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.129313 (+677066us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.129675 (+   362us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:37.129750 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:37.129918 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.130046 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.585593 (+455547us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b1800371680. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d522 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:37.819395 (+233802us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b540043b2d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:37.819645 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":414399,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":92,"raft.queue_time_us":310250,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":15900,"spinlock_wait_cycles":743646336,"thread_start_us":967018,"threads_started":3,"wal-append.queue_time_us":474763}
I20260709 13:04:37.850669 20405 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:37.858696 20442 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:37.857525 20431 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.828557 20425 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.873117 16032 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:37.874884 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:04:37.876380 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.872570 20605 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:37.874475 20431 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.978180 20431 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:37.925305 20690 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.979635 15242 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
W20260709 13:04:37.980511 20680 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.492s	user 0.003s	sys 0.000s
W20260709 13:04:37.981035 20630 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
I20260709 13:04:37.981513 20630 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:37.995242 15398 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:04:37.998960 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:37.999614 16028 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.931689 20547 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:38.008585 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:38.009423 16031 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:37.932638 20676 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:37.933727 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:37.933813 20446 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:37.934381 15397 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:04:37.932667 20539 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:37.934991 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 70511.7us
I20260709 13:04:38.017711 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:38.020913 15317 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:04:38.021329 15317 pending_rounds.cc:85] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 10
I20260709 13:04:38.021549 15317 pending_rounds.cc:107] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:04:38.021782 15317 raft_consensus.cc:2889] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:37.940018 20677 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.359s	user 0.003s	sys 0.000s
I20260709 13:04:38.023933 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:37.958830 20701 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:04:37.967100 20705 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:04:37.968112 20589 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.002s
I20260709 13:04:37.897377 20273 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:37.885987 20693 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.202s
I20260709 13:04:37.971388 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:37.974941 20443 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:37.928308 20425 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:37.990006 15363 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:38.012596 15290 leader_election.cc:336] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.624s (SENT)
I20260709 13:04:38.044080 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.013461 20700 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:38.014551 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:38.046518 15245 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:38.014654 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:38.026603 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 92983us
I20260709 13:04:38.026754 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:38.050695 15242 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:38.027153 15391 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:04:38.027921 15394 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: [16.8-16.8]
I20260709 13:04:37.996876 20541 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.031093 15250 raft_consensus.cc:2410] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:04:38.006707 20591 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:04:38.033459 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:38.057070 16028 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:38.043395 20531 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:04:38.042060 20589 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.016710 20431 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:04:38.034945 15215 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:04:38.039891 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68585.2us
I20260709 13:04:38.090539 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:38.061703 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59882.8us
I20260709 13:04:38.046598 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:38.050845 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.047679 20393 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:38.113308 15395 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
W20260709 13:04:38.101408 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 83745.3us
I20260709 13:04:38.046080 20273 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:38.013985 20448 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:38.054847 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 64970us
I20260709 13:04:38.112123 15316 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:38.044991 20539 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:38.039855 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:38.114295 15999 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:38.116078 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 65338.9us
I20260709 13:04:38.127856 15320 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:38.071898 20255 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:38.131287 15363 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:38.131800 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:38.133883 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:38.134816 15250 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:38.056113 20429 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:38.138356 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:38.058265 20446 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:38.142851 15365 leader_election.cc:400] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:38.143312 15365 leader_election.cc:403] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:04:38.129567 20273 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.138983 15321 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:04:38.118052 15318 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:04:38.086197 19916 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.094149 20630 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:38.121680 16031 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:38.153764 15395 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:38.145740 15250 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:38.146093 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:38.128752 20573 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:04:38.141248 20604 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.530s	user 0.005s	sys 0.008s
I20260709 13:04:38.155167 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:38.116629 20393 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.115027 20668 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.157727 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2543) took 1097 ms. Trace:
I20260709 13:04:38.164809 20604 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:38.165577 20393 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:38.162053 19916 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.168515 19916 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:38.169094 20630 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:38.169629 20630 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:38.170463 20668 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.170579 20630 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.172086 20589 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:38.174096 15393 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:38.174750 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:38.177130 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:38.178957 15244 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:38.163923 15397 rpcz_store.cc:276] 0709 13:04:37.044214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.044521 (+   307us) service_pool.cc:224] Handling call
0709 13:04:38.141702 (+1097181us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54002b5a54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:38.141880 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043628928}
I20260709 13:04:38.159049 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.130429 20255 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:38.139178 20258 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:38.186687 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:38.156718 20448 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:38.057524 20700 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.126610 20558 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:04:38.187258 19916 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:38.190250 15399 pending_rounds.cc:85] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 6
I20260709 13:04:38.198311 15399 pending_rounds.cc:107] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:04:38.198665 15399 raft_consensus.cc:2889] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:38.057706 20541 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.192510 15242 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
W20260709 13:04:38.205938 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46995us
I20260709 13:04:38.187986 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:38.185457 20670 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:38.191812 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 77244.4us
I20260709 13:04:38.154124 20347 raft_consensus.cc:2764] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:04:38.188110 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 153252us
I20260709 13:04:38.214668 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.188417 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:38.163200 20547 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.203186 15316 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:38.215445 15245 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:38.215652 15321 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:38.162017 20539 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:38.190770 19990 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:38.154296 20528 raft_consensus.cc:2764] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:04:38.208717 15365 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.208973 15391 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:38.211221 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:38.211611 15249 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:38.212625 16028 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:38.242643 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:38.243686 20589 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:38.244234 20589 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:38.245072 20589 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.205446 20573 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:38.256536 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48048.1us
I20260709 13:04:38.204473 19916 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.259016 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:38.260310 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 128607us
I20260709 13:04:38.261123 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.262938 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.205279 20448 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:38.210647 20405 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:38.213541 20312 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:38.193964 20623 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.323125 15250 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:38.222716 20670 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:38.333581 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 118983us
I20260709 13:04:38.336516 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.337594 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:38.276787 19916 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:38.268353 20443 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:38.345662 15391 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:38.266867 20337 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:38.216445 20434 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:04:38.405454 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:38.329288 20676 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:38.325956 20604 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:38.322278 20712 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.429405 20728 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:38.429975 20728 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.429816 20712 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.430104 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.431444 20213 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:38.432045 20213 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:38.432183 20712 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:38.433034 20213 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.439316 20717 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:38.439869 20717 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.440268 20717 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:38.285425 20312 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.323534 20674 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:38.406936 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 70505.8us
I20260709 13:04:38.455519 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.453368 15390 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:38.286069 20662 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:38.281183 20573 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:38.412930 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 134729us
W20260709 13:04:38.415843 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 204351us
I20260709 13:04:38.418520 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:38.366184 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 87171.5us
I20260709 13:04:38.422324 15394 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:38.423682 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:38.430421 20728 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:38.225497 20547 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.226596 20429 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.175s
I20260709 13:04:38.463928 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:38.348145 20539 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:04:38.454576 20312 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:38.444032 20442 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:38.324326 20255 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.425190 20690 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:38.486078 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.466675 20531 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.509994 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.478024 20583 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:04:38.510015 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 80004.4us
I20260709 13:04:38.518860 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.491156 20443 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:04:38.526595 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.571142 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:38.573282 15396 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:38.452085 20713 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:04:38.576830 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 636) took 1106 ms. Trace:
I20260709 13:04:38.577268 15249 rpcz_store.cc:276] 0709 13:04:37.470199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.557039 (+ 86840us) service_pool.cc:224] Handling call
0709 13:04:38.576672 (+1019633us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b540010ca54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:38.576775 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408436096}
W20260709 13:04:38.580017 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58159.2us
I20260709 13:04:38.582604 15397 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:38.529181 20558 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:38.578616 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:38.587620 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 68869.7us
I20260709 13:04:38.481729 20448 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.605147 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.529547 20666 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:38.513046 20485 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:04:38.518348 20347 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:04:38.518512 20531 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.517699 20357 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:04:38.581477 20718 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 13:04:38.621949 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.606119 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.610791 20449 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:38.611661 20547 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:38.584030 20690 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:38.611511 20699 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:38.607697 15320 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:38.531586 20674 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:04:38.530586 20591 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:04:38.581128 20443 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:38.658376 20443 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:38.659142 20729 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:04:38.660408 20539 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:38.660976 20539 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:38.609288 20719 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
W20260709 13:04:38.650857 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44846.9us
I20260709 13:04:38.615223 20541 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:38.664144 20690 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:38.664610 20690 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:38.664502 20449 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:38.664935 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.666177 20449 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:38.667891 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:38.655022 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.655289 20573 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:38.655586 20703 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:38.649616 20697 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.687s	user 0.002s	sys 0.002s
I20260709 13:04:38.657202 20591 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:38.663077 20539 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:38.649384 20712 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:38.665549 20690 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.520457 20670 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:38.656040 20722 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:04:38.676693 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:38.678114 15999 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.802s (SENT)
I20260709 13:04:38.635070 20255 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.668665 16031 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 10: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:38.635504 20583 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:38.691447 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:38.693578 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 688) took 1594 ms. Trace:
I20260709 13:04:38.690495 20703 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.707937 15392 rpcz_store.cc:276] 0709 13:04:37.099603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.131297 (+ 31694us) service_pool.cc:224] Handling call
0709 13:04:37.158393 (+ 27096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.090497 (+932104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:38.090542 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:38.090600 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:38.090655 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.693304 (+602649us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b54001955d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:38.693352 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:38.693510 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142970624}
I20260709 13:04:38.697376 20531 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:38.641309 20393 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:38.703142 15996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.030s	sys 0.025s
I20260709 13:04:38.674118 19990 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:38.672670 20743 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:38.701642 20742 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:38.712368 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:38.713032 15996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.031s	sys 0.025s
I20260709 13:04:38.703874 20700 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:38.713786 16031 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:38.692016 20591 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:38.716033 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.693281 20712 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:38.725343 15398 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:04:38.720016 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:38.715044 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 87174.4us
I20260709 13:04:38.670787 20666 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:04:38.727586 15318 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:38.727705 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:38.729485 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.731894 20703 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:38.716219 20690 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:38.732921 16028 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:38.734632 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 2948) took 1943 ms. Trace:
I20260709 13:04:38.735018 15323 rpcz_store.cc:276] 0709 13:04:36.791733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.200269 (+408536us) service_pool.cc:224] Handling call
0709 13:04:37.224245 (+ 23976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:37.443588 (+219343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:37.443634 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:37.462120 (+ 18486us) log.cc:844] Serialized 26 byte log entry
0709 13:04:37.632429 (+170309us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:37.632474 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.632551 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:38.189053 (+556502us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:38.734320 (+545267us) raft_consensus.cc:1685] finished
0709 13:04:38.734342 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:38.734562 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":270738,"raft.queue_time_us":114718,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":2406144,"thread_start_us":254495,"threads_started":2,"wal-append.queue_time_us":215101}
I20260709 13:04:38.731909 20591 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.743860 20591 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:38.747355 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.747764 20393 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:38.748243 20703 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:38.718647 20742 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:38.750597 20742 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.722419 20429 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:38.755173 20717 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.757521 20717 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:38.758133 20583 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:38.759928 20699 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:38.760455 20429 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:38.761139 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.761435 20429 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.761970 20703 raft_consensus.cc:2764] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:04:38.742925 20740 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:04:38.766423 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:38.766215 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.765631 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:38.769918 15321 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:04:38.774780 15318 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:38.774921 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.772058 20666 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:38.729616 20700 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:38.780573 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:38.749662 20712 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.779672 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.777314 20741 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:38.774286 20393 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:38.758083 19916 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.794097 20703 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:38.787919 20717 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:04:38.810362 20668 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:38.810722 20703 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:38.811141 20717 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:38.811592 20717 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:38.811821 20703 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.812402 20717 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.813773 20717 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:38.790311 20665 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:04:38.795565 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.818432 20213 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:04:38.821424 20731 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 13:04:38.821614 16026 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:38.822886 15394 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:38.824048 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:38.824244 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:38.824739 16024 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:38.824967 16033 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:38.826206 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:38.800414 15248 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:04:38.826906 15248 pending_rounds.cc:85] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 8
I20260709 13:04:38.827162 15248 pending_rounds.cc:107] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:04:38.827400 15248 raft_consensus.cc:2889] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:38.827566 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:38.780215 20737 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:38.807191 20749 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:04:38.807715 20712 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:38.828989 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.831072 20258 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:38.831677 20258 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:38.832513 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:38.832726 20258 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.832990 20728 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.834009 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:38.834642 15390 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:38.835108 20728 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:38.779007 20666 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:38.836421 20666 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.837666 20666 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:38.838601 20657 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:38.839011 20657 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:38.839847 20657 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.840871 20657 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:38.841271 15249 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:38.835299 20623 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:38.831938 20744 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:38.824091 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:38.845676 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:38.808246 20393 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:38.848711 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.855113 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:38.850329 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:38.853904 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 60740.1us
W20260709 13:04:38.870420 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.870810 15249 raft_consensus.cc:2376] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14. Re-sending same reply.
I20260709 13:04:38.851505 15242 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:38.871888 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:38.846400 15245 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:38.853875 15363 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:38.845945 20713 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.883937 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:38.877043 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:38.877858 15317 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:38.888617 15390 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:38.889040 15243 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:04:38.884347 20686 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.470s	user 0.004s	sys 0.000s
I20260709 13:04:38.815909 19916 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:38.785782 20448 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.914716 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:38.915421 20448 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.917758 20448 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:38.900316 20742 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:38.918987 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:38.920313 20431 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.920864 20431 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.893908 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:38.922991 15321 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:38.925897 15317 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:38.894898 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.890297 15390 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:38.898077 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:38.930413 15249 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.898620 15320 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:38.899710 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:38.900381 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:38.932003 15242 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:38.901535 15241 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:04:38.902478 15247 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:38.903010 20539 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:38.884581 20442 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.884831 20690 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.905589 20393 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:38.846588 20746 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.906867 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:38.908886 15322 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
W20260709 13:04:38.948294 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53154.1us
I20260709 13:04:38.974047 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:38.960002 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:38.961541 15394 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:38.883841 20713 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:38.973838 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1827) took 1508 ms. Trace:
I20260709 13:04:38.893309 19990 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:38.979939 15248 rpcz_store.cc:276] 0709 13:04:37.465558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.567792 (+102234us) service_pool.cc:224] Handling call
0709 13:04:37.568106 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:38.827851 (+1259745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.973550 (+145699us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54003980d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:38.973770 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2833227008}
I20260709 13:04:38.924970 20742 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:38.978842 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:38.988890 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:38.990435 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:38.991245 15241 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:38.984118 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:38.950523 20539 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.996587 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:38.849807 20730 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.130s
I20260709 13:04:39.001793 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:39.008630 15244 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:39.005970 15249 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:39.011381 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:39.012115 15246 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
W20260709 13:04:39.014494 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 142663us
I20260709 13:04:38.949787 20623 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:04:38.998759 20703 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.963660 20558 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:04:38.892536 20312 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:39.007416 20539 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:38.998885 20665 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:38.977113 20442 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:39.053326 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 51647.2us
I20260709 13:04:39.060331 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:39.052904 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:38.980861 20690 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.056380 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:39.064886 15241 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:38.988948 20746 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.066587 19916 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:39.068171 20746 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:39.047022 19990 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:39.072475 20312 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:39.073315 15325 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:04:39.053158 20737 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:39.010883 20666 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:04:39.058609 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44528.8us
W20260709 13:04:39.047739 20686 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:39.061160 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:39.061161 15246 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:04:39.043817 20337 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:39.077080 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:39.054279 20573 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:39.048374 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:39.085666 15249 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:39.084233 20420 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:39.076586 20737 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:39.090840 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:39.093747 16024 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:39.098585 16025 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:39.094952 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:39.089933 20420 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:39.074717 19990 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.099604 15246 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:39.104193 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:39.104893 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:39.105201 15241 raft_consensus.cc:2410] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 18 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:04:39.106745 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:39.108436 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:39.082278 20429 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:39.084601 20541 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:39.113277 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:39.114363 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:39.116149 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:39.069351 20662 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:04:39.116766 15398 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:39.117913 15244 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:39.119100 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:39.063352 20665 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:39.057624 20703 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:39.121421 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:39.118999 15324 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:04:39.122689 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:39.123111 15321 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:39.124372 15394 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:39.140163 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:39.124527 15396 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:04:39.125114 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:39.124927 20420 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.116757 20741 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:04:39.100342 19990 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.100473 20737 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:39.126356 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:39.116284 20337 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:39.127827 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:39.128551 15244 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:04:39.146912 15320 raft_consensus.cc:2368] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15.
I20260709 13:04:39.119513 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:39.147601 15322 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:39.129603 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:39.130291 20548 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:39.132747 20442 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:39.134179 20690 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:39.149124 20548 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:39.141331 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 95317.4us
I20260709 13:04:39.154395 20548 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.155609 20548 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.142743 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:39.144258 20700 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:04:39.125725 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:39.160636 15399 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:39.138957 15392 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:39.140899 15396 pending_rounds.cc:85] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 7
I20260709 13:04:39.107388 20728 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:39.161720 15396 pending_rounds.cc:107] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:04:39.162051 15396 raft_consensus.cc:2889] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:39.162145 20312 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:39.168371 20737 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.150516 20420 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:39.150906 20753 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:04:39.151265 20730 raft_consensus.cc:2764] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:04:39.129555 20756 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:04:39.172857 15321 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:39.144811 20347 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:39.179210 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:39.186513 20312 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:39.146484 20337 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:39.188550 20337 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.189815 20337 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:39.194592 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:39.200042 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:39.194612 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:39.216832 15398 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:39.190601 20347 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.227813 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:39.229403 15395 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:04:39.231977 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.218865 20442 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:39.208338 20670 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:39.223306 20741 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:04:39.250888 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:39.242439 16024 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:39.222939 20431 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:39.221484 20312 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:39.229120 20347 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.223491 20531 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:04:39.252774 20312 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:39.259462 20312 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.246629 20668 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:04:39.261270 20737 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:39.222296 20541 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:04:39.247495 20442 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.299135 20442 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:39.287041 20357 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:39.302520 20357 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:39.303423 20357 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.304705 20357 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:39.306354 20604 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:39.306810 20604 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:39.307637 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.308140 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:39.312775 20703 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:39.314162 20665 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:39.323786 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:39.331748 15249 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:39.333282 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:39.335986 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:39.336983 16032 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:39.339803 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:39.292701 20700 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.307643 20604 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:39.343675 20604 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.330605 20744 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:39.344743 20700 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:39.345518 20712 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.005s
I20260709 13:04:39.251837 20713 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:39.259491 20528 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:04:39.346429 20312 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.255235 20670 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:39.348994 20312 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:39.349176 20670 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:39.328861 20690 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:04:39.351437 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:39.352088 15250 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:39.354404 20591 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:39.356351 20591 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:39.357465 20531 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:39.357892 20531 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.358264 20531 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.358636 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:39.359508 20690 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:39.359925 20690 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:39.360294 20690 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:39.330688 20541 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.386713 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:39.389199 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:39.396914 15322 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
W20260709 13:04:39.379166 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 127633us
I20260709 13:04:39.399303 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:39.400583 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:39.390112 15323 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:39.403971 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:39.404848 15250 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
W20260709 13:04:39.405277 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.406951 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:39.407660 15317 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:39.408780 15317 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:39.412972 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:39.414000 20732 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.414513 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:39.415819 20662 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:39.415877 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:39.414528 20732 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:39.418304 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:39.419628 20732 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:39.410073 15317 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:39.420841 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:39.425328 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:39.426828 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:39.426580 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:39.428069 15250 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:39.429612 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:39.430672 15250 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:39.431494 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:39.376171 15365 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:39.435077 15398 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:39.435094 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:39.436041 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:39.436631 15245 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:39.437928 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58742.4us
I20260709 13:04:39.358287 20744 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:39.441210 15250 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:39.464442 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:39.465541 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.461181 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:39.471642 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:39.472546 15398 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:39.497419 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:39.500952 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 69591.7us
I20260709 13:04:39.374640 20312 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:04:39.469376 20662 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:04:39.435490 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 59416.9us
I20260709 13:04:39.465660 20431 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.437577 20443 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:39.444458 20732 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:39.511917 15245 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:39.402750 20717 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:04:39.434399 20712 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:04:39.470031 20676 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:39.434034 20347 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.515554 19990 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.513412 20662 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.421634 20541 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.561939 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:39.525977 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:39.563294 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:39.612470 15316 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:04:39.617987 15248 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:04:39.505029 20558 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:04:39.560020 20443 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:39.496701 20728 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.499059 20573 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:39.544211 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:39.547768 15319 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:39.554322 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:39.554268 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 213306us
I20260709 13:04:39.499553 20670 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:04:39.575601 15393 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:39.571727 20662 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.599282 19990 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:39.606416 20744 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:39.609473 20755 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.525s	user 0.002s	sys 0.000s
I20260709 13:04:39.609323 20531 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:39.496140 20539 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:39.510892 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:39.805881 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 295044us
I20260709 13:04:39.631943 15249 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
W20260709 13:04:39.665333 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.558058 20700 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:39.677652 15324 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:39.686269 20693 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:39.686412 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 160532us
I20260709 13:04:39.566697 20676 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:39.532603 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:39.818944 15362 leader_election.cc:400] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15.
I20260709 13:04:39.830616 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:39.842583 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 449483us
I20260709 13:04:39.869112 15391 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:39.689694 20448 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.148s
I20260709 13:04:39.826957 20573 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:39.674398 20443 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.536661 20431 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:39.692857 20728 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:39.867671 20657 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:39.917411 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 845) took 1206 ms. Trace:
I20260709 13:04:39.843019 20623 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:04:39.871582 19990 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:39.917972 16028 rpcz_store.cc:276] 0709 13:04:38.710888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.711014 (+   126us) service_pool.cc:224] Handling call
0709 13:04:39.917134 (+1206120us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b540041d2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:39.917289 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15186304}
I20260709 13:04:39.866135 20665 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:04:39.886785 20700 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:39.945511 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:39.964402 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 80929.8us
W20260709 13:04:39.969172 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 127488us
I20260709 13:04:39.976523 16025 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:39.982724 16031 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:04:39.971393 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:39.985922 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:39.986817 16033 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:39.996124 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:39.996611 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:39.943231 20347 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:40.004483 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:40.007704 20558 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
W20260709 13:04:40.011842 20772 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:04:40.011857 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.975878 20746 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:40.042371 15248 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:39.992553 20573 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.051324 15248 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:40.050704 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 703) took 1842 ms. Trace:
I20260709 13:04:40.056835 15325 rpcz_store.cc:276] 0709 13:04:38.208396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.208521 (+   125us) service_pool.cc:224] Handling call
0709 13:04:38.219322 (+ 10801us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:39.073756 (+854434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.047134 (+973378us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b540016dd54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:40.050640 (+  3506us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963372928}
I20260709 13:04:40.065150 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:40.018122 20670 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:40.063203 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:39.986481 20700 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:40.085218 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 92021.3us
I20260709 13:04:40.047291 20706 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:40.002452 20448 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:04:40.062346 20405 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:40.097190 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2645) took 1143 ms. Trace:
I20260709 13:04:40.075907 20670 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:40.058521 20746 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:40.098966 20762 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.564s	user 0.001s	sys 0.000s
I20260709 13:04:40.124666 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:40.127203 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 130838us
W20260709 13:04:40.127480 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 156228us
I20260709 13:04:40.118463 15246 rpcz_store.cc:276] 0709 13:04:38.954219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.118264 (+164045us) service_pool.cc:224] Handling call
0709 13:04:39.118593 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:39.146294 (+ 27701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:39.146328 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:39.154198 (+  7870us) log.cc:844] Serialized 26 byte log entry
0709 13:04:39.542668 (+388470us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:39.542729 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.542854 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:40.096987 (+554133us) raft_consensus.cc:1685] finished
0709 13:04:40.097008 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:40.097130 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23171,"raft.queue_time_us":27223,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":14021,"thread_start_us":388038,"threads_started":1,"wal-append.queue_time_us":940893}
I20260709 13:04:40.130028 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:40.115724 20541 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:40.128921 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:40.001423 20676 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.063421 20573 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.097349 20783 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:40.119690 20431 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:40.122453 20531 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:40.119606 20405 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:40.098821 20706 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.142206 20405 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:40.143478 20442 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.000s
I20260709 13:04:40.143937 20706 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:40.143903 20442 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.144871 20778 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:40.146588 20768 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:40.147032 20768 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:40.149967 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:40.157213 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:40.167688 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2582) took 1003 ms. Trace:
W20260709 13:04:40.170747 15396 consensus_meta.cc:287] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.004s
I20260709 13:04:40.170902 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:40.171161 15390 rpcz_store.cc:276] 0709 13:04:39.164683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.164841 (+   158us) service_pool.cc:224] Handling call
0709 13:04:39.165283 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:39.165781 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:39.165825 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:39.166481 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:04:39.329162 (+162681us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:39.329203 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.329270 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:40.098370 (+769100us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:40.167447 (+ 69077us) raft_consensus.cc:1685] finished
0709 13:04:40.167465 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:40.167627 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1407,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":19676928,"thread_start_us":162187,"threads_started":1,"wal-append.queue_time_us":271532}
I20260709 13:04:40.172647 15396 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:40.168927 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:40.175447 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:40.191134 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:40.192374 15390 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:40.151397 20769 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:04:40.195182 20443 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:40.195870 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:40.140528 20539 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:40.147405 20768 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:40.150938 20767 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:04:40.164064 20541 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:40.150518 20442 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:40.208076 15390 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:40.141794 20783 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:40.155793 20431 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:40.188136 20393 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:40.221218 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2583) took 1006 ms. Trace:
W20260709 13:04:40.268433 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65722.4us
I20260709 13:04:40.168779 20778 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:04:40.221854 15392 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:40.151089 20623 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:04:40.234855 20790 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:40.240152 20485 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:40.207381 20541 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.246165 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:40.250349 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:40.268215 15394 rpcz_store.cc:276] 0709 13:04:39.214588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.214784 (+   196us) service_pool.cc:224] Handling call
0709 13:04:39.215225 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:39.232998 (+ 17773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:39.233046 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:39.243341 (+ 10295us) log.cc:844] Serialized 26 byte log entry
0709 13:04:39.674955 (+431614us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:39.675048 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.675181 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:40.220992 (+545811us) raft_consensus.cc:1685] finished
0709 13:04:40.221015 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:40.221154 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3772,"raft.queue_time_us":22095,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4708,"thread_start_us":365400,"threads_started":1,"wal-append.queue_time_us":670452}
I20260709 13:04:40.255553 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:40.167950 20728 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:40.258138 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:40.138396 20788 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:04:40.279449 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:40.280714 15322 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:40.263445 20258 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:40.234527 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 832349us
W20260709 13:04:40.264498 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.150837 20531 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 13:04:40.155565 20405 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.156653 20794 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:04:40.201676 20795 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:40.292152 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:40.243225 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 694) took 1056 ms. Trace:
I20260709 13:04:40.264696 20783 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:40.277371 15323 raft_consensus.cc:2376] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15. Re-sending same reply.
I20260709 13:04:40.296814 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:40.293777 15391 rpcz_store.cc:276] 0709 13:04:39.187278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.192912 (+  5634us) service_pool.cc:224] Handling call
0709 13:04:40.242893 (+1049981us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54002b5a54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:40.243130 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472896768}
I20260709 13:04:40.263875 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:40.278090 15325 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:40.286804 15291 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:40.299345 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:40.301093 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:40.276943 20485 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:40.262164 20690 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.901s	user 0.006s	sys 0.006s
I20260709 13:04:40.278513 20541 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:40.191138 20670 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.304822 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:40.203485 20746 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.284535 20700 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:40.286201 20258 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:40.309667 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:40.304615 19990 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:40.318666 19990 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:40.317895 20795 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:40.307955 20788 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:40.319602 19990 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.328064 20405 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:40.302714 20312 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:40.312410 20690 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.313062 20728 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:40.320603 20258 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:40.278188 20790 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.354717 15323 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:40.346766 20690 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:40.321344 20795 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.321600 20788 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:40.359547 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 58469.3us
I20260709 13:04:40.353591 20485 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.363061 20485 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:40.363260 15323 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:04:40.370900 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:40.358429 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 54796.4us
I20260709 13:04:40.376654 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:40.377507 20676 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:40.371193 20795 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:40.388681 20573 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:40.393173 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:40.384234 20676 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:40.394529 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:40.395453 20676 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.396095 20800 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:40.396693 20800 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.397264 20258 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.389441 20312 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:40.398753 20312 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.401014 20312 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:40.373930 20801 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:40.402055 20788 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.403430 20788 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:40.387629 20790 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:40.409929 20662 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 13:04:40.410458 20662 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.413235 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:40.418028 15395 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:04:40.420054 15390 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:04:40.421751 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.421677 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:40.422423 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.427241 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:40.428932 15390 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:40.438408 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:40.439570 15394 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:40.415201 20393 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:40.443082 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:40.417183 20528 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:04:40.448889 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:40.448647 20573 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:40.429090 20713 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.450515 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:40.451339 15390 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:40.442205 20547 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:40.450017 20573 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:40.456976 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:40.457125 20573 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:40.458420 20573 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.429121 20312 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:40.436473 20337 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.434130 20786 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:40.467834 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.435702 20717 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.469885 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:40.465170 20547 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:40.455972 20531 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.512408 15213 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:40.460156 20573 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:40.470613 20258 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:40.473553 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:40.441591 20803 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
W20260709 13:04:40.519423 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 85252.6us
I20260709 13:04:40.454860 20393 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:40.528652 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.462888 20713 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.517485 20539 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.530403 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:40.532265 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:40.532557 15245 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:40.531046 15244 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:40.533253 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:40.531646 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:40.531205 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:40.534305 15243 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:40.521126 20347 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:40.538321 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1882) took 1152 ms. Trace:
I20260709 13:04:40.538537 15250 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:40.538559 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:40.538772 15316 rpcz_store.cc:276] 0709 13:04:39.385658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.385905 (+   247us) service_pool.cc:224] Handling call
0709 13:04:39.403052 (+ 17147us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:39.640841 (+237789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.538045 (+897204us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001e50d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:40.538256 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480937728}
I20260709 13:04:40.506199 20312 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.521723 20790 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:40.719406 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:40.534322 15246 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
W20260709 13:04:40.669476 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.506353 20337 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.738014 20337 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:40.517737 20485 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:04:40.757874 20485 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:40.758458 20485 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:40.759454 20485 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.762080 20662 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:40.763854 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:40.764722 15241 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:04:40.508044 20783 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.511329 20717 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.523762 20676 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:40.506057 20786 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.524431 20800 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:40.517074 20531 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.815029 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:40.822961 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2586) took 1306 ms. Trace:
W20260709 13:04:40.830386 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.832268 15320 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:40.717535 20347 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.849712 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:40.851218 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:40.846083 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:40.841817 15395 rpcz_store.cc:276] 0709 13:04:39.516685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.598115 (+ 81430us) service_pool.cc:224] Handling call
0709 13:04:39.598482 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:40.418476 (+819994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.822564 (+404088us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54001540d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:40.822867 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884211456}
I20260709 13:04:40.963387 16026 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:04:40.858156 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:40.964493 15244 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:40.871673 15245 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:04:40.965683 15245 pending_rounds.cc:85] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 7
I20260709 13:04:40.826035 20665 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.718319 20539 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.987417 20539 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:40.865869 20623 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.988232 20623 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:40.879848 20807 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.347s	user 0.000s	sys 0.000s
W20260709 13:04:40.880760 20809 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.409s	user 0.001s	sys 0.000s
I20260709 13:04:40.884380 20393 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:40.888036 20713 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.031500 20357 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.823992 20547 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.890616 20312 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:40.893471 20806 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.376s	user 0.000s	sys 0.001s
I20260709 13:04:40.895236 20783 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:40.532433 20768 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:40.834863 20676 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:40.866809 20405 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:40.915944 20796 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:40.916074 20717 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:40.916703 20425 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:40.853543 20347 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:40.950531 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:40.836285 20662 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:04:40.952142 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:40.955726 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:41.007316 20810 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.961489 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:40.966034 15245 pending_rounds.cc:107] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:04:41.082624 15245 raft_consensus.cc:2889] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:40.959875 20531 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.007596 20712 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:40.980610 20814 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:40.981845 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.087391 16028 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:40.982443 16024 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:41.055534 20623 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:40.991657 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.994535 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.092772 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:41.093674 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.049s	sys 0.088s
W20260709 13:04:41.094023 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.049s	sys 0.088s
I20260709 13:04:41.023319 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:41.052286 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.095153 15392 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:41.054464 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:41.059301 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.032115 20357 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:41.094390 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 567863us
I20260709 13:04:41.062645 20405 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:41.081128 20393 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:41.094682 20794 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.002s	sys 0.017s
W20260709 13:04:41.074548 15393 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.000s	sys 0.015s
W20260709 13:04:41.124670 15393 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.000s	sys 0.016s
W20260709 13:04:41.079834 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 129401us
I20260709 13:04:40.957090 20786 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.083643 16033 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:41.077368 20425 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:41.083151 20312 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:41.138051 20312 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.140448 20312 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:40.984225 20665 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:41.089236 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.997740 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.143390 15394 raft_consensus.cc:2410] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:41.143460 20665 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.145426 20528 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:41.094410 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:41.092730 20814 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.148814 20814 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.062937 20796 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:41.150164 20796 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.151043 20786 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:41.151517 20796 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:41.153432 20541 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.840s	user 0.010s	sys 0.000s
W20260709 13:04:41.065410 15243 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 13:04:41.096438 15399 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
W20260709 13:04:41.154254 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:41.099879 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45552.5us
W20260709 13:04:41.101236 15290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.065s	sys 0.160s
W20260709 13:04:41.159860 15290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.065s	sys 0.160s
I20260709 13:04:41.160416 20690 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:04:41.066596 20801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.087s	sys 0.191s
W20260709 13:04:41.161336 20801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.087s	sys 0.192s
W20260709 13:04:41.069415 20262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.001s	sys 0.014s
W20260709 13:04:41.162616 20262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.001s	sys 0.019s
I20260709 13:04:41.163416 20700 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:41.106534 20405 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:41.164947 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.165555 16033 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:41.098203 20717 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:41.111681 20623 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:41.166813 20623 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.167265 20623 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:41.167541 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2646) took 2199 ms. Trace:
I20260709 13:04:41.169090 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:41.111414 20703 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.170981 20703 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:41.135529 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.173197 20703 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.173610 20662 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:41.174207 20662 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.175153 20255 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:41.175706 20255 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:41.075165 15319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.007s
W20260709 13:04:41.177340 15319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.007s
I20260709 13:04:41.177778 20255 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.167984 15242 rpcz_store.cc:276] 0709 13:04:38.968446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.126691 (+158245us) service_pool.cc:224] Handling call
0709 13:04:39.324756 (+198065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:39.326994 (+  2238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:39.327025 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:39.329426 (+  2401us) log.cc:844] Serialized 26 byte log entry
0709 13:04:39.799665 (+470239us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:39.799706 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.799786 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:40.195907 (+396121us) raft_consensus.cc:1685] finished
0709 13:04:40.195928 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.167268 (+971340us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400315950. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:41.167481 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1853,"raft.queue_time_us":3789,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4747,"spinlock_wait_cycles":454682496,"thread_start_us":443439,"threads_started":1,"wal-append.queue_time_us":636063}
I20260709 13:04:41.178745 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:41.179252 20531 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.179780 20531 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.182890 20531 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:41.120014 20794 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.003s	sys 0.018s
I20260709 13:04:41.184358 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.186486 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.091310 20712 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:41.134869 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 316646us
I20260709 13:04:41.136950 20425 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.093091 15390 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
W20260709 13:04:41.159346 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65046.7us
I20260709 13:04:41.162299 20429 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:41.163656 20732 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:41.171196 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:41.154007 15243 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:41.085777 20810 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.135723 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:41.067240 15291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.006s	sys 0.008s
W20260709 13:04:41.212795 15291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.007s	sys 0.008s
I20260709 13:04:41.199725 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.200094 20662 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:41.200903 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:41.204449 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.199726 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.209316 15247 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 18 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:41.246622 15242 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:41.214574 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:41.216665 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 81013.4us
I20260709 13:04:41.217536 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.248973 15399 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:41.213223 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 740991us
I20260709 13:04:41.216406 20425 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:41.231122 20817 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.202749 19990 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:41.153931 20541 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.219755 20732 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:41.244429 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.215593 20700 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.207857 20312 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:04:41.214524 15397 raft_consensus.cc:2410] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:04:41.250607 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:41.251931 16032 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:41.256134 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:41.212107 20531 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:04:41.297199 16033 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:41.294693 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:41.281908 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:41.291188 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:41.299365 15318 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:41.299916 15247 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
W20260709 13:04:41.273355 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.281641 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:41.250870 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:41.269774 15244 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:41.244551 20814 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:41.295353 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:41.308983 15325 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
W20260709 13:04:41.272161 20788 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.868s	user 0.008s	sys 0.005s
I20260709 13:04:41.247025 20255 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.293151 15394 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:41.302587 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:41.307861 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 51812.9us
I20260709 13:04:41.259254 20258 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:41.277951 20824 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.202s	user 0.003s	sys 0.000s
I20260709 13:04:41.315794 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:41.315799 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:41.334100 15317 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:41.278872 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:41.245536 20799 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.953s	user 0.002s	sys 0.017s
I20260709 13:04:41.256368 20825 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:41.318127 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.318149 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.335889 20825 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.321514 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:41.305013 15396 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 14. Ops: []
I20260709 13:04:41.322409 20393 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:41.339147 20393 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.339756 20393 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:41.247483 20539 consensus_queue.cc:1175] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "edcf4a6bae7e4781bce325a586109ca5" responder_term: 15 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [14.12-14.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:41.344460 20810 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.345371 20810 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:41.332962 20255 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.348801 20255 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:41.292891 20732 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.303534 20700 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.350569 20676 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.318540 20803 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:41.352675 20803 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:41.353211 20803 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:41.354358 20831 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:41.354853 20831 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:41.355767 20831 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.356971 20405 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.319003 20786 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:41.332427 16025 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:04:41.358942 16025 pending_rounds.cc:85] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 11
I20260709 13:04:41.359184 16025 pending_rounds.cc:107] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:04:41.359412 16025 raft_consensus.cc:2889] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:41.319223 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:41.325544 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.358511 20703 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:41.292136 20431 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.352195 20700 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.316416 20662 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:41.365130 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:41.383875 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 62497.6us
I20260709 13:04:41.385020 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:41.387415 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:41.350606 20312 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:04:41.364269 20767 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:04:41.357007 20831 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:41.344561 20357 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.401994 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:41.389804 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 54023.5us
I20260709 13:04:41.259618 20817 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.349953 20347 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.319075 20728 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:04:41.388985 20665 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.396790 20739 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:41.412256 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 195379us
I20260709 13:04:41.396087 19990 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:41.399672 20825 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.396265 20558 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:41.434058 20558 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.437408 20558 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.366633 20703 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.428318 20668 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.438606 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.438483 20668 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.439580 20703 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.440723 20668 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:41.432627 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.440835 20717 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:41.441658 16032 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:41.449486 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:41.392721 20662 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:41.450871 20357 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:41.451301 20357 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.451711 20357 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:41.392033 20312 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:41.453472 20665 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:41.454339 15249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2650) took 2127 ms (client timeout 1801 ms). Trace:
W20260709 13:04:41.454754 15249 rpcz_store.cc:269] 0709 13:04:39.326708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.332988 (+  6280us) service_pool.cc:224] Handling call
0709 13:04:41.454077 (+2121089us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400315454. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:41.454204 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684920064}
I20260709 13:04:41.459666 20541 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.460870 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:41.464533 20405 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:41.464757 20357 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.466715 20347 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.467427 20357 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.469710 20717 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:41.470871 20817 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.471658 15397 raft_consensus.cc:2410] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:04:41.472916 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:41.474151 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:41.396057 20700 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:41.376170 20431 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.477828 20431 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.409452 20712 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.479314 20347 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:41.479861 20706 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:41.479924 20347 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.480520 20706 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.480651 20347 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:41.481006 20706 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:41.483394 20573 consensus_meta.cc:287] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.959s	user 0.008s	sys 0.004s
I20260709 13:04:41.484259 20739 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:41.485054 15399 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:41.395601 20820 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:04:41.489260 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3023) took 1442 ms. Trace:
I20260709 13:04:41.466135 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:41.492617 16032 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:04:41.497871 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 174296us
I20260709 13:04:41.484148 20837 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:41.504740 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:41.489645 15396 rpcz_store.cc:276] 0709 13:04:40.046749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.192540 (+145791us) service_pool.cc:224] Handling call
0709 13:04:40.198971 (+  6431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.338762 (+1139791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.489013 (+150251us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400195fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:41.489198 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2543176576}
I20260709 13:04:41.508181 15390 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:04:41.518923 15390 pending_rounds.cc:85] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 11
I20260709 13:04:41.519349 15390 pending_rounds.cc:107] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:04:41.519730 15390 raft_consensus.cc:2889] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:41.521273 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.524194 15363 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:41.464540 20670 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:41.502051 20573 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.451882 20662 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.529891 20816 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.534241 20844 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.534479 20665 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.534926 20712 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:41.535964 20717 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:41.535727 20837 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.538067 20690 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:41.570025 20803 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.575485 20690 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.577251 20803 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.529935 20357 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:41.578655 20357 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:41.579342 20726 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:04:41.579200 20712 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.539095 15245 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:04:41.538975 20347 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.540172 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:41.563053 20795 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.148s	user 0.000s	sys 0.012s
I20260709 13:04:41.523722 20732 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.550541 20623 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.554129 15390 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:41.523308 20541 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:41.564673 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.598430 20541 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.601271 20541 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:41.603268 15392 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 13:04:41.603542 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.605449 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.565012 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.607385 15396 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:41.608470 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.609202 15396 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:41.620669 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 859) took 1230 ms. Trace:
I20260709 13:04:41.621272 16028 rpcz_store.cc:276] 0709 13:04:40.390565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.390769 (+   204us) service_pool.cc:224] Handling call
0709 13:04:40.391088 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.087862 (+696774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.620329 (+532467us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540065e354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:41.620586 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1600925568}
W20260709 13:04:41.623270 15320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1884) took 2235 ms (client timeout 1948 ms). Trace:
W20260709 13:04:41.623837 15320 rpcz_store.cc:269] 0709 13:04:39.388251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.388418 (+   167us) service_pool.cc:224] Handling call
0709 13:04:41.622968 (+2234550us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54001e64d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:41.623132 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3139712256}
I20260709 13:04:41.626031 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:41.626799 15391 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:41.630638 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.631517 16030 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:04:41.633219 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.636642 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.582921 20717 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.637378 15399 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:41.638669 15998 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:41.530305 20448 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:04:41.528403 20558 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:41.528923 20794 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.547253 20786 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.587265 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:41.664872 15398 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:41.587289 20425 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:41.572067 20816 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.661556 20558 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:41.668792 20558 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:41.588461 20712 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.669323 20786 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.670698 15247 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:04:41.588830 20347 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.588984 20357 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.590119 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:41.592530 15241 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.014s	sys 0.026s
W20260709 13:04:41.724653 15241 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.017s	sys 0.027s
I20260709 13:04:41.572916 20844 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.596161 20623 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:41.597502 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.643162 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:41.545743 20393 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:41.730257 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 206135us
I20260709 13:04:41.648288 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.736285 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.650717 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:41.638128 20732 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:41.655117 20831 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:41.655755 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:41.485038 20739 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.569307 20810 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:41.659353 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:41.660727 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.577832 20690 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.666409 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:41.581732 20431 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:41.716468 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.563133 20573 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:41.697222 20840 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:04:41.729894 15390 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:41.746743 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:41.749861 20821 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.681s	user 0.002s	sys 0.000s
I20260709 13:04:41.762220 15398 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:41.766347 15391 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:41.766573 15244 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:41.766765 15249 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:41.767547 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.785317 15250 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:41.792222 15245 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:41.793637 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:41.794420 15245 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:41.793869 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:41.795482 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:41.799650 15245 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:41.642002 20795 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:41.802044 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.799475 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:41.757593 20831 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:41.803097 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.816749 15245 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:04:41.843245 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:41.845745 15245 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:41.806658 15392 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:41.847285 15398 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:41.848130 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:41.804921 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.670501 20794 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.755555 20803 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:41.786044 20790 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:41.858026 15249 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:41.861855 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:41.866205 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:41.905768 15319 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:41.907032 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:41.860559 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48931.5us
W20260709 13:04:41.912076 15362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.948s (SENT) [suppressed 9 similar messages]
W20260709 13:04:41.913278 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.914789 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:41.915809 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:41.916419 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 73280.6us
I20260709 13:04:41.841444 20831 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:41.920258 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:41.921826 15317 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:41.917241 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:41.807704 20541 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:41.913713 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:41.925287 15215 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:41.848297 20817 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:41.786128 20431 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.927702 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:41.858857 20623 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:41.917544 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:41.932191 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:41.806836 20825 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:04:41.914103 20814 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.863018 20420 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:41.904448 20717 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.948078 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1861) took 1172 ms. Trace:
I20260709 13:04:41.948628 15241 rpcz_store.cc:276] 0709 13:04:40.775992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.817802 (+ 41810us) service_pool.cc:224] Handling call
0709 13:04:40.855135 (+ 37333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:40.855430 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:41.725194 (+869764us) log.cc:844] Serialized 14 byte log entry
0709 13:04:41.947689 (+222495us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:41.947758 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:41.947822 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.947885 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.948021 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":466963,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"thread_start_us":1091449,"threads_started":2}
W20260709 13:04:41.972282 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 124232us
I20260709 13:04:41.934692 20790 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.852209 20728 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:04:41.924336 20849 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:41.913944 20425 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:04:41.939283 20548 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:41.939560 20816 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.943171 20837 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:41.937994 20623 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:41.971529 20668 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:41.918277 20803 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.017671 15320 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
W20260709 13:04:42.005180 20846 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:04:42.063738 20794 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:42.022464 20861 raft_consensus.cc:2764] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:04:42.018369 20786 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:41.983816 20856 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:42.069231 20573 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:42.026479 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.076918 15318 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:41.940512 20817 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:41.991039 20717 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:42.042953 20795 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:42.029680 20623 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.045455 20431 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:41.971724 20814 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:42.049604 20845 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260709 13:04:41.985913 20849 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:42.059341 20844 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:42.082337 16032 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.589s	user 0.016s	sys 0.000s
I20260709 13:04:42.139796 16032 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:42.088714 15317 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:41.975994 20420 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.076236 20732 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:42.119441 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 253290us
W20260709 13:04:42.120532 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 147534us
I20260709 13:04:41.987162 20790 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.151014 20790 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.105552 20717 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:42.039263 20548 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:42.153466 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 236285us
I20260709 13:04:42.153985 15213 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:42.157033 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 245005us
W20260709 13:04:42.157039 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 239596us
W20260709 13:04:42.163633 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 238394us
I20260709 13:04:42.139163 20849 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.142356 20393 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:42.165375 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:42.165686 16033 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:42.168023 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:42.168219 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:42.169054 16032 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:04:42.157382 20717 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.156803 20548 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:42.165339 20739 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.173887 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.164537 20347 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:42.180052 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.180845 15317 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:42.185703 20803 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:42.169741 20861 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:42.187166 20861 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.187541 20861 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:42.179291 20347 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.194866 20347 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.173734 20816 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:42.199208 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 708) took 2004 ms. Trace:
I20260709 13:04:42.199679 15393 rpcz_store.cc:276] 0709 13:04:40.194951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.246107 (+ 51156us) service_pool.cc:224] Handling call
0709 13:04:40.246569 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:40.293184 (+ 46615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.293216 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:40.300332 (+  7116us) log.cc:844] Serialized 26 byte log entry
0709 13:04:40.361351 (+ 61019us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:41.126370 (+765019us) log.cc:844] Serialized 14 byte log entry
0709 13:04:41.132840 (+  6470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.198778 (+1065938us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b54000c0154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:42.198846 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:42.198907 (+    61us) raft_consensus.cc:1685] finished
0709 13:04:42.198993 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.199147 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67626,"prepare.queue_time_us":559180,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":8391,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":18589,"spinlock_wait_cycles":106323200,"thread_start_us":756331,"threads_started":2,"wal-append.queue_time_us":114749}
I20260709 13:04:42.182559 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:42.207628 20768 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:42.208613 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:42.199265 20798 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.889s	user 0.002s	sys 0.010s
I20260709 13:04:42.212301 20420 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.213186 20843 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:42.213276 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1893) took 2148 ms. Trace:
I20260709 13:04:42.213730 20843 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:42.214857 20558 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.545s	user 0.014s	sys 0.000s
I20260709 13:04:42.214699 20843 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.215368 20558 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.219561 20668 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.220544 20668 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.213866 15324 rpcz_store.cc:276] 0709 13:04:40.065318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.069462 (+  4144us) service_pool.cc:224] Handling call
0709 13:04:40.069810 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:40.070195 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.070240 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:40.070841 (+   601us) log.cc:844] Serialized 52 byte log entry
0709 13:04:40.264335 (+193494us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:40.277996 (+ 13661us) log.cc:844] Serialized 14 byte log entry
0709 13:04:40.283130 (+  5134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.283206 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:40.535197 (+251991us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b180042aba0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:42.198673 (+1663476us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:42.213004 (+ 14331us) raft_consensus.cc:1685] finished
0709 13:04:42.213029 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.213186 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14958,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":2780,"raft.queue_time_us":5288,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":5288,"spinlock_wait_cycles":36964608,"thread_start_us":144336,"threads_started":1,"wal-append.queue_time_us":221928}
I20260709 13:04:42.217926 20558 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:42.226476 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44028.9us
I20260709 13:04:42.226440 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:42.232887 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:42.233261 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:42.234292 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:42.234584 15246 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:42.236526 15247 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:42.238070 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.249423 20312 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.252172 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:42.254882 15247 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:42.208454 20816 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:42.262635 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:42.264559 20818 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:42.264484 20801 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:04:42.266170 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.267099 15246 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:42.271792 20485 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:42.282559 20312 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:42.330534 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:42.277437 20347 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.334844 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.338130 15323 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:42.263041 20803 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:42.339979 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:42.327812 20262 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:42.283824 20816 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:42.254328 20853 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:04:42.300153 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.239017 20583 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:42.349797 20690 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:42.359411 20583 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.359642 20690 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.360098 20583 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:42.335582 20790 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:04:42.337265 20706 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.856s	user 0.005s	sys 0.011s
I20260709 13:04:42.257081 20843 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:42.342566 20803 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:42.341380 20789 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.449s	user 0.028s	sys 0.039s
I20260709 13:04:42.342216 20668 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:42.371084 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.376428 20844 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:42.377177 20844 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.380033 20844 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:42.381812 20670 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.820s	user 0.011s	sys 0.005s
I20260709 13:04:42.383205 20746 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:42.383723 20829 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.118s	user 0.003s	sys 0.000s
I20260709 13:04:42.349625 20420 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:42.386937 20420 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.386564 20861 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.387367 20420 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:42.389063 20861 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:42.389849 20814 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.344692 20817 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.352581 20262 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.396667 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.398463 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:42.399300 15317 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:42.402292 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 71855.5us
W20260709 13:04:42.391957 20789 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.499s	user 0.028s	sys 0.040s
I20260709 13:04:42.414354 15317 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:42.412931 20763 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.366762 20790 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:42.369827 20803 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:42.407815 20262 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.418798 20763 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.442421 20871 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:42.443370 20871 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:42.443986 20693 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.444550 20693 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.444641 20871 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.369956 20706 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.448093 20690 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:42.453564 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.456287 20623 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.458750 20790 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.460446 20790 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:42.468080 20856 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:42.478335 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:04:42.476339 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 327837us
I20260709 13:04:42.470117 20870 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:42.473158 20713 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.489926 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:42.482620 20831 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 13:04:42.516774 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:42.517822 16033 raft_consensus.cc:2410] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:04:42.533053 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:42.478801 20795 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:42.533922 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:42.534646 15323 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.536180 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:42.536830 15319 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:04:42.536840 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.474022 20670 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:04:42.508212 20869 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:42.472230 20717 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.512883 20547 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:42.542546 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 59907.2us
I20260709 13:04:42.550491 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:42.542914 20732 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:42.518826 20558 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.519868 20810 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:42.560818 15319 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:42.567821 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.568868 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.568011 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:42.570111 15394 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:42.572387 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.572957 15394 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:42.574626 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.541184 20668 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:42.575304 15392 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:42.552595 20662 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:04:42.578140 20442 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:42.588117 20442 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.570077 20558 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.590030 20420 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.519690 20713 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.592581 20668 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.577425 20810 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:42.595021 20668 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:42.595633 20881 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:42.596520 20420 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.549690 20541 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:42.598577 20541 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.562376 20547 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.595515 20604 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.603440 20604 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.580081 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.514473 20870 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.535225 20831 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:42.596784 20875 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:04:42.597534 20850 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:42.604468 15398 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:42.613248 15323 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:42.604519 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:42.635437 15324 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:42.594578 20810 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.593039 20713 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:42.598026 20866 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:42.606596 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56207.9us
W20260709 13:04:42.598021 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 54839.5us
W20260709 13:04:42.644603 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.566552 20869 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:42.649674 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.612313 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.579548 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:42.610221 20668 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:42.615013 20700 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:42.615583 20558 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:42.615936 20393 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:42.616526 15242 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:42.617252 20880 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.618660 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 865) took 1373 ms. Trace:
W20260709 13:04:42.683080 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 217349us
I20260709 13:04:42.638499 20763 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.622931 15213 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:42.579587 20657 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:42.628472 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.629439 20870 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.708156 20763 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.610038 20856 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.564069 20732 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.547031 20795 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.735903 20795 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:42.604482 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.737326 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:42.737965 15393 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.738960 20803 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.653084 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:42.678052 20668 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.746743 15244 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:42.605316 20623 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:42.665693 16030 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:42.629436 20547 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.621347 20706 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.683017 16025 rpcz_store.cc:276] 0709 13:04:41.245153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.245325 (+   172us) service_pool.cc:224] Handling call
0709 13:04:41.251519 (+  6194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.359843 (+108324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.618418 (+1258575us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b54005f14d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:42.618600 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167594368}
I20260709 13:04:42.703058 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.716859 15324 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:42.675024 20700 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:42.634284 20548 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.705056 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.639261 20850 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.704803 20820 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.630484 19990 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:42.708658 20558 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:42.726764 15392 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:42.708279 20591 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:42.708317 20393 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:42.667171 20262 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.606472 20442 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:42.740137 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 117314us
W20260709 13:04:42.742102 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89107.5us
I20260709 13:04:42.744163 15246 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:42.744747 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:42.656044 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:42.774303 15243 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:42.780776 15398 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:42.682356 20583 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.765187 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:42.785586 15244 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:42.749137 15250 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:42.765785 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:42.786757 15319 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:42.791074 20717 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.730018 20657 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:42.793548 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.795104 20657 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:42.737308 20849 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.000s
I20260709 13:04:42.796489 20849 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.798389 20831 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.798708 20849 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:42.684697 20879 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:04:42.799595 20879 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:42.799959 20879 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:42.801064 20879 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.801693 20855 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:42.783685 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.708810 20880 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.784206 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:42.765904 15323 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:42.807338 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:42.808157 15391 raft_consensus.cc:2368] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
W20260709 13:04:42.808547 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.808959 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.809530 15391 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:42.811671 16028 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.811754 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:42.813476 15244 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:42.776769 15241 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:42.815116 15391 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:04:42.799887 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.817798 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.818590 15324 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:42.819164 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:42.820302 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:42.817857 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:42.821475 15393 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:42.666093 20866 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.763666 20713 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:42.849798 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:42.747081 20870 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:42.825565 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:42.860184 20818 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:42.860462 20870 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.835673 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:42.860934 20870 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:42.827574 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:42.865724 16028 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:42.872753 20693 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.852960 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:42.854547 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 107340us
I20260709 13:04:42.857753 15317 raft_consensus.cc:2368] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:42.784626 19990 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:42.811028 20591 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.859452 20700 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.859900 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:42.900446 15398 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.829883 15319 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:42.882004 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.882278 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.902175 15316 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:42.902487 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.903614 15319 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:04:42.883303 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 63078.5us
I20260709 13:04:42.884470 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.875741 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:42.906553 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:42.906564 20337 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.907267 15249 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:42.907460 20337 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.908293 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:42.909549 20337 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:42.910305 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:42.911541 20894 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:42.912052 20894 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.912436 20894 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:42.883407 15213 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:42.742054 20763 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.890884 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:42.915691 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:42.916769 20485 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:42.917282 20485 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:42.918512 20814 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:42.919454 20814 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:42.918623 20485 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.920641 20814 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.930328 20763 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:42.918876 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.940415 15321 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:42.940299 15316 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:42.940415 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:42.824294 20312 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:42.945011 16028 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:04:42.952647 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.945787 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:42.858011 20789 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:42.953877 15325 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 16: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:42.854790 20717 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:42.955456 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.968593 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.969113 15316 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:42.969457 15322 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:04:42.969635 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.947767 15213 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:42.959147 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.878993 20713 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:42.875167 20855 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:42.810817 20558 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.971071 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:42.978749 15398 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:42.899176 20786 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:42.980826 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:42.983181 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.983304 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:42.985812 15241 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
W20260709 13:04:43.057957 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 176247us
I20260709 13:04:43.058749 15325 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:04:43.061367 15316 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:42.811159 20820 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:43.069247 15392 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:43.060855 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:43.070405 15398 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:42.966349 20393 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:42.897360 20870 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:43.076298 16024 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:42.784705 20869 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:42.979909 20713 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:42.960196 20789 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:42.963181 20700 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:42.990674 20337 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:43.086151 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.090380 15318 raft_consensus.cc:2410] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:04:43.107975 20547 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.091094 20803 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:43.093269 20262 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:43.090749 20891 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:04:43.067597 20429 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.108741 20547 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:43.087477 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.116176 15243 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:42.968369 20312 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:43.118764 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 185357us
I20260709 13:04:43.119027 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:42.980221 20717 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.131289 15321 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:43.112769 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:43.105795 20789 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:43.136494 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:43.141448 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:43.104368 20337 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:43.130833 20886 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.413s	user 0.000s	sys 0.001s
I20260709 13:04:43.145731 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.115473 20657 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:43.144160 15290 leader_election.cc:400] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:43.149461 15290 leader_election.cc:403] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:04:43.148077 15241 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:43.151502 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.152447 15245 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 11.
I20260709 13:04:43.152573 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:43.149909 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:43.157817 15321 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:43.162828 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3040) took 1635 ms. Trace:
I20260709 13:04:43.163391 15396 rpcz_store.cc:276] 0709 13:04:41.527955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.785969 (+258014us) service_pool.cc:224] Handling call
0709 13:04:41.847842 (+ 61873us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:42.459616 (+611774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:42.459647 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:42.460133 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:04:42.515035 (+ 54902us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:42.515080 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.161872 (+646792us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000280d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:43.161939 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.162004 (+    65us) raft_consensus.cc:1685] finished
0709 13:04:43.162026 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.162745 (+   719us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":487523,"raft.queue_time_us":490459,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":5949,"spinlock_wait_cycles":284904704,"thread_start_us":54505,"threads_started":1,"wal-append.queue_time_us":54860}
W20260709 13:04:43.166641 20800 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.271s	user 0.038s	sys 0.069s
W20260709 13:04:43.198336 20800 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.302s	user 0.039s	sys 0.069s
I20260709 13:04:43.144562 20262 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:43.199028 20347 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.199858 20262 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:43.180291 20485 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:43.201063 20485 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.204015 20485 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:43.205904 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:43.206558 16025 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:43.191381 20849 raft_consensus.cc:2764] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:04:43.208156 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:43.208943 16028 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:43.212410 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:43.214020 20889 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:04:43.217891 20668 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:43.144759 20732 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:43.146272 20337 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:43.225329 20866 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:43.227175 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:43.201268 20262 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.236586 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.240479 15245 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:43.241873 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:43.242717 15245 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:43.249872 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:43.250821 16028 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:43.120718 20429 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:43.254590 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.083338 15316 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:43.181145 20739 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:43.257362 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:43.266637 15243 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:43.227360 20790 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.001s
I20260709 13:04:43.275820 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:43.261420 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:43.264971 20591 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.187631 20657 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:43.284143 20896 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:04:43.285463 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:43.285825 20429 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.287147 20890 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:43.226078 20850 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:43.287910 20547 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.279011 20795 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:43.288884 20795 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:43.289258 20795 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.295392 20548 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.188052 20763 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:43.238888 20255 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.297573 20255 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:43.264845 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.300563 20255 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:43.300843 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.267956 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:43.301564 20794 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:43.302027 20794 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:43.302785 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:43.302858 20794 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:43.303682 20870 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.303959 20794 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:43.304177 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:43.305166 20884 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:43.307575 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:43.110423 19990 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.141958 15325 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.274863 20867 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:43.252281 20347 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:43.252028 20690 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:43.324229 20255 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:43.324426 20850 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:43.131036 20855 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:43.281045 20706 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:43.362187 16030 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 827) took 1728 ms (client timeout 1644 ms). Trace:
I20260709 13:04:43.364832 20706 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:43.364892 16030 rpcz_store.cc:269] 0709 13:04:41.633954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.642455 (+  8501us) service_pool.cc:224] Handling call
0709 13:04:43.361894 (+1719439us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400474d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:43.362091 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114141952}
I20260709 13:04:43.348043 20773 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:43.363533 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.367098 20773 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.367733 20706 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.268365 20583 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.368070 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:43.368863 15317 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:43.342028 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:43.370714 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:43.348258 20866 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:43.371505 20866 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:43.370397 15145 catalog_manager.cc:5697] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 1 to 9, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 9 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:04:43.373322 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:43.301605 15322 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:43.349665 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:43.342021 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.376148 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:43.376848 15395 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:43.377678 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:43.351177 15398 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:04:43.350883 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:43.378947 15318 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:04:43.377678 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:43.380270 15397 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:04:43.353529 16025 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:04:43.343250 15998 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:43.382903 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:43.269675 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.267596 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:43.369328 20773 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.373486 20866 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:43.379035 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.386924 15242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1871) took 2107 ms (client timeout 1730 ms). Trace:
I20260709 13:04:43.384491 15241 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:43.385067 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:43.387493 15242 rpcz_store.cc:269] 0709 13:04:41.279887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.283931 (+  4044us) service_pool.cc:224] Handling call
0709 13:04:43.386682 (+2102751us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540025bcd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:43.386831 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2949766400}
I20260709 13:04:43.388861 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.390555 15215 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:43.327456 15320 raft_consensus.cc:1217] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Deduplicated request from leader. Original: 13.11->[14.12-14.12]   Dedup: 14.12->[]
I20260709 13:04:43.349128 15243 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:43.410310 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.394716 15319 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:43.413203 15320 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:04:43.396219 15362 leader_election.cc:400] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:43.414480 15362 leader_election.cc:403] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:04:43.418351 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:43.369644 20541 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:43.339123 20814 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.450870 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:43.472410 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.524819 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.508960 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.518916 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 175751us
W20260709 13:04:43.519166 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 123171us
I20260709 13:04:43.358263 19990 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:43.520154 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 129706us
I20260709 13:04:43.356269 20746 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:43.541615 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.571465 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.390798 20485 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:43.287946 20890 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.575837 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.407915 20583 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:43.518721 20255 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.595662 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:43.574832 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:43.582549 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.398272 20850 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:43.605824 15322 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:43.374439 20347 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:43.523540 20541 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.546733 20773 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:43.589006 15323 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:43.593632 15241 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:43.380779 20690 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:43.619098 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.668411 15319 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
W20260709 13:04:43.591590 20894 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.667s	user 0.008s	sys 0.003s
I20260709 13:04:43.600175 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:43.545248 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 441716us
I20260709 13:04:43.537710 20732 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:43.602126 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.686497 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.537539 20866 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:43.544785 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.687785 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:43.688907 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.546775 20693 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:43.616953 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:43.619341 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:43.691768 15398 raft_consensus.cc:2368] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:43.692853 15393 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:43.685647 15318 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:43.701836 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.425858 15317 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:43.394475 20867 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.728684 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.729697 15322 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:43.700801 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:43.740248 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:43.604036 20850 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:43.755753 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.650461 20541 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:43.740432 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.613116 20558 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:43.614584 20782 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.771021 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:43.775408 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:43.776552 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:43.744182 15246 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:43.746171 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.719183 15321 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
W20260709 13:04:43.752765 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 52127.7us
W20260709 13:04:43.710125 15291 connection.cc:256] RPC call timeout handler was delayed by -1.2874544100000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:04:43.733489 20773 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:43.727375 20820 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.765232 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.766307 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.712908 20255 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.569809 20814 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.777710 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:43.780085 15321 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:43.815974 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.721623 15245 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:43.780448 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:43.578157 20746 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.754904 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:43.768093 20870 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:43.722962 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.819528 15322 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:43.762857 20850 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:43.715535 20894 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.785367 20693 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:43.743232 20795 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.775774 20604 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:43.844859 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 64505.6us
W20260709 13:04:43.851191 20262 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.010s	sys 0.022s
I20260709 13:04:43.823868 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:43.884251 15245 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:43.841560 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:43.861449 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 106629us
I20260709 13:04:43.856087 15145 catalog_manager.cc:5697] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 3 to 6, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 6 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.865167 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:43.887785 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:43.847728 20818 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.008s	sys 0.022s
I20260709 13:04:43.725044 20732 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:43.921439 20732 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:43.935777 20814 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:43.936640 20814 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.938753 20690 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:43.941838 20739 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.000s
I20260709 13:04:44.000468 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:44.001726 15323 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:44.002897 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:44.008301 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 468729us
W20260709 13:04:43.894378 20818 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.009s	sys 0.023s
I20260709 13:04:44.016782 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:43.950043 20880 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:43.842461 15250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.000s	sys 0.018s
I20260709 13:04:43.879515 15241 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:43.783265 20782 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.882926 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.888630 15317 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:44.026930 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:43.890167 15325 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.002s
I20260709 13:04:44.027688 15325 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:44.027746 15321 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:44.004101 20739 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:43.818114 20312 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:43.889674 20693 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:43.889945 20262 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.011s	sys 0.022s
I20260709 13:04:43.823434 20255 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.866566 20547 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:43.890656 20825 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:04:43.955901 20867 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:43.956573 20773 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:43.957666 20803 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:43.963116 20890 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:43.964283 20884 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.659s	user 0.006s	sys 0.005s
I20260709 13:04:43.980314 20795 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:43.852793 20717 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:43.869962 15291 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:44.169044 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 299172us
I20260709 13:04:44.170120 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:43.785593 20548 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
W20260709 13:04:44.005739 20855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.024s	sys 0.037s
I20260709 13:04:44.020941 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:44.174611 15245 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:44.176043 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:44.177350 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:44.139164 20713 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.031s	user 0.013s	sys 0.000s
I20260709 13:04:43.731289 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:44.028554 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:43.851123 20813 raft_consensus.cc:2764] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:04:43.842135 20393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.010s	sys 0.005s
I20260709 13:04:44.031121 15322 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:44.035313 15324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.109s	sys 0.215s
I20260709 13:04:44.179906 20547 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:43.894582 20604 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:44.075896 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:44.058611 20337 consensus_meta.cc:287] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.835s	user 0.012s	sys 0.000s
W20260709 13:04:44.135840 15997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.185s	sys 0.275s
I20260709 13:04:44.150985 15317 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
W20260709 13:04:44.153666 15244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.004s	sys 0.013s
I20260709 13:04:44.160761 20894 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.184634 20825 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:04:44.218082 15324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.110s	sys 0.215s
I20260709 13:04:44.178038 15245 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:44.025324 15250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.000s	sys 0.019s
I20260709 13:04:44.182758 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:44.188611 15318 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:04:44.194701 20916 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:04:44.154444 20820 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:04:44.166406 20746 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:44.222290 15244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.005s	sys 0.013s
W20260709 13:04:44.221585 15997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.185s	sys 0.275s
I20260709 13:04:44.154655 20884 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:44.180178 20855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.024s	sys 0.037s
W20260709 13:04:44.216727 20794 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.912s	user 0.013s	sys 0.000s
W20260709 13:04:44.260751 15362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.004s	sys 0.024s
W20260709 13:04:44.261366 15362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.004s	sys 0.024s
I20260709 13:04:44.215701 20255 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:44.221269 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:44.247651 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:44.243196 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 722) took 1144 ms. Trace:
W20260709 13:04:44.214215 20700 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.102s	user 0.009s	sys 0.001s
I20260709 13:04:44.219110 20547 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:04:44.254557 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2691) took 1115 ms. Trace:
I20260709 13:04:44.181527 20347 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.209826 20541 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.265466 15397 raft_consensus.cc:2410] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:44.280851 15323 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:04:44.282285 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:44.267535 15318 rpcz_store.cc:276] 0709 13:04:43.098810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.187992 (+1089182us) service_pool.cc:224] Handling call
0709 13:04:44.188287 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.242797 (+ 54510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.243114 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.244478 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2685) took 1363 ms. Trace:
I20260709 13:04:44.222697 20825 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:44.269362 15244 rpcz_store.cc:276] 0709 13:04:43.139047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.139364 (+   317us) service_pool.cc:224] Handling call
0709 13:04:43.139762 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.140004 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:43.169948 (+ 29944us) log.cc:844] Serialized 14 byte log entry
0709 13:04:44.254043 (+1084095us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.254121 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:44.254190 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.254312 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.254482 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44972,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":14351,"thread_start_us":1075890,"threads_started":1,"wal-append.queue_time_us":1021579}
I20260709 13:04:44.284885 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:44.285456 15244 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:44.285746 16024 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:04:44.246590 20816 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:44.248170 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 65505.6us
I20260709 13:04:44.286263 16024 pending_rounds.cc:85] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 9
I20260709 13:04:44.287060 15250 rpcz_store.cc:276] 0709 13:04:42.881311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.881446 (+   135us) service_pool.cc:224] Handling call
0709 13:04:42.881739 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:42.881945 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:43.175098 (+293153us) log.cc:844] Serialized 14 byte log entry
0709 13:04:44.244012 (+1068914us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.244085 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:44.244146 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.244240 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.244392 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":77456,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":47,"raft.queue_time_us":118,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":8521,"thread_start_us":1298896,"threads_started":2,"wal-append.queue_time_us":851320}
I20260709 13:04:44.221586 20337 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.231019 20713 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.220085 20604 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:44.231765 20739 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 13:04:44.299037 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:44.320001 15390 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.019s	sys 0.015s
W20260709 13:04:44.320389 15390 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.019s	sys 0.015s
I20260709 13:04:44.289790 16024 pending_rounds.cc:107] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:04:44.320971 16024 raft_consensus.cc:2889] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:44.289940 15318 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:04:44.286326 20825 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:44.289593 20866 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:04:44.287075 20700 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:44.296936 15245 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
W20260709 13:04:44.299330 20915 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:04:44.305383 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:44.305438 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 411485us
W20260709 13:04:44.332104 15242 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.011s	sys 0.024s
W20260709 13:04:44.332633 15242 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.012s	sys 0.024s
I20260709 13:04:44.322961 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1929) took 1098 ms. Trace:
I20260709 13:04:44.333388 15318 rpcz_store.cc:276] 0709 13:04:43.224214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.283498 (+1059284us) service_pool.cc:224] Handling call
0709 13:04:44.283793 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:44.322580 (+ 38787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.322876 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.282768 20312 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.335353 20312 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.336136 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3044) took 1067 ms. Trace:
I20260709 13:04:44.331743 15245 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:04:44.292270 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:44.332590 15250 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:44.334590 15290 leader_election.cc:400] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:44.295650 20880 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:44.336591 15318 rpcz_store.cc:276] 0709 13:04:43.268312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.335332 (+1067020us) service_pool.cc:224] Handling call
0709 13:04:44.335639 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.335803 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.335827 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.335868 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:44.335898 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.335966 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.336081 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.340341 15290 leader_election.cc:403] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:04:44.334481 20803 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:44.341081 15250 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15. Ops: []
W20260709 13:04:44.346259 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54086.5us
I20260709 13:04:44.347424 15243 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:44.346845 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:44.322975 15365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.022s	sys 0.012s
W20260709 13:04:44.329305 15214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.012s	sys 0.020s
I20260709 13:04:44.294886 20894 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:44.318096 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.016s	sys 0.017s
I20260709 13:04:44.342309 15248 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:44.375576 20894 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:44.312536 20870 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:44.379235 20870 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:44.382608 20919 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:04:44.345068 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3045) took 1076 ms. Trace:
I20260709 13:04:44.383697 15318 rpcz_store.cc:276] 0709 13:04:43.268616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.343416 (+1074800us) service_pool.cc:224] Handling call
0709 13:04:44.343758 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.343990 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.344028 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.344082 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:44.344127 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.344202 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.344992 (+   790us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.385955 20541 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:44.300297 15241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41098c861400432692b47f484ad4dd2d"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:44.386142 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3047) took 1117 ms. Trace:
I20260709 13:04:44.398324 15318 rpcz_store.cc:276] 0709 13:04:43.269214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.385051 (+1115837us) service_pool.cc:224] Handling call
0709 13:04:44.385467 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.385710 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.385752 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.385811 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:44.385858 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.385933 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.386087 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.391945 20604 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:44.392323 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:44.402987 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 723) took 1303 ms. Trace:
I20260709 13:04:44.403616 20337 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.393965 20879 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:44.405403 20713 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.406594 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3048) took 1098 ms. Trace:
I20260709 13:04:44.407142 15318 rpcz_store.cc:276] 0709 13:04:43.308058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.399681 (+1091623us) service_pool.cc:224] Handling call
0709 13:04:44.400106 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.400349 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.400389 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.400459 (+    70us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:44.400506 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.406310 (+  5804us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.406509 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.397783 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2674) took 1653 ms. Trace:
I20260709 13:04:44.411099 15248 rpcz_store.cc:276] 0709 13:04:42.744445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.745177 (+   732us) service_pool.cc:224] Handling call
0709 13:04:42.772008 (+ 26831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.375842 (+1603834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.378154 (+  2312us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540011a3d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:44.397688 (+ 19534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3610903296}
I20260709 13:04:44.394887 15241 raft_consensus.cc:606] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:44.403434 15319 rpcz_store.cc:276] 0709 13:04:43.099076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.714532 (+615456us) service_pool.cc:224] Handling call
0709 13:04:44.392088 (+677556us) spinlock_profiling.cc:243] Waited 880 us on lock 0x7b58000f5498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:04:44.402897 (+ 10809us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024320}
W20260709 13:04:44.415058 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 68286.3us
W20260709 13:04:44.416018 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.416175 15319 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:04:44.416873 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 69383.1us
W20260709 13:04:44.417483 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.017s	sys 0.017s
I20260709 13:04:44.418596 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:44.348219 15365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.023s	sys 0.012s
W20260709 13:04:44.348945 15214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.013s	sys 0.021s
W20260709 13:04:44.419623 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 667219us
I20260709 13:04:44.360877 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1903) took 1534 ms. Trace:
I20260709 13:04:44.424414 15320 rpcz_store.cc:276] 0709 13:04:42.826661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.826771 (+   110us) service_pool.cc:224] Handling call
0709 13:04:42.850758 (+ 23987us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.318025 (+467267us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b540016cea0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfc1c0 00007f3669bfd231 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c
0709 13:04:43.414061 (+ 96036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.360480 (+946419us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540016cea0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfda02 00007f3669bf9dd6 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:04:44.360788 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376364544}
W20260709 13:04:44.364321 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.366523 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:44.331259 20866 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
W20260709 13:04:44.421572 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 643886us
I20260709 13:04:44.429061 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:44.352337 20909 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:04:44.429911 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 63539.6us
I20260709 13:04:44.434353 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:44.347265 20700 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:44.378044 20894 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.436154 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:04:44.421739 20448 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.009s	sys 0.031s
I20260709 13:04:44.420651 20739 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:44.346098 20803 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:44.470937 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:44.452363 16033 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:04:44.484126 16033 pending_rounds.cc:85] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 10
I20260709 13:04:44.484489 16033 pending_rounds.cc:107] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:04:44.484534 15392 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:44.484884 16033 raft_consensus.cc:2889] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:44.452409 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:44.453049 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:44.350965 20782 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:44.454154 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.487243 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:44.487946 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:44.409613 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3049) took 1087 ms. Trace:
I20260709 13:04:44.488649 15318 rpcz_store.cc:276] 0709 13:04:43.322058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.408451 (+1086393us) service_pool.cc:224] Handling call
0709 13:04:44.408921 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.409165 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.409202 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.409262 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:44.409308 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.409382 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.409539 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.457113 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:44.489681 16027 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:44.459636 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:44.491058 15395 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:44.442627 20604 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:44.460505 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.438340 20337 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:44.472307 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:44.437917 15216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.024s	sys 0.008s
I20260709 13:04:44.434676 20548 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:44.436837 20713 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:44.482196 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.348487 20880 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:44.410470 20901 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.701s	user 0.004s	sys 0.000s
I20260709 13:04:44.473289 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:44.500203 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:44.494072 15216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.025s	sys 0.008s
I20260709 13:04:44.506922 20782 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:44.501456 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:44.481797 20448 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.010s	sys 0.031s
I20260709 13:04:44.504561 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:44.472529 20866 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:44.482362 20262 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.516129 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:44.516938 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:44.554162 15241 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
W20260709 13:04:44.496505 20850 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.003s
W20260709 13:04:44.556227 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 51748.2us
I20260709 13:04:44.557605 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:44.511919 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:44.519187 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:44.559207 15392 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:44.560214 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.561462 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.495975 20548 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.562477 20548 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:44.519552 20924 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:04:44.502614 20700 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:44.568851 20866 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.570721 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:44.571372 20866 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:44.571600 15245 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:44.507737 20920 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.573499 20920 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.576388 20920 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:44.577054 20262 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:44.510353 20894 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:44.525893 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1902) took 1699 ms. Trace:
I20260709 13:04:44.553383 15248 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:44.580125 15324 rpcz_store.cc:276] 0709 13:04:42.826351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.826482 (+   131us) service_pool.cc:224] Handling call
0709 13:04:42.826804 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:42.878055 (+ 51251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:42.878106 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:42.880118 (+  2012us) log.cc:844] Serialized 52 byte log entry
0709 13:04:44.230690 (+1350572us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:44.230733 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.230809 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:44.525664 (+294855us) raft_consensus.cc:1685] finished
0709 13:04:44.525683 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.525834 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36469,"raft.queue_time_us":25714,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":4289,"thread_start_us":1172481,"threads_started":1,"wal-append.queue_time_us":1322744}
I20260709 13:04:44.526841 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1891) took 1177 ms. Trace:
I20260709 13:04:44.581877 15243 rpcz_store.cc:276] 0709 13:04:43.349713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.585336 (+235623us) service_pool.cc:224] Handling call
0709 13:04:44.526573 (+941237us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b54001a86d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:44.526765 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535133952}
I20260709 13:04:44.464008 20861 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:44.583037 20861 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.583439 20861 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:44.583560 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:44.586531 20884 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:44.587095 20884 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:44.587965 20884 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.592044 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1921) took 1495 ms. Trace:
I20260709 13:04:44.592595 15317 rpcz_store.cc:276] 0709 13:04:43.096567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.026686 (+930119us) service_pool.cc:224] Handling call
0709 13:04:44.591834 (+565148us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b540021a2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:44.591974 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146836352}
W20260709 13:04:44.531476 20789 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.371s	user 0.013s	sys 0.001s
I20260709 13:04:44.532739 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1915) took 1438 ms. Trace:
I20260709 13:04:44.593618 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2625) took 1216 ms. Trace:
I20260709 13:04:44.593806 15323 rpcz_store.cc:276] 0709 13:04:43.094535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.002595 (+908060us) service_pool.cc:224] Handling call
0709 13:04:44.528548 (+525953us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400077454. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:44.532678 (+  4130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635795840}
I20260709 13:04:44.538092 15395 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:44.594146 15391 rpcz_store.cc:276] 0709 13:04:43.377609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.378600 (+   991us) service_pool.cc:224] Handling call
0709 13:04:43.378858 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.655792 (+276934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.655844 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:43.655908 (+    64us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:43.655961 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.593367 (+937406us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54001d9f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:44.593421 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.593561 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":636196224}
I20260709 13:04:44.595841 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.596058 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.596529 15395 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:44.596907 15391 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:44.597388 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:44.597770 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:44.597968 15395 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:44.600275 15391 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:44.600806 20825 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.592875 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.544276 15250 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:44.593655 20789 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.602373 20794 raft_consensus.cc:2764] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:04:44.529945 15396 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:44.602077 15325 raft_consensus.cc:2410] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:04:44.585167 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:44.605850 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48335.9us
I20260709 13:04:44.612124 15244 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:44.592593 20861 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:44.606573 15398 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:44.608407 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 96577.5us
I20260709 13:04:44.534680 20782 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.613024 15244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:44.654623 15244 raft_consensus.cc:606] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:44.623080 15395 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:44.651311 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:44.656483 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.658540 15391 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:44.609833 20255 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:44.651278 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:44.661401 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 485518us
I20260709 13:04:44.661975 15392 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:44.612049 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:44.662946 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 50971.2us
I20260709 13:04:44.585704 20803 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:44.611164 20893 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:44.664321 15395 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:44.665616 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:44.670075 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:44.669382 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.671833 15395 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:44.654717 20690 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.658905 20782 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:44.607064 20850 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:44.668335 20920 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:04:44.677321 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 415263us
I20260709 13:04:44.670832 20312 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.677385 20866 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:44.677340 20541 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:44.664085 20768 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:04:44.701409 15399 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:44.683609 20803 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:44.706418 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.684828 20262 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.712561 15244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0024621f21043e889d114f180f1dccb"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:44.686589 20690 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:44.707720 19990 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.132s	user 0.014s	sys 0.000s
I20260709 13:04:44.702414 20541 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.719066 20262 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:44.721325 20262 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.721740 20262 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:44.723042 20690 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:44.708513 20825 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.725449 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:44.726145 15395 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:44.725203 20548 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.731721 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2629) took 1137 ms. Trace:
I20260709 13:04:44.732304 15397 rpcz_store.cc:276] 0709 13:04:43.594758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.595403 (+   645us) service_pool.cc:224] Handling call
0709 13:04:44.729827 (+1134424us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b540009a6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:44.731629 (+  1802us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1537858944}
I20260709 13:04:44.709066 20920 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:44.743484 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:44.744113 15395 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:44.751058 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1925) took 1527 ms. Trace:
I20260709 13:04:44.752029 20548 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.752952 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1888) took 1500 ms. Trace:
I20260709 13:04:44.753515 15246 rpcz_store.cc:276] 0709 13:04:43.252854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.262899 (+ 10045us) service_pool.cc:224] Handling call
0709 13:04:44.752696 (+1489797us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b540023aad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:44.752877 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150989568}
I20260709 13:04:44.751680 15325 rpcz_store.cc:276] 0709 13:04:43.223168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.028323 (+805155us) service_pool.cc:224] Handling call
0709 13:04:44.750774 (+722451us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54001c66d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:44.750972 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953826688}
I20260709 13:04:44.757709 20850 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:44.761747 15247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2672) took 2017 ms (client timeout 1989 ms). Trace:
I20260709 13:04:44.728834 20541 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:44.767171 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:44.762302 15247 rpcz_store.cc:269] 0709 13:04:42.743895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.744508 (+   613us) service_pool.cc:224] Handling call
0709 13:04:44.761447 (+2016939us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54003985d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:44.761644 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3412168064}
I20260709 13:04:44.732362 20880 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.786818 16025 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:44.787617 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 721) took 1689 ms. Trace:
I20260709 13:04:44.788750 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 728) took 1688 ms. Trace:
I20260709 13:04:44.795678 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:44.795950 15322 rpcz_store.cc:276] 0709 13:04:43.100356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.218433 (+1118077us) service_pool.cc:224] Handling call
0709 13:04:44.218863 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.219128 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:04:44.453479 (+234351us) log.cc:844] Serialized 14 byte log entry
0709 13:04:44.788303 (+334824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.788378 (+    75us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:04:44.788446 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.788530 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.788679 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2270,"prepare.queue_time_us":479860,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":2402,"thread_start_us":564730,"threads_started":2}
I20260709 13:04:44.798651 15395 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:04:44.804505 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.806198 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.800367 15998 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:44.817724 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:44.828099 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:44.856612 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:44.856606 15996 leader_election.cc:336] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.634s (SENT)
I20260709 13:04:44.787575 20894 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:44.872579 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.858629 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:44.871538 20746 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:04:44.876816 20337 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:44.877338 20337 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:44.878257 20337 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.881564 20867 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:44.882086 20867 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:44.872555 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 454031us
I20260709 13:04:44.891187 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:44.893440 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:44.809796 20810 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:44.897404 15323 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:44.886363 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:44.895789 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:44.898989 15317 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:44.895880 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:44.899736 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:44.900086 15316 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:44.809556 20789 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.898054 15324 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:04:44.900972 15324 pending_rounds.cc:85] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 11
I20260709 13:04:44.901434 15324 pending_rounds.cc:107] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:04:44.901811 15324 raft_consensus.cc:2889] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:44.853375 19990 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.856839 20880 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:44.910559 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:44.911732 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:44.923018 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:44.923267 15318 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:44.923861 15325 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:44.873701 20929 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:44.863598 20820 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:44.810444 20768 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:04:44.862694 20357 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:44.887070 20861 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:44.908839 20825 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.929620 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:44.896361 20913 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:44.936007 15323 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:44.939743 20818 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:44.925892 20929 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:44.978080 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48588.7us
I20260709 13:04:44.940362 20357 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.922819 19990 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.959329 20312 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:44.941073 20810 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:44.957024 20861 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.987064 20861 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.989320 20861 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:44.974220 20880 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:44.955125 20825 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:44.990670 20880 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:44.993011 20880 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:44.993112 20825 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:44.971276 20913 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:44.978619 20929 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:44.896643 20894 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:45.020617 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 334483us
I20260709 13:04:45.029948 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:44.984206 20312 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.883009 20867 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.871917 20920 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.980192 15363 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:44.982347 20357 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:45.054826 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 1933) took 1522 ms. Trace:
I20260709 13:04:44.939563 20820 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:44.989393 20262 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:45.002183 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.959110 20768 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:04:45.048605 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:45.064227 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:44.944203 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 292986us
I20260709 13:04:45.049752 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:45.019743 20893 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:45.072844 15249 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:45.055639 15320 rpcz_store.cc:276] 0709 13:04:43.531960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.425809 (+893849us) service_pool.cc:224] Handling call
0709 13:04:44.431527 (+  5718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.431813 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:44.785248 (+353435us) log.cc:844] Serialized 14 byte log entry
0709 13:04:45.054478 (+269230us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:45.054533 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:45.054580 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.054646 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.054767 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1045,"prepare.queue_time_us":296486,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":1157,"thread_start_us":620801,"threads_started":2}
I20260709 13:04:45.091351 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:45.053687 20312 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:45.097481 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:45.098636 16024 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 11: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:45.099216 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:45.059885 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53006.4us
W20260709 13:04:45.062491 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 82380.2us
I20260709 13:04:45.101887 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:45.056453 20547 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:45.104426 16030 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:45.064791 20657 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:45.110122 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.128995 15243 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:45.060920 20866 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:45.145373 20940 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:45.147017 20825 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:45.147500 20825 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:45.148866 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.148814 20825 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:45.147324 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46809.3us
I20260709 13:04:45.152516 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.152012 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:45.153504 15247 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:45.154086 20940 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:45.157038 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 56582us
I20260709 13:04:45.105198 20867 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:45.163110 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 113469us
I20260709 13:04:45.094539 20816 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:04:45.164280 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.165977 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:45.167234 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.170101 15250 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
W20260709 13:04:45.167063 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 118604us
I20260709 13:04:45.187585 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.177228 20782 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.194792 20892 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:45.195293 20892 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:45.178290 20558 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:45.196249 20558 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:45.196161 20892 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.196736 20558 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:45.197229 20892 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:45.197592 20818 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:45.194824 19990 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.179139 20657 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:45.202467 20657 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:45.202967 20657 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:45.205981 20825 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:45.206140 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:45.206872 15325 raft_consensus.cc:2376] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15. Re-sending same reply.
I20260709 13:04:45.206925 20820 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:45.208009 20945 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:04:45.209388 20944 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:04:45.179579 15390 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:45.111284 20547 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.065582 20850 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:04:45.218305 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:45.219045 15317 raft_consensus.cc:2376] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16. Re-sending same reply.
I20260709 13:04:45.220711 15316 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:45.171054 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.134384 20583 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:45.224491 15325 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:04:45.186054 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 105832us
W20260709 13:04:45.174752 20943 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:04:45.187691 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:45.190372 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:45.189993 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:45.193331 20942 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:04:45.193632 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:45.212574 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:45.213035 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47129.1us
I20260709 13:04:45.218434 20393 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:45.238864 20393 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:45.238914 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:45.107029 20913 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.230402 20604 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.185948 20893 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.243822 20884 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:45.110965 20949 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:04:45.169303 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.164108 20948 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:45.197700 20541 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.253814 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:45.228677 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:45.230993 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.255656 15250 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:04:45.231048 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:45.188547 20931 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:45.223620 20803 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 13:04:45.237797 15241 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:45.239379 20393 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:45.242668 20604 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.216918 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:45.266695 15319 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:45.268348 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:45.271034 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.246753 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:45.271921 15319 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:45.272310 15325 raft_consensus.cc:2376] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15. Re-sending same reply.
I20260709 13:04:45.241731 20657 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.251873 20558 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.256495 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:45.257530 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67835.5us
W20260709 13:04:45.260195 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 101078us
I20260709 13:04:45.263298 15390 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:45.265379 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:45.281730 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:45.271942 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.276832 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:45.303239 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.265944 20972 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:45.287001 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.289358 20913 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:45.265493 20952 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:45.295806 20558 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:45.297294 20604 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.298408 20929 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.325752 20929 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:45.270959 20866 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.256491 20312 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.328662 20312 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.328732 20959 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:45.271377 20931 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.282637 20958 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.330592 20958 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.333561 20958 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.336469 20931 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:45.284731 20448 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:45.337337 20448 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:45.337746 20448 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:45.302760 20357 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.317494 20803 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:45.339289 20803 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:45.339645 20803 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:45.303774 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1889) took 2028 ms. Trace:
I20260709 13:04:45.340569 15243 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:45.328665 20541 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:45.304797 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:45.343057 20657 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:45.343487 20746 raft_consensus.cc:993] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:45.344671 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:45.345232 20746 raft_consensus.cc:1081] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:45.345489 15316 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:45.305794 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.347311 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.307862 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.266842 20337 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.350380 20931 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:45.350335 20337 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.352990 20337 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.319769 20950 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:04:45.321460 20810 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.355405 20810 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.355990 20913 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:45.304843 15247 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:45.311519 15246 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:45.357432 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.317287 20870 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:04:45.358698 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.277861 20262 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.359789 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:45.360376 15247 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:45.340864 15242 rpcz_store.cc:276] 0709 13:04:43.275389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.777545 (+502156us) service_pool.cc:224] Handling call
0709 13:04:43.824095 (+ 46550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:44.333268 (+509173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.333312 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:44.422035 (+ 88723us) log.cc:844] Serialized 26 byte log entry
0709 13:04:44.816118 (+394083us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:45.130991 (+314873us) log.cc:844] Serialized 14 byte log entry
0709 13:04:45.131387 (+   396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.131464 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:45.303549 (+172085us) raft_consensus.cc:1685] finished
0709 13:04:45.303570 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.303719 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4973,"prepare.queue_time_us":438060,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":112985,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":30563,"thread_start_us":1090929,"threads_started":3,"wal-append.queue_time_us":525958}
I20260709 13:04:45.361676 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.363319 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.357641 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:44.795379 15321 rpcz_store.cc:276] 0709 13:04:43.098469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.028609 (+930140us) service_pool.cc:224] Handling call
0709 13:04:44.146721 (+118112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.146973 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:04:44.457175 (+310202us) log.cc:844] Serialized 14 byte log entry
0709 13:04:44.787255 (+330080us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.787312 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:44.787363 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.787429 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.787563 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8611,"prepare.queue_time_us":538345,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":2329,"spinlock_wait_cycles":40961408,"thread_start_us":598135,"threads_started":2}
I20260709 13:04:45.357523 20810 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.340570 20357 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.365384 20970 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:45.417811 20970 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:45.418339 20970 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:45.418886 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.419852 15397 raft_consensus.cc:2410] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:45.369711 15213 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:45.423307 15397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:04:45.424232 20962 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:04:45.424376 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54727.2us
I20260709 13:04:45.426216 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:45.435436 20921 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:45.426673 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:45.379237 15396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2631) took 1724 ms (client timeout 1855 ms). Trace:
W20260709 13:04:45.438603 15396 rpcz_store.cc:269] 0709 13:04:43.654554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.657095 (+  2541us) service_pool.cc:224] Handling call
0709 13:04:45.379032 (+1721937us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b54003d81d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:45.379168 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598125952}
I20260709 13:04:45.439357 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:45.440232 20867 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:45.440652 20867 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:45.440971 20867 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:45.379344 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 71548.2us
I20260709 13:04:45.442564 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.390036 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.390921 15393 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:45.380355 20558 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:45.455155 15244 raft_consensus.cc:606] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:45.456668 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:45.368901 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:45.380520 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.381278 15245 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:04:45.382207 20255 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:45.373833 15246 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:04:45.430481 15241 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:45.425220 20782 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.431555 16033 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:45.432160 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:45.472141 15247 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:45.391744 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:45.392030 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:45.497427 15394 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:45.386468 15250 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:45.412828 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65591.3us
I20260709 13:04:45.478503 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.365170 15242 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:04:45.500506 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:45.442590 16025 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:04:45.425168 15397 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.502288 15397 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:45.391438 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.496980 15243 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:45.515000 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.414817 20948 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:45.412678 20950 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:45.406770 20879 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:45.458667 20952 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:45.521535 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78402.1us
I20260709 13:04:45.522818 15246 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:45.536972 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.524295 15245 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:04:45.446805 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.525835 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:45.538741 16033 raft_consensus.cc:2368] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15.
I20260709 13:04:45.408936 20547 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.518172 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:45.528182 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:45.543206 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:45.460026 20548 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:45.529340 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:45.551281 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:45.555020 16024 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:45.555619 15390 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: []
W20260709 13:04:45.559767 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 59352.9us
I20260709 13:04:45.510758 20262 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:45.561050 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:45.561582 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 43541.6us
W20260709 13:04:45.561903 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66874.4us
I20260709 13:04:45.562422 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:45.557111 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.563675 15390 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:45.565235 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:45.522908 20541 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:45.530634 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:45.579747 16025 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:45.580233 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.429971 20803 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.521271 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.389608 20894 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.366926 20393 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.524453 20948 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:45.505569 20773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.013s	sys 0.006s
W20260709 13:04:45.581867 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 136859us
I20260709 13:04:45.585072 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:45.553969 20548 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:45.523909 20884 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:04:45.599202 20894 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:45.599435 20548 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:45.599730 20894 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:45.600262 20894 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:45.601260 20706 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:45.550575 20255 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:45.572808 20547 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:45.602900 20547 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:45.568842 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:45.503789 20558 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.606220 20818 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:45.606648 20818 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:45.607463 20818 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.608016 20558 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:45.588214 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67015.7us
I20260709 13:04:45.591040 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.609032 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.609467 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.610767 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:45.611544 20966 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:45.611860 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.612638 20255 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:45.614665 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:45.615383 16032 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:45.615759 20393 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:45.616227 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.617048 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:45.617292 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.617897 15392 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 10.
I20260709 13:04:45.594551 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:45.669649 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 75163.9us
I20260709 13:04:45.526945 20825 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:04:45.618517 15398 raft_consensus.cc:2368] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15.
I20260709 13:04:45.600067 20884 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:45.619835 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:45.532045 20879 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:45.622859 20966 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:45.529592 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:45.624846 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.618132 20977 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:04:45.636094 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 73743.5us
I20260709 13:04:45.612646 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.597553 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2692) took 2442 ms. Trace:
I20260709 13:04:45.672246 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.678439 15392 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:45.579198 20866 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:45.686390 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 89767.1us
W20260709 13:04:45.686995 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88079us
I20260709 13:04:45.535075 20794 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:04:45.583636 19990 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:45.595948 20773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.014s	sys 0.007s
I20260709 13:04:45.622752 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:45.610874 20894 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.580010 20820 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 13:04:45.679781 20870 raft_consensus.cc:2764] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:04:45.678159 20980 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:45.686169 20884 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:45.703791 16032 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:45.726169 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:45.714216 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 101650us
W20260709 13:04:45.722113 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49942.4us
W20260709 13:04:45.704821 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 175292us
I20260709 13:04:45.754859 16025 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:45.770974 15399 raft_consensus.cc:2410] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:45.779785 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:45.819092 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 94280.1us
I20260709 13:04:45.749768 15394 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
W20260709 13:04:45.760543 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 44426.4us
I20260709 13:04:45.822791 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:45.823227 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:45.823599 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:45.820277 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 257463us
I20260709 13:04:45.827798 15244 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:45.822086 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:45.832289 15394 raft_consensus.cc:2376] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14. Re-sending same reply.
I20260709 13:04:45.834553 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:45.835848 15244 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:45.721005 20768 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:45.807402 20974 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:04:45.713871 15249 rpcz_store.cc:276] 0709 13:04:43.145978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.146132 (+   154us) service_pool.cc:224] Handling call
0709 13:04:43.146449 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.072616 (+1926167us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b5400400c20. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfc1c0 00007f3669bfd231 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c
0709 13:04:45.091130 (+ 18514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.454966 (+363836us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b5400400c20. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfda02 00007f3669bf9dd6 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:04:45.587669 (+132703us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54001a8bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:45.587849 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4234644352}
W20260709 13:04:45.760200 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 164283us
I20260709 13:04:45.708356 20977 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:45.698480 16024 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:45.858188 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:45.846024 15214 leader_election.cc:400] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15.
I20260709 13:04:45.862174 15214 leader_election.cc:403] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:04:45.743933 19990 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:45.849395 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:45.885237 15246 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:45.806787 20982 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:04:45.727260 20920 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:45.701316 20657 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:45.752281 20979 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:04:45.816638 20818 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:45.844074 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.898432 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:45.899052 15242 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:04:45.900301 15399 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:45.741374 20866 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.853782 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:45.902763 15243 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:45.812139 20894 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.708042 20790 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.148s
I20260709 13:04:45.858587 20913 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:45.863117 20547 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:45.853482 20558 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:45.864128 20870 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:45.850005 20816 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.827641 20972 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:45.732209 20820 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:45.868811 20987 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.131s	user 0.000s	sys 0.003s
I20260709 13:04:45.740319 20940 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 13:04:45.874641 20952 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:45.876993 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44362.9us
I20260709 13:04:45.877579 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:45.934195 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:45.935117 15362 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:45.878404 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:45.936161 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:45.834779 15394 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:45.919250 20870 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.938427 20894 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:45.939683 20870 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:45.890153 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 58934.1us
I20260709 13:04:45.760002 20548 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.893136 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:45.884928 15397 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.820438 20448 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.903364 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:45.877266 20977 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:45.910490 15390 raft_consensus.cc:2368] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:45.876802 20803 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.741183 20948 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.892318 20262 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:45.857645 20966 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:04:45.913570 20558 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:46.004804 20558 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:45.753981 20879 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.008150 20541 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:45.926656 19990 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.919476 20816 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:45.996908 20867 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.000s
I20260709 13:04:45.930291 20790 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:45.931167 20990 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:45.826917 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:46.040784 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 213971us
W20260709 13:04:45.936736 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58431.1us
I20260709 13:04:45.940383 20820 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.952867 20931 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:45.765520 20884 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:45.987200 20972 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:45.966877 20255 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:45.995893 20548 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:45.964581 20393 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:45.913046 20970 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:45.966987 20920 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:46.026432 20816 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:46.037365 20985 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.305s	user 0.001s	sys 0.001s
I20260709 13:04:46.043991 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:46.044755 20782 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:46.048259 16024 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:04:46.040098 20790 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:46.045282 20931 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:46.046082 20990 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:46.047775 20972 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:46.049070 20393 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:46.055173 20773 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:46.053139 20920 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:46.056180 20255 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:46.056684 20782 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:46.084148 20920 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:46.055011 20892 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:04:46.088137 20255 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.083798 20931 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.046605 20867 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:46.106989 20994 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:04:46.080451 20773 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.081182 20972 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:46.110683 20989 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.236s	user 0.002s	sys 0.000s
I20260709 13:04:46.112705 20931 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.122598 20773 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.108729 20990 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.128382 20990 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.131723 20879 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.134701 20884 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:46.137475 20948 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:46.091284 20970 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:46.158525 20950 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:46.159133 20950 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:46.160223 20950 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.169888 20866 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:46.138617 20448 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:46.081264 20393 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.180090 20867 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:46.162012 20950 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.183393 20820 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:46.180997 20790 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.186892 20790 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:46.094761 20782 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:46.305648 20920 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.310995 20920 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:46.307170 20977 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.315924 20977 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:46.312422 20972 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.319270 20972 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:45.880062 15215 leader_election.cc:400] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15.
I20260709 13:04:45.882134 15244 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
W20260709 13:04:46.374464 15291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.008s	sys 0.016s
W20260709 13:04:46.375870 15324 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.021s	sys 0.063s
I20260709 13:04:45.998260 15399 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
W20260709 13:04:46.378736 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 411850us
I20260709 13:04:46.488883 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:46.489781 15324 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.022s	sys 0.063s
I20260709 13:04:46.379588 15390 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:46.387050 15392 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:45.946616 15398 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:46.491878 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 737) took 1277 ms. Trace:
W20260709 13:04:46.488893 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.494393 15291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.008s	sys 0.017s
W20260709 13:04:46.495308 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.495850 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:46.391649 15393 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:46.393170 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3108) took 1002 ms. Trace:
I20260709 13:04:45.998744 15397 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:46.502591 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39722 (request call id 3105) took 1113 ms. Trace:
I20260709 13:04:46.503051 15397 rpcz_store.cc:276] 0709 13:04:45.389488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.423157 (+ 33669us) service_pool.cc:224] Handling call
0709 13:04:46.502298 (+1079141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:46.503068 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:46.506487 15243 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:46.379523 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 476093us
I20260709 13:04:46.456213 20690 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.469728 20547 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:46.482170 20866 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.520828 20866 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.522636 20940 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:46.523569 20940 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.526573 20931 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.527423 20931 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.528064 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.529066 20867 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:46.489033 20448 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.529966 20867 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.530798 20448 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.531879 15323 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:04:46.532282 15323 pending_rounds.cc:85] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 11
I20260709 13:04:46.532569 15323 pending_rounds.cc:107] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:04:46.532598 20867 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:46.533023 15323 raft_consensus.cc:2889] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:46.533806 20448 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:46.447885 15394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.002s
I20260709 13:04:46.514108 20997 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:46.516206 20992 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:46.517210 19990 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.518028 20548 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.518524 20820 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:46.519865 20990 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.519307 20690 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.536566 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.501675 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:46.483088 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 431438us
I20260709 13:04:46.546751 15325 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 11.
I20260709 13:04:46.547053 20992 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.547626 20547 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.511782 20999 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:46.552533 15394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.008s	sys 0.003s
I20260709 13:04:46.524204 20866 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:46.555467 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.540602 20931 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:46.558211 20990 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.559176 20312 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:04:46.560182 20548 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.561816 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:46.565146 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 91012.1us
I20260709 13:04:46.500986 15396 rpcz_store.cc:276] 0709 13:04:45.390201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.439738 (+ 49537us) service_pool.cc:224] Handling call
0709 13:04:45.440190 (+   452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:45.440674 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.440717 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:45.441451 (+   734us) log.cc:844] Serialized 52 byte log entry
0709 13:04:45.860348 (+418897us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:45.860396 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.860477 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.392373 (+531896us) raft_consensus.cc:1685] finished
0709 13:04:46.392440 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.392884 (+   444us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13610,"raft.queue_time_us":5468,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":47601,"thread_start_us":418424,"threads_started":1,"wal-append.queue_time_us":462801}
W20260709 13:04:46.574446 15395 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.007s	sys 0.002s
I20260709 13:04:46.560248 20992 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:46.581876 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:46.578883 20312 consensus_queue.cc:1243] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:46.584967 20547 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:46.585947 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:46.587419 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.588743 15319 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:46.588897 20990 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:46.589754 20558 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.007s
I20260709 13:04:46.574172 20940 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:46.548897 19990 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.578967 15320 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:46.590188 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.492543 15324 rpcz_store.cc:276] 0709 13:04:45.213823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.213958 (+   135us) service_pool.cc:224] Handling call
0709 13:04:45.214295 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.214503 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:04:45.236392 (+ 21889us) log.cc:844] Serialized 14 byte log entry
0709 13:04:45.555735 (+319343us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b180038c8c0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:04:46.046464 (+490729us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:46.490881 (+444417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:46.491053 (+   172us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:04:46.491231 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.491399 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.491650 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21739,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":7414,"raft.queue_time_us":118268,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":59,"spinlock_wait_cycles":42119808,"thread_start_us":934349,"threads_started":2,"wal-append.queue_time_us":585427}
I20260709 13:04:46.595721 15323 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:46.597131 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.597872 15323 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:46.591710 15395 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.008s	sys 0.002s
I20260709 13:04:46.598785 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:46.604496 15365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.018s
W20260709 13:04:46.615597 15365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.000s	sys 0.020s
W20260709 13:04:46.622306 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 729210us
I20260709 13:04:46.623342 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2637) took 1065 ms. Trace:
I20260709 13:04:46.623975 15320 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:46.625311 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.631557 15243 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:04:46.626699 15318 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.634976 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3110) took 1231 ms. Trace:
I20260709 13:04:46.635576 15393 rpcz_store.cc:276] 0709 13:04:45.403872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.464701 (+ 60829us) service_pool.cc:224] Handling call
0709 13:04:45.465142 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.498411 (+1033269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.634582 (+136171us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400328cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:46.634870 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128998272}
I20260709 13:04:46.640961 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:46.601146 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.642566 20448 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:46.643131 15321 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:46.647099 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2635) took 1090 ms. Trace:
I20260709 13:04:46.647324 20690 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:46.647675 15392 rpcz_store.cc:276] 0709 13:04:45.557071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.715056 (+157985us) service_pool.cc:224] Handling call
0709 13:04:45.715433 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.491528 (+776095us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.646726 (+155198us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b54003cc154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:46.647014 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542951296}
I20260709 13:04:46.650636 20548 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:46.651345 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 715279us
W20260709 13:04:46.652128 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 822021us
I20260709 13:04:46.652781 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:46.654175 20816 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:04:46.656461 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 70706.8us
I20260709 13:04:46.657666 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:46.653923 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:46.630124 15398 rpcz_store.cc:276] 0709 13:04:45.557598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.727889 (+170291us) service_pool.cc:224] Handling call
0709 13:04:45.946332 (+218443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.492311 (+545979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.622894 (+130583us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540009bfd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:46.623101 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501418368}
I20260709 13:04:46.670432 21004 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:04:46.671057 15317 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:46.672477 20977 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:46.672942 21004 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:46.673543 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:46.674026 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:46.651250 20999 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:46.675536 20893 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:46.677109 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:46.678656 20884 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:46.675554 20999 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:46.679045 19990 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:46.688366 20879 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.005s
I20260709 13:04:46.690523 16024 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:46.690927 20690 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:46.691628 20690 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:46.658993 20547 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:46.666375 20548 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:46.698408 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.672986 20977 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:46.610209 20773 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.613337 20558 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.705891 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:46.706743 20866 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:46.707522 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:46.708024 20866 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:46.708577 20866 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:46.711380 20977 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.714372 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:46.725644 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.700034 20690 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.736259 20558 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:46.738876 15398 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:46.741786 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:46.741927 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:46.743168 20547 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:46.741788 15246 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.856s	user 0.014s	sys 0.010s
I20260709 13:04:46.743949 15246 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:46.744032 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:46.745522 19990 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:46.745735 20884 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:46.746351 20884 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.746740 20884 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:46.750692 20790 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.014s
I20260709 13:04:46.750541 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.681315 20999 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.745550 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:46.759624 16024 raft_consensus.cc:2368] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:46.744099 20548 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:46.769500 15317 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:46.770128 15319 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
W20260709 13:04:46.763911 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 65910.3us
I20260709 13:04:46.731746 20816 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:46.763608 20706 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15.
I20260709 13:04:46.775563 20816 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.775873 15148 catalog_manager.cc:5697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.780125 15325 raft_consensus.cc:2410] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:04:46.768677 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:46.788514 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 102417us
I20260709 13:04:46.777930 15148 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 8 to 12, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 12 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:46.790570 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.710068 20866 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.793346 15317 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:46.793510 20866 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.793931 20713 raft_consensus.cc:993] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:46.794559 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.796072 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.797253 15318 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
W20260709 13:04:46.799142 20393 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.011s
I20260709 13:04:46.794593 20713 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.800570 20884 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.788821 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.808341 15318 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:04:46.808818 21012 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.809427 21012 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.810400 16025 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:46.810532 20393 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.811283 15317 raft_consensus.cc:2410] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:04:46.813233 21016 raft_consensus.cc:1081] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:46.815454 20948 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:46.816365 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:46.817699 20713 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.820313 20713 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:46.823470 20884 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:46.824942 15242 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.925s	user 0.009s	sys 0.014s
W20260709 13:04:46.825376 21010 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.204s	user 0.003s	sys 0.003s
I20260709 13:04:46.825531 15242 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:46.827728 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:46.828433 15246 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:46.813349 20393 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:46.787178 20548 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:46.839480 15320 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:04:46.844568 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 98660.5us
I20260709 13:04:46.850526 15324 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:46.852702 15363 leader_election.cc:400] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:46.853188 15363 leader_election.cc:403] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:46.858363 19990 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.859207 19990 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.862581 19990 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:46.871371 20773 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:46.875530 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:46.877478 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.877980 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:46.878922 15248 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:46.879506 21012 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:46.879683 20790 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:04:46.879980 20782 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.013s
I20260709 13:04:46.880302 20790 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:46.880443 20782 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.882740 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:46.884006 20548 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.878945 15242 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:46.890424 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:46.891330 15250 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
W20260709 13:04:46.894791 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 89476.5us
I20260709 13:04:46.901170 20690 raft_consensus.cc:993] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:46.901824 20690 raft_consensus.cc:1081] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:46.907799 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.908170 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.908573 15316 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:46.909049 15322 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:46.909598 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.909881 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.910431 21015 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:46.910758 15322 raft_consensus.cc:2410] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:04:46.911705 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.912317 15322 raft_consensus.cc:2376] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14. Re-sending same reply.
I20260709 13:04:46.913244 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.892023 20999 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.913864 15325 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.913681 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.915539 15316 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
W20260709 13:04:46.917382 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.918047 15322 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 11: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:46.920849 15246 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:46.921831 16025 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:46.922559 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.915134 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:46.924592 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:46.933745 16024 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:46.930452 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:46.938571 15323 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:46.925951 20920 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.922148 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:46.881569 20790 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:46.911192 21015 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:46.945003 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.945029 15318 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:46.953156 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.946163 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:46.935998 15213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.178s (SENT) [suppressed 22 similar messages]
I20260709 13:04:46.955478 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:46.959249 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:46.959645 20782 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:46.963918 15316 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:46.964612 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:46.928249 20977 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.970088 16024 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:46.959584 15148 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 5 to 11, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 11 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.969662 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:46.959271 20990 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:04:46.977910 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.979285 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:46.974098 19990 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:46.926553 20706 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:04:46.982980 20803 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.986434 20866 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:04:46.990337 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.930963 21019 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:04:46.997205 15323 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:04:46.974484 20972 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:04:47.002756 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.999943 15148 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.000044 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:47.007416 15246 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:47.009747 15398 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:46.995651 19990 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.000263 20558 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:47.019182 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 125135us
I20260709 13:04:47.018900 20558 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.019485 20706 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:47.020212 20706 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.020467 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:47.005409 20990 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:47.027098 20558 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:47.028244 20706 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:47.030481 21015 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:47.014469 20448 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:47.036913 15398 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:47.038184 16025 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:04:47.015779 19990 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:47.015836 20866 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:47.017221 20972 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:47.039304 15148 catalog_manager.cc:5697] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 9 to 12, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 12 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:47.045054 15325 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:47.047052 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:47.046841 20972 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.047413 20866 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:47.075007 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.092028 16024 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:04:47.050118 20690 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:47.049288 20547 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:47.096031 15324 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:47.112501 16032 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:04:47.113556 20884 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:47.064339 20706 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:47.087634 21015 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:47.115453 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68626us
I20260709 13:04:47.021214 20803 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.091123 15148 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 12 to 15, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 15 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:47.122049 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:47.136900 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:47.107323 20690 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:47.065109 20558 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:04:47.119777 20879 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.170292 20879 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.175485 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:47.177579 16024 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:04:47.092083 20448 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:47.178417 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 158050us
I20260709 13:04:47.178835 16025 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:47.180047 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 252833us
I20260709 13:04:47.124775 20773 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:47.115274 20884 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.188916 15148 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.168254 20893 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:47.201314 20768 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:47.192510 21010 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:47.183183 20879 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:47.180639 20706 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.167372 21015 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.249776 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:47.201304 20794 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:47.254621 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:47.255972 15249 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:47.263295 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:47.259524 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47418.1us
I20260709 13:04:47.265625 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:47.258898 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:47.261626 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:47.271842 21015 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:47.203694 20990 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.279731 20706 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:47.280339 20768 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:47.281353 20768 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.248186 20940 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.283314 20940 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.285279 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:47.285645 20940 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:47.286075 15324 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:47.286392 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:47.287003 15323 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
W20260709 13:04:47.288385 21025 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:04:47.290086 21023 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:04:47.291683 20884 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:47.293975 20448 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:47.297678 20920 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:47.298429 15250 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:47.298842 15250 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:47.299785 15250 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.301015 15250 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:47.304813 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:47.305565 15245 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:47.306458 15247 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:04:47.306646 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:47.307240 15249 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:04:47.307324 20690 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.308073 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:47.308454 15246 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:47.309037 15241 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 10.
I20260709 13:04:47.235282 20893 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:47.311076 20893 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.240334 20773 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.317883 20773 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:47.318558 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:47.325280 15318 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:47.319334 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:47.319164 15244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c377e25836b14680beed769c143a593c"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:47.320529 15290 leader_election.cc:400] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:47.325886 15325 raft_consensus.cc:2376] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11. Re-sending same reply.
I20260709 13:04:47.326294 15290 leader_election.cc:403] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:04:47.318647 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.270041 21032 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:04:47.325960 15244 raft_consensus.cc:606] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:47.308497 20690 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:47.368742 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 155141us
I20260709 13:04:47.379947 20940 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15.
I20260709 13:04:47.385463 21013 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.386055 15319 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:04:47.389469 21016 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:47.391808 20713 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:47.389953 19990 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.392737 21012 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:47.393944 21028 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:47.395476 15395 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:47.395612 20803 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:47.381132 20558 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:04:47.404132 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 262990us
I20260709 13:04:47.404744 15319 pending_rounds.cc:85] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 7
I20260709 13:04:47.411084 15319 pending_rounds.cc:107] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:04:47.411388 15319 raft_consensus.cc:2889] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:47.282002 20794 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:47.414301 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 170957us
I20260709 13:04:47.417390 15250 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:47.428416 20448 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:47.429121 20448 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.432159 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:47.432786 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:47.432916 16032 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
W20260709 13:04:47.434180 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 187895us
I20260709 13:04:47.435276 20803 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:47.435577 20940 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:47.436554 20803 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:47.436721 20940 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:47.437012 20803 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:47.437208 20940 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:47.438164 20940 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.439488 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:47.440244 20940 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:47.442389 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:47.443207 16030 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:47.438153 20803 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.445302 15393 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:47.449666 15289 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:47.405620 20920 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.463074 15392 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
W20260709 13:04:47.471007 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 349016us
I20260709 13:04:47.481046 21028 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.489909 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:47.490372 20920 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.493229 20920 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:47.495456 20794 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:47.520474 21016 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.524758 20448 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:47.531503 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.636446 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.461864 21013 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.521410 20977 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:47.539887 20825 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:04:47.628768 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 161585us
I20260709 13:04:47.445655 20803 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:47.639161 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:47.640538 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 115146us
I20260709 13:04:47.657970 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:47.663475 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:47.669684 15289 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:47.642511 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.644253 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.645831 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 256769us
I20260709 13:04:47.672602 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:47.676061 15322 raft_consensus.cc:2368] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15.
I20260709 13:04:47.678455 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:47.688195 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 57588.9us
I20260709 13:04:47.648666 20825 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:47.695194 15322 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:47.689812 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:47.679989 20999 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:47.704432 15393 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:47.687887 20790 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:47.712606 15250 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:47.716897 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:47.708650 20884 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:47.726877 20884 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:47.727903 20884 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.729578 21028 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:47.731587 21013 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:47.732920 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:47.734289 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:47.698259 20825 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:47.736230 20713 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:47.738775 20713 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:47.739970 20706 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:47.707315 15148 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 9 to 16, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 16 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.749318 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:47.710647 20999 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:47.654306 21016 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.755468 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:47.767535 15249 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:47.766113 15999 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:47.768229 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:47.771072 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:47.771780 15246 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:47.775045 15247 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:04:47.776921 15241 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:47.759249 19990 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:47.780330 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:47.780798 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:47.765741 20999 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:47.788846 15320 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:47.792997 15321 raft_consensus.cc:2368] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17.
I20260709 13:04:47.790999 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:47.794973 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:47.795725 15316 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:47.807482 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:47.808344 15318 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:47.781809 20448 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:04:47.782320 20547 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.814649 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:47.815512 15362 leader_election.cc:336] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.539s (SENT)
I20260709 13:04:47.816051 21042 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:47.816560 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 131899us
I20260709 13:04:47.818917 15325 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:04:47.819620 21009 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:47.820097 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:47.820221 21009 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:47.812173 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:47.809890 15248 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:47.785461 21028 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:47.789402 15393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41098c861400432692b47f484ad4dd2d"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:04:47.792388 20790 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.832152 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:47.843490 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:47.883410 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 127334us
I20260709 13:04:47.830400 19990 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:47.837950 21028 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.797197 20794 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:04:47.850441 15318 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:04:47.798936 20558 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
W20260709 13:04:47.884567 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 66710.5us
I20260709 13:04:47.896024 15325 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:47.850818 15247 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:04:47.895680 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 105489us
W20260709 13:04:47.906198 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 109696us
I20260709 13:04:47.907546 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:47.907900 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 124845us
I20260709 13:04:47.911594 15320 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:47.843981 20547 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.896768 19990 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.902474 21028 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:47.851193 20990 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:04:47.920321 16030 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:47.924504 15325 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:47.925997 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:47.926862 15320 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:47.892179 20548 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:04:47.881201 20790 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:47.914898 20940 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:47.944471 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 101622us
I20260709 13:04:47.948328 15246 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:47.938920 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:47.921133 19990 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:47.931072 20558 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:47.967772 15291 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:48.017195 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49545.9us
I20260709 13:04:48.019605 15394 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0024621f21043e889d114f180f1dccb"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:04:48.023065 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:48.038115 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 113964us
I20260709 13:04:48.049513 15325 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:47.966215 21013 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:48.027050 21060 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:48.016777 20558 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:47.949376 20940 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:47.910722 21009 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.062384 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:48.074043 15318 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:04:47.968429 21026 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:04:48.052549 21012 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:48.085139 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:48.016215 21055 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:04:48.058782 15148 catalog_manager.cc:5697] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 4 to 13, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 13 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:48.083950 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:48.093156 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 142663us
W20260709 13:04:48.103935 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 85962.3us
I20260709 13:04:48.058000 21060 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.093336 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:48.106245 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 198752us
I20260709 13:04:48.101042 15320 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
W20260709 13:04:48.102586 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 163759us
I20260709 13:04:48.112828 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:48.104075 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:48.117329 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:48.075634 20782 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.117408 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.109126 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:48.096513 21016 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:48.123165 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:48.129050 16030 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:48.130009 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:48.098531 21062 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:48.106323 20990 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:48.132463 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.140892 15246 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:48.139649 15250 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:04:48.145507 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:48.095290 21013 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.112377 21060 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:48.145592 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:48.146569 15247 raft_consensus.cc:2376] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15. Re-sending same reply.
I20260709 13:04:48.148371 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.140301 21062 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.128609 21012 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:48.157588 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49315.4us
I20260709 13:04:48.160595 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:48.157064 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:48.161463 15394 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.162103 15394 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:48.149226 20768 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:04:48.129492 20950 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.232s
I20260709 13:04:48.164351 15318 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:48.149698 21026 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:48.167476 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:48.148104 21070 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:48.179612 20794 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:48.182148 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:48.160341 21062 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:48.193475 15318 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:48.198478 21077 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:48.201138 21077 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.172725 20706 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:48.206174 15318 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
W20260709 13:04:48.210210 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 64700.4us
I20260709 13:04:48.214403 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:48.181685 21067 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:48.183313 20990 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:48.219437 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:48.181865 21070 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:48.164337 20782 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.206470 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:48.224864 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:48.225553 15246 raft_consensus.cc:606] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:48.225873 15246 raft_consensus.cc:614] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:04:48.231180 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 80982.8us
I20260709 13:04:48.213577 20706 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.212986 20794 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:48.166268 20558 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:48.250474 21063 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:04:48.235746 20706 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:48.244242 16032 raft_consensus.cc:2393] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:04:48.252393 21066 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:04:48.253399 21064 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:04:48.254997 20782 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:48.255354 20558 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:48.255374 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:48.250950 21073 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.273869 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:48.228514 20790 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:48.224382 21070 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:48.230773 20547 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:48.282104 20825 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.003s
I20260709 13:04:48.298365 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.322943 15398 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:48.275245 21072 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.309425 20990 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:48.311311 20803 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.004s
I20260709 13:04:48.312804 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.313831 15396 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:48.314605 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.315233 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:48.317531 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:48.306175 20690 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.936s	user 0.011s	sys 0.002s
I20260709 13:04:48.344120 15317 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:48.298507 15318 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:48.324093 20825 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.325627 21013 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:48.328403 21057 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:04:48.329033 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:48.329880 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:48.330406 16024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:51484
I20260709 13:04:48.368276 16024 raft_consensus.cc:606] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:48.368752 16024 raft_consensus.cc:614] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:48.330696 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:48.331512 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:48.331450 21077 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:48.370275 21042 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.004s
I20260709 13:04:48.367363 15321 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:04:48.371127 15324 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:48.369629 15323 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:48.335671 15325 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:48.343070 15391 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:48.364873 15395 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:04:48.337343 20999 consensus_meta.cc:287] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.001s
I20260709 13:04:48.373687 15316 raft_consensus.cc:2368] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
W20260709 13:04:48.367542 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 446349us
W20260709 13:04:48.366878 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 211929us
I20260709 13:04:48.385310 21080 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:48.386013 21080 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:48.386243 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.389022 20825 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:48.390456 15319 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:48.385205 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:48.253324 20794 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.391245 15317 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:48.333076 21072 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.322562 21073 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.385222 21042 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:48.372097 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.386459 21080 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:48.395032 15324 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:48.306420 21067 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:04:48.416008 15320 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:48.382732 21013 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:48.423286 21013 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:48.390786 20999 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.423777 21013 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:48.425544 20999 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:48.426560 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 259143us
I20260709 13:04:48.426893 21072 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:48.427361 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:48.420127 15394 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.282783 21012 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.430567 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:48.433404 15321 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:04:48.433919 15318 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:48.434877 15323 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:48.430244 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:48.439025 15322 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:04:48.441496 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:48.441954 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.462517 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:48.462921 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:48.463846 16024 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:48.392135 20690 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:48.468545 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:48.471408 15316 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:48.430702 20825 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:48.475966 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:48.435596 20940 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:48.435210 20782 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:48.498829 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:48.500612 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:48.484282 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 262690us
I20260709 13:04:48.485208 15242 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
W20260709 13:04:48.492573 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 327568us
I20260709 13:04:48.497459 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:48.503379 15323 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:04:48.513100 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 256102us
I20260709 13:04:48.514163 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:48.493594 21081 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:48.495862 20893 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:48.523687 15321 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:04:48.498553 21072 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:48.531996 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:48.532608 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 217466us
I20260709 13:04:48.505059 20782 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.545145 21042 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:48.547132 20782 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:48.519618 20690 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:48.547906 21051 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:48.548310 21051 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:48.553045 21051 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.555699 20803 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:48.556190 20803 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.556535 20803 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:48.558007 21077 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.558633 21077 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.561796 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:48.562562 15323 raft_consensus.cc:2376] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14. Re-sending same reply.
I20260709 13:04:48.563005 16026 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:04:48.566671 21017 raft_consensus.cc:993] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:48.567234 21017 raft_consensus.cc:1081] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
W20260709 13:04:48.565874 15242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1927) took 1337 ms (client timeout 1548 ms). Trace:
W20260709 13:04:48.570561 15242 rpcz_store.cc:269] 0709 13:04:47.228572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.237293 (+  8721us) service_pool.cc:224] Handling call
0709 13:04:48.565667 (+1328374us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001a77d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:48.565779 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542929792}
I20260709 13:04:48.486754 20825 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.578816 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.486153 21085 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:04:48.583745 15242 raft_consensus.cc:2410] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 13:04:48.545725 21078 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
W20260709 13:04:48.592841 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.594779 20893 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:48.603962 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:48.608645 21079 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.274s	user 0.002s	sys 0.000s
I20260709 13:04:48.602447 21089 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.627055 21089 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.629455 21089 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:48.598500 21051 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:48.595279 21094 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:48.635666 21094 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.615744 20893 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.641690 15393 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.642271 15393 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:48.644301 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:48.645119 15321 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
W20260709 13:04:48.650772 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 60722us
I20260709 13:04:48.637967 21094 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:48.655339 15289 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:48.657298 16026 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:04:48.668025 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.672927 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:48.649101 19990 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.006s
I20260709 13:04:48.619908 20768 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:48.680145 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:48.682056 15243 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
I20260709 13:04:48.582558 21072 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.653616 20977 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:48.700299 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:48.691337 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.700765 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.574605 21081 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.703645 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.704463 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.665680 21089 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:48.738022 21089 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:48.739075 21089 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.741269 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:48.742297 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.743628 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.744355 15396 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:48.745234 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:48.745925 15396 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:48.751674 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51500.2us
W20260709 13:04:48.708063 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 176132us
I20260709 13:04:48.753460 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:48.712143 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:48.688819 19990 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.709177 15244 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:48.712769 21068 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.713197 21093 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:48.713347 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:48.714568 21098 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:48.715277 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.716912 21070 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:48.720729 21026 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.536s	user 0.007s	sys 0.000s
W20260709 13:04:48.690397 21028 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.744s	user 0.005s	sys 0.006s
I20260709 13:04:48.724437 21044 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:48.734493 21095 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:48.735625 20825 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:48.737030 21077 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:48.754513 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46180.2us
I20260709 13:04:48.817732 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.799299 15395 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:48.791069 15316 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:48.687873 21015 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.707553 20448 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.755420 16030 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:48.821717 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.802685 15393 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.821677 16025 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:48.815744 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.824672 15289 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:48.825521 15390 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:48.826018 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:48.766055 20706 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.829656 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:48.829692 15397 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:48.830130 15324 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:48.830402 15318 raft_consensus.cc:2376] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16. Re-sending same reply.
I20260709 13:04:48.823050 15395 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:48.825099 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:48.832460 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 164979us
I20260709 13:04:48.833639 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:48.806077 21026 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:48.751240 21094 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:04:48.835079 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:48.705300 20768 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.709301 20977 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.833724 21013 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.810881 21028 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.844164 15246 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:04:48.837594 20448 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.828521 21015 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.845408 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:48.848803 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 95418.7us
I20260709 13:04:48.851003 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:48.837621 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:48.835520 20825 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:48.859946 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 179853us
I20260709 13:04:48.813699 21068 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.834774 21077 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:48.746011 21080 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:48.871115 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.871871 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:48.895731 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 44809.5us
I20260709 13:04:48.907560 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:48.805150 21098 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:48.900723 15213 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:48.855094 21042 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:48.914911 21096 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.915547 15243 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:04:48.920116 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.820799 21044 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.924065 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.829278 21095 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:48.910907 21015 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:48.943914 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 98571.6us
I20260709 13:04:48.931077 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.951391 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:48.952215 15243 raft_consensus.cc:2376] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14. Re-sending same reply.
I20260709 13:04:49.053444 15396 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 10.
I20260709 13:04:49.055984 21028 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.057638 20794 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:48.929339 21096 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.058307 20794 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:49.060392 21096 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.060971 21096 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:04:49.061851 21101 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:04:49.063369 21013 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.064553 21102 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.210s
I20260709 13:04:49.066166 21109 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:49.066418 20448 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.067065 20448 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:49.067389 20448 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:49.068692 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 168042us
I20260709 13:04:49.069620 21070 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:49.070013 21107 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:04:49.071157 19990 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.071480 21016 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:49.071806 20558 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.001s
I20260709 13:04:49.072054 20977 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.072359 20558 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:49.072710 20977 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:49.073886 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:49.072198 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 117957us
I20260709 13:04:49.068305 20448 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.075057 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:48.911597 20999 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:04:48.925662 21062 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.003s
I20260709 13:04:49.092480 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:49.092283 21062 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.093312 15248 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:49.095588 15398 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:48.913571 21077 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:49.102874 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.057471 21068 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.089655 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:49.090422 21110 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:04:49.052695 21055 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.053381 21026 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:48.933290 21060 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.768s	user 0.011s	sys 0.000s
I20260709 13:04:49.079648 15399 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:04:49.088671 21095 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.109386 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:49.118996 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.110984 15318 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:49.069634 21072 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.096159 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:49.104576 20977 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:49.116935 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.056037 20706 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.111156 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:49.060647 20794 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.127030 20690 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:49.123818 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:49.120023 21083 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.072073 21016 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:49.132972 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.137588 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:49.139556 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:49.156378 15243 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:49.104386 20558 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:04:49.080184 20803 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:49.172179 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.103857 21015 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:04:49.145450 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 81781.5us
I20260709 13:04:49.165951 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:49.169211 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:49.214841 15321 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:49.128072 20977 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:49.216213 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.134079 19990 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:49.216637 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 50849.2us
W20260709 13:04:49.214974 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 265275us
I20260709 13:04:49.221305 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:49.230075 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:49.231091 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:49.244679 16024 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:49.248032 15396 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:49.249841 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:49.120045 21060 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:49.243626 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 127688us
I20260709 13:04:49.120349 21055 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.141355 20999 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:04:49.219190 21072 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:49.265875 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:49.266849 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:49.260187 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:49.167335 20690 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.283613 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.284371 15396 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:49.263068 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:49.252166 21098 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.281819 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:49.288636 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:49.297636 21104 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:04:49.298553 20977 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.300228 20977 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:49.300434 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.301841 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.302495 21016 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.302961 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.243495 19990 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:49.303610 20803 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.305215 19990 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.305825 19990 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:49.308629 15321 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:49.309386 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:49.309906 15244 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:49.277798 15243 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
W20260709 13:04:49.312960 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 169280us
I20260709 13:04:49.309222 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:49.315934 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:49.316293 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53317.9us
I20260709 13:04:49.317108 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:49.319559 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.320813 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:49.286866 21042 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.181165 21083 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.290942 21051 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:49.329669 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:49.345239 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.346554 15362 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:49.313207 21013 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:04:49.348408 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 130971us
I20260709 13:04:49.349089 15291 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:49.355610 15396 raft_consensus.cc:2410] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:04:49.318830 21080 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.359375 21042 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:49.373317 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:49.326596 21098 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:49.286584 21093 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:04:49.329155 21094 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:49.377202 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:49.265666 21077 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:49.363853 20548 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:49.360152 21013 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.360339 20803 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:49.364089 21068 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:49.316844 19990 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:49.376747 21098 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.386524 21017 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:49.390990 21013 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:49.403196 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.390581 20803 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:49.404573 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 94049.2us
I20260709 13:04:49.407537 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:49.390873 21068 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.412779 15321 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:49.417820 21112 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:49.417693 21124 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:04:49.403905 21075 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:49.418591 21112 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:49.418772 21075 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.415794 21059 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:49.419261 21075 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:49.419451 21059 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:49.420033 21124 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:49.419653 21112 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.420452 21059 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.421268 21082 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:49.421711 21082 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.422101 21082 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:49.426736 21114 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:49.427296 21114 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:49.427706 21114 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:49.429363 21075 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.410323 20803 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:49.430473 21113 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:49.431886 21122 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:49.437084 21075 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.439606 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.440353 15395 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:49.441376 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:49.441975 15395 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:49.442909 16032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 930) took 1391 ms (client timeout 1530 ms). Trace:
W20260709 13:04:49.447563 21084 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.024s	user 0.005s	sys 0.007s
I20260709 13:04:49.450121 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:49.452371 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.397778 21098 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:49.461536 16032 rpcz_store.cc:269] 0709 13:04:48.051014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.055846 (+  4832us) service_pool.cc:224] Handling call
0709 13:04:49.442669 (+1386823us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54006fed54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:49.442821 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310416256}
I20260709 13:04:49.404829 21117 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.417212 21068 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:49.498880 21072 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.499605 21072 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.501808 21072 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:49.503108 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 156647us
I20260709 13:04:49.504346 21080 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.505076 21080 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:49.507126 15321 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:49.507928 21080 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.518077 20548 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:49.526005 20548 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:49.528268 21106 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.309s	user 0.001s	sys 0.001s
W20260709 13:04:49.529266 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 247565us
I20260709 13:04:49.451412 21081 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:49.552031 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48066.4us
I20260709 13:04:49.553303 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:49.529193 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.480958 21042 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.562561 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:49.560428 21084 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:04:49.563892 21081 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.593695 21081 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.556612 21060 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.562619 21072 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.617738 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.591987 21042 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.591766 21136 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:49.581604 21094 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:04:49.594715 21073 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.562469 21059 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:04:49.485507 21117 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:49.628715 15320 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1959) took 1505 ms (client timeout 1789 ms). Trace:
I20260709 13:04:49.629190 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1976) took 1141 ms. Trace:
I20260709 13:04:49.632637 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.639652 21142 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:49.640321 21142 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.642618 21087 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.168s
I20260709 13:04:49.619987 21095 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:49.637336 15316 rpcz_store.cc:276] 0709 13:04:48.484858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.485031 (+   173us) service_pool.cc:224] Handling call
0709 13:04:49.625937 (+1140906us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54000fb9d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:49.626047 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666379008}
W20260709 13:04:49.636703 15320 rpcz_store.cc:269] 0709 13:04:48.118363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.118535 (+   172us) service_pool.cc:224] Handling call
0709 13:04:49.623415 (+1504880us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54002a6cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:49.623547 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":510488960}
I20260709 13:04:49.629858 21134 raft_consensus.cc:2764] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:04:49.652783 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:49.653412 15320 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:49.649606 21119 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:04:49.663592 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.692876 15391 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:49.693266 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:49.693943 15396 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:49.628051 21042 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.623641 21072 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.662195 21049 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:49.660687 21075 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.705843 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:49.714310 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 60858.6us
I20260709 13:04:49.648643 21136 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.720292 15320 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:49.722865 20690 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.723023 21042 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.724882 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:49.725662 15393 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.755075 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39722 (request call id 3124) took 1985 ms. Trace:
I20260709 13:04:49.755430 15393 rpcz_store.cc:276] 0709 13:04:47.770002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.770154 (+   152us) service_pool.cc:224] Handling call
0709 13:04:49.724449 (+1954295us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54003d86d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf1a3d 00007f366ebc1cd0 00007f3668146254 00007f36681461e2 00007f3668146111 00007f366814608c 00007f3668145342 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:49.755010 (+ 30561us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847947008}
W20260709 13:04:49.726498 15319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 1944) took 2088 ms (client timeout 1781 ms). Trace:
I20260709 13:04:49.692349 21138 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:04:49.705793 21142 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.760488 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:49.728267 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:49.706494 21049 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.728693 21055 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.730368 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:49.764662 15324 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
W20260709 13:04:49.733853 21131 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:04:49.735044 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.770367 15242 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 12.
I20260709 13:04:49.771143 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:49.735906 21139 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:04:49.737228 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.761214 16028 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:49.738508 21136 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.713824 21075 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.740366 21117 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.743315 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 873) took 1303 ms. Trace:
I20260709 13:04:49.728785 19990 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.746949 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:49.698851 21083 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.718536 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:49.750798 15395 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
W20260709 13:04:49.756451 15319 rpcz_store.cc:269] 0709 13:04:47.637773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.638147 (+   374us) service_pool.cc:224] Handling call
0709 13:04:49.726279 (+2088132us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002ed1d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:49.726413 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657073024}
I20260709 13:04:49.763211 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:49.782883 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:49.772981 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.774646 15397 raft_consensus.cc:2410] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:04:49.775183 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:49.776055 15242 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:49.784054 15393 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 12.
I20260709 13:04:49.778115 21147 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:49.787665 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.788321 15395 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:04:49.779019 15325 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:49.777482 16025 rpcz_store.cc:276] 0709 13:04:48.440333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.440962 (+   629us) service_pool.cc:224] Handling call
0709 13:04:48.476684 (+ 35722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:48.823982 (+347298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.743035 (+919053us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54003e26d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:49.743213 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792813952}
I20260709 13:04:49.763415 21085 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.784668 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:49.791178 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:49.785300 15316 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:49.791355 15242 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:49.769547 21049 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:49.793180 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2660) took 1072 ms. Trace:
I20260709 13:04:49.793449 16033 raft_consensus.cc:2393] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:49.796087 15319 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:49.793681 15395 rpcz_store.cc:276] 0709 13:04:48.716223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.787418 (+1071195us) service_pool.cc:224] Handling call
0709 13:04:49.788739 (+  1321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:49.774245 21134 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.798697 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.803004 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.804160 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:49.786828 21087 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:49.805668 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.785451 21081 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.787207 21080 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:49.793023 21147 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:49.815876 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:49.819970 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.826471 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:49.826686 21059 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:49.828014 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:49.799494 21140 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:04:49.831524 15396 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:49.828054 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2675) took 1107 ms. Trace:
I20260709 13:04:49.833587 15397 rpcz_store.cc:276] 0709 13:04:48.720313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.790934 (+1070621us) service_pool.cc:224] Handling call
0709 13:04:49.827990 (+ 37056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:49.836119 15396 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:04:49.836513 15396 pending_rounds.cc:85] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 8
I20260709 13:04:49.836736 15396 pending_rounds.cc:107] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:04:49.836980 15396 raft_consensus.cc:2889] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:49.838135 15397 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:49.838861 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2667) took 1120 ms. Trace:
I20260709 13:04:49.839191 15397 rpcz_store.cc:276] 0709 13:04:48.718125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.834577 (+1116452us) service_pool.cc:224] Handling call
0709 13:04:49.837900 (+  3323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:49.838595 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.838801 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:49.840878 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.842267 15243 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:49.843276 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.844794 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:49.855450 15243 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:49.846084 21072 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.828310 21087 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.846984 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1947) took 1169 ms. Trace:
I20260709 13:04:49.847441 21080 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:49.849033 21075 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.827303 21059 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.844975 20803 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.856036 15243 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:49.856513 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2666) took 1138 ms. Trace:
I20260709 13:04:49.869253 15396 rpcz_store.cc:276] 0709 13:04:48.717882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.833893 (+1116011us) service_pool.cc:224] Handling call
0709 13:04:49.834174 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:49.856196 (+ 22022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.856449 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:49.877170 15242 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:49.878059 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 769) took 1206 ms. Trace:
I20260709 13:04:49.879515 21059 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.881857 21062 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.855314 21081 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:49.882544 21082 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.882661 21081 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.883567 20768 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.884984 21082 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.885162 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:49.885986 15241 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:49.886874 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:49.881858 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 704) took 1329 ms. Trace:
I20260709 13:04:49.895722 15246 rpcz_store.cc:276] 0709 13:04:48.552170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.552378 (+   208us) service_pool.cc:224] Handling call
0709 13:04:48.590744 (+ 38366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:48.874172 (+283428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.881575 (+1007403us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540010b154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:49.881783 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582276352}
I20260709 13:04:49.878525 15392 rpcz_store.cc:276] 0709 13:04:48.671457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.692993 (+ 21536us) service_pool.cc:224] Handling call
0709 13:04:48.752252 (+ 59259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:48.889037 (+136785us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:04:49.159077 (+270040us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.622009 (+462932us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.623208 (+  1199us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:49.623276 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:49.623325 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.727612 (+104287us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b180037e520. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d522 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:04:49.877113 (+149501us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b180037e520. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419
0709 13:04:49.877825 (+   712us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54002bdc54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:49.877871 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:49.878001 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48135,"prepare.queue_time_us":348855,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":2857,"raft.queue_time_us":59098,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":11866,"spinlock_wait_cycles":410743680,"thread_start_us":662751,"threads_started":3,"wal-append.queue_time_us":257440}
I20260709 13:04:49.866057 21087 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:49.796020 21085 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:49.862813 15249 rpcz_store.cc:276] 0709 13:04:48.666198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.667088 (+   890us) service_pool.cc:224] Handling call
0709 13:04:48.676026 (+  8938us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:48.908613 (+232587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:48.908661 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:48.928876 (+ 20215us) log.cc:844] Serialized 26 byte log entry
0709 13:04:49.380257 (+451381us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:49.380295 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.380371 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:49.835355 (+454984us) raft_consensus.cc:1685] finished
0709 13:04:49.835377 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:49.835521 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100194,"raft.queue_time_us":123596,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":10564,"thread_start_us":370676,"threads_started":2,"wal-append.queue_time_us":365534}
I20260709 13:04:49.901641 15243 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.907200 15243 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:49.915665 21114 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:49.918002 20803 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.918402 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:49.918720 21147 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:49.833046 21134 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:49.885056 21081 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:49.924059 15246 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:04:49.924751 21080 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:49.932264 15243 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:49.942720 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:49.946370 15249 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:49.948938 15393 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:49.955843 15243 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:49.965065 15390 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:04:49.966415 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:49.964176 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:49.976730 15243 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:49.983397 15392 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:49.984433 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2677) took 1263 ms. Trace:
I20260709 13:04:49.984918 15392 rpcz_store.cc:276] 0709 13:04:48.720895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.967916 (+1247021us) service_pool.cc:224] Handling call
0709 13:04:49.983104 (+ 15188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:49.984124 (+  1020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.984362 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:49.991569 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 774) took 1196 ms. Trace:
I20260709 13:04:49.992262 15396 rpcz_store.cc:276] 0709 13:04:48.794793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.967366 (+1172573us) service_pool.cc:224] Handling call
0709 13:04:49.990706 (+ 23340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:49.991012 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:49.991055 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:49.991122 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:49.991183 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.991267 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:49.991460 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:49.962560 20768 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:50.004467 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3143) took 1206 ms. Trace:
I20260709 13:04:50.028175 15392 rpcz_store.cc:276] 0709 13:04:48.797810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.986030 (+1188220us) service_pool.cc:224] Handling call
0709 13:04:50.003771 (+ 17741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.004044 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.004083 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:50.004135 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:50.004171 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.004237 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.004391 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:50.014026 20768 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:50.015941 21098 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
I20260709 13:04:50.016145 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2661) took 1299 ms. Trace:
W20260709 13:04:50.017349 21013 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.001s
I20260709 13:04:50.034616 15390 rpcz_store.cc:276] 0709 13:04:48.716486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.819683 (+1103197us) service_pool.cc:224] Handling call
0709 13:04:50.015884 (+196201us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54003d90d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:50.016075 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331053312}
I20260709 13:04:50.018853 15321 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:50.019383 21093 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:50.019574 15246 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:50.025655 15319 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:50.011955 21134 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:49.988720 20950 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:50.018618 21114 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:50.041335 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 775) took 1151 ms. Trace:
I20260709 13:04:50.041752 15392 rpcz_store.cc:276] 0709 13:04:48.889588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.029431 (+1139843us) service_pool.cc:224] Handling call
0709 13:04:50.040943 (+ 11512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.041076 (+   133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.041091 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:50.041120 (+    29us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:50.041141 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.041178 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.041258 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:50.046895 21155 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:04:50.055595 21085 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:50.057281 15325 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:50.061069 20448 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.063418 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2655) took 1350 ms. Trace:
I20260709 13:04:50.063922 15399 rpcz_store.cc:276] 0709 13:04:48.713313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.740988 (+ 27675us) service_pool.cc:224] Handling call
0709 13:04:50.063136 (+1322148us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b5400026cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:50.063323 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764869504}
I20260709 13:04:50.065397 15390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c377e25836b14680beed769c143a593c"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:04:50.066154 15390 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:50.066601 15390 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.071481 15396 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:04:50.071964 15396 pending_rounds.cc:85] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 11
I20260709 13:04:50.072221 15396 pending_rounds.cc:107] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:04:50.072484 15396 raft_consensus.cc:2889] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.065507 15399 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:50.038450 21093 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:50.038127 21098 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.084156 15392 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:50.085700 21098 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:50.087205 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1948) took 1420 ms. Trace:
I20260709 13:04:50.089871 20706 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:50.096231 15319 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:04:50.042753 21013 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:50.094164 21068 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:04:50.104048 21068 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.105468 21013 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.108112 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:50.109077 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:50.103256 20768 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:50.124315 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.127213 15394 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:50.125933 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:50.127875 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39722 (request call id 3129) took 2164 ms. Trace:
W20260709 13:04:50.128111 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.101837 21087 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.130798 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.131070 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.131563 15244 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:50.131883 15246 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:50.132308 21087 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.129182 20768 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:50.129673 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.129964 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:50.132925 15395 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:50.133235 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.134192 15241 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:50.132954 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:50.201030 15318 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:50.136067 15319 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:50.128257 15394 rpcz_store.cc:276] 0709 13:04:47.963534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.964677 (+  1143us) service_pool.cc:224] Handling call
0709 13:04:49.468396 (+1503719us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540009bfd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf1a3d 00007f366ebc1cd0 00007f3668146254 00007f36681461e2 00007f3668146111 00007f366814608c 00007f3668145342 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:49.815868 (+347472us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b4c00537240. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3667ec6a20 00007f3667ed7a29 00007f3667ed813f 00007f3667e9c2ab 00007f3667ec9f3c 00007f3667eca3fe 00007f366815788b 00007f3669b56495 00007f3669ba730f 00007f3669bf1a55 00007f366ebc1cd0
0709 13:04:50.127089 (+311221us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4c00536ec0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3667ec6a20 00007f3667ed7a29 00007f3667ed813f 00007f3667e9c2ab 00007f3667ec9f3c 00007f3667eca3fe 00007f366815788b 00007f3669b56495 00007f3669ba730f 00007f3669bf1a55 00007f366ebc1cd0
0709 13:04:50.127783 (+   694us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371970048}
I20260709 13:04:50.203020 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:50.124222 21049 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:50.177702 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.146673 20768 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:50.146641 21089 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:50.136359 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3112) took 1050 ms. Trace:
I20260709 13:04:50.146414 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:50.192206 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1951) took 1256 ms. Trace:
I20260709 13:04:50.201552 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:50.200805 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:50.198634 15390 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.209301 15394 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:50.211588 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.212225 21068 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:50.218255 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:50.228552 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.220888 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:50.214685 15247 rpcz_store.cc:276] 0709 13:04:48.936130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.937608 (+  1478us) service_pool.cc:224] Handling call
0709 13:04:49.066582 (+128974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:49.133978 (+ 67396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:49.134014 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:49.134059 (+    45us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:04:49.134096 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.150172 (+1016076us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b540011a8d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:50.191959 (+ 41787us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.192133 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154427264}
I20260709 13:04:50.231588 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:50.232564 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.236450 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:50.240617 15393 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:50.236529 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:50.240166 15319 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:04:50.228451 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 159083us
I20260709 13:04:50.213922 15322 rpcz_store.cc:276] 0709 13:04:49.086068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.904482 (+818414us) service_pool.cc:224] Handling call
0709 13:04:49.904842 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:49.919865 (+ 15023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:49.919899 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:49.923392 (+  3493us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.033860 (+110468us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:50.033912 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.033995 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.136116 (+102121us) raft_consensus.cc:1685] finished
0709 13:04:50.136140 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.136297 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14621,"raft.queue_time_us":14991,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":20581,"thread_start_us":65792,"threads_started":1,"wal-append.queue_time_us":149132}
I20260709 13:04:50.245141 16024 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:50.245690 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:50.249749 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.250614 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:50.250939 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.250661 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.257382 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:50.227672 20768 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.213580 21098 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.233829 21110 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:50.267942 21110 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.268558 21110 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.264185 20884 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.270267 20884 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.261255 21147 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:04:50.272887 20884 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:50.276556 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:50.279174 15398 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:04:50.279929 21158 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:04:50.280862 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2668) took 1562 ms. Trace:
I20260709 13:04:50.281644 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3107) took 1196 ms. Trace:
I20260709 13:04:50.283366 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2670) took 1564 ms. Trace:
I20260709 13:04:50.282059 15316 rpcz_store.cc:276] 0709 13:04:49.084974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.794201 (+709227us) service_pool.cc:224] Handling call
0709 13:04:49.794671 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:49.795027 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:49.795053 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:49.799889 (+  4836us) log.cc:844] Serialized 26 byte log entry
0709 13:04:49.965486 (+165597us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:49.971202 (+  5716us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.978158 (+  6956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.978313 (+   155us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.279352 (+301039us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:50.281313 (+  1961us) raft_consensus.cc:1685] finished
0709 13:04:50.281428 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.281581 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6666,"prepare.queue_time_us":47416,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":6960,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":12370,"spinlock_wait_cycles":15832064,"thread_start_us":103211,"threads_started":1,"wal-append.queue_time_us":240772}
I20260709 13:04:50.283803 15395 rpcz_store.cc:276] 0709 13:04:48.718988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.805437 (+1086449us) service_pool.cc:224] Handling call
0709 13:04:50.283147 (+477710us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54003d8bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:50.283309 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686756608}
I20260709 13:04:50.261158 21075 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:50.287035 21075 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:50.287967 21075 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.234359 20940 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:50.291877 20940 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.292301 20940 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.294552 21044 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.265122 15390 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:50.297756 15390 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:04:50.227957 21124 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:04:50.298731 15397 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:50.299062 21026 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:50.299111 21098 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.299681 21026 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:50.300185 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:50.300786 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2669) took 1582 ms. Trace:
I20260709 13:04:50.301057 21089 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:50.244014 21085 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:50.254743 21112 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:50.239673 20706 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:50.302418 21112 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:50.302798 20706 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:50.303560 20706 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:50.303357 21112 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.306149 15242 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:04:50.311831 21017 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:50.311959 15394 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:50.312377 21017 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.306532 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:50.261427 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:50.314738 15393 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:50.281335 15398 rpcz_store.cc:276] 0709 13:04:48.718416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.217283 (+498867us) service_pool.cc:224] Handling call
0709 13:04:50.280627 (+1063344us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002b5054. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:50.280790 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2364419328}
I20260709 13:04:50.315115 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2750) took 1226 ms. Trace:
W20260709 13:04:50.315426 21157 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.318s	user 0.000s	sys 0.005s
I20260709 13:04:50.315506 15248 rpcz_store.cc:276] 0709 13:04:49.088820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.105519 (+ 16699us) service_pool.cc:224] Handling call
0709 13:04:50.314886 (+1209367us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b540010c054. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:50.315033 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095056768}
I20260709 13:04:50.267848 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:50.314574 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:50.317195 15244 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:50.249837 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 119950us
I20260709 13:04:50.298162 15390 pending_rounds.cc:85] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 8
I20260709 13:04:50.321950 15390 pending_rounds.cc:107] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:04:50.322368 15390 raft_consensus.cc:2889] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.313946 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.326828 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3102) took 1243 ms. Trace:
I20260709 13:04:50.277909 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:50.301211 15397 rpcz_store.cc:276] 0709 13:04:48.718709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.840104 (+1121395us) service_pool.cc:224] Handling call
0709 13:04:50.298358 (+458254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.299193 (+   835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.300545 (+  1352us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54001540d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:50.300718 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053052288}
I20260709 13:04:50.307327 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2679) took 1491 ms. Trace:
I20260709 13:04:50.330054 15396 rpcz_store.cc:276] 0709 13:04:48.816205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.993737 (+1177532us) service_pool.cc:224] Handling call
0709 13:04:50.066016 (+ 72279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.079552 (+ 13536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.307099 (+227547us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b5400026cd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:50.307252 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100009216}
I20260709 13:04:50.308184 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:50.264518 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.336953 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:50.338706 20548 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:50.339148 20548 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.339468 20548 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.339921 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:50.338199 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 267500us
I20260709 13:04:50.343636 15392 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:50.327392 15324 rpcz_store.cc:276] 0709 13:04:49.083791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.765361 (+681570us) service_pool.cc:224] Handling call
0709 13:04:49.774029 (+  8668us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:49.789016 (+ 14987us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:49.805056 (+ 16040us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.893593 (+ 88537us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18004ac740. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:04:49.960592 (+ 66999us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:49.966296 (+  5704us) log.cc:844] Serialized 52 byte log entry
0709 13:04:49.966471 (+   175us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:50.320438 (+353967us) log.cc:844] Serialized 14 byte log entry
0709 13:04:50.321007 (+   569us) log.cc:844] Serialized 14 byte log entry
0709 13:04:50.326382 (+  5375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.326546 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.326591 (+    45us) raft_consensus.cc:1685] finished
0709 13:04:50.326604 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.326752 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11971,"prepare.queue_time_us":60904,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":2196,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":7389,"spinlock_wait_cycles":6078208,"thread_start_us":360195,"threads_started":2,"wal-append.queue_time_us":231866}
I20260709 13:04:50.301604 21089 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:50.258831 21080 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:50.352212 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.352504 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:50.353083 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.307039 21026 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.301486 21098 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:50.340874 21124 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.340569 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:50.354311 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:50.370270 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:50.326164 21062 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.364185 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:50.370852 15248 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:50.371358 15398 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:50.368076 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:50.376243 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:50.362087 15390 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:50.376921 15324 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.375336 15248 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:50.359395 15397 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:50.357893 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:50.349301 21089 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:50.380893 15241 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:50.378574 21165 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:04:50.387598 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3104) took 1303 ms. Trace:
I20260709 13:04:50.390334 15320 rpcz_store.cc:276] 0709 13:04:49.084285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.784573 (+700288us) service_pool.cc:224] Handling call
0709 13:04:49.794622 (+ 10049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:49.794837 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:49.794863 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:49.795295 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:04:49.904636 (+109341us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:49.951339 (+ 46703us) log.cc:844] Serialized 14 byte log entry
0709 13:04:50.008258 (+ 56919us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b18000b5840. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f36697b0d70 00007f36697a4293 00007f3669799cea 00007f366979a23a 00007f3669c04a2a 00007f3669c140bf 00007f3669c14038
0709 13:04:50.008629 (+   371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.008732 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.208753 (+200021us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:50.387393 (+178640us) raft_consensus.cc:1685] finished
0709 13:04:50.387416 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.387540 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8773,"prepare.queue_time_us":21592,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":5980,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"spinlock_wait_cycles":10665344,"thread_start_us":81908,"threads_started":2,"wal-append.queue_time_us":142290}
I20260709 13:04:50.388819 15241 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:50.396030 15244 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:50.353927 15246 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:50.397413 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:50.367383 21072 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:50.362998 21124 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.363922 21049 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:50.360666 21026 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.399426 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:50.394666 15241 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.401157 15398 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.406330 15241 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.401458 15392 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:50.404268 15390 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:50.405956 15248 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.362607 21044 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:04:50.409168 15248 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.411646 15246 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:50.390865 21017 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.384122 21087 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:04:50.413581 21049 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:50.415067 21087 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:50.415454 21087 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:50.416313 21087 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.417512 21087 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.378659 21062 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.418448 20706 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.420362 21062 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:50.390550 21080 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:04:50.424594 15248 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:50.384690 20940 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.433809 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:50.435464 15398 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:50.437176 15324 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:04:50.409684 21098 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:50.426720 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:50.483229 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56983.1us
I20260709 13:04:50.423022 21072 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:50.422422 20706 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:50.481487 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:50.407742 20768 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:50.479140 21157 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:04:50.481226 21042 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:50.481014 21098 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.490041 20448 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:50.543853 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 107387us
I20260709 13:04:50.544924 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:50.500581 21113 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:50.497901 21085 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:04:50.510623 21042 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:50.511356 21098 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:50.547843 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 139152us
I20260709 13:04:50.559147 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:50.566184 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:50.548152 20448 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:50.569316 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 703) took 2420 ms. Trace:
I20260709 13:04:50.551723 20706 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:50.563884 21110 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.564034 21133 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:50.556749 21042 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:50.553752 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 149516us
I20260709 13:04:50.569752 15250 rpcz_store.cc:276] 0709 13:04:48.145665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.147682 (+  2017us) service_pool.cc:224] Handling call
0709 13:04:48.147987 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:48.174558 (+ 26571us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:04:48.478306 (+303748us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.094675 (+616369us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b18003a0660. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287
0709 13:04:49.393151 (+298476us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.400125 (+  6974us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:49.400180 (+    55us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:04:49.402863 (+  2683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.565461 (+1162598us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b54001a7cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:50.565516 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.565644 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60379,"prepare.queue_time_us":653945,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":14852,"raft.queue_time_us":171351,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":11840,"spinlock_wait_cycles":49250432,"thread_start_us":738591,"threads_started":4,"wal-append.queue_time_us":321464,"wal-append.run_cpu_time_us":3004,"wal-append.run_wall_time_us":1588966}
I20260709 13:04:50.584729 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:50.587334 15998 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:50.564179 21012 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:04:50.576167 21113 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:50.603508 15249 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:50.600664 16024 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:04:50.602118 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:50.602835 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:50.605314 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 237320us
I20260709 13:04:50.606585 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:50.627404 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:50.597883 21164 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:04:50.636219 16024 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:50.638870 15393 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:50.593938 20706 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:50.644096 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:50.578617 21028 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:04:50.597308 21016 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:50.579339 21136 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:04:50.607712 21017 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.633406 21113 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:50.654737 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:50.636068 21072 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:50.638264 20803 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:50.663820 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:50.637354 21124 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.639753 21026 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:50.650934 21016 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.674221 15241 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:50.653211 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:50.667963 21081 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:50.697175 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:50.686568 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:50.657264 21085 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:04:50.694024 21016 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:50.692102 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 108896us
I20260709 13:04:50.704522 16033 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:50.675777 20803 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.710053 21185 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:50.713742 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:50.714351 21185 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:50.718612 21113 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.682156 20448 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.661636 21060 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:04:50.693545 20768 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.650274 20920 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:04:50.682667 21136 consensus_queue.cc:1243] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:04:50.669510 20940 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.723470 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:50.725054 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3152) took 1276 ms. Trace:
I20260709 13:04:50.726919 15247 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:04:50.713436 20803 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:50.743511 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 361274us
I20260709 13:04:50.752745 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:50.753948 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:50.693619 21026 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.773810 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:50.774861 21180 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:04:50.779649 20548 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.783535 21156 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:50.784067 21156 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:50.785027 21156 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.736464 21097 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:50.787532 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:50.788348 16032 raft_consensus.cc:2393] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 13: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:50.793087 20768 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.795862 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 778) took 1033 ms. Trace:
I20260709 13:04:50.796528 15318 rpcz_store.cc:276] 0709 13:04:49.762705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.238503 (+475798us) service_pool.cc:224] Handling call
0709 13:04:50.241352 (+  2849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.247042 (+  5690us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.247078 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.247554 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.583551 (+335997us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:50.583592 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.583658 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.795510 (+211852us) raft_consensus.cc:1685] finished
0709 13:04:50.795546 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.795763 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":10571,"thread_start_us":232506,"threads_started":1,"wal-append.queue_time_us":334930}
I20260709 13:04:50.797966 21110 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:50.798465 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3122) took 1267 ms. Trace:
I20260709 13:04:50.799103 15321 rpcz_store.cc:276] 0709 13:04:49.531368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.037208 (+505840us) service_pool.cc:224] Handling call
0709 13:04:50.043784 (+  6576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.044181 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.044215 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.044684 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.428342 (+383658us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:50.488069 (+ 59727us) log.cc:844] Serialized 14 byte log entry
0709 13:04:50.488333 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.488447 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.798169 (+309722us) raft_consensus.cc:1685] finished
0709 13:04:50.798189 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.798381 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57852,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1701,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":16535,"spinlock_wait_cycles":9551616,"thread_start_us":341129,"threads_started":1,"wal-append.queue_time_us":719202}
I20260709 13:04:50.802951 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:50.736564 20977 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:04:50.730928 20706 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:50.804625 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.747728 21124 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:04:50.807749 21124 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:04:50.807888 21171 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:04:50.808200 21124 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:50.808728 20940 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:50.809417 20940 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:50.809065 21124 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.810381 21093 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.811585 21093 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.812358 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:50.813565 15324 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:50.813777 15316 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:04:50.814608 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:50.814826 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:50.815191 15317 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.815478 15325 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:50.755453 20884 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:50.818951 20884 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:50.819976 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:50.819896 20884 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.821171 20920 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:50.750254 20782 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:50.821774 20920 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:50.822165 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:50.822721 20920 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.823964 20920 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.824424 21124 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:50.826660 21097 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:50.826931 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:50.827715 21097 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.772732 21060 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:50.829900 21060 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:50.830772 21060 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.831838 15244 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:50.831965 21060 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.832696 20977 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:50.833112 20977 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:50.833287 15244 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:04:50.833972 20977 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.090683 15245 rpcz_store.cc:276] 0709 13:04:48.666514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.667520 (+  1006us) service_pool.cc:224] Handling call
0709 13:04:48.691896 (+ 24376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:49.108450 (+416554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:49.108496 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:49.121679 (+ 13183us) log.cc:844] Serialized 26 byte log entry
0709 13:04:49.258081 (+136402us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:04:49.590834 (+332753us) log.cc:844] Serialized 14 byte log entry
0709 13:04:50.086523 (+495689us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b1800233d40. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:04:50.086729 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.086812 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.086861 (+    49us) raft_consensus.cc:1685] finished
0709 13:04:50.086965 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.087125 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122782,"prepare.queue_time_us":297999,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":619580,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":8915,"spinlock_wait_cycles":11104640,"thread_start_us":723442,"threads_started":3,"wal-append.queue_time_us":263156}
I20260709 13:04:50.835318 20977 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.835093 21085 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:50.836395 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:50.836592 21085 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:50.837025 21085 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:50.838029 21133 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:50.837824 21085 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.815763 21026 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:50.838760 21133 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:50.839082 21085 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:50.839800 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.840240 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.840668 21026 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:50.841094 21026 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:50.793707 20768 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.835945 15245 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:50.841910 21026 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.842276 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:50.842952 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:50.843284 20768 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.843532 15398 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:50.844023 21134 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.844503 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:50.844511 21134 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.845224 15392 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.846599 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:50.846824 21134 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:50.821269 20884 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.852119 21156 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.853346 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:50.854050 15245 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.506184 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:50.859146 16025 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:04:50.862527 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 777) took 1010 ms. Trace:
I20260709 13:04:50.862980 15394 rpcz_store.cc:276] 0709 13:04:49.851791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.313397 (+461606us) service_pool.cc:224] Handling call
0709 13:04:50.313755 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.314851 (+  1096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.314884 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.315426 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.541251 (+225825us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:50.541296 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.541371 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.862273 (+320902us) raft_consensus.cc:1685] finished
0709 13:04:50.862297 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.862461 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":531,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":225419,"threads_started":1,"wal-append.queue_time_us":440693}
I20260709 13:04:50.856556 15148 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.867479 21135 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:50.867940 21135 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:50.868947 21135 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.781970 20548 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.874377 15244 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:50.880101 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:50.867126 21089 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:50.882169 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.887327 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:50.769888 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 182661us
I20260709 13:04:50.748663 21081 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:50.890959 15324 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:04:50.749104 15391 rpcz_store.cc:276] 0709 13:04:49.448568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.295751 (+847183us) service_pool.cc:224] Handling call
0709 13:04:50.296091 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.296300 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:50.584329 (+288029us) log.cc:844] Serialized 14 byte log entry
0709 13:04:50.723901 (+139572us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:50.724107 (+   206us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:50.724249 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.724508 (+   259us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.724857 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19933,"prepare.queue_time_us":405628,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":20770,"spinlock_wait_cycles":11278208,"thread_start_us":397057,"threads_started":2}
I20260709 13:04:50.894430 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:50.911265 15213 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:50.871554 21135 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.849295 21042 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.915870 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:50.918489 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:50.931967 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:50.919862 15316 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:50.923918 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:50.927855 15246 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:04:50.936858 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.937433 15317 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:50.939261 15392 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:50.925601 21136 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.918782 21026 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.941030 21028 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:50.941965 20548 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:50.943753 20548 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:50.944141 20548 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:50.944983 20548 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:50.946743 21111 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:50.947474 21111 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:50.947867 21111 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:50.918129 20825 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:04:50.948280 21111 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.948823 20825 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:50.949210 20825 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:50.925964 20940 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:50.951261 20940 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:50.951750 21089 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.952435 21087 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.952265 20940 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.953025 21087 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:50.946159 15145 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49186 (request call id 216) took 63315 ms (client timeout 15000 ms). Trace:
I20260709 13:04:50.926266 21017 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:50.955319 21087 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.955627 21017 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.955914 21042 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:50.956111 21017 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:50.956331 21012 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:50.909337 21072 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.957402 21072 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.909283 21110 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.958803 21110 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:50.914119 21081 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:50.959743 21081 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:50.960940 21110 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:50.950102 20825 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:50.965996 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 76639.5us
I20260709 13:04:50.968997 15245 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:50.972378 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:50.973425 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53658.1us
W20260709 13:04:50.909075 21177 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
W20260709 13:04:50.983174 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47236.7us
I20260709 13:04:50.986521 21118 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:50.989450 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:50.992251 21118 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:50.939071 20884 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:50.998405 21094 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:50.998960 21094 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:50.999888 21094 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.001219 21094 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:50.954887 15145 rpcz_store.cc:269] 0709 13:03:47.641498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.644776 (+  3278us) service_pool.cc:224] Handling call
0709 13:03:48.857122 (+1212346us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b64090 00007f3669c02f3a 00007f366f9b91cc 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc 00007f366df77392 00007f3667f3548c 00007f3667f348c6
0709 13:04:50.945880 (+62088758us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:44.884003 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:44.884792 (+   789us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:44.884872 (+    80us) write_op.cc:435] Acquired schema lock
0709 13:04:44.884893 (+    21us) tablet.cc:662] Decoding operations
0709 13:04:44.885518 (+   625us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:44.885634 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:44.885682 (+    48us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:44.890247 (+  4565us) tablet.cc:701] Row locks acquired
0709 13:04:44.911256 (+ 21009us) write_op.cc:260] PREPARE: finished
0709 13:04:44.949442 (+ 38186us) write_op.cc:270] Start()
0709 13:04:44.970544 (+ 21102us) write_op.cc:276] Timestamp: P: 1783602284937134 usec, L: 0
0709 13:04:44.978364 (+  7820us) op_driver.cc:348] REPLICATION: starting
0709 13:04:44.979199 (+   835us) log.cc:844] Serialized 935 byte log entry
0709 13:04:45.586772 (+607573us) op_driver.cc:464] REPLICATION: finished
0709 13:04:45.732255 (+145483us) write_op.cc:301] APPLY: starting
0709 13:04:45.732364 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:45.734600 (+  2236us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:45.734720 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:45.736028 (+  1308us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:45.736332 (+   304us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:04:45.736381 (+    49us) write_op.cc:312] APPLY: finished
0709 13:04:45.736658 (+   277us) log.cc:844] Serialized 33 byte log entry
0709 13:04:45.757947 (+ 21289us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:45.759381 (+  1434us) write_op.cc:454] Released schema lock
0709 13:04:45.763554 (+  4173us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:45.807842 (+ 44288us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:45.807877 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1231854,"reported_tablets":51,"spinlock_wait_cycles":393043840,"child_traces":[["op",{"apply.queue_time_us":145182,"apply.run_cpu_time_us":5592,"apply.run_wall_time_us":75571,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12483,"num_ops":2,"prepare.queue_time_us":662124,"prepare.run_cpu_time_us":19299,"prepare.run_wall_time_us":284349,"raft.queue_time_us":262136,"raft.run_cpu_time_us":6450,"raft.run_wall_time_us":199929,"replication_time_us":608203,"spinlock_wait_cycles":1889024,"thread_start_us":965706,"threads_started":4,"wal-append.queue_time_us":275371,"wal-append.run_cpu_time_us":9707,"wal-append.run_wall_time_us":1482921}]]}
W20260709 13:04:51.004940 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 81143.7us
I20260709 13:04:51.007702 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:51.007911 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:51.008750 15316 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:51.016290 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:51.021754 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.023874 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:04:51.023990 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56691.4us
W20260709 13:04:51.025795 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53562.5us
I20260709 13:04:51.026660 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:51.027655 15148 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:51.029633 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:51.028512 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 50065.3us
I20260709 13:04:51.033124 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:51.033874 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.961192 21111 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.037813 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:51.040004 15246 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:04:51.033901 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 372313us
W20260709 13:04:51.046926 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.047557 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:51.035389 15148 catalog_manager.cc:5697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 9 to 12, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 12 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:51.040910 21087 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:04:51.039276 21028 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:51.028999 20950 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:51.049409 15148 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 9 to 12, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 12 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:51.041222 20782 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:51.028138 20548 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:51.053987 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:51.076122 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:51.032968 21133 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:51.057330 15148 catalog_manager.cc:5697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 7 to 10, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 10 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:51.051025 20782 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:51.087108 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49379.8us
I20260709 13:04:51.032511 20825 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:51.089386 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:51.046802 21089 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:51.098981 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:51.058532 21150 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:51.011137 21016 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.112169 15148 catalog_manager.cc:5697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 3 to 13, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 13 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:04:51.129489 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3159) took 1002 ms. Trace:
I20260709 13:04:51.038663 21178 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:04:51.129987 15393 rpcz_store.cc:276] 0709 13:04:50.126914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.341262 (+214348us) service_pool.cc:224] Handling call
0709 13:04:50.341597 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.639387 (+297790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.129189 (+489802us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b540009bfd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:51.129415 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683127680}
I20260709 13:04:51.085757 20950 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:51.091357 21095 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:51.131595 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3151) took 1688 ms. Trace:
I20260709 13:04:51.088896 21133 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:51.137108 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:51.137887 15243 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:51.075474 21165 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:04:51.143832 15395 rpcz_store.cc:276] 0709 13:04:49.443432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.285885 (+842453us) service_pool.cc:224] Handling call
0709 13:04:50.286218 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.348050 (+ 61832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.348079 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.360960 (+ 12881us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.596523 (+235563us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:50.596564 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.596637 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:51.131302 (+534665us) raft_consensus.cc:1685] finished
0709 13:04:51.131335 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.131524 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3703,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":13391,"thread_start_us":235161,"threads_started":1,"wal-append.queue_time_us":338239}
I20260709 13:04:51.052076 21184 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 13:04:51.152313 15248 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:04:51.156864 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.153189 15245 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:04:51.091846 21012 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:04:51.116350 21186 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:51.169291 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:51.170454 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89824.9us
I20260709 13:04:51.155916 21015 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:04:51.148336 21075 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:04:51.150166 21098 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.000s
I20260709 13:04:51.181404 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.182061 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:51.175196 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.174650 15148 catalog_manager.cc:5697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:51.127223 21044 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:04:51.179530 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:51.182302 15390 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:51.157423 21111 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:51.160245 20782 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:51.198464 15394 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:51.203450 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.204301 15396 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:04:51.211817 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:51.216017 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.217198 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:51.180647 21072 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:51.230798 15394 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:51.150480 21198 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:04:51.237082 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.240485 21049 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:51.251338 21016 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:51.253237 21087 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:51.253698 21087 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:51.251328 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 1978) took 1003 ms. Trace:
I20260709 13:04:51.237134 15396 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:51.161497 20950 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:51.256139 15243 rpcz_store.cc:276] 0709 13:04:50.247687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.492371 (+244684us) service_pool.cc:224] Handling call
0709 13:04:50.509699 (+ 17328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:51.149495 (+639796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.251096 (+101601us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b540023a5d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:51.251263 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443798784}
I20260709 13:04:51.261619 21044 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:51.266633 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.190894 21098 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:51.298868 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:51.295431 15323 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:51.298652 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:51.319867 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:51.320595 15319 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:51.321184 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:51.256484 20803 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.236235 21192 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:51.275606 21072 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:51.323730 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:51.329394 15395 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:04:51.325829 15243 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:51.306354 15242 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:04:51.229408 21075 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:51.282014 21136 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:51.331578 21123 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:51.277503 21044 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:51.217468 21133 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.328872 21026 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:04:51.423565 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.345289 21072 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:51.424049 15321 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.424495 15319 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
W20260709 13:04:51.425307 15362 leader_election.cc:336] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.546s (SENT)
W20260709 13:04:51.436767 15362 leader_election.cc:336] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.548s (SENT)
W20260709 13:04:51.440632 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 292759us
I20260709 13:04:51.305197 15394 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
W20260709 13:04:51.446354 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:51.440801 15362 leader_election.cc:336] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.588s (SENT)
I20260709 13:04:51.328715 21087 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:51.432629 21181 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.105s	user 0.000s	sys 0.004s
I20260709 13:04:51.457814 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:51.460821 15245 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 12: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:51.438190 20920 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.008s
W20260709 13:04:51.467336 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 413403us
I20260709 13:04:51.471302 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:51.453382 21194 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 13:04:51.437100 21089 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:51.467756 21081 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.003s
I20260709 13:04:51.456296 21026 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:51.489604 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:51.472244 21093 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.488621 21081 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:51.493278 15243 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:04:51.493498 21044 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:51.495188 21098 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:51.475869 21133 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:51.522336 21072 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.454648 21080 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:04:51.532523 15316 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:51.533349 21081 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:51.513152 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:51.536489 21169 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:51.536978 21169 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:51.538561 21093 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.541615 21142 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:51.542207 21142 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:51.543170 21142 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.544703 21142 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:51.546695 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2770) took 1226 ms. Trace:
I20260709 13:04:51.547246 15241 rpcz_store.cc:276] 0709 13:04:50.320586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.685882 (+365296us) service_pool.cc:224] Handling call
0709 13:04:50.711621 (+ 25739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.731995 (+ 20374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.732041 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.732625 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:04:51.019444 (+286819us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:51.020587 (+  1143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.025521 (+  4934us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:51.546415 (+520894us) raft_consensus.cc:1685] finished
0709 13:04:51.546443 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.546616 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32703,"raft.queue_time_us":24076,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":7024,"thread_start_us":243530,"threads_started":1,"wal-append.queue_time_us":331834}
I20260709 13:04:51.548663 21093 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:51.549410 20803 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:51.551112 15246 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:04:51.553330 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 55268.1us
I20260709 13:04:51.488178 20920 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:04:51.500509 20548 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:51.515134 20825 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:51.514699 21026 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.515849 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 943) took 1197 ms. Trace:
W20260709 13:04:51.562139 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:51.517998 21017 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 13:04:51.482693 21087 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:51.572445 16025 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:04:51.581305 16025 pending_rounds.cc:85] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 13
I20260709 13:04:51.581672 16025 pending_rounds.cc:107] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:04:51.581943 16025 raft_consensus.cc:2889] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:51.577988 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:51.511170 21094 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.509s	user 0.003s	sys 0.009s
I20260709 13:04:51.589905 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:51.560757 16030 rpcz_store.cc:276] 0709 13:04:50.318698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.318846 (+   148us) service_pool.cc:224] Handling call
0709 13:04:50.325804 (+  6958us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.339157 (+ 13353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.339188 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.339669 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.542962 (+203293us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:50.543018 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.543115 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:51.515578 (+972463us) raft_consensus.cc:1685] finished
0709 13:04:51.515602 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.515780 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22953,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":13132,"thread_start_us":202825,"threads_started":1,"wal-append.queue_time_us":983354}
W20260709 13:04:51.606244 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.610389 15391 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:04:51.500500 21075 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.619442 21114 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:51.622754 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.631933 21089 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.604439 21185 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:04:51.635442 21185 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:51.635854 21185 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:51.636758 21185 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:51.575248 20548 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:51.646597 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:51.652060 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 162649us
I20260709 13:04:51.653146 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:51.638010 21185 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:51.664831 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:51.665709 16032 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:51.662371 21124 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.818s	user 0.005s	sys 0.007s
W20260709 13:04:51.676745 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 227337us
I20260709 13:04:51.583719 21017 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:51.678409 15362 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.714s (SENT)
I20260709 13:04:51.681481 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:51.537817 21169 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:51.682706 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.662220 20548 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:51.690651 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 211763us
I20260709 13:04:51.696215 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:51.681902 21203 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:51.697693 21072 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:04:51.701404 20940 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:51.759734 16032 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
W20260709 13:04:51.745280 15362 leader_election.cc:336] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.753s (SENT)
I20260709 13:04:51.702517 21202 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:51.700344 21098 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:51.704595 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:51.758498 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66269.6us
I20260709 13:04:51.742821 20548 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:51.760959 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:51.762993 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:51.769863 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65385.6us
I20260709 13:04:51.697605 21081 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:04:51.785101 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.768702 21202 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:51.798894 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53657.3us
W20260709 13:04:51.803130 15362 leader_election.cc:336] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.756s (SENT)
W20260709 13:04:51.804304 15362 leader_election.cc:336] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.781s (SENT)
I20260709 13:04:51.804791 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:51.787127 20803 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:51.786660 21093 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:51.823324 20940 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:51.792279 21193 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:04:51.893988 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:51.823717 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:51.831837 21097 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:51.808533 21094 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:04:51.825798 20548 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:51.822549 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:51.813129 15247 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:51.822652 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:51.918071 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:51.791081 21062 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:04:51.816573 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3128) took 1005 ms. Trace:
I20260709 13:04:51.817567 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:51.798817 21068 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:51.820443 21135 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:51.764570 21198 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:04:51.807915 21202 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:51.832541 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.847366 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:51.928369 15319 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:51.848445 15324 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:04:51.823447 21093 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:51.863004 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58726.2us
I20260709 13:04:51.855289 21123 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.874377 21098 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:51.876597 21072 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.810693 21060 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:04:51.877830 21081 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.879721 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.950389 21081 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:51.951148 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:51.951539 15244 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:04:51.952286 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:51.952943 21081 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:51.953784 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:51.954676 15399 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:51.962193 21112 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:51.967504 21072 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:51.802574 21113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.009s	sys 0.006s
I20260709 13:04:51.880718 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.971551 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:51.972700 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.973747 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.881860 15390 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
W20260709 13:04:51.810248 21150 consensus_meta.cc:287] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.000s
I20260709 13:04:51.883091 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:51.883388 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.884114 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.980042 15394 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:04:51.981703 15394 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:04:51.884745 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.982364 16032 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:51.811264 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:51.891876 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.924098 21186 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:51.823964 21205 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:51.906857 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 83207.8us
I20260709 13:04:52.002211 15998 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:51.907575 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.918992 15325 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:51.920626 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:51.924913 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:52.007890 15398 raft_consensus.cc:2376] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16. Re-sending same reply.
W20260709 13:04:51.925788 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 108304us
W20260709 13:04:51.925999 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 103551us
I20260709 13:04:51.922537 15321 rpcz_store.cc:276] 0709 13:04:50.811056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.823338 (+ 12282us) service_pool.cc:224] Handling call
0709 13:04:50.823659 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:51.433188 (+609529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.816312 (+383124us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54002edbd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:51.816508 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184968448}
I20260709 13:04:51.902951 21142 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.006966 15391 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:51.883628 20950 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:51.934624 15362 leader_election.cc:336] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.789s (SENT)
I20260709 13:04:52.011346 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:51.907033 20940 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:51.934119 21133 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:51.944844 21097 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:51.934371 21124 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:51.947029 21198 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:51.949311 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:52.038897 15392 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:51.974367 15390 pending_rounds.cc:85] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 7
W20260709 13:04:51.983601 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 94225us
I20260709 13:04:51.903993 15393 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:04:52.042317 15390 pending_rounds.cc:107] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:04:52.042719 15390 raft_consensus.cc:2889] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:52.043040 15390 pending_rounds.cc:107] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:04:52.043272 15390 raft_consensus.cc:2889] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:52.043720 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:52.012109 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:04:52.012768 21113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.010s	sys 0.007s
I20260709 13:04:51.970111 21072 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.018131 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:52.014081 21211 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:52.065560 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53519.7us
W20260709 13:04:52.068253 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:52.010425 21028 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.012s	sys 0.039s
I20260709 13:04:52.074600 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:52.002512 21150 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:52.074725 15248 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:52.069993 15392 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:52.012877 21185 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:04:51.977401 21123 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.003252 21186 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.141965 15325 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:52.106362 15399 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:52.094102 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:52.130887 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 196279us
I20260709 13:04:52.083247 15241 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:52.065586 21198 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:04:52.147893 15362 leader_election.cc:336] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.799s (SENT)
W20260709 13:04:52.148829 15362 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.816s (SENT)
I20260709 13:04:52.149245 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:52.133492 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49630.2us
I20260709 13:04:52.090399 21124 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:52.151057 15213 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:52.072495 21089 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:04:52.089387 21028 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.012s	sys 0.040s
I20260709 13:04:52.035481 21142 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.011628 21205 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.081096 21044 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:52.108670 21112 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:52.160785 21114 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:52.161131 21094 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:52.161675 20940 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.093832 21189 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:52.064006 20950 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.157446 21150 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:52.154740 21133 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:52.187891 15362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.839s (SENT) [suppressed 31 similar messages]
I20260709 13:04:52.152653 21186 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:52.194869 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.194375 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.220328 15318 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:52.171249 20548 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.166142 21089 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:52.196324 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 120250us
I20260709 13:04:52.175876 20803 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:52.173076 21044 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:52.189179 21028 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:52.228631 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 210596us
W20260709 13:04:52.219009 21199 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:04:52.240088 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:52.241102 15247 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:52.246174 15324 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:52.231681 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:52.233022 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:52.238963 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.249611 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:52.252496 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 101403us
I20260709 13:04:52.254557 15323 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:52.260639 15318 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:04:52.221487 21150 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:52.222066 21189 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:52.271708 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:52.273701 15247 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:04:52.236222 21044 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:52.192164 21114 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.269788 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.233726 21170 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:52.283255 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:52.282758 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45948.7us
I20260709 13:04:52.294800 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.301198 15321 raft_consensus.cc:2376] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15. Re-sending same reply.
I20260709 13:04:52.285379 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.302194 15324 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:52.225468 20825 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:04:52.295562 15318 raft_consensus.cc:2368] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17.
I20260709 13:04:52.262135 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:52.295393 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.243294 20920 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.231148 20548 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.221336 21185 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:04:52.241277 21198 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.317474 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.317953 21089 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.318852 21142 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.318943 20920 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.297958 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.305960 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:52.289995 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56643.2us
I20260709 13:04:52.306115 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.310896 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.322955 15318 raft_consensus.cc:2368] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17.
I20260709 13:04:52.323177 15320 raft_consensus.cc:2376] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16. Re-sending same reply.
W20260709 13:04:52.311400 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 78499us
I20260709 13:04:52.311622 21114 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.326959 20448 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.327605 20448 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.329895 15247 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:52.321193 20920 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:52.330089 20448 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:52.314803 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 95716.1us
I20260709 13:04:52.191398 21097 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.311233 21211 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:52.325425 20548 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.326105 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.341406 15399 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:04:52.299139 21093 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:52.350342 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:52.347024 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 85926.1us
I20260709 13:04:52.348584 15399 pending_rounds.cc:85] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 11
I20260709 13:04:52.351625 15399 pending_rounds.cc:107] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:04:52.351982 15399 raft_consensus.cc:2889] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:52.230916 21124 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:52.354589 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.356105 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.352648 21142 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:04:52.344839 21133 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.358500 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.359289 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.359979 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.363785 15318 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
I20260709 13:04:52.366014 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.364315 15322 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:52.371142 21189 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.374480 21123 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:52.377806 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 61653.8us
I20260709 13:04:52.383361 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.368294 21252 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:52.385051 15320 raft_consensus.cc:2368] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15.
I20260709 13:04:52.387007 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.387118 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.387881 15325 raft_consensus.cc:2368] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:52.387887 15324 raft_consensus.cc:2368] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17.
I20260709 13:04:52.391724 15321 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:04:52.401090 15325 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:52.403208 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.360288 21028 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.377863 21150 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.406170 15321 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.424685 20950 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:52.447347 15324 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:52.410045 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.465840 15320 raft_consensus.cc:2410] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:04:52.471005 21240 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:52.471909 21240 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.475030 21240 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.487288 15321 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:52.493976 21252 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:52.494343 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 115527us
I20260709 13:04:52.495092 21252 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.497033 21114 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.497627 21114 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.500882 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:52.500962 21114 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:52.502045 21123 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:52.502465 21123 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:52.502827 21123 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:52.419168 21254 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:52.503764 21254 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:52.503638 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.504606 15325 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:52.504766 21254 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.507310 21260 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.507865 21260 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.508881 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.509889 15325 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:52.511548 15321 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:52.515326 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.516171 15324 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:04:52.506034 21254 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.529368 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.539885 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.409339 21186 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.547533 15325 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
W20260709 13:04:52.535344 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:52.535642 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 198739us
I20260709 13:04:52.531635 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.556596 15245 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:52.557349 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.559259 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.559969 15325 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:52.565769 16032 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:52.547607 21260 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:52.571722 15324 raft_consensus.cc:1217] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Deduplicated request from leader. Original: 9.7->[12.8-14.10]   Dedup: 14.10->[]
I20260709 13:04:52.572052 15325 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:04:52.572329 15324 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [12.8-14.10]
I20260709 13:04:52.573112 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.573575 15324 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:04:52.574540 15325 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:52.564195 21185 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:52.583009 21185 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.583151 21044 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.604645 21044 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.595739 21186 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.596664 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.600015 21203 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:52.606052 15319 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:52.607625 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.608281 15321 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:52.606041 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.610904 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.612097 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.610503 21203 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:52.613236 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.613765 15325 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.585932 21185 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:52.620441 15362 leader_election.cc:336] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.984s (SENT)
I20260709 13:04:52.621905 21178 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:52.624080 21178 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:52.624523 15362 leader_election.cc:336] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.076s (SENT)
I20260709 13:04:52.624956 21178 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.625717 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:52.626573 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:52.627719 21112 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:52.626140 21178 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:52.622270 21189 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:52.635030 15362 leader_election.cc:336] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.093s (SENT)
I20260709 13:04:52.635874 15319 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:04:52.650058 15319 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:52.659062 15319 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:04:52.655470 15321 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:52.641934 15324 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:52.660996 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:52.653244 15325 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12.
I20260709 13:04:52.661731 15390 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:52.657816 21097 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.664106 21097 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.658131 21112 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:52.639249 21243 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.411s	user 0.003s	sys 0.004s
I20260709 13:04:52.684084 21097 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:52.639509 21272 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.685045 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:52.685261 21272 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.687635 21272 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.666884 21112 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.689531 21112 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:52.637729 21189 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:52.697577 15362 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.192s (SENT)
I20260709 13:04:52.698719 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:52.701033 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:52.701457 15318 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:04:52.701967 15393 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:52.646925 21185 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:04:52.716001 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:52.716588 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:52.714850 16028 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:52.716944 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:52.716020 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:52.717665 16026 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:04:52.717890 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:52.720388 21017 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.716835 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 722) took 1547 ms. Trace:
I20260709 13:04:52.783179 15390 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:52.783558 15393 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:52.783583 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:52.784169 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:52.784909 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:52.779989 15397 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:52.786075 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 88552.4us
W20260709 13:04:52.787187 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.783581 15248 rpcz_store.cc:276] 0709 13:04:51.169557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.170409 (+   852us) service_pool.cc:224] Handling call
0709 13:04:51.186397 (+ 15988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.079557 (+893160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.716609 (+637052us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b540010ca54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:52.716780 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2042531712}
W20260709 13:04:52.787187 15362 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.235s (SENT)
I20260709 13:04:52.789484 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:52.695648 21202 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.000s
I20260709 13:04:52.717895 16024 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:52.716744 16027 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:52.782090 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:52.791505 21260 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:52.792652 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:52.799479 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:52.805205 15398 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:04:52.814183 15323 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:52.816390 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:52.838284 15397 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:52.802177 21112 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:52.840934 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.840469 21271 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:52.820897 21028 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:52.815145 21097 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:52.824040 21211 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:52.845472 21271 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:52.852756 16024 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:52.872618 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.818320 21202 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.821954 21260 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.848320 21028 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:52.860056 21211 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.889750 15316 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:52.875366 21189 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:52.907812 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.896193 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:52.910291 15323 raft_consensus.cc:2368] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 11. Current term is 12.
I20260709 13:04:52.910964 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:04:52.913240 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.914980 15398 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:52.890900 21028 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:52.890715 21211 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:52.902493 21095 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.886646 21123 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.924665 15323 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:52.903939 21202 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.927728 21095 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.936628 21123 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.928797 21142 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 13:04:52.940510 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.929275 21271 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.917415 21252 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:52.945684 21241 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:52.964872 21241 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:52.947216 21252 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:52.923076 21203 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:52.953007 21282 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:52.992375 21228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.031s	sys 0.059s
I20260709 13:04:52.974726 21169 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:52.984851 21252 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:53.000528 21228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.031s	sys 0.059s
I20260709 13:04:53.015772 21241 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:53.018874 21239 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.750s	user 0.000s	sys 0.007s
I20260709 13:04:53.019194 21095 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.019917 21260 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.027398 21203 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:52.993903 21282 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.030299 21282 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:53.035602 21270 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.487s	user 0.004s	sys 0.000s
I20260709 13:04:53.042125 21170 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:53.050078 21170 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:53.051474 21211 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.053709 21211 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.053925 21186 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.054345 21211 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.054454 21186 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.054823 21211 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.056988 21211 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.061129 21170 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.061399 21028 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.064692 21252 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.067570 21028 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.058045 21186 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:53.082027 21170 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.084728 21252 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.088780 21271 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:53.089493 21271 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.092999 21271 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:53.102360 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:53.108971 21232 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.878s	user 0.006s	sys 0.000s
I20260709 13:04:53.111521 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.113142 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 954) took 1447 ms. Trace:
I20260709 13:04:53.113633 16025 rpcz_store.cc:276] 0709 13:04:51.665904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.666037 (+   133us) service_pool.cc:224] Handling call
0709 13:04:51.668274 (+  2237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:51.668510 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:51.668531 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:51.669021 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:04:51.892549 (+223528us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:04:51.892588 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.892654 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:53.108271 (+1215617us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:53.112824 (+  4553us) raft_consensus.cc:1685] finished
0709 13:04:53.112848 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.113076 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239971712,"thread_start_us":195153,"threads_started":1,"wal-append.queue_time_us":474487}
I20260709 13:04:53.126895 21205 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.139680 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.140560 16025 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:04:53.188525 21236 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.012s	user 0.003s	sys 0.004s
W20260709 13:04:53.201017 21233 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.046s	user 0.001s	sys 0.006s
I20260709 13:04:53.202617 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 953) took 1563 ms. Trace:
I20260709 13:04:53.203039 16030 rpcz_store.cc:276] 0709 13:04:51.639325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.639471 (+   146us) service_pool.cc:224] Handling call
0709 13:04:51.639918 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:51.640364 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:51.640393 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:51.640901 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:04:51.890864 (+249963us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:04:51.890922 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.891016 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:53.200354 (+1309338us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:53.202260 (+  1906us) raft_consensus.cc:1685] finished
0709 13:04:53.202287 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.202548 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21393,"raft.queue_time_us":2436,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":7023,"spinlock_wait_cycles":435242752,"thread_start_us":249532,"threads_started":1,"wal-append.queue_time_us":433209}
I20260709 13:04:53.216809 21135 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.217447 21135 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:53.218953 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.222555 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.223218 16032 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:53.223989 16025 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:04:53.224121 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:53.224953 16024 raft_consensus.cc:2368] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17.
I20260709 13:04:53.224480 16025 pending_rounds.cc:85] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 9
I20260709 13:04:53.225845 16025 pending_rounds.cc:107] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:04:53.226135 16025 raft_consensus.cc:2889] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:53.226210 21135 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.227227 16030 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:53.228727 21170 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:53.229369 21170 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.231863 21170 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.238533 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.239799 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.239948 21094 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.240626 21246 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:53.241174 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:53.241608 21246 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:53.241989 21246 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:53.242110 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:53.240584 21094 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.243225 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.246460 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.246570 16030 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:53.240621 15248 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:53.243801 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.248348 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.249368 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.250109 16027 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:53.250200 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.250907 15246 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:53.254024 21062 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:53.245571 21246 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.255563 21246 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:53.255795 21268 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.443s	user 0.000s	sys 0.002s
I20260709 13:04:53.257297 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:53.255666 21062 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:04:53.257910 15323 raft_consensus.cc:2376] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12. Re-sending same reply.
I20260709 13:04:53.258275 21062 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:53.258641 21062 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:53.255599 21094 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.260351 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.261255 15248 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.263010 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:53.260138 21252 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:53.264899 21252 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.265239 21252 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:53.266027 21028 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:53.266465 21028 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:53.266816 21028 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:53.269701 15214 leader_election.cc:400] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17.
I20260709 13:04:53.270068 15214 leader_election.cc:403] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:04:53.259542 21062 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.260254 21135 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:53.274755 21062 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:53.276760 21135 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.277483 21135 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:53.284847 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2787) took 1093 ms. Trace:
I20260709 13:04:53.285813 15242 rpcz_store.cc:276] 0709 13:04:52.191731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.294731 (+103000us) service_pool.cc:224] Handling call
0709 13:04:52.295036 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.309808 (+ 14772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:52.309853 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:52.309915 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:52.309962 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.284549 (+974587us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b5400119ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:53.284595 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.284768 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33296768}
I20260709 13:04:53.288789 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.289275 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:53.286926 21203 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:53.290520 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:53.290333 21170 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:53.290333 21133 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:53.293296 21170 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:53.293747 21170 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.294091 21170 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:53.295791 21150 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:53.296244 21150 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:53.297160 21150 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.298380 21150 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:53.298523 21198 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:53.299511 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:53.302800 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.304309 21094 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.304884 21094 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.295782 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3153) took 1411 ms. Trace:
I20260709 13:04:53.306730 15316 rpcz_store.cc:276] 0709 13:04:51.885380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.919568 (+ 34188us) service_pool.cc:224] Handling call
0709 13:04:51.920139 (+   571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.890411 (+970272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.295516 (+405105us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54001e6ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:53.295715 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2229453184}
I20260709 13:04:53.307567 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.308290 15242 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:04:53.311580 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.309278 21097 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.314620 21097 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:53.316919 21251 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.010s	user 0.000s	sys 0.007s
I20260709 13:04:53.317414 21097 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:53.319656 21094 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:53.320629 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.323300 15248 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:04:53.333195 15397 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:04:53.333693 15397 pending_rounds.cc:85] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 8
I20260709 13:04:53.334059 15397 pending_rounds.cc:107] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:04:53.334364 15397 raft_consensus.cc:2889] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:53.333537 21238 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:53.335465 21238 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.337822 21238 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:53.339730 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.340284 21252 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.341672 15249 raft_consensus.cc:2368] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
W20260709 13:04:53.343546 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.350762 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:53.350958 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:53.352439 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:53.353533 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:53.354053 15390 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:53.357337 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:53.364619 15390 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:04:53.369629 21252 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.369918 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:53.370276 21203 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17.
I20260709 13:04:53.375969 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.381102 15244 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:53.389726 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:53.385419 15395 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
W20260709 13:04:53.380443 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 70066.1us
I20260709 13:04:53.398056 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:53.398558 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:53.360198 21062 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:53.399377 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.400251 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:53.400851 15324 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:53.401762 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.397864 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:53.402400 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.394937 15322 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:53.403820 15322 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:53.403661 15390 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:53.399145 15325 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:53.408898 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:53.409602 15323 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.395740 15316 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:53.417157 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:53.418926 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.417157 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.421397 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:53.390050 21256 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:53.404645 15322 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.424045 15322 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:53.398689 21198 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:53.397665 21252 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.398893 21203 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.401374 21238 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.405238 21133 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.438800 15395 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:53.459311 15246 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:04:53.426997 21254 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:53.390774 21183 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:04:53.445320 15325 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:53.447064 15321 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:04:53.447135 15324 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:53.451133 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:53.476161 15317 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:53.426151 21256 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.424649 21124 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.458335 15323 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:53.439828 15390 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:04:53.405827 21062 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.473533 15395 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:53.460518 21136 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:53.430269 21017 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:04:53.463815 21254 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:53.491647 15395 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:04:53.452401 21252 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.441304 21198 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.478569 21256 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:53.458627 21203 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.463599 21133 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.487183 21136 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.485092 21123 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:53.498288 21299 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:04:53.461378 21238 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.496863 21254 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:53.483311 21124 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.492918 21135 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.524402 15242 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:53.499989 21170 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.506525 21028 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.532891 15248 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:53.518945 21123 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.536525 15322 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:04:53.543912 21300 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:04:53.551900 21062 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:53.561964 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 119579us
I20260709 13:04:53.564108 21133 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.565876 21028 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.566926 15391 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:04:53.559458 21295 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:04:53.575026 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 133894us
I20260709 13:04:53.578890 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:53.580149 21309 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:53.599700 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.614104 21305 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:53.569873 21203 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.624413 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.624843 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.623718 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.624416 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:53.627946 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:53.636323 16024 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:04:53.578729 21136 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.578383 21124 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.660146 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.660795 15247 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:53.615494 21257 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.592952 21028 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:04:53.674636 16024 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:53.658972 21203 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:53.678813 15391 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:04:53.679060 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:53.681674 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.666908 21304 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:53.688903 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:53.670677 21257 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.696586 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.691905 21192 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:53.697266 15247 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:53.700034 15998 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:53.702034 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.703634 15391 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:04:53.703536 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:53.704669 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.704924 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.705538 15399 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:53.705446 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:53.705513 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:53.706867 15398 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:53.706995 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.707612 15399 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:53.709040 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.682538 21203 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.709656 15242 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:53.710147 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.711784 15390 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:04:53.711925 15998 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:53.713148 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:53.696532 21123 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.691599 21304 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.706640 21192 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.715907 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:53.718741 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.702651 21305 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:53.715842 21235 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:04:53.709350 21250 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:53.710932 21272 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:53.721392 21203 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.717684 21183 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:53.727185 15247 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:53.735539 21231 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.656s	user 0.009s	sys 0.000s
I20260709 13:04:53.735757 21257 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.742596 21305 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.730252 21304 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.730435 21192 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.734920 21272 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:53.744402 21272 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.727960 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:53.728240 21123 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:53.729038 21189 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:53.749615 21123 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:53.750272 21305 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:53.753369 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:53.754112 15319 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:53.753670 21304 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:53.761575 21123 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:53.765383 15319 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:53.765750 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:53.767474 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.770363 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:53.774581 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.774967 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:53.776859 21133 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:53.777477 21133 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:53.778833 21203 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:53.779299 21203 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.779676 21203 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:53.716423 21307 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:53.780370 21257 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:53.781416 21307 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:53.786451 21256 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.787752 21307 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.788873 21256 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:53.783181 21257 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.791034 21257 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:53.794817 21203 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.797096 21203 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:53.798240 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 67765.5us
I20260709 13:04:53.800693 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:53.801445 16026 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:04:53.806033 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.781306 21017 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:53.808418 21017 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:53.809008 21017 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:53.805812 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:53.810608 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.812879 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:53.813540 16030 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:53.811374 21123 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:53.812474 21296 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.812780 21028 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:53.820122 21028 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.821123 21254 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.814610 21304 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:04:53.823268 21254 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.824914 21028 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:53.825886 15394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.018s	sys 0.030s
W20260709 13:04:53.826264 15394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.019s	sys 0.031s
I20260709 13:04:53.826984 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3188) took 1040 ms. Trace:
I20260709 13:04:53.827301 15394 rpcz_store.cc:276] 0709 13:04:52.786271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.786807 (+   536us) service_pool.cc:224] Handling call
0709 13:04:52.787184 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.787466 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:52.908780 (+121314us) log.cc:844] Serialized 14 byte log entry
0709 13:04:53.826626 (+917846us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:53.826683 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:53.826727 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.826794 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.826915 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":80183,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":3060,"thread_start_us":1014971,"threads_started":2,"wal-append.queue_time_us":107677}
I20260709 13:04:53.832065 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:53.832752 15247 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:53.841856 15247 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:04:53.811628 21203 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:04:53.863377 21252 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:53.867878 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.868996 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.869740 15399 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:53.869849 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.870661 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:53.870788 15394 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:53.871227 15399 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:53.872229 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:53.879439 21256 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:53.880043 21256 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:53.881023 21256 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:53.882655 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.884380 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:53.887244 15393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.015s	sys 0.009s
W20260709 13:04:53.887769 15393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.015s	sys 0.009s
I20260709 13:04:53.889870 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.890856 15390 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:53.893281 15247 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:04:53.899804 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.830106 21296 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.905647 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:53.910411 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:53.916476 15399 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:53.912563 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:53.856896 21028 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:53.921427 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:04:53.920172 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 80572.9us
I20260709 13:04:53.919106 21136 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:53.920954 21252 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:53.928264 21304 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:04:53.942976 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.929273 21142 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:53.942261 21252 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.936455 21136 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.945492 21304 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:53.928047 21028 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.928875 21272 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:04:53.936931 21257 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.948037 21142 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:53.951242 21252 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:53.950646 21136 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:53.951545 21304 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.977152 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:53.978003 15396 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:53.958174 21017 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:53.943540 21318 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:04:53.996138 21317 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:04:53.998582 21296 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:54.044694 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.083621 21303 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.256903 21303 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:54.103273 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.196250 21304 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.216274 21135 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:54.231024 21309 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:54.233345 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.261152 21309 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.236393 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2007) took 2260 ms. Trace:
I20260709 13:04:54.263814 21309 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:54.262385 15250 rpcz_store.cc:276] 0709 13:04:51.976389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.977175 (+   786us) service_pool.cc:224] Handling call
0709 13:04:51.977486 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:52.197018 (+219532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:52.197056 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:52.197542 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:04:52.665027 (+467485us) spinlock_profiling.cc:243] Waited 938 us on lock 0x7b180036ef80. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:04:52.780269 (+115242us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:52.780314 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.857404 (+ 77090us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:54.236001 (+1378597us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540023a5d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:54.236069 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:54.236127 (+    58us) raft_consensus.cc:1685] finished
0709 13:04:54.236142 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.236324 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1649,"raft.queue_time_us":28944,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":9033,"spinlock_wait_cycles":509762432,"thread_start_us":115038,"threads_started":1,"wal-append.queue_time_us":604260,"wal-append.run_cpu_time_us":2584,"wal-append.run_wall_time_us":1018539}
I20260709 13:04:54.266839 20940 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.267388 20940 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.269500 20940 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:54.284793 15243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 1998) took 2474 ms (client timeout 1552 ms). Trace:
W20260709 13:04:54.285346 15243 rpcz_store.cc:269] 0709 13:04:51.810538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.810784 (+   246us) service_pool.cc:224] Handling call
0709 13:04:54.284472 (+2473688us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b540023b4d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:54.284652 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332542720}
I20260709 13:04:54.295658 21136 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.297763 21170 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:54.299638 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.324507 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.325454 15317 raft_consensus.cc:2410] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:04:54.325898 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.326583 15316 raft_consensus.cc:2376] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17. Re-sending same reply.
I20260709 13:04:54.326753 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.326918 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.327410 15318 raft_consensus.cc:2376] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19. Re-sending same reply.
I20260709 13:04:54.327816 15323 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:04:54.328210 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.328156 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.328917 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.327814 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.330129 15317 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:54.329767 15320 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:04:54.326982 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.331621 15324 raft_consensus.cc:2368] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13.
W20260709 13:04:54.333305 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.335203 21028 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:54.344127 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.341255 21142 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:54.365968 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.363437 21272 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.366991 15324 raft_consensus.cc:2410] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:04:54.366796 21272 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:54.369113 21272 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:54.369493 21238 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:54.372923 15362 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.551s (SENT)
I20260709 13:04:54.373368 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:04:54.362571 21098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.023s	sys 0.042s
I20260709 13:04:54.377409 21094 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:54.378842 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.360664 21133 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.379766 15324 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:54.380226 21133 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:04:54.381515 15362 leader_election.cc:336] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.633s (SENT)
I20260709 13:04:54.381711 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.381999 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.382344 15324 raft_consensus.cc:2376] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16. Re-sending same reply.
I20260709 13:04:54.383975 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.385653 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.386839 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.387094 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.387444 15317 raft_consensus.cc:2376] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16. Re-sending same reply.
I20260709 13:04:54.387856 15324 raft_consensus.cc:2368] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:54.388761 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.383846 21094 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:54.389379 15320 raft_consensus.cc:2376] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 12. Re-sending same reply.
W20260709 13:04:54.377794 21098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.023s	sys 0.042s
W20260709 13:04:54.390306 15362 leader_election.cc:336] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.724s (SENT)
I20260709 13:04:54.390785 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.388357 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.393853 21094 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:54.394130 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:54.393357 15362 leader_election.cc:336] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.739s (SENT)
I20260709 13:04:54.394851 15322 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:54.395017 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.395769 21094 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:54.399030 15320 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:04:54.401731 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.402911 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.403416 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2785) took 2229 ms. Trace:
I20260709 13:04:54.403856 15245 rpcz_store.cc:276] 0709 13:04:52.173797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.174019 (+   222us) service_pool.cc:224] Handling call
0709 13:04:52.174436 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.558318 (+383882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.403160 (+1844842us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400315954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:54.403350 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878324608}
I20260709 13:04:54.406596 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.409492 15324 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:54.413376 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.414340 15325 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:04:54.414791 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.415664 15317 raft_consensus.cc:2410] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:04:54.418107 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:54.418895 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:54.422578 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.422886 15398 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:04:54.424152 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:54.425081 15396 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:54.426021 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:54.427713 15390 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:54.418926 15394 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:54.430769 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.432348 21017 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:54.432884 21094 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:54.434106 21094 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:54.434537 21094 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:54.435318 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.435431 21094 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.437012 21094 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:54.438373 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:54.439168 21257 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:54.443759 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:54.442176 15320 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:54.444764 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:54.445096 21098 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:54.446475 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:54.447952 21254 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.448830 21089 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:54.448524 21254 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:54.449571 21089 raft_consensus.cc:2764] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:04:54.450959 21254 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:54.453833 21098 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:54.455395 20940 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:54.460078 21282 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:54.460559 21282 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:54.462668 21321 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:54.466030 21189 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:54.467211 21189 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:54.461483 21282 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.468101 21189 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:54.471683 21189 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:54.471442 21089 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:54.470175 21282 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:54.473786 15245 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:54.474702 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:54.475415 15247 raft_consensus.cc:2368] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:04:54.477059 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:54.477059 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:54.478485 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:54.479257 15247 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:54.476940 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.482645 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:54.487305 15362 leader_election.cc:336] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.823s (SENT)
I20260709 13:04:54.489557 15247 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:54.487829 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.493196 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:54.493882 15245 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:04:54.494328 15247 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:54.495764 21296 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:54.497013 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:54.497306 21089 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:54.497743 21309 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:54.497906 21089 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:54.499303 21334 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:54.499992 15394 raft_consensus.cc:1217] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[12.8-14.9]   Dedup: 14.9->[]
I20260709 13:04:54.499879 21334 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:54.480711 21098 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:04:54.500540 15394 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:04:54.500257 21089 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:54.502815 15362 leader_election.cc:336] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.839s (SENT)
I20260709 13:04:54.507759 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:54.510046 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.513623 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:54.516662 21309 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:54.520888 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:54.524036 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:54.524989 15396 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:54.527087 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:54.529645 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:54.534425 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:54.537210 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:54.538936 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:54.541198 15362 leader_election.cc:400] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 12 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13.
I20260709 13:04:54.541610 21334 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:54.536706 21309 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:54.487775 21094 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:04:54.543277 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.545984 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2780) took 2991 ms. Trace:
I20260709 13:04:54.546411 15241 rpcz_store.cc:276] 0709 13:04:51.554193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.555229 (+  1036us) service_pool.cc:224] Handling call
0709 13:04:51.586054 (+ 30825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.147850 (+561796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.545736 (+2397886us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b540010c554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:54.545914 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142979328}
I20260709 13:04:54.538002 21097 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:54.538247 21318 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:54.554189 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.555260 15317 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:54.559111 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.559573 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.559845 15324 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:54.543958 21112 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:54.561847 21335 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.562381 21335 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.564236 21335 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:54.566066 21296 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:54.566689 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.567689 21296 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:54.568336 21296 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:54.568279 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.569362 21306 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:54.569818 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.569525 21296 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.570595 21306 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:04:54.571583 15362 leader_election.cc:400] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:04:54.572892 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.574692 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:54.573668 21306 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:54.577402 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.573927 21321 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:54.578846 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.579924 15324 raft_consensus.cc:2410] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:04:54.579208 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:54.579545 21309 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:54.581617 21318 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:04:54.585343 21318 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:54.565045 21112 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:54.590346 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.591264 15325 raft_consensus.cc:2368] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
I20260709 13:04:54.578365 21305 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:54.606359 15317 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:04:54.588313 21112 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:54.609931 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.616823 15325 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:54.617864 21089 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.624447 21089 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.625507 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.626165 15319 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:54.626725 21089 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:54.599754 21305 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:54.627616 21305 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:54.618022 15290 connection.cc:256] RPC call timeout handler was delayed by -1.0509366999999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
I20260709 13:04:54.622676 15317 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
W20260709 13:04:54.623066 21205 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.050s	sys 0.090s
W20260709 13:04:54.629755 15290 connection.cc:256] RPC call timeout handler was delayed by -1.0158367000000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
I20260709 13:04:54.632059 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:54.636560 15317 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:04:54.637123 15317 pending_rounds.cc:85] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 11
I20260709 13:04:54.637456 15317 pending_rounds.cc:107] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 15.12
W20260709 13:04:54.630601 21205 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.051s	sys 0.091s
I20260709 13:04:54.650061 21136 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:54.659380 21304 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:54.664467 21318 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:54.666803 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:54.669688 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.670373 15322 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:04:54.670713 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.671389 15323 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:54.672302 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.672634 20940 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.673147 20940 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:54.674574 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.674703 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:54.675202 15325 raft_consensus.cc:2376] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19. Re-sending same reply.
I20260709 13:04:54.675951 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:54.676131 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.676762 15318 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:54.677829 15322 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:04:54.678028 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:54.637750 15317 raft_consensus.cc:2889] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:54.678928 16026 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:04:54.679600 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:54.680156 16028 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:54.681593 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:54.682209 16033 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:04:54.682780 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:54.678123 21309 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:54.685075 21309 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:54.686815 15319 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:04:54.687130 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:54.670483 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.690264 21315 raft_consensus.cc:2764] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:04:54.694144 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:54.695891 15247 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:04:54.696300 15247 pending_rounds.cc:85] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 10
I20260709 13:04:54.696514 15247 pending_rounds.cc:107] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:04:54.696724 15247 raft_consensus.cc:2889] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:54.699262 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:54.701151 16026 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
W20260709 13:04:54.702334 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 70355.5us
I20260709 13:04:54.703716 21340 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:54.707006 15396 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:04:54.704540 21306 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:54.708490 21306 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.708856 21306 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:54.709744 21272 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:54.704614 21094 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:04:54.711163 21094 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:54.711557 21094 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:54.712416 21094 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.713586 21094 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:54.714526 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.703776 21315 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:54.714920 21112 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:54.715615 21315 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.716006 21315 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:54.717373 21112 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:54.723389 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2011) took 1326 ms. Trace:
I20260709 13:04:54.723838 15248 rpcz_store.cc:276] 0709 13:04:53.396782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.396907 (+   125us) service_pool.cc:224] Handling call
0709 13:04:53.397186 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:53.533327 (+136141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.723169 (+1189842us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54000ad554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:54.723325 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311657344}
I20260709 13:04:54.724364 15394 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:54.703593 21296 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:04:54.726707 21087 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:04:54.728145 21252 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.003s
I20260709 13:04:54.730324 21252 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.732568 21252 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:54.747272 15393 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:54.747864 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.733992 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:54.748592 15316 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:54.749050 16028 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:04:54.749694 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:54.748687 15390 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:54.750988 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:54.751266 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:54.751860 15390 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:54.751911 15241 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:54.706727 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:54.737254 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:54.738488 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:54.754217 15392 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:54.754534 15247 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:54.754660 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:54.753145 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47733.5us
I20260709 13:04:54.755298 15241 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:04:54.740543 15999 leader_election.cc:400] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
I20260709 13:04:54.741261 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:54.744204 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.757121 15322 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:54.744663 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.745345 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.745705 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.759037 15323 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:04:54.759824 15999 leader_election.cc:403] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:54.760762 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:54.762945 15291 leader_election.cc:400] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:04:54.763571 15291 leader_election.cc:403] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:54.765012 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.770337 15249 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:04:54.766918 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 60285.5us
I20260709 13:04:54.771692 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:54.767500 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:54.768549 15245 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:04:54.769369 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.773926 15325 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:54.776657 15248 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:04:54.781522 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.782495 15318 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:54.785200 15248 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:54.787737 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:54.788481 15248 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
W20260709 13:04:54.789299 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.790859 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.791661 15321 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:54.779899 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:54.801402 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:54.803485 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:54.804728 15318 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:54.807257 15324 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:04:54.813609 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46189.2us
I20260709 13:04:54.815034 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:54.816637 15323 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
W20260709 13:04:54.833542 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.832252 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:54.832252 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:54.835357 15244 raft_consensus.cc:2410] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:04:54.820787 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:54.836705 15323 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:54.843254 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:54.843689 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:54.851655 15390 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:54.797844 21340 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:54.797417 21205 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:54.861227 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:54.865003 15323 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:54.865250 15321 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:54.808086 21135 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.836565 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:54.831975 21334 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:04:54.892621 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.894332 16025 raft_consensus.cc:2410] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 14 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
W20260709 13:04:54.889599 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 149264us
I20260709 13:04:54.901717 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:54.904421 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:54.913291 21356 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:54.914085 21356 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:54.879698 15392 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:54.916556 21356 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:54.842404 21017 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:54.836391 21335 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:54.920286 21017 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.818884 21343 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:54.920750 21017 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:54.922462 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:54.848513 21089 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:04:54.927115 21345 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:54.929100 21305 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.929229 20940 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.931617 21305 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:54.931695 21315 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.892343 21136 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:54.887557 21205 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:04:54.893460 21087 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:54.896975 21340 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:54.909662 21189 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
I20260709 13:04:54.940263 21334 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:54.963991 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 120370us
I20260709 13:04:54.923262 21318 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:54.932866 20940 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:54.892653 21135 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.943573 21335 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:54.966786 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:54.935416 21017 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:54.967965 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 205244us
I20260709 13:04:54.909317 21306 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.945827 21136 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:54.989831 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:54.990407 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.992799 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2018) took 1553 ms. Trace:
I20260709 13:04:54.993592 15242 rpcz_store.cc:276] 0709 13:04:53.438264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.711636 (+273372us) service_pool.cc:224] Handling call
0709 13:04:53.711898 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:53.727088 (+ 15190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.727110 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:53.727141 (+    31us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:04:53.727164 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.990955 (+1263791us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b540011a8d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:54.991023 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.991208 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34488192}
W20260709 13:04:55.011071 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.960196 21087 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:55.031699 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46371.2us
W20260709 13:04:55.018729 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 269787us
W20260709 13:04:55.043520 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.990536 21136 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:54.980643 21238 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:04:54.988437 21198 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:55.174333 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 207626us
I20260709 13:04:55.175552 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:55.143334 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 97524.2us
I20260709 13:04:54.982780 21340 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:04:54.978394 21318 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:54.968223 21334 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:54.987128 21305 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:55.199563 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 313141us
I20260709 13:04:55.200379 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:55.176487 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 135419us
I20260709 13:04:55.201310 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:55.201399 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:55.203368 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:55.043498 21335 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.155s
I20260709 13:04:55.219134 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:55.230821 15242 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:04:55.201761 20940 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:55.252264 20940 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:55.230523 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:55.218600 21192 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 13:04:55.233561 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.235880 21017 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:55.236335 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08003358c0 after lost signal to thread 14142
W20260709 13:04:55.250036 21309 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.000s
I20260709 13:04:55.243968 21135 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:55.218780 21205 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:55.221774 21343 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:55.201932 21364 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.296777 21364 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:55.300139 21364 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:55.275592 21365 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:04:55.302903 21369 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:55.307783 21369 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:55.309074 21369 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.246680 21334 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:55.247459 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:55.311546 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 64176.7us
I20260709 13:04:55.248791 21189 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:55.222187 21315 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:55.313982 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.207127 21305 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.263311 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:55.316794 15392 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:55.317179 21305 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:55.318487 21347 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:04:55.265794 15398 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:55.266449 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:55.322686 15393 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:55.302047 21365 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:55.323546 21365 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:55.324393 21365 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:55.325690 21365 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.252322 21306 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:55.196791 21089 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
W20260709 13:04:55.331295 21348 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.417s	user 0.002s	sys 0.009s
I20260709 13:04:55.005817 21028 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:04:55.237185 21346 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.271s	user 0.001s	sys 0.000s
W20260709 13:04:55.228708 21282 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.003s
I20260709 13:04:55.193298 21355 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:04:55.277194 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08004039c0 after lost signal to thread 15182
I20260709 13:04:55.282374 15397 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
W20260709 13:04:55.280727 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 58694.1us
I20260709 13:04:55.341500 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 824) took 1541 ms. Trace:
I20260709 13:04:55.341533 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:55.289050 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:55.342092 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6da0 after lost signal to thread 15274
W20260709 13:04:55.294912 21349 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:04:55.337740 15393 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:55.338151 15392 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:04:55.342530 15390 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 11.
W20260709 13:04:55.342545 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08003c17a0 after lost signal to thread 15275
I20260709 13:04:55.351560 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:04:55.352450 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7800 after lost signal to thread 15349
W20260709 13:04:55.353730 15420 debug-util.cc:398] Leaking SignalData structure 0x7b0800333040 after lost signal to thread 15423
I20260709 13:04:55.280170 21357 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:55.342046 15397 rpcz_store.cc:276] 0709 13:04:53.799694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.800605 (+   911us) service_pool.cc:224] Handling call
0709 13:04:55.281902 (+1481297us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:04:55.282109 (+   207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.341235 (+ 59126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.341444 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6715136}
I20260709 13:04:55.345741 15396 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:55.346797 15398 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:55.356550 15420 debug-util.cc:398] Leaking SignalData structure 0x7b0800396520 after lost signal to thread 15424
W20260709 13:04:55.370797 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 534282us
I20260709 13:04:55.371168 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:55.366914 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:55.376107 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:55.377319 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:55.390859 15291 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:55.369730 21028 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:55.364073 20940 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:04:55.394825 21026 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:55.291661 21309 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:55.394330 21375 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:55.400166 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:55.405546 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:55.407998 21282 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:55.408074 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:55.375349 21343 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:55.374989 21357 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:55.397545 21203 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:04:55.413262 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.352514 21361 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:04:55.378989 21355 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:55.417186 15247 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:55.419597 21026 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:55.422767 21318 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:55.422255 21028 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:55.427680 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:55.398873 20940 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:55.486354 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:55.486470 20940 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.488023 20940 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:04:55.431340 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08003fb9a0 after lost signal to thread 16057
I20260709 13:04:55.379630 21334 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:55.433048 21335 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.495103 21335 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.497328 21335 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:55.433231 21380 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:55.497937 21380 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.498349 21380 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:55.499347 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:55.500186 15317 raft_consensus.cc:2368] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
W20260709 13:04:55.447710 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.457638 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 249576us
I20260709 13:04:55.502867 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:55.504599 21026 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.416596 21375 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.406546 21364 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:55.460661 15399 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
W20260709 13:04:55.530368 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.538839 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 165639us
I20260709 13:04:55.566188 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:55.566390 15247 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:55.481845 21080 raft_consensus.cc:2764] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:04:55.572355 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 195128us
W20260709 13:04:55.573791 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 71033.6us
I20260709 13:04:55.439785 21350 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.128s
I20260709 13:04:55.432051 21282 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.575394 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:55.582314 21369 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:55.539903 21203 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:55.669842 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 242209us
I20260709 13:04:55.564081 21375 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:55.670466 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 86252us
I20260709 13:04:55.673269 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:55.683336 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 108042us
I20260709 13:04:55.684185 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:04:55.673666 21379 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:04:55.690829 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:55.671552 21369 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.668514 21305 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.574990 21387 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:04:55.712092 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:55.704334 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:55.681573 21390 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:55.723088 15394 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:55.723899 15398 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:55.724011 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:55.724786 15393 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:55.725997 15390 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:55.727068 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:55.702333 21369 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:55.698096 21347 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:55.702267 21391 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:55.754283 15390 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:55.780275 15317 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:04:55.752296 15396 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:04:55.718004 21359 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.726975 21364 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:55.797945 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:55.798808 15398 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:04:55.783532 15317 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:04:55.799579 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:55.793776 15390 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:55.794400 15318 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:04:55.794639 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:55.800935 15396 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:55.795964 15319 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: [10.5-12.6]
I20260709 13:04:55.796801 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:55.728899 21374 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:55.806493 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:55.753310 21389 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:55.798148 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:55.818610 15394 raft_consensus.cc:2410] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:04:55.672372 21357 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.711180 21305 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.779043 21390 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:55.781773 21395 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:55.678956 21343 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.797585 21364 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.872776 15396 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
W20260709 13:04:55.842674 21388 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:04:55.875012 21395 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:55.816375 21017 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:55.756356 21183 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:04:55.815634 21309 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:55.815161 21347 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:55.803855 21359 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.878077 21364 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:55.752658 21203 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.860471 21389 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:55.881039 21017 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:55.696548 21355 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:55.924974 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.880072 21395 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:55.927734 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 247363us
W20260709 13:04:55.922706 21373 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.435s	user 0.001s	sys 0.000s
I20260709 13:04:55.873855 21390 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:55.930905 21136 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.003s
I20260709 13:04:55.923543 21306 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:04:55.934545 21378 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:04:55.922937 21374 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:04:55.925437 21387 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:55.935411 21282 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:55.971414 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 1.9532e+06us
I20260709 13:04:55.973878 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2031) took 1137 ms. Trace:
I20260709 13:04:55.974335 15244 rpcz_store.cc:276] 0709 13:04:54.836210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.836384 (+   174us) service_pool.cc:224] Handling call
0709 13:04:54.874974 (+ 38590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.020886 (+145912us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.020953 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.022470 (+  1517us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.274536 (+252066us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:55.274575 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.274644 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.973466 (+698822us) raft_consensus.cc:1685] finished
0709 13:04:55.973489 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.973809 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5885,"raft.queue_time_us":71717,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10967,"thread_start_us":390259,"threads_started":2,"wal-append.queue_time_us":367344}
W20260709 13:04:55.979765 15213 connection.cc:256] RPC call timeout handler was delayed by -1.8305599849999226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
I20260709 13:04:55.957146 21306 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:55.980372 15213 connection.cc:256] RPC call timeout handler was delayed by -1.8233599849999109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:04:55.982188 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.982971 21306 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:55.986892 15213 connection.cc:256] RPC call timeout handler was delayed by -1.5893599849999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 13:04:55.992347 15213 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:55.995806 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:55.969573 21374 consensus_queue.cc:1243] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:55.954541 21136 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:55.995271 21399 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.012936 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:56.006434 21385 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:04:56.017289 15245 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:55.958539 21017 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.003966 21361 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:55.999805 21028 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 13:04:56.041819 21404 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:04:56.043865 21398 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:04:56.044917 21403 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:04:56.046962 21402 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:04:56.025019 21399 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.052487 21399 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.050545 15391 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:56.043422 21028 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:55.962414 21347 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:56.060241 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.069723 15391 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:56.069741 21017 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:56.086263 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 266184us
I20260709 13:04:56.088302 21405 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:56.090499 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:56.099421 15214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.002s	sys 0.016s
W20260709 13:04:56.099803 15214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.002s	sys 0.016s
W20260709 13:04:56.043283 21394 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:04:56.053941 21365 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.728s	user 0.009s	sys 0.001s
W20260709 13:04:56.104950 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 87023.2us
W20260709 13:04:56.105605 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 534972us
I20260709 13:04:56.043267 21254 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:56.034512 21305 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:56.035401 21026 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:56.112951 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:56.114693 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:56.116230 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 127628us
I20260709 13:04:56.024469 21397 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 13:04:56.071316 21361 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:56.123099 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 70662.3us
I20260709 13:04:56.103701 21399 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.977643 21389 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.132737 21413 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:56.123495 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:56.112314 21405 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:56.133275 21413 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:56.149664 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:56.151311 21410 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:56.151269 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:56.143822 21413 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.152238 21355 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:56.152611 21335 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:56.152899 21355 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:56.153766 21391 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:04:56.153926 21412 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:04:56.154207 21391 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:56.155113 21391 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.159034 20940 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:56.159893 20940 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.170266 20940 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.173965 15996 leader_election.cc:400] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
I20260709 13:04:56.152992 21413 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:56.126592 21254 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:04:56.192950 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 80724.2us
I20260709 13:04:56.196784 15213 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:04:56.198292 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.198529 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:56.172508 21359 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:56.190168 21380 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.691s	user 0.007s	sys 0.006s
W20260709 13:04:56.226708 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49716.3us
W20260709 13:04:56.235939 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 123093us
I20260709 13:04:56.186812 21250 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:56.146759 21399 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.172072 21407 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:04:56.175093 21395 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.238734 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:56.238896 21405 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:56.254492 21359 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:04:56.261339 21418 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:04:56.261719 21359 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.262550 21254 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.263844 21411 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:56.264184 21359 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:56.265041 21405 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.267776 21405 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.250821 21026 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:56.269068 21399 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.269697 21417 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:56.261046 21392 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.270450 21392 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.259253 21136 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.272961 21392 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.269243 21026 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.275868 21391 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:56.280618 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:56.255221 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:56.285957 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 87488.7us
I20260709 13:04:56.287693 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:56.288681 21429 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:56.289285 21429 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:56.289741 21429 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:56.294709 21435 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:56.297828 21435 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.301765 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:56.302886 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 68311.3us
I20260709 13:04:56.303416 21136 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:56.304210 21136 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.308094 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:56.308251 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:56.309489 15391 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:56.309945 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:56.311576 21433 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:56.312026 21433 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:56.312404 21433 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:56.314541 21399 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:56.315479 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:56.315984 21399 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:56.316526 21399 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:56.317368 21399 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.318892 21400 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:56.319684 21400 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.323508 21400 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.312950 21136 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.325591 21136 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:56.326619 21136 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:56.327833 21136 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:56.329406 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 90764.2us
I20260709 13:04:56.239797 21380 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.335337 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:56.227488 21361 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.337491 21397 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:56.243042 21250 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.342724 21365 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:56.358970 21396 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:56.359609 21435 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:56.359804 21420 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:56.360514 21437 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:56.361232 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:56.363231 21432 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:04:56.284308 21417 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.367681 21380 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.347508 21433 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.370493 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:56.372830 21365 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.400969 21417 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:56.401460 21421 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:56.403584 21250 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.403808 21272 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:56.404175 21272 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:56.405164 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:56.405035 21272 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.407555 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:56.408459 15395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3244) took 1666 ms (client timeout 2091 ms). Trace:
W20260709 13:04:56.408840 15395 rpcz_store.cc:269] 0709 13:04:54.742007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.771156 (+ 29149us) service_pool.cc:224] Handling call
0709 13:04:56.407381 (+1636225us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:04:56.408396 (+  1015us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11975936}
I20260709 13:04:56.410939 21395 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.412184 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:56.412564 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:56.413789 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:56.420800 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 832) took 1728 ms. Trace:
I20260709 13:04:56.421350 15399 rpcz_store.cc:276] 0709 13:04:54.692823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.693044 (+   221us) service_pool.cc:224] Handling call
0709 13:04:54.693421 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.565326 (+871905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.420543 (+855217us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54001955d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:56.420732 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764032256}
W20260709 13:04:56.426025 16025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 978) took 1749 ms (client timeout 1662 ms). Trace:
W20260709 13:04:56.426501 16025 rpcz_store.cc:269] 0709 13:04:54.676770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.682467 (+  5697us) service_pool.cc:224] Handling call
0709 13:04:56.425782 (+1743315us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540067edd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:56.425943 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484050304}
W20260709 13:04:56.428700 15420 debug-util.cc:398] Leaking SignalData structure 0x7b080015e7a0 after lost signal to thread 21179
I20260709 13:04:56.391024 21359 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:56.418053 21375 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.002s
I20260709 13:04:56.431849 21413 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.429718 21340 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:56.396170 21365 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:56.436791 15420 debug-util.cc:398] Leaking SignalData structure 0x7b0800360260 after lost signal to thread 21246
I20260709 13:04:56.402074 21421 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:56.362118 21429 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.372679 21397 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.389462 21437 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:56.447619 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.429512 21380 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.454037 21400 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:56.466135 21427 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:04:56.467397 21400 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.469781 21400 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.473552 21390 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.453792 21433 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.483361 21421 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.485031 21397 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:56.463397 21369 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.675s	user 0.013s	sys 0.002s
I20260709 13:04:56.486321 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:56.487741 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 152200us
I20260709 13:04:56.466084 21429 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.492504 15248 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 11: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:56.438728 21359 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.498003 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:56.500156 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:56.505205 16025 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 10.
I20260709 13:04:56.437944 21375 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.442399 21413 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.505236 16030 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:56.446153 21340 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.545444 21340 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.545957 21413 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.548250 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:56.549010 15247 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:04:56.537292 21437 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.550086 21397 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:56.551131 21431 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:04:56.476701 21380 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.489516 21369 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.550825 21397 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.553965 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:56.554267 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:56.539851 21359 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.553710 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:56.555894 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:56.556768 15241 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:56.557621 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:56.559166 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:56.559424 15246 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:56.560420 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:56.560979 15246 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:56.571264 15249 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
W20260709 13:04:56.558399 21364 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.633s	user 0.017s	sys 0.000s
I20260709 13:04:56.582844 15241 raft_consensus.cc:2410] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:04:56.587152 21375 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.588910 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:56.589874 16025 raft_consensus.cc:2410] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:04:56.590785 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:56.592921 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:56.590910 21413 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:56.593993 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:56.555862 21365 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.596549 15316 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:04:56.599970 21452 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:56.600587 21452 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.603132 21452 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:56.604207 21416 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.384s	user 0.000s	sys 0.001s
I20260709 13:04:56.604367 21397 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:56.607254 21365 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.609095 21380 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.595765 21340 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:56.610205 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.611550 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.611804 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.611908 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:56.610198 21257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.667s	user 0.013s	sys 0.014s
I20260709 13:04:56.611208 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.614656 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.618127 15316 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:56.619397 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.621958 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:56.623098 15324 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:56.624179 15318 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 18 because replica has last-logged OpId of term: 17 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:04:56.626067 15247 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
W20260709 13:04:56.619892 21257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.696s	user 0.014s	sys 0.014s
I20260709 13:04:56.630131 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.630844 15318 raft_consensus.cc:2376] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18. Re-sending same reply.
I20260709 13:04:56.597618 21364 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.632532 15325 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:56.633594 21364 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.635051 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:56.635630 21369 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.635659 15318 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:04:56.642850 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.637539 15248 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
W20260709 13:04:56.745398 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.746207 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.746256 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:56.646199 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:56.598096 21413 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.672124 21087 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.752704 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.752610 21089 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:56.680106 21192 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:56.621066 21340 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.777709 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.780736 21340 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.738791 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:56.767736 21413 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.742020 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:56.782845 21361 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:56.783371 21361 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.776139 21192 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:56.783769 21361 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:56.790524 21413 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.791420 21413 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:56.795360 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 53794.9us
I20260709 13:04:56.802976 21413 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.801769 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:56.804845 21421 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:56.805276 21421 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:56.805647 21421 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:56.785665 21192 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.809806 21192 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:56.815315 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:56.816860 16025 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:04:56.783118 21089 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.819905 21089 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:56.832602 21443 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:56.832945 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:56.834553 21257 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:56.838936 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:56.842567 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2807) took 1439 ms. Trace:
I20260709 13:04:56.843133 15245 rpcz_store.cc:276] 0709 13:04:55.402958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.403171 (+   213us) service_pool.cc:224] Handling call
0709 13:04:55.403583 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.025932 (+622349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.841934 (+816002us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b540001f754. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:56.842349 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410950528}
I20260709 13:04:56.836654 21421 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.849537 21413 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:56.850050 21340 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:56.850641 21413 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.851397 21340 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.853169 21303 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.862465 21089 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.863696 21089 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.854732 21413 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.856020 21257 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:56.867888 21364 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.869024 21364 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.871407 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:56.872578 16030 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:04:56.876870 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:56.882788 21364 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:56.888662 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:56.889740 15321 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:56.889761 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.891230 15317 raft_consensus.cc:2410] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:04:56.891474 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:56.892253 15321 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:56.895969 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 916) took 1995 ms. Trace:
I20260709 13:04:56.900416 15322 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:56.901021 15322 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:56.902529 15322 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.906543 15322 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:56.906701 21272 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:56.912937 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:56.913602 21386 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.116s	user 0.002s	sys 0.000s
I20260709 13:04:56.918459 15322 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
W20260709 13:04:56.918735 21383 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.963s	user 0.000s	sys 0.004s
W20260709 13:04:56.919518 21205 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:04:56.920920 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 760) took 1592 ms. Trace:
I20260709 13:04:56.921388 15242 rpcz_store.cc:276] 0709 13:04:55.328809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.332518 (+  3709us) service_pool.cc:224] Handling call
0709 13:04:55.332826 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.333165 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.333195 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.343392 (+ 10197us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.688846 (+345454us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:04:55.688898 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.688985 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.881191 (+1192206us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:56.920334 (+ 39143us) raft_consensus.cc:1685] finished
0709 13:04:56.920361 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.920738 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1930,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10751,"spinlock_wait_cycles":3852032,"thread_start_us":345136,"threads_started":1,"wal-append.queue_time_us":511472}
I20260709 13:04:56.896454 16024 rpcz_store.cc:276] 0709 13:04:54.900855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.901039 (+   184us) service_pool.cc:224] Handling call
0709 13:04:54.901343 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.163466 (+262123us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:04:55.196732 (+ 33266us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.053757 (+857025us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b18002be580. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:04:56.294394 (+240637us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.294800 (+   406us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:56.294862 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.895455 (+600593us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54006f0754. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:04:56.895524 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.895775 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4305,"prepare.queue_time_us":33047,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":83273,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":607510016,"thread_start_us":240290,"threads_started":2,"wal-append.queue_time_us":1229512}
I20260709 13:04:56.925122 21318 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.925937 21318 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:56.928735 21318 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:56.930959 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:56.932586 16026 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:04:56.932551 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:56.935123 16024 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:56.944031 21387 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.945101 21387 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.946911 21425 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.947317 21390 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:56.947918 21390 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:56.947975 21425 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:56.949200 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.949669 21334 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:56.950781 21413 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:56.951296 21413 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:56.953390 15998 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:56.955506 21395 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:56.955704 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:56.949744 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.959025 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.953692 21183 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:56.967063 21183 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:56.967599 21183 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:56.969038 21183 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:56.961699 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:56.970307 15323 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:56.970975 15397 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:04:56.975026 15321 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:04:56.984378 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:04:56.989241 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 132741us
I20260709 13:04:57.015828 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:57.023075 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:55.966614 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:57.032755 21315 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:56.994952 21318 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:57.042217 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:57.043272 15321 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:04:56.842904 21361 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.041308 21135 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.051923 21135 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.055162 21318 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.060662 21340 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.060853 21183 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:57.060693 15323 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:57.067327 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:57.068778 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:57.069617 21089 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:57.070308 21359 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:57.070640 21413 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.071172 21359 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.072459 21413 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:57.070071 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:57.075470 15323 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:04:57.086617 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:57.090590 21321 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:57.091360 21321 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.094452 21315 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.098519 21189 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:57.093957 21321 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:57.132911 15321 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:57.113329 21315 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.111393 21425 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.131912 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:57.140820 21135 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:57.140408 21318 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:57.155160 15321 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:57.156347 21315 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:57.167479 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:57.170264 15316 consensus_meta.cc:287] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.009s
I20260709 13:04:57.170818 15316 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
W20260709 13:04:57.172003 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 73315.3us
I20260709 13:04:57.171928 21315 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.174536 21315 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.174605 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.175307 21315 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.175843 21315 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:57.178431 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.183542 15322 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
W20260709 13:04:57.175995 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 79656.3us
I20260709 13:04:57.184715 21315 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:57.213892 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.215346 15243 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:57.216986 21359 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.204861 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.213250 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.142777 21321 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:57.211889 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 379325us
I20260709 13:04:57.174366 21318 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:57.182437 21375 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.186483 21421 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:57.229636 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.231149 15245 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:04:57.239292 21318 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.237484 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:04:57.244871 15244 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:04:57.244992 21375 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.226569 21364 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.248535 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:57.248903 21364 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.250418 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:57.251434 21352 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:57.251894 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:57.251977 21364 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.245414 21321 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.242532 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.252286 21352 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:57.228578 21387 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.254782 15242 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:57.260358 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.260277 21272 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:04:57.265769 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:57.276738 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.267274 21272 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:57.289718 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 251340us
W20260709 13:04:57.291257 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.283195 21272 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:57.297124 15243 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:57.299842 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.259167 21390 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.301262 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:57.306030 15244 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:57.310447 21470 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:57.311347 21470 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.310627 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:57.317092 15322 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.316534 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.318126 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:57.322846 15245 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:57.329903 15323 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:04:57.332155 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:57.333124 15318 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:57.330331 15323 pending_rounds.cc:85] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 11
I20260709 13:04:57.329591 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:04:57.337903 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 98951.3us
I20260709 13:04:57.319059 21359 raft_consensus.cc:476] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Not starting pre-election -- already a leader
W20260709 13:04:57.342211 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 101773us
I20260709 13:04:57.331069 21315 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.340101 15323 pending_rounds.cc:107] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:04:57.345988 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.350515 15321 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 8. (term mismatch)
I20260709 13:04:57.350983 15323 raft_consensus.cc:2889] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:57.351181 15321 pending_rounds.cc:85] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 7
I20260709 13:04:57.352419 15321 pending_rounds.cc:107] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 17.8
I20260709 13:04:57.352710 15321 raft_consensus.cc:2889] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:57.336217 21183 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:57.353369 21390 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:57.358413 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:57.364627 21310 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:57.365226 21310 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:57.343080 21359 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:57.344506 21470 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:57.343736 21375 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:57.367861 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 59992.4us
I20260709 13:04:57.365639 21310 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:57.344065 21465 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:57.370865 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.365402 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:57.374595 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.374758 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.375336 16030 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:57.378098 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:57.369407 21315 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.363129 21318 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:57.381539 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.383432 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:57.381556 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:57.377897 21321 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.376911 21470 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:57.394524 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:57.395743 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.397745 21430 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:04:57.398929 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 43608.1us
I20260709 13:04:57.389843 21318 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:04:57.402833 15245 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:57.404822 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.404747 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.384506 21359 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.403798 21387 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.414570 15397 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:57.414361 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:57.402000 21321 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:57.421026 15393 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:04:57.404363 21364 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:57.425899 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.427129 15250 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
W20260709 13:04:57.425981 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 62386.5us
I20260709 13:04:57.405733 21470 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.425415 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.414412 21387 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.422456 21192 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.420811 21471 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:57.434527 15244 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:57.441036 21315 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:57.444804 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.436735 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:57.452263 15322 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
W20260709 13:04:57.454447 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 92342.5us
I20260709 13:04:57.427129 21364 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:57.464721 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 102330us
W20260709 13:04:57.472337 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 91321.9us
I20260709 13:04:57.443075 21192 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.474007 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.463058 21359 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.481410 21315 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:57.486250 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.488917 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.486130 21315 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:57.490694 21315 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:57.468703 21471 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.496616 21471 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.497617 21387 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:57.479317 21467 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.236s	user 0.003s	sys 0.003s
I20260709 13:04:57.499835 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:57.499878 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 913) took 2678 ms. Trace:
I20260709 13:04:57.501046 16028 rpcz_store.cc:276] 0709 13:04:54.821734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.821868 (+   134us) service_pool.cc:224] Handling call
0709 13:04:54.822221 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:54.942909 (+120688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.942946 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:56.940880 (+1997934us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b2c00048698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:04:56.942173 (+  1293us) log.cc:844] Serialized 52 byte log entry
0709 13:04:57.076071 (+133898us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:57.076109 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.085048 (+  8939us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.410922 (+325874us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:04:57.499439 (+ 88517us) raft_consensus.cc:1685] finished
0709 13:04:57.499472 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.499666 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90443,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":27902976,"thread_start_us":249155,"threads_started":2,"wal-append.queue_time_us":241106}
I20260709 13:04:57.487603 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.504308 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.476033 21352 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.474058 21425 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:57.512036 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.512796 16026 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:04:57.516778 21361 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:04:57.520310 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.516925 21470 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:57.530683 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.531865 16026 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:57.530735 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:57.539371 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 77710.7us
I20260709 13:04:57.539489 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.544355 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:57.546401 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 105894us
I20260709 13:04:57.549934 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:57.550843 21375 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:57.551280 21375 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.551654 21375 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:57.556787 15396 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:57.560583 21315 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.564044 21315 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.567735 21413 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.568315 21413 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.570627 21413 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:57.572394 15247 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:04:57.530630 21337 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.574760 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.574638 21337 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.575511 15244 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:57.574504 21205 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:57.577004 21205 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.577441 21337 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:57.542006 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.578801 16028 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:57.579392 21205 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:57.525831 21387 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:04:57.581158 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 69554.7us
I20260709 13:04:57.584251 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.587320 15397 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:57.588981 15247 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:57.514185 21352 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.589839 15363 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:57.601460 21472 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:57.601917 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.602685 16028 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:57.604175 21192 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:57.615561 15396 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:57.580006 21205 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:57.537011 21425 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.623294 15395 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:57.622992 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:57.620271 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:57.615170 21471 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:57.590730 21337 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
W20260709 13:04:57.638474 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.639055 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:57.608345 21470 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:04:57.642167 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 155175us
I20260709 13:04:57.611979 21318 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:04:57.599305 21387 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.640391 21471 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.632247 21205 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.658499 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.643689 21352 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:57.669077 15398 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:04:57.669598 21133 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:04:57.670446 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:57.671132 15391 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.671350 15390 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 13:04:57.672672 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.672940 16028 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:57.673947 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:57.666481 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.656147 21471 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:57.674374 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:57.679869 15394 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:57.685818 21474 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:57.686389 21474 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:57.687361 21474 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.688711 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:57.689491 16033 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.692464 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:57.688803 21474 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:57.701748 15397 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:57.678663 21364 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:57.705320 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:57.713812 21470 raft_consensus.cc:2764] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:04:57.714792 21470 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:57.715768 21470 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:57.716100 21470 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:57.717458 21465 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:57.722786 21425 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:57.723156 21205 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:57.723528 15291 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:57.725292 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:57.729629 21315 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:04:57.733919 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 135405us
I20260709 13:04:57.732836 21425 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:57.735301 15390 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:57.735028 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:57.736888 15398 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:57.737119 15390 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:57.735004 15393 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:04:57.717519 21470 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.752081 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:57.753612 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:57.756279 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.757879 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:57.759070 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:57.762516 21425 raft_consensus.cc:2764] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:04:57.762806 21387 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:57.763341 21364 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:57.763804 21364 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:57.764202 21364 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:57.766593 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.730144 21315 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:57.759871 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:57.730144 21205 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:57.752975 15396 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:57.783134 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:57.787402 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:57.801017 16033 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:57.806972 15398 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:57.807495 15398 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:57.807245 21315 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.808701 21315 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:57.808347 15398 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.809440 15398 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:57.810504 21425 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:57.811045 21425 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.811328 16027 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:57.811450 21425 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:57.810429 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 59826.6us
I20260709 13:04:57.812916 21387 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:57.813740 21387 consensus_queue.cc:1243] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:57.814337 21387 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:57.814674 21387 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:57.814754 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:57.816457 21421 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:57.817317 15289 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:57.818914 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:57.819190 21390 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:57.819685 21390 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.820040 21390 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:57.821131 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:57.824460 15391 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
W20260709 13:04:57.826633 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.829109 21192 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:04:57.834295 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:57.834619 21192 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:57.835335 16032 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:57.834400 21433 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
W20260709 13:04:57.857756 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.867656 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:57.863620 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 200961us
I20260709 13:04:57.869197 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:57.851400 21470 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:57.875840 15998 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:57.884289 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 63235.9us
I20260709 13:04:57.885409 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:57.875378 21433 consensus_queue.cc:1243] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:04:57.902552 21483 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:57.902472 21465 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:57.903716 21465 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:57.905684 21318 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:57.906083 21318 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:57.906394 21359 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:04:57.906840 21359 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:57.907038 21318 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.907675 21359 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.908447 21318 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:57.908946 21359 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:57.891347 21413 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:57.894572 21477 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
W20260709 13:04:57.920073 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 44351.7us
I20260709 13:04:57.902041 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:57.894773 21353 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:57.892735 21433 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:57.930483 21433 raft_consensus.cc:697] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:57.931871 15998 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:57.927052 15394 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:57.931562 21433 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.928403 21387 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.946426 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:04:57.945806 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47280.6us
I20260709 13:04:57.884846 21310 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:57.950376 21310 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:57.933308 21352 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:57.951073 21352 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:57.951468 21352 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:57.954559 15148 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 138) took 17799 ms (client timeout 15000 ms). Trace:
I20260709 13:04:57.957459 21387 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:57.909850 15143 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 9 to 14, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 14 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.964263 15143 catalog_manager.cc:5697] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 5 to 10, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 10 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
W20260709 13:04:57.966437 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 64508.3us
I20260709 13:04:57.968128 15398 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:57.972520 15394 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 12.
I20260709 13:04:57.973681 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:04:57.974536 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 159874us
W20260709 13:04:57.955106 15148 rpcz_store.cc:269] 0709 13:04:40.154812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.155043 (+   231us) service_pool.cc:224] Handling call
0709 13:04:57.946350 (+17791307us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:51.959467 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:51.960147 (+   680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:51.960197 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:04:51.960214 (+    17us) tablet.cc:662] Decoding operations
0709 13:04:51.961650 (+  1436us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:51.961752 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:51.961789 (+    37us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:04:52.317893 (+356104us) tablet.cc:701] Row locks acquired
0709 13:04:52.317945 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:04:52.318118 (+   173us) write_op.cc:270] Start()
0709 13:04:52.318320 (+   202us) write_op.cc:276] Timestamp: P: 1783602292318054 usec, L: 0
0709 13:04:52.318369 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:04:52.319231 (+   862us) log.cc:844] Serialized 6390 byte log entry
0709 13:04:52.854612 (+535381us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f3666af00ac 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b
0709 13:04:53.091189 (+236577us) op_driver.cc:464] REPLICATION: finished
0709 13:04:53.107181 (+ 15992us) write_op.cc:301] APPLY: starting
0709 13:04:53.107294 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:53.116849 (+  9555us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:53.116895 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:53.146025 (+ 29130us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:53.146503 (+   478us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:04:53.146562 (+    59us) write_op.cc:312] APPLY: finished
0709 13:04:53.150044 (+  3482us) log.cc:844] Serialized 148 byte log entry
0709 13:04:53.151050 (+  1006us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:53.151215 (+   165us) write_op.cc:454] Released schema lock
0709 13:04:53.151291 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:53.151740 (+   449us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:53.151770 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3790542,"reported_tablets":27,"spinlock_wait_cycles":33152,"child_traces":[["op",{"apply.queue_time_us":15678,"apply.run_cpu_time_us":22465,"apply.run_wall_time_us":44544,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70975,"num_ops":16,"prepare.queue_time_us":320143,"prepare.run_cpu_time_us":98102,"prepare.run_wall_time_us":1055972,"raft.queue_time_us":20261,"raft.run_cpu_time_us":5433,"raft.run_wall_time_us":16331,"replication_time_us":772361,"spinlock_wait_cycles":71837056,"thread_start_us":877917,"threads_started":4,"wal-append.queue_time_us":747982,"wal-append.run_cpu_time_us":19739,"wal-append.run_wall_time_us":1561305}]]}
I20260709 13:04:57.978144 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:57.979214 21474 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:57.982715 15365 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:57.933494 21479 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:04:57.995168 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:57.979344 21189 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:57.984074 21205 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:57.983800 21133 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:57.982414 21472 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:58.001660 15291 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:04:58.013886 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 151273us
W20260709 13:04:58.006790 15290 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.515s (SENT) [suppressed 26 similar messages]
I20260709 13:04:57.993111 21478 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:58.027105 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:58.029501 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:04:58.029882 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 115640us
I20260709 13:04:58.003213 21205 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.032655 21205 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:58.043126 21433 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:58.012753 21375 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:57.965880 15143 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 7 to 11, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 11 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:58.007157 21133 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:58.016333 21474 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:58.016952 21337 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:58.024806 21478 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.071916 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.074669 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:58.074808 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.081245 15244 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:58.075551 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.083006 15242 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 13: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:58.076352 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.077752 15245 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:04:58.078601 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:58.085129 15322 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
W20260709 13:04:58.045619 21272 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.741s	user 0.005s	sys 0.013s
I20260709 13:04:58.036895 21192 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:58.086169 16030 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:58.034585 21485 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:58.012387 21421 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 13:04:58.093734 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 64314.1us
W20260709 13:04:58.094920 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 93756us
I20260709 13:04:58.095168 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:58.080245 21467 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:58.098155 15291 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:58.080027 21474 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.105160 21474 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:58.032905 21413 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
W20260709 13:04:58.105751 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 91280.4us
I20260709 13:04:58.088173 21478 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:58.037884 21390 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.103771 21471 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.094485 21272 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.093014 21183 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:04:58.159868 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.114653 15247 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:58.117008 21205 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.118109 15398 raft_consensus.cc:1217] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[12.8-15.9]   Dedup: 12.8->[15.9-15.9]
I20260709 13:04:58.090672 21192 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.109560 21321 raft_consensus.cc:3055] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:58.036173 21364 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.086650 21472 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:58.089357 21189 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:04:58.140405 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 75802.2us
I20260709 13:04:58.154520 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:58.161473 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.086220 21337 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.164127 15398 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: [12.8-15.9]
I20260709 13:04:58.166769 16026 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:04:58.169382 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:58.171710 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 100681us
W20260709 13:04:58.180485 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.184015 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.187600 15397 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: [16.9-16.9]
W20260709 13:04:58.192744 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 94672.4us
I20260709 13:04:58.193693 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:58.197530 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.168630 21192 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:58.119216 21483 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 13:04:58.197973 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 189340us
I20260709 13:04:58.168888 21321 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:58.218143 21493 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:04:58.223924 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:58.236557 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:58.236760 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 129673us
I20260709 13:04:58.237251 15398 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:58.237794 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:04:58.253754 21490 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.223611 21493 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:58.273937 15397 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.8-17.8]
I20260709 13:04:58.215982 21421 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:04:58.267628 21413 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:58.284097 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:04:58.268666 21493 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:58.293155 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.295631 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:58.278362 21390 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:58.296494 16026 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:58.306325 16031 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:04:58.258526 21472 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.311559 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.312099 21133 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.314847 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:58.320384 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:58.323204 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.282508 21485 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:58.320243 15395 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:04:58.316903 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:58.280731 21375 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:58.259016 21494 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:04:58.292618 21493 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:58.337687 15390 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:58.335060 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.331555 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:58.338539 15242 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:04:58.339897 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.268465 21490 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.354521 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.355217 15395 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:04:58.356242 15399 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:04:58.357378 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.348062 15397 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:58.360298 15396 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:58.356110 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:58.345351 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.346477 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:58.361232 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 144036us
I20260709 13:04:58.346776 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.347177 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.348026 15392 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:58.350317 21501 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:58.350785 21500 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:58.351171 21499 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:58.351642 21133 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:58.352293 21492 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:04:58.352677 21504 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.353133 21353 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:58.337554 21387 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:58.353770 21502 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:58.388954 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.389392 21509 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.389695 15392 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:58.389994 21509 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.390792 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.392009 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:58.392661 15392 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:58.392537 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.393179 15396 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:58.393486 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.385468 21500 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.397850 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.398284 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:58.398880 16028 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:58.399093 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:58.400040 21425 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.008s
I20260709 13:04:58.400125 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:58.400602 21425 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.401192 21505 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:58.371923 21485 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.401721 21505 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:58.401950 15318 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 16: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:58.402171 21505 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:58.370579 21501 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:58.402766 21501 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:58.394162 15392 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:58.403695 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.404691 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.405073 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:58.267308 21189 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.394487 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.406754 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:58.370177 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 63952.9us
I20260709 13:04:58.370864 15393 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:58.370194 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.409440 15394 raft_consensus.cc:2410] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:04:58.324061 21483 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:58.292232 21413 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.337128 21470 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:58.385787 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.353664 21471 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:58.390391 21508 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:58.362614 15244 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:58.393991 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.394733 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.409987 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.360236 15398 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
W20260709 13:04:58.410754 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 131161us
W20260709 13:04:58.342087 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.380044 21272 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:58.425908 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.400193 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.426702 16028 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:58.386055 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:58.412189 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.416364 15249 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:04:58.411581 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 251473us
I20260709 13:04:58.417595 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.236280 15143 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 7 to 11, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 11 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:58.418329 15362 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:58.421850 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:58.356099 21490 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:58.396744 21500 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:58.417889 21205 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:58.439992 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:58.420157 21470 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:58.448845 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.451305 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:58.429986 21337 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:58.451313 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:58.457574 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48504.6us
I20260709 13:04:58.458954 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:58.462584 15242 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:04:58.449340 21470 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:58.467720 21413 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:58.469566 21425 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:58.441677 21508 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:04:58.442667 21364 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:58.420084 21483 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:58.472903 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56704.2us
I20260709 13:04:58.473315 16026 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:04:58.473978 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:58.475199 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:58.448607 21471 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:04:58.394323 21504 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.437467 21421 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:04:58.484174 15289 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:58.379653 21499 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:04:58.477798 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.479472 21494 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:58.480515 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:58.454159 21315 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:04:58.474411 21359 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.565s	user 0.005s	sys 0.010s
I20260709 13:04:58.486267 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:04:58.502488 16031 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:58.456670 21509 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:58.508369 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:58.512774 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53941.7us
I20260709 13:04:58.513604 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:58.510191 15249 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:04:58.516264 15391 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:04:58.483551 21479 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:58.518424 21507 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.518599 16026 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:58.519088 21507 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.463989 21465 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:04:58.500190 21425 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:04:58.521044 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 57005.1us
I20260709 13:04:58.515534 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:58.491719 21490 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:04:58.532999 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 52569.7us
I20260709 13:04:58.513152 21472 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:58.542522 16032 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 13:04:58.545643 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 74054.5us
I20260709 13:04:58.487078 21375 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:04:58.547293 15215 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:58.539736 21315 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:04:58.560334 21487 raft_consensus.cc:2764] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:04:58.548996 21352 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.004s
I20260709 13:04:58.579219 21133 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:58.539460 21425 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:58.534013 21509 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:58.598569 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.573778 21470 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.598569 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:58.433681 15143 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 11 to 12, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 12 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.601938 16029 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:58.612412 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:04:58.614786 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 94611.2us
I20260709 13:04:58.559501 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:58.604857 21352 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.620604 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:58.618533 21315 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:58.628830 21192 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.552878 21479 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 13:04:58.643959 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 130439us
I20260709 13:04:58.646296 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:58.641021 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:58.637076 21318 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.004s
I20260709 13:04:58.648500 15397 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:58.648386 21315 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.649320 21512 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:04:58.497131 21502 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 13:04:58.650789 21515 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:04:58.655807 21364 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:58.656847 21524 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:58.630127 15390 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:04:58.658579 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 99156.2us
I20260709 13:04:58.658788 15399 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:58.553807 21430 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:04:58.661131 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:58.636300 16031 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:04:58.639307 15395 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:58.662333 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:58.663367 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:58.668593 16033 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:58.666335 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:58.663916 21500 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:04:58.684291 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 120188us
I20260709 13:04:58.668849 21479 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:58.687968 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:58.688308 21430 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:04:58.689215 21518 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:58.689603 21506 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:04:58.688972 21425 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.663810 21364 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:58.695472 21500 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.674762 21390 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:58.679589 21205 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:58.663857 21413 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:04:58.704116 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:58.646095 21474 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.707525 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:58.709381 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:58.710182 21315 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:58.702513 21430 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:58.698652 21479 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:58.670878 21509 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.711766 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:58.735646 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:58.736650 21318 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:58.737242 21490 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:58.715646 21315 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.716881 21523 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:58.719789 21471 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:04:58.721810 21478 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 13:04:58.738065 21523 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.737973 21315 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:58.738739 21523 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:58.738529 21478 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.738233 21471 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:04:58.741460 21471 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.736950 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:58.743064 21490 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:58.743957 21471 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:58.745440 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:58.737957 16032 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:58.713055 21500 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:58.750190 15396 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:58.713091 21390 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.751715 21490 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:58.751941 21390 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:58.752259 21490 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:58.752869 21490 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:58.766914 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 66245.5us
I20260709 13:04:58.767987 15213 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:58.731650 21483 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:58.775513 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 44021.1us
I20260709 13:04:58.776048 21535 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:58.776873 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53585.8us
I20260709 13:04:58.748111 21387 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:58.783715 21519 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:04:58.784787 21526 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:58.794992 15143 catalog_manager.cc:5697] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 9 to 13, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 13 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:58.797546 21528 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.821159 16031 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:58.797302 21315 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.799332 21390 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.767700 21507 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:58.817487 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:58.888712 15249 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:58.887938 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:58.824707 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:04:58.892679 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 76680.3us
I20260709 13:04:58.772382 21501 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.813812 21506 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:58.889140 21352 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:58.895627 21512 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:04:58.932821 16030 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:04:58.935215 15316 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:04:58.939738 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 230383us
I20260709 13:04:58.941211 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:58.943399 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:58.944622 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:58.946038 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:58.893348 21387 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:04:58.804612 21364 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.948158 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:58.887151 21528 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.953032 15317 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:04:58.953315 15325 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:04:58.947777 21526 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:58.961644 21521 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.183s
I20260709 13:04:58.962486 21521 consensus_queue.cc:1243] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:04:58.962862 21526 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.963621 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:58.964452 15324 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:58.965621 21501 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:58.966418 21506 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.966854 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:58.967927 15247 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:58.811451 21430 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.970651 15316 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:04:58.946349 21533 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:58.817600 21479 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:58.965665 15324 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:04:58.976106 15391 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:04:58.977777 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:58.980424 21390 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:58.980854 21528 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:58.982759 21509 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:58.982998 21522 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.983508 21522 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:58.984341 21504 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:58.985711 21499 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:58.995395 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 95707.1us
I20260709 13:04:58.949150 21535 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:58.975771 15143 catalog_manager.cc:5697] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:04:58.946451 21487 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:04:58.948223 21485 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.996160 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:04:59.004519 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:58.974043 21521 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.991161 21533 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:59.022333 21533 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:59.011863 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:59.019282 15325 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:59.000170 21536 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:59.036660 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:04:59.020727 21529 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:04:59.021096 21489 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.814s	user 0.001s	sys 0.006s
I20260709 13:04:59.011245 21474 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:59.000416 21507 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:59.033926 21505 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.002s
I20260709 13:04:59.066249 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:59.000509 21523 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.067847 15316 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:59.069332 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:59.070922 15391 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:59.041198 21502 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:59.036243 21465 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:59.072480 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.038750 21536 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:59.092710 15394 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:04:59.092964 15396 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:59.098513 15320 raft_consensus.cc:2368] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17.
I20260709 13:04:58.999763 21321 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:59.099175 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 103341us
I20260709 13:04:59.105404 21315 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:59.105984 21536 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.110373 21439 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 13:04:59.033528 21521 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.092329 21502 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:59.067030 21205 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:04:59.115301 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 110842us
I20260709 13:04:59.088373 21425 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:59.103088 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.187472 15316 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:04:59.206192 15395 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:04:59.212085 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.073055 21505 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.216332 15394 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:04:59.091867 21465 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.237465 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:04:59.242139 15316 pending_rounds.cc:85] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 10
I20260709 13:04:59.242602 15316 pending_rounds.cc:107] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:04:59.242871 15316 raft_consensus.cc:2889] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:59.139938 21500 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.250048 15317 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:04:59.252261 21471 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.267814 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:59.273504 21470 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:59.243963 21536 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:59.287488 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.296657 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:59.295703 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:59.301802 15249 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:59.235353 21535 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:04:59.311625 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:59.311724 15320 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 13:04:59.318622 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:59.293332 21189 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:59.324018 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:59.324355 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:59.324544 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:59.324802 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:59.324996 15244 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:04:59.325873 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:59.302500 21387 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:04:59.327015 15247 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:04:59.329406 15241 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:59.306525 21364 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:59.331167 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 93932.8us
I20260709 13:04:59.305934 21321 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:59.330034 15291 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:59.333190 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:59.335343 21546 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:04:59.336480 21465 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:59.336594 21541 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:04:59.327477 21205 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.329182 21542 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:59.319787 15243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:59.346635 15243 raft_consensus.cc:606] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:59.347023 15243 raft_consensus.cc:614] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:59.335389 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:59.321875 21539 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:04:59.375483 21544 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:04:59.326440 15143 catalog_manager.cc:5697] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 7 to 12, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 12 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:04:59.386760 21521 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.387332 21500 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.302839 21502 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.328806 21133 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:04:59.407943 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:59.396580 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:04:59.398131 15323 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.003s
I20260709 13:04:59.399554 15244 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:59.348009 21465 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:59.403169 15249 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:04:59.350523 21189 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.294581 21471 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.411809 15323 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:04:59.346073 21487 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:04:59.414188 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 82243.9us
I20260709 13:04:59.415454 21465 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.343259 21364 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.418857 21510 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.413246 21474 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:59.421239 21375 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:04:59.405695 21541 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:59.362947 21539 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.413436 21524 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.463140 15319 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:04:59.352643 21542 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.438280 21501 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:59.454331 21375 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:59.424417 21189 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:59.484927 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 70832.8us
I20260709 13:04:59.486951 21538 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:04:59.489446 21538 consensus_queue.cc:1243] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:59.491279 15213 leader_election.cc:400] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17.
I20260709 13:04:59.491662 15213 leader_election.cc:403] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:59.492256 21485 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:59.492442 21361 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17.
I20260709 13:04:59.454646 21510 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.494416 21471 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:59.494324 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:59.476807 21505 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:59.482683 21513 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:04:59.508294 21361 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:04:59.508736 21543 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:04:59.510437 21364 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.510725 21523 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.512043 21539 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:59.469106 21521 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:04:59.515556 15243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:59.552928 15243 raft_consensus.cc:606] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:59.516111 21189 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.517306 21510 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:59.524135 21490 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.771s	user 0.011s	sys 0.003s
I20260709 13:04:59.525369 21465 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:59.455888 21474 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.527478 16030 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:04:59.480615 21501 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.565574 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:59.486043 21192 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:04:59.527235 21533 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.003s
I20260709 13:04:59.596201 21533 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.563644 21490 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.472340 21524 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:04:59.543434 21544 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:04:59.536442 21133 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:59.599687 21133 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.539470 21513 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:59.570581 21501 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.572785 21474 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:59.573757 21559 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:04:59.495862 21526 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:04:59.581805 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 251786us
I20260709 13:04:59.583804 21506 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:04:59.610761 21506 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.611202 21506 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:59.613200 15243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:59.613865 15243 raft_consensus.cc:606] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:59.614540 21505 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.615077 21505 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.617241 21505 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.621436 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:59.623190 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:59.623823 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:59.546573 21493 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.177s	user 0.013s	sys 0.001s
W20260709 13:04:59.587384 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 232744us
I20260709 13:04:59.588167 21390 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:59.634647 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.590992 21539 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.636663 21539 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.624788 15241 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:59.591969 21472 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.639988 21472 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.552964 21361 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:59.642568 21493 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.643337 21361 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.645772 21493 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.595293 21496 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:59.597254 21479 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:59.586161 21512 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:04:59.630934 15243 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:04:59.631728 21413 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:04:59.631912 21538 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:59.562466 21375 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.647629 15398 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:04:59.648217 15248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:04:59.681447 15248 raft_consensus.cc:606] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:04:59.649448 21490 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:59.653882 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:04:59.654929 15143 catalog_manager.cc:5697] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
W20260709 13:04:59.660046 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 173359us
I20260709 13:04:59.594775 21425 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:59.663362 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.668582 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.696174 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.670682 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:59.617936 21505 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:59.677387 15394 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:59.678506 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:59.698136 15397 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:59.673312 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 62971.5us
I20260709 13:04:59.696396 15399 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:59.700541 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.684794 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.686084 21526 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.696534 15324 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:04:59.705804 21526 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.708467 21526 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.709751 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:59.710790 21485 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:59.711853 21472 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:04:59.698457 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 71437.2us
I20260709 13:04:59.714057 21485 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:04:59.713912 21527 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:59.715199 21527 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:59.715114 21485 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.715976 21533 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:59.716154 21528 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:04:59.659197 21513 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.717979 21523 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:04:59.713958 21390 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.681386 21496 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.719269 21525 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:04:59.718290 21513 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:59.719746 21525 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:59.720453 21496 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.695246 21543 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:04:59.720645 21525 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.720854 21505 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.696889 15321 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:04:59.682190 21512 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:04:59.692905 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.723229 21505 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:59.723934 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.724112 15325 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:59.725116 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.725857 15398 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:59.718427 21523 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:59.726994 21523 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.728200 21523 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:04:59.728472 21539 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:59.729027 21524 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:59.729558 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:59.718961 21390 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.730454 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.730875 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.731477 15325 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:04:59.719283 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.733111 15324 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:59.734952 15324 pending_rounds.cc:85] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 8
I20260709 13:04:59.735265 15324 pending_rounds.cc:107] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:04:59.735239 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:59.735626 21425 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:59.730378 15321 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:04:59.735746 15324 raft_consensus.cc:2889] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:59.731688 21133 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:59.738090 15391 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:04:59.740137 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:04:59.741604 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 118106us
I20260709 13:04:59.745519 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:59.688223 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.740888 15396 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:04:59.752008 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.739812 21272 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:59.753075 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.753856 15394 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:04:59.715997 21527 consensus_queue.cc:1243] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:04:59.754905 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.722078 21525 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:59.756301 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.756955 15394 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:59.757856 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.739955 21493 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:59.759053 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:59.760468 21504 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.760958 21413 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.761140 15143 catalog_manager.cc:5697] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 3 to 11, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 11 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.750977 21470 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:04:59.736093 21425 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.763135 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.770347 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:59.788949 15321 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:59.770613 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:59.762928 21472 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.790275 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:04:59.771273 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:59.770365 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.766824 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.791970 15391 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:59.773283 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.786204 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.793574 15317 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:04:59.775832 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.790303 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.792610 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.777696 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:04:59.787865 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.800951 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.802753 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:59.803231 21478 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:59.804097 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.786054 21504 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.804802 15390 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:04:59.804989 21522 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:04:59.806180 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.807034 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 843) took 1321 ms. Trace:
I20260709 13:04:59.807499 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.807406 15323 rpcz_store.cc:276] 0709 13:04:58.485837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.486348 (+   511us) service_pool.cc:224] Handling call
0709 13:04:59.806839 (+1320491us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540016dd54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:04:59.806951 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":727105280}
I20260709 13:04:59.808689 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.809258 15318 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:04:59.811170 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:59.812031 21502 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:59.813301 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.813984 15143 catalog_manager.cc:5697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 8 to 11, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 11 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:04:59.815158 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:04:59.791065 21425 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:59.815820 15143 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 7 to 12, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 12 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:59.818439 21565 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:59.818873 21565 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.819226 21565 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:59.820250 21559 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:59.820727 21559 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.821092 21559 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:59.821424 21539 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:59.822391 21421 raft_consensus.cc:993] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:59.822820 21390 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:04:59.823468 21421 raft_consensus.cc:1081] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:59.811193 15399 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:59.825495 15399 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:59.828323 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:59.828964 21526 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:59.829470 21526 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.829805 21526 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:59.769093 21493 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:04:59.830475 21133 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:59.831060 21493 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:59.831650 21133 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:59.832072 21133 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:04:59.832607 21524 raft_consensus.cc:993] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:59.833101 21524 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:04:59.832885 21133 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.833519 21524 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.833923 21524 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:04:59.834713 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.834456 21472 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.788758 21413 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.815786 15394 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:59.837101 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46935.9us
I20260709 13:04:59.810089 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.846086 15322 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:59.859860 15397 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:04:59.877393 21542 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:04:59.883693 21526 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.888052 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.907653 15392 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
W20260709 13:04:59.889686 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 83459.3us
I20260709 13:04:59.890187 21535 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:59.897199 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.833241 21538 raft_consensus.cc:1081] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:04:59.834127 21133 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:59.917060 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.918708 15247 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:04:59.918578 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:04:59.928581 15397 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:04:59.920047 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:59.914323 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72178.6us
I20260709 13:04:59.920990 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:04:59.923990 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 152763us
I20260709 13:04:59.929728 15249 raft_consensus.cc:2410] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:04:59.924701 15398 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:04:59.913282 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:04:59.898022 21421 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:59.924963 15215 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:04:59.925843 21483 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:59.940651 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:59.940912 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:04:59.949939 15248 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:04:59.905872 21511 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:04:59.904886 21501 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:59.835651 21508 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:04:59.912235 21522 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.911985 21470 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.946278 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:04:59.926028 15396 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:04:59.971132 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:59.948830 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:04:59.948891 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:59.959067 15392 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:04:59.943506 21430 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:04:59.933171 21500 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:04:59.974839 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:04:59.975205 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:04:59.973727 15394 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:04:59.978628 15249 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:04:59.984059 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:04:59.924844 21542 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:04:59.989120 15247 raft_consensus.cc:2393] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:04:59.975983 21501 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:04:59.952008 21421 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:04:59.818054 15143 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 7 to 11, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 11 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:04:59.981070 21439 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:05:00.077739 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.107666 21375 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:00.110603 21579 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:00.115589 21501 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.121279 21562 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:05:00.122794 21549 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:05:00.123955 21580 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:05:00.105351 21485 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:00.126950 21485 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:00.129452 21574 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 13:05:00.135270 21573 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:04:59.978037 21470 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.085034 15321 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:00.146798 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:04:59.946092 21505 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:04:59.975847 21522 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.078732 15318 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:00.143419 15249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:00.148015 15249 raft_consensus.cc:606] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:05:00.148355 15249 raft_consensus.cc:614] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:59.985363 21500 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:04:59.970299 21508 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.079627 21538 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:00.143519 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:00.177834 21576 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:05:00.188719 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:00.190297 21535 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:00.191128 21522 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:00.158906 21439 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:00.196475 21439 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.198616 21413 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:00.199775 21569 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:00.200309 21569 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.200165 21524 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.200706 21569 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:00.160302 21538 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.260977 21522 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.261315 21538 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:00.144486 21579 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:00.151738 21562 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:00.278717 15321 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:00.280025 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:00.266865 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:00.274747 21579 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.141714 21506 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.284592 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:00.276190 21512 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.000s
I20260709 13:05:00.254992 21421 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.261749 21522 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.191182 21535 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.302506 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:00.310032 21479 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:00.310665 21479 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:00.311249 21479 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:00.312613 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:00.309801 15321 raft_consensus.cc:2368] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19.
I20260709 13:05:00.318353 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:00.320767 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:00.318964 21478 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:00.322916 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:00.322162 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:00.318964 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:00.259223 15248 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:00.138099 15143 catalog_manager.cc:5697] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.337410 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:00.349200 15325 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:00.293390 21526 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:00.354907 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:00.362497 15248 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:00.366662 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:00.369453 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:00.368044 15325 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:00.336413 21352 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:00.357807 21575 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.398s	user 0.000s	sys 0.001s
I20260709 13:05:00.375788 15248 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:00.373843 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:00.354017 21478 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:00.382644 21478 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:00.300211 21512 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.384370 15396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:05:00.384467 15241 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:00.385118 15396 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.385504 21512 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:00.385519 15396 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:00.387666 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:00.390722 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:00.391368 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:00.392668 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:00.326079 21559 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.398335 15325 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:00.395783 21387 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:00.389604 21525 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.000s
I20260709 13:05:00.400933 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:00.374854 21205 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:00.361143 21502 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:05:00.419202 21470 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.419960 21522 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.457031 21395 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:00.425890 15244 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:00.457774 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:00.426182 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3247) took 1184 ms. Trace:
W20260709 13:05:00.404982 21493 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.573s	user 0.009s	sys 0.003s
I20260709 13:05:00.429448 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:00.431401 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:00.432159 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:00.438702 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:00.445346 15246 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:00.447175 15249 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:00.449487 15320 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:00.445804 15396 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.467000 15250 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:00.451669 16026 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:00.398442 21507 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:00.428257 21567 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:00.459187 15316 rpcz_store.cc:276] 0709 13:04:59.241406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.241560 (+   154us) service_pool.cc:224] Handling call
0709 13:04:59.241935 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:59.247918 (+  5983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:59.247951 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:59.248532 (+   581us) log.cc:844] Serialized 52 byte log entry
0709 13:04:59.581208 (+332676us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b18003e9080. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f366dace58f 00007f3666b0d571 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd
0709 13:04:59.613059 (+ 31851us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18003e9080. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9
0709 13:04:59.732440 (+119381us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b18003e9080. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:04:59.777649 (+ 45209us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:59.779229 (+  1580us) log.cc:844] Serialized 14 byte log entry
0709 13:04:59.786140 (+  6911us) log.cc:844] Serialized 14 byte log entry
0709 13:04:59.886360 (+100220us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18003e9080. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:04:59.886640 (+   280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:59.886747 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:00.425915 (+539168us) raft_consensus.cc:1685] finished
0709 13:05:00.425940 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.426095 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104909,"prepare.queue_time_us":1295,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":31970,"raft.queue_time_us":106263,"raft.run_cpu_time_us":464,"raft.run_wall_time_us":60196,"spinlock_wait_cycles":60184832,"thread_start_us":45015,"threads_started":1,"wal-append.queue_time_us":515375}
I20260709 13:05:00.477942 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:00.360052 21589 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:05:00.471433 15396 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:00.472326 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 104245us
I20260709 13:05:00.446589 21533 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:00.483489 15250 raft_consensus.cc:2368] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:05:00.368860 21562 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.457834 21395 consensus_queue.cc:1243] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:05:00.493171 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:00.495476 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:00.499306 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 144518us
I20260709 13:05:00.489975 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:00.503207 21583 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:05:00.504041 21584 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:05:00.504244 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:00.507292 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:00.461885 21586 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.138s	user 0.001s	sys 0.001s
I20260709 13:05:00.526036 16029 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:00.526189 15390 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:05:00.518781 16030 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:00.527585 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:00.527704 21507 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:00.528235 21507 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.523845 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:00.531559 21507 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:00.492067 21425 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.675s	user 0.011s	sys 0.000s
I20260709 13:05:00.485234 21508 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.542002 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:00.542465 21599 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.543675 21470 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:00.544840 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:00.546082 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 153481us
I20260709 13:05:00.480078 21387 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:05:00.474440 21493 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.561148 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:00.559294 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:00.548476 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:00.558461 21421 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.563676 21599 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.567862 21421 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.569618 21598 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:00.571347 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:00.572088 21523 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.843s	user 0.011s	sys 0.000s
I20260709 13:05:00.572080 16025 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:00.573824 15363 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:00.574971 21599 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.506392 21524 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.482980 21567 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.565778 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:00.583276 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:00.583969 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:00.592741 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 811849us
I20260709 13:05:00.594606 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:00.586642 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:00.560266 21470 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.603188 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:00.614152 16033 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:00.576606 21506 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:00.578253 21421 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:00.619771 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:00.619932 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:00.586642 21508 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:00.539726 21479 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:00.633905 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 68191.7us
I20260709 13:05:00.635190 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:00.609839 21599 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:00.610811 21511 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.550297 21425 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.611006 21535 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.613598 21507 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:00.591461 21602 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:00.643368 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:00.650305 15390 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.653949 15390 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:00.587199 21598 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:05:00.628156 21526 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:00.677136 15319 raft_consensus.cc:2368] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:05:00.649011 21506 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:00.675546 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 101827us
I20260709 13:05:00.663146 21602 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:00.613780 21470 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:00.632684 21608 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:00.669868 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:00.633908 21375 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:00.669250 21535 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:00.679927 16033 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:00.676867 21559 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:00.691746 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:00.698427 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.705120 21470 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.706307 21599 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:00.707691 21470 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.711139 21538 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.680634 21600 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:00.651909 21511 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.708817 21567 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:00.707794 21479 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.681617 21506 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:00.713591 15390 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.683061 21602 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:00.751397 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:00.757395 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65729.2us
W20260709 13:05:00.757738 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 154618us
I20260709 13:05:00.758737 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:00.685701 21608 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.763907 21504 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:00.719152 21501 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.713857 21565 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.894s	user 0.013s	sys 0.000s
I20260709 13:05:00.760859 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:00.706370 21387 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:00.753748 21598 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:00.773404 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 886) took 1024 ms. Trace:
I20260709 13:05:00.773954 15398 rpcz_store.cc:276] 0709 13:04:59.749124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.751146 (+  2022us) service_pool.cc:224] Handling call
0709 13:05:00.773170 (+1022024us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54002bb6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:00.773329 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396752128}
I20260709 13:05:00.760654 21506 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:00.783916 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:00.696179 21569 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.769901 21501 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.789170 21479 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:00.791780 21472 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.796213 21511 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:00.781438 21487 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:00.765323 21413 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:05:00.807567 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:00.808982 21425 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:00.824790 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:00.825912 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:00.787024 21493 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:00.829223 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.834690 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:00.844774 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 61019.3us
I20260709 13:05:00.867743 15393 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:00.868062 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:00.766151 21608 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:00.860231 15248 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:00.831849 21559 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.861162 15391 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:00.861454 15394 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:00.836262 21527 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.861661 16027 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 11.
I20260709 13:05:00.771195 21565 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.857563 21487 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:00.908744 15394 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:05:00.859103 21614 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:00.911437 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:00.914775 16031 raft_consensus.cc:2368] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18.
I20260709 13:05:00.915512 15394 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 13:05:00.924300 21597 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.506s	user 0.002s	sys 0.002s
I20260709 13:05:00.928164 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2864) took 1008 ms. Trace:
I20260709 13:05:00.928601 15241 rpcz_store.cc:276] 0709 13:04:59.919277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.921449 (+  2172us) service_pool.cc:224] Handling call
0709 13:04:59.921703 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.385193 (+463490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.927933 (+542740us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400317254. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:00.928103 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063646592}
I20260709 13:05:00.932150 15395 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:05:00.935333 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 789) took 1639 ms. Trace:
I20260709 13:05:00.935958 15246 rpcz_store.cc:276] 0709 13:04:59.295527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.298033 (+  2506us) service_pool.cc:224] Handling call
0709 13:05:00.935000 (+1636967us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540025cbd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:00.935227 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2580502784}
I20260709 13:05:00.939671 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:00.940328 15244 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:00.936456 21485 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:00.932358 15396 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:00.942607 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:00.944489 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:00.890465 21559 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:00.947840 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:00.950013 15247 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:00.951496 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:00.952416 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:00.953073 15249 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:00.950369 15247 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:00.955288 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:00.955888 15241 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:00.916765 21430 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:00.951546 21493 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 13:05:00.966884 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 1.0155e+06us
I20260709 13:05:00.969208 21559 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:00.970515 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:00.971673 15394 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:00.979274 21133 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:00.979792 21133 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:00.982059 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 146484us
I20260709 13:05:00.986035 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:00.986744 15242 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:00.986642 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:00.990420 15391 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:00.902451 21527 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.997157 15244 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: [14.10-16.11]
I20260709 13:05:00.998404 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:00.998971 15244 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:00.991299 15291 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:01.000581 15291 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:00.954146 15247 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.001495 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:01.001801 15247 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:01.001569 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:01.013715 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.015554 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.015475 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:01.018991 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:01.020000 15391 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:01.027352 15324 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:00.951784 21487 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.029085 21487 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:01.029438 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:01.030133 15245 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:01.032081 21527 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:01.032215 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:00.993628 21430 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:00.980656 21133 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.033914 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.034544 21133 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:01.034855 15397 raft_consensus.cc:2410] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:05:00.995597 21567 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:01.037858 15249 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
W20260709 13:05:01.035848 21616 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:05:01.008798 21602 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.042798 15241 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:01.007305 21493 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:01.013113 21413 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:01.044987 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:01.045997 15244 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:01.047497 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:01.019155 21485 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:05:01.025650 21497 raft_consensus.cc:2764] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:05:01.026044 21538 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.052019 21565 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.054512 15245 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:01.055776 21430 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:01.042563 21567 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:01.056471 21413 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:01.049242 15391 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
W20260709 13:05:01.081557 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:01.090884 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.082162 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:01.091872 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.092550 15244 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:01.093533 21413 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.050056 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:01.087509 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:01.098340 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:01.098881 15291 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:01.099238 15319 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:01.100299 15241 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:01.101927 15397 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:01.063220 21569 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:01.089797 21567 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:01.090329 21523 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.142625 16029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:51484
I20260709 13:05:01.101854 21430 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.103260 21485 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:01.117069 21535 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:01.135025 21497 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.100598 21493 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:05:01.184266 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 316266us
I20260709 13:05:01.161751 21513 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.166671 21497 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.167949 21608 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.184046 15319 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:01.161075 21602 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:01.186172 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.192137 21614 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:01.199460 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:01.197640 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 257456us
I20260709 13:05:01.150192 21485 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:01.173799 21500 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.183421 21352 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:01.227313 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.203135 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:01.228468 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.228479 21485 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:01.238651 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.204558 15365 leader_election.cc:400] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:05:01.240097 15365 leader_election.cc:403] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:01.194504 21479 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:01.149397 21523 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.245949 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.153261 21430 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.202337 21472 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:01.234433 21352 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:01.278016 21627 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:01.197090 21513 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.280439 15398 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:05:01.268679 21500 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:01.200363 21478 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:05:01.281638 21500 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:01.283162 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78790.3us
I20260709 13:05:01.284575 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.274014 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:01.276322 21614 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:01.272644 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:01.289067 15392 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:01.247541 21533 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.002s
I20260709 13:05:01.309455 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:01.312860 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.247113 21470 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:01.269217 21522 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:01.324066 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:01.280496 21513 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.330186 15393 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:01.339944 15391 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:01.340361 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:01.341500 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:01.237128 21601 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:01.242928 21611 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:05:01.292219 21479 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:05:01.349802 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:01.307091 21600 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:01.327011 21375 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.315032 21533 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:01.350584 15394 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:05:01.342918 21470 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:01.347975 21522 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:01.356200 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 115650us
I20260709 13:05:01.319497 21472 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:01.328464 21500 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:01.355450 15393 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:01.359642 21613 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:05:01.371402 21542 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.336802 21478 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:05:01.375779 21425 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:01.378998 21608 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:01.381376 21430 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.368040 21493 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:01.382277 21533 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.485215 21533 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.487416 21533 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.383572 21523 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:01.487816 21478 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:01.488260 21478 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:01.489135 21478 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.489845 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:01.490648 15391 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:01.491603 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.491766 21614 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:01.492147 21614 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:01.492699 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.492924 21614 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.391955 21485 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.395114 21497 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:01.395720 16030 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:01.320454 21609 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.094s
I20260709 13:05:01.396829 21413 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:01.398756 21506 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
I20260709 13:05:01.404219 15242 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:01.409631 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 137057us
I20260709 13:05:01.454917 15247 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:01.455324 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 796) took 1472 ms. Trace:
I20260709 13:05:01.458614 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:01.463734 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.508863 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.421689 21535 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:01.510185 15243 rpcz_store.cc:276] 0709 13:04:59.983240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.983754 (+   514us) service_pool.cc:224] Handling call
0709 13:05:00.051771 (+ 68017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.142270 (+ 90499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.142307 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:00.142355 (+    48us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:00.142385 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.454964 (+1312579us) spinlock_profiling.cc:243] Waited 90.2 ms on lock 0x7b540010b654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:01.455030 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.455232 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207498112}
I20260709 13:05:01.512483 15245 raft_consensus.cc:2410] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:05:01.513125 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.523602 15362 leader_election.cc:400] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19.
I20260709 13:05:01.524075 15362 leader_election.cc:403] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:01.525533 15362 leader_election.cc:400] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14.
I20260709 13:05:01.480799 21425 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:01.500408 21478 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:01.468008 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:01.477595 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.420733 21472 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.482403 15394 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:01.460359 21522 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.484678 21493 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.493463 15391 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:01.363135 21375 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.494343 15318 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:01.494208 21614 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:01.464833 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.495486 21485 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:01.539160 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 75552.6us
I20260709 13:05:01.487931 21533 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:01.523438 21470 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:05:01.542109 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.544485 21472 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:01.533715 21613 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:05:01.545331 21636 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:01.527794 21608 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:01.550335 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 940) took 1116 ms. Trace:
I20260709 13:05:01.554163 15393 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:05:01.555835 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.559603 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.508783 21413 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.511394 21612 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:05:01.544040 21609 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19.
I20260709 13:05:01.482364 21542 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.546792 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.604995 15394 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:01.584645 16033 rpcz_store.cc:276] 0709 13:05:00.428784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.431114 (+  2330us) service_pool.cc:224] Handling call
0709 13:05:01.544717 (+1113603us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540066eed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:01.544830 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344766336}
I20260709 13:05:01.607158 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.607441 15394 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:01.608168 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:01.592262 15391 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:05:01.553807 21493 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.595369 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.608930 15323 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:01.599761 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.610323 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:01.611977 15391 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:01.601236 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:01.612859 15392 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:01.614770 16029 raft_consensus.cc:606] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:05:01.616374 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.617272 15317 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:05:01.617359 15391 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:05:01.618026 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:01.610081 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:01.620540 15325 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.582181 21637 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:01.628494 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:01.589316 21608 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:01.517154 21506 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.635569 16030 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:05:01.604362 21470 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:01.587937 21535 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.583828 21533 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.622991 21635 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:01.634783 21637 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.655303 21637 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:01.643661 21641 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:01.626703 21636 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:01.582177 21425 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.632892 21608 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:01.665926 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 106305us
I20260709 13:05:01.636973 21375 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.674913 15323 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
W20260709 13:05:01.676306 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47908.4us
W20260709 13:05:01.674775 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 159003us
I20260709 13:05:01.649019 21635 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:01.679544 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:01.678435 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.682479 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.684778 21272 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:01.685289 21272 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:01.685743 21272 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:01.687762 21496 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:05:01.690442 21567 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.000s
I20260709 13:05:01.690912 21567 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.692607 21542 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.693122 21567 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.693704 21501 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.690752 21635 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.648902 21470 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.699007 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:01.704185 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:01.700639 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:01.716284 15325 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:05:01.721889 15290 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:01.722839 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.697160 21600 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:01.724977 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.698604 21425 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:01.725229 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.727207 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:01.727196 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:01.762334 15322 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:01.762655 15242 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 13.
I20260709 13:05:01.725127 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:01.763639 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:01.734666 21439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.308s	user 0.007s	sys 0.014s
I20260709 13:05:01.736749 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:01.739300 15249 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: [14.10-16.11]
I20260709 13:05:01.771251 15247 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:01.740614 15241 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
W20260709 13:05:01.744589 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 61708.4us
I20260709 13:05:01.750604 15244 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:01.773677 15241 pending_rounds.cc:85] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 11
I20260709 13:05:01.727640 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:01.774101 15241 pending_rounds.cc:107] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:05:01.697218 21613 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:05:01.774380 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46854.9us
I20260709 13:05:01.774613 15241 raft_consensus.cc:2889] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:01.778872 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:01.778927 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:01.784201 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.718176 21485 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:01.703375 21192 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:01.801016 15325 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:01.789000 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:01.791867 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:01.724472 21637 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:05:01.782618 21439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.356s	user 0.007s	sys 0.015s
I20260709 13:05:01.783416 21500 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:01.767165 21536 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:01.759514 21387 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:01.806527 15317 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:01.769341 21601 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:01.769259 21505 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:01.837190 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.826392 15320 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:05:01.827785 21522 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:01.807346 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:01.779464 21611 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:01.825201 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.847991 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.808763 21413 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.862351 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:01.863199 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 136115us
I20260709 13:05:01.827291 21536 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:01.827044 21637 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:01.809428 21192 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.836998 21505 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:01.868641 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:01.873590 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:01.874738 15317 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:05:01.876758 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:01.879047 16025 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:01.879247 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:01.880851 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:01.838752 21601 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:01.847601 21522 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:01.885496 15248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2070) took 1485 ms (client timeout 1740 ms). Trace:
I20260709 13:05:01.885332 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:01.887776 16028 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:01.888823 21652 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:01.888811 21644 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:01.889722 21644 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.892802 21644 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:01.893589 21644 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:01.896669 15250 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: [13.13-15.14]
W20260709 13:05:01.887251 15248 rpcz_store.cc:269] 0709 13:05:00.400457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.400641 (+   184us) service_pool.cc:224] Handling call
0709 13:05:01.885275 (+1484634us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b5400315e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:01.885425 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033884032}
I20260709 13:05:01.874092 21505 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:01.898371 15319 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:01.877566 21500 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:01.904043 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.883085 21479 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:01.880620 21641 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:01.932983 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.808192 21636 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:01.963203 15396 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:01.965857 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:01.983207 16033 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:01.986176 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:01.986943 15319 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:05:01.861794 21611 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:02.000792 16031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 941) took 1571 ms (client timeout 1582 ms). Trace:
W20260709 13:05:02.001446 16031 rpcz_store.cc:269] 0709 13:05:00.429049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.429168 (+   119us) service_pool.cc:224] Handling call
0709 13:05:02.000504 (+1571336us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54004844d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:02.000707 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038731648}
I20260709 13:05:02.003594 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:02.005314 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:02.007818 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 1018) took 1022 ms. Trace:
I20260709 13:05:01.883987 21535 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:05:02.008265 16030 rpcz_store.cc:276] 0709 13:05:00.985867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.995089 (+  9222us) service_pool.cc:224] Handling call
0709 13:05:01.395584 (+400495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.636120 (+240536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.007570 (+371450us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54004740d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:02.007746 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866817920}
I20260709 13:05:01.905894 21652 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:02.017364 21658 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:05:02.028369 21658 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:02.028877 21658 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:01.898957 21522 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.035131 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:01.992745 21644 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.993238 21479 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:02.030175 21645 log.cc:927] Time spent T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Append to log took a long time: real 0.152s	user 0.000s	sys 0.002s
W20260709 13:05:02.054200 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.046849 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:02.022791 21535 consensus_queue.cc:1243] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:02.030411 21637 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:02.087256 21656 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
W20260709 13:05:02.087437 21352 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.004s
I20260709 13:05:02.087939 21352 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:02.088348 21655 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:05:02.022439 16033 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:02.053682 21589 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:02.055120 21470 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:02.127112 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:02.090237 21508 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:02.136339 15324 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:05:02.144591 21660 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:02.145417 21660 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.150283 15390 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:02.151254 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:39722 (request call id 3326) took 2072 ms. Trace:
I20260709 13:05:02.152204 15390 rpcz_store.cc:276] 0709 13:05:00.078815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.526044 (+447229us) service_pool.cc:224] Handling call
0709 13:05:02.123570 (+1597526us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54001964d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf1a3d 00007f366ebc1cd0 00007f3668146254 00007f36681461e2 00007f3668146111 00007f366814608c 00007f3668145342 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:02.151140 (+ 27570us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284027264}
W20260709 13:05:02.126019 21657 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:05:02.053684 21644 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.143584 21508 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.189625 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:02.160995 21665 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:02.030061 21658 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.197327 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:02.197467 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:02.053375 21536 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.210711 15319 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:02.212642 15321 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:05:02.219035 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 174710us
I20260709 13:05:02.220556 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:02.193089 21508 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:02.224560 15322 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:02.221261 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:02.229063 15390 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:02.211442 21192 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:02.218032 21272 consensus_meta.cc:287] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.532s	user 0.002s	sys 0.010s
I20260709 13:05:02.237816 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:02.284073 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:02.282979 15390 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:05:02.286340 21637 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:05:02.287443 15399 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:02.226991 21535 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:02.234889 21658 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:02.188544 21479 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.203608 21665 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:02.294570 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 228694us
I20260709 13:05:02.316272 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3347) took 1235 ms. Trace:
I20260709 13:05:02.316783 15397 rpcz_store.cc:276] 0709 13:05:01.079561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.079701 (+   140us) service_pool.cc:224] Handling call
0709 13:05:01.080040 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.102366 (+ 22326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.314150 (+1211784us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b540009a6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:02.314404 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49888640}
I20260709 13:05:02.318645 15397 raft_consensus.cc:1217] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[12.8-17.10]   Dedup: 12.8->[15.9-17.10]
I20260709 13:05:02.319157 15397 pending_rounds.cc:85] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 8
I20260709 13:05:02.319393 15397 pending_rounds.cc:107] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:05:02.286564 21272 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.322695 21504 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:02.323153 21272 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:02.323172 21504 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:02.325583 21504 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:02.326818 21673 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:05:02.327236 21504 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:02.166934 21652 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.290952 21637 consensus_queue.cc:1243] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:02.233734 21500 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:05:02.320303 15397 raft_consensus.cc:2889] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:02.343433 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 134773us
I20260709 13:05:02.298831 21535 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.383922 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:02.312253 21669 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:02.405385 21614 consensus_meta.cc:287] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.839s	user 0.007s	sys 0.004s
I20260709 13:05:02.385552 21662 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:02.406260 15393 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
W20260709 13:05:02.411077 21668 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:05:02.382721 21667 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:05:02.413542 21678 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:02.415665 21678 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:02.417047 21665 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:02.427520 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 43712.5us
I20260709 13:05:02.384757 21535 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:02.343333 21637 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:02.394683 21600 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.448604 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:02.449316 15322 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:02.438990 21504 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:02.475339 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:02.476356 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.426690 21669 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.481920 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:02.450136 21522 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:02.483649 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.481920 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:02.484349 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 263852us
I20260709 13:05:02.485977 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:02.486593 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 91327.7us
I20260709 13:05:02.488302 15248 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:02.488320 15289 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:02.490825 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:02.491415 15243 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:05:02.476847 21672 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:05:02.491647 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:02.490978 16028 raft_consensus.cc:2410] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:05:02.445367 21637 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.491762 15243 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:02.469084 21506 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:02.491437 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:02.451834 21600 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.497646 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.502254 16027 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:02.496647 15243 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.503312 15243 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:02.500710 15248 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:02.505024 21666 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:05:02.510457 21611 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:02.510879 21600 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:02.515079 21525 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.515259 21601 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:02.515666 21525 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.516749 21660 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:02.517843 21525 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:02.496372 21505 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.001s
I20260709 13:05:02.494503 21678 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:02.523118 15243 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:02.500797 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:02.523168 21478 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.978s	user 0.011s	sys 0.002s
I20260709 13:05:02.539067 21133 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:02.554373 15322 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:02.501789 21644 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:02.555576 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.523851 21678 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:02.559882 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72595.4us
I20260709 13:05:02.561671 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:02.566980 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.569674 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:02.572605 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 81077.9us
I20260709 13:05:02.575040 21681 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:02.575691 21681 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.570492 21133 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:02.578923 21133 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.578729 21683 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:05:02.580971 21683 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:02.581511 21683 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.584491 15363 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:02.587623 21527 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:02.589025 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.589252 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.562387 21678 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:02.593479 15325 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:02.590039 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.581934 21683 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:02.579489 21133 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:02.538873 21505 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.598776 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.601732 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.599340 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.599778 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.577980 21681 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:02.603178 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 45211.7us
I20260709 13:05:02.603515 16025 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:05:02.603667 15363 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:02.566704 21526 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:05:02.605713 15289 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:02.608736 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:02.596751 21660 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:02.611454 15320 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:02.612404 15363 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:02.615012 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:02.618294 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:02.619725 21669 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:02.620373 21636 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:02.617420 21600 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:02.622675 21637 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:02.625180 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:02.630805 21611 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:02.631290 21611 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.631673 21611 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:02.632344 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3353) took 1176 ms. Trace:
I20260709 13:05:02.632738 15393 rpcz_store.cc:276] 0709 13:05:01.456436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.595096 (+138660us) service_pool.cc:224] Handling call
0709 13:05:02.632160 (+1037064us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54001950d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:02.632280 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832381696}
W20260709 13:05:02.633205 21387 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.807s	user 0.004s	sys 0.006s
I20260709 13:05:02.633704 21387 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:02.638813 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:02.639727 16024 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:02.611074 21601 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:02.613144 21660 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.614024 21681 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:02.614413 21478 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:02.647675 15324 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:02.602831 21652 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 13:05:02.652462 21425 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.872s	user 0.012s	sys 0.000s
I20260709 13:05:02.655835 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 871) took 1198 ms. Trace:
I20260709 13:05:02.656445 21686 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:02.657678 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 888) took 1429 ms. Trace:
I20260709 13:05:02.705479 15398 rpcz_store.cc:276] 0709 13:05:01.228040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.228192 (+   152us) service_pool.cc:224] Handling call
0709 13:05:02.657457 (+1429265us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b54001d9f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:02.657584 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118016768}
I20260709 13:05:02.659215 21505 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:02.659603 15394 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:05:02.712532 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 61884.2us
I20260709 13:05:02.715839 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:02.721871 15316 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:02.649363 21681 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:02.726744 21681 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:02.711454 21395 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:05:02.730811 21508 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.731737 21395 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:02.732125 21395 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:02.733325 21508 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:02.733011 21395 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.705312 21686 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:02.734793 21686 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.736142 21686 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:02.739924 15999 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:02.741994 21133 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.742779 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 800) took 1870 ms. Trace:
I20260709 13:05:02.743225 15250 rpcz_store.cc:276] 0709 13:05:00.872367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.897871 (+ 25504us) service_pool.cc:224] Handling call
0709 13:05:01.885647 (+987776us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:01.899251 (+ 13604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.742545 (+843294us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400315e50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:02.742713 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2270758656}
I20260709 13:05:02.744186 21497 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:02.746424 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.748466 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:02.749068 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:02.749344 15398 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:05:02.749683 15393 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:02.749837 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:02.750448 15390 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:02.750597 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:02.705021 15318 rpcz_store.cc:276] 0709 13:05:01.457147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.457346 (+   199us) service_pool.cc:224] Handling call
0709 13:05:01.457781 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:01.554382 (+ 96601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.655580 (+1101198us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54004038d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:02.655769 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83399424}
I20260709 13:05:02.650027 21660 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:02.709796 21637 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:02.777181 21387 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:02.795485 21387 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.797797 21387 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:02.798431 21472 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.209s	user 0.007s	sys 0.007s
I20260709 13:05:02.799070 21540 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.798915 21472 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.799593 21540 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.800722 15393 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:02.801621 21540 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:02.802999 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:02.803668 15318 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:02.708060 21522 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:02.712409 21614 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:02.791850 21497 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 13:05:02.804386 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:02.753151 21608 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.039s	user 0.013s	sys 0.000s
I20260709 13:05:02.664001 21601 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:02.818702 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.820293 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.820678 15320 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:02.778333 21483 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:02.802311 21472 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:02.834375 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:02.836613 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:02.839304 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:02.837337 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 263746us
I20260709 13:05:02.825969 21540 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:02.828624 21387 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:02.833505 21504 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:02.807416 21637 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.830965 21390 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:02.853546 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:02.857843 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:02.860702 16032 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:02.851655 21501 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:05:02.820640 21608 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.869593 21608 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:02.871462 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:02.857277 21579 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:02.873342 21579 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.875752 21579 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:02.876621 21352 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:02.877370 21133 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:02.881728 15318 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:02.821830 21614 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.891921 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:02.822387 21522 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.832894 21483 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:02.907294 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 1.13323e+06us
I20260709 13:05:02.829281 21683 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.913525 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:02.859964 21387 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.908325 15246 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:05:02.916894 21692 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:05:02.918543 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:02.919219 15248 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:02.919997 21425 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:02.920452 21425 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.920794 21425 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:02.912257 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:02.924572 15393 raft_consensus.cc:2368] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
I20260709 13:05:02.928515 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:02.929800 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:02.930531 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:02.942015 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:02.892654 21390 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:02.958345 21611 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:02.928038 21501 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.966305 21483 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:02.971468 15322 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:02.971695 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:02.971575 21637 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:02.976199 21425 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.029354 21540 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:02.977198 21614 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:02.977782 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:02.933831 21644 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:02.981341 21533 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:02.982617 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:02.984452 21535 consensus_meta.cc:287] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
I20260709 13:05:02.985661 21522 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:02.987934 21683 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:02.944470 21472 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:05:02.989799 21650 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.075s	user 0.004s	sys 0.000s
I20260709 13:05:02.953140 21696 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:05:02.976202 15391 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:02.997432 15245 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:02.966143 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51484 (request call id 2) took 1829 ms. Trace:
I20260709 13:05:02.999070 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.009930 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:03.059196 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49409.3us
I20260709 13:05:03.002182 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:03.030910 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:03.031203 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 181694us
I20260709 13:05:03.031785 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:02.904532 21608 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:05:03.042303 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.061218 15248 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.047892 15393 raft_consensus.cc:2368] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16.
I20260709 13:05:02.982127 21493 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.063912 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:03.050596 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:02.931874 21579 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:05:03.028061 21612 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.057178 15391 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:03.064630 15214 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:03.064851 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 62751.7us
I20260709 13:05:03.057561 16029 rpcz_store.cc:276] 0709 13:05:01.142338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.142472 (+   134us) service_pool.cc:224] Handling call
0709 13:05:02.965969 (+1823497us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54006f0754. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf4853 00007f366ebc260a 00007f36681487d4 00007f3668148762 00007f3668148691 00007f366814860c 00007f36681478c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:02.966053 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084079872}
I20260709 13:05:03.036840 21485 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.067329 15319 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:05:03.037181 21644 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.079339 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:03.088872 15397 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.079838 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:02.933573 21601 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:03.086344 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 226994us
I20260709 13:05:03.066191 21522 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:03.097342 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:03.083979 15391 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.099596 15391 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:03.104084 15248 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
W20260709 13:05:03.108175 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.022s	sys 0.015s
I20260709 13:05:03.032970 21501 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.068902 21472 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:03.073218 21641 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:03.073029 21478 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:03.113598 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:03.092563 21644 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.116051 15319 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:03.051731 21535 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.053295 21540 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.127991 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:03.131004 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:03.133203 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2799) took 1809 ms. Trace:
W20260709 13:05:03.134107 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 69599.4us
I20260709 13:05:03.137187 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.084133 21609 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:05:03.133620 15392 rpcz_store.cc:276] 0709 13:05:01.323291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.613625 (+290334us) service_pool.cc:224] Handling call
0709 13:05:01.636255 (+ 22630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.640562 (+  4307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.640608 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.649212 (+  8604us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.759611 (+110399us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:01.759676 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.759771 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.989140 (+1229369us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:03.122355 (+133215us) raft_consensus.cc:1685] finished
0709 13:05:03.122380 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:03.133132 (+ 10752us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2858,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":14304,"spinlock_wait_cycles":17482624,"thread_start_us":85628,"threads_started":1,"wal-append.queue_time_us":177193}
I20260709 13:05:03.147192 15397 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:03.143179 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:03.108738 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.023s	sys 0.015s
I20260709 13:05:03.088585 21505 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 13:05:03.148056 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 576763us
I20260709 13:05:03.149098 21511 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:03.150291 21511 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:03.150709 21511 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:03.151599 21511 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.153009 21511 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:03.150312 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.156131 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:03.157482 15998 leader_election.cc:400] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
I20260709 13:05:03.157740 15998 leader_election.cc:403] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:05:03.157816 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:03.158650 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:03.158939 21352 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:03.159324 15391 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:03.159392 21352 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:03.159996 21352 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:03.160557 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:03.161429 21505 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:03.162032 21505 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.162453 21497 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:03.164490 21505 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.165354 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:03.173609 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.173990 21608 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.174597 21608 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.174741 21472 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.177342 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:03.178144 21390 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.178893 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.179292 21387 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:03.179939 21602 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:05:03.143709 21702 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:03.180709 21651 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:03.181131 15248 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:03.181334 21600 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.181879 21600 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.183079 21497 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
I20260709 13:05:03.119127 21636 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:03.146612 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:03.118466 21641 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.083017 21678 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.092193 21485 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.121579 21479 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:03.118512 21669 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:05:03.188087 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:03.193970 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47438.4us
I20260709 13:05:03.150056 21700 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:03.083174 21612 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.199463 15290 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:03.194535 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 59679.2us
I20260709 13:05:03.242573 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:03.226401 21598 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:03.230135 21485 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:03.230363 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 69691us
I20260709 13:05:03.230710 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3295) took 1199 ms. Trace:
I20260709 13:05:03.230796 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:03.259086 15392 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:03.231108 21501 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:03.232583 21706 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:05:03.232802 21660 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.233705 21637 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.234795 21611 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:03.236291 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:03.286912 16029 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.132686 21478 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:03.238197 21678 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:03.200555 21702 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:03.239809 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.240355 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:03.239850 15399 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 13.
I20260709 13:05:03.196298 21641 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:03.186450 21696 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:03.248559 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:03.249576 21677 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:03.250372 21701 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:05:03.223045 21479 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.268100 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:03.346689 15325 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:03.257879 15324 rpcz_store.cc:276] 0709 13:05:02.031475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.196962 (+165487us) service_pool.cc:224] Handling call
0709 13:05:03.230541 (+1033579us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400218ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:03.230653 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024134400}
I20260709 13:05:03.273576 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:03.256820 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57445.7us
I20260709 13:05:03.342010 15250 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 20 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:05:03.301802 15398 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:03.348497 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:03.344676 16029 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:03.268849 21528 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:03.353232 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:03.354825 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 106338us
W20260709 13:05:03.356200 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 115768us
I20260709 13:05:03.358700 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:03.358772 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:03.363759 15365 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.022s (SENT) [suppressed 10 similar messages]
W20260709 13:05:03.285539 21681 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.000s
I20260709 13:05:03.364578 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:03.365599 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:03.272179 21413 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:03.376432 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:03.378937 21710 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.379745 21710 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.287297 21527 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.106s
I20260709 13:05:03.341698 21696 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.388821 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:03.392836 15322 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:03.393127 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:03.345649 21505 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.274669 21522 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:03.303849 21387 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:03.402750 16029 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:03.403174 21698 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:05:03.405959 21716 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:03.329916 21637 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.383715 21699 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:03.407795 21352 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.409144 21647 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:03.366531 21533 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:03.366418 21687 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:03.363368 21569 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:03.385035 21205 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:03.387748 21710 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:03.367671 21702 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:03.384641 21609 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.367434 21669 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.418989 21652 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.443526 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:03.398694 21696 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:03.453687 15396 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:05:03.389289 21611 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.397464 21413 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:03.411681 21133 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:03.469904 21709 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:05:03.474613 21630 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:03.318660 21478 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.431324 15322 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:05:03.450877 21533 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.432479 21430 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:03.390193 21681 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.453613 21535 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.493086 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:03.456849 21647 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:03.457079 21716 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.494354 21678 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.442675 21714 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:03.496826 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.497164 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.466957 21699 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:03.501233 21660 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:03.476491 21687 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:03.486864 21710 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.428285 21505 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.495714 21611 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.477142 21522 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:05:03.514623 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:03.533679 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:03.534374 15322 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:03.492254 21652 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:03.498803 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 133299us
I20260709 13:05:03.486554 21609 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.537760 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:03.433051 21387 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:03.518391 21690 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:03.509790 21205 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.513697 21533 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:03.490118 21669 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.500133 21133 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.540890 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:03.517627 21681 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:03.516650 21413 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.543926 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:03.539929 21660 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.544682 21387 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:03.537485 21652 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.546550 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.547741 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.548245 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.556103 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:03.558494 21647 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.563896 21505 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.566320 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:03.569023 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 204530us
I20260709 13:05:03.578598 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.584661 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:03.581167 15243 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:03.585491 15244 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:03.582366 15318 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:03.580396 21699 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.587031 15318 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:05:03.588020 15246 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:03.581511 15245 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:03.588881 15318 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:03.581792 15250 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:05:03.523311 21678 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.580531 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.585047 15249 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:05:03.602002 15399 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:03.604475 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:03.549839 21612 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:03.600103 15242 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:03.535271 21710 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.557734 21641 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.580040 21725 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.580453 21660 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.623795 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:03.617739 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.624656 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.627754 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.565583 21205 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.606508 21647 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:03.630534 15242 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:03.650650 15215 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:03.652608 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:03.656558 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.658901 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:03.661255 15244 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.662395 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.662837 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:03.628006 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 87256.9us
I20260709 13:05:03.633046 15323 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:03.668380 15249 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:03.669901 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.675026 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:03.679405 15244 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:03.540795 21702 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.683633 15245 raft_consensus.cc:2368] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
I20260709 13:05:03.658711 21698 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:03.687055 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:03.684746 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:03.660856 21683 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:03.687960 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:03.689844 15249 raft_consensus.cc:2368] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16.
I20260709 13:05:03.659181 21716 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:03.690456 21713 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:05:03.698038 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.694422 15393 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:03.666402 21637 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:03.684286 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:03.695802 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.696933 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 275407us
I20260709 13:05:03.701690 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:03.704500 21723 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:05:03.704923 21710 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:03.705483 21710 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.706082 21710 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.626017 21725 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.665951 21714 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:03.693882 21133 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.711004 21678 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.711452 21641 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:03.711759 21724 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.711128 21714 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.687093 21505 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:05:03.705547 21716 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.714805 15243 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:05:03.717500 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.724740 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:03.728713 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.729072 16024 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.725114 21716 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.728245 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.729524 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:03.691939 21651 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.691085 21698 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.730996 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:03.733866 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:03.691845 21683 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.739028 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:03.702051 21681 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:03.759443 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 165735us
I20260709 13:05:03.621764 21687 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.701210 21535 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.734477 21601 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:03.761229 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.759877 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.760138 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:03.757963 15998 leader_election.cc:400] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16.
I20260709 13:05:03.777235 15998 leader_election.cc:403] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:05:03.764242 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:03.695183 21727 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:03.765966 21387 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.738862 21637 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:05:03.768515 21601 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.736418 21710 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:03.763168 21683 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:03.758817 21698 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:03.777840 15249 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:03.825574 21730 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.767549 21681 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.769001 21609 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:03.771054 21535 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.842257 21601 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.785743 21612 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16.
I20260709 13:05:03.823730 21387 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.826948 21660 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:03.758638 21651 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:03.722045 21726 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.855858 21731 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:03.840992 21721 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:03.820703 21669 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.835175 21205 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:03.865294 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 101139us
I20260709 13:05:03.871816 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:03.876148 21651 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.858129 21533 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.880622 16024 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
I20260709 13:05:03.882974 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:03.907343 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:03.912561 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:03.881794 21644 consensus_meta.cc:287] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.743s	user 0.012s	sys 0.001s
I20260709 13:05:03.919656 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:03.924151 21533 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:03.925034 21728 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:05:03.924250 21700 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:03.927147 15321 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:03.879446 21731 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.932024 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:03.884562 21660 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:03.938316 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:03.931097 21700 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:03.936461 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:03.915304 21721 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:03.929118 21644 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:03.917732 21727 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:03.935416 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:03.944022 15321 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:03.942677 21733 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:03.983103 21647 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:03.983634 21387 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.984022 21734 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:03.864027 21730 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:03.947700 21732 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:05:03.986119 21644 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:03.986651 15319 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:03.989926 21535 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:03.938643 21472 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:03.996476 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:03.996928 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:03.997357 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 62031.6us
I20260709 13:05:03.938432 21731 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:03.949741 21614 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:03.957947 21721 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:04.017500 15390 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:03.882308 21726 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.002329 21716 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:03.995107 21733 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:04.007954 15321 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:03.943063 21660 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.010722 21472 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:04.048130 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.013077 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:03.999931 21737 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:04.016453 21730 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:04.017189 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2810) took 1006 ms. Trace:
I20260709 13:05:04.004583 21724 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:04.019585 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:04.019937 16027 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
W20260709 13:05:04.003202 21696 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.509s	user 0.002s	sys 0.010s
I20260709 13:05:04.013398 21614 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:04.000540 21647 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.048692 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.001063 21698 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.101553 15393 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:04.021497 21721 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:04.049633 15396 rpcz_store.cc:276] 0709 13:05:03.011059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.142910 (+131851us) service_pool.cc:224] Handling call
0709 13:05:04.016967 (+874057us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002b5a54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:04.017118 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702939520}
I20260709 13:05:04.054210 21730 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:04.051815 21472 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:04.112993 16027 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:04.054999 21425 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.055877 21352 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.057103 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:04.057541 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.026427 21714 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:05:04.061700 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:04.063452 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:04.069078 21725 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:04.071827 21611 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.072892 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2792) took 2751 ms. Trace:
I20260709 13:05:04.082993 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.121908 15397 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.090703 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3357) took 1342 ms. Trace:
I20260709 13:05:04.092190 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.046315 21733 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.105628 21609 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.105885 21737 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.108349 21698 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.108742 16030 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:04.109299 21614 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.112035 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.049019 15321 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:04.135656 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:04.136351 15321 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:04.115447 15392 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:04.013199 21700 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.126152 15319 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:04.124958 15395 rpcz_store.cc:276] 0709 13:05:02.748467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.757571 (+  9104us) service_pool.cc:224] Handling call
0709 13:05:02.757865 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.910447 (+152582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.910478 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.910519 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:02.910558 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.090501 (+1179943us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54001540d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:04.090546 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.090639 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350419200}
I20260709 13:05:04.142290 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.143002 15392 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.146466 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:04.147855 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:04.148766 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.149756 21504 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:04.099614 21696 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.137779 21737 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.135713 21600 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.138463 21609 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.100713 21727 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.120994 15394 rpcz_store.cc:276] 0709 13:05:01.321266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.608857 (+287591us) service_pool.cc:224] Handling call
0709 13:05:02.659249 (+1050392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.713961 (+ 54712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.072590 (+1358629us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001d9f50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:04.072782 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2407241472}
I20260709 13:05:04.129542 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.118877 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.150739 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.162564 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:04.166334 15395 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.166805 16030 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:04.163079 15244 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:04.163221 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.160710 15321 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:04.163074 15392 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:05:04.169682 15394 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:04.170909 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.172309 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.171788 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:04.173525 15324 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:05:04.170853 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.174911 15394 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:04.176604 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:04.184363 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.185763 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:04.187896 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.187876 15397 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:05:04.189158 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.189455 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:04.189987 15397 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:04.137564 21425 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:04.158759 21736 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:05:04.198616 21485 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:05:04.150861 21739 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:05:04.162140 21609 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:04.157848 21737 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.199215 21500 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:04.150206 21504 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:04.203585 21731 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.228101 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3359) took 1479 ms. Trace:
I20260709 13:05:04.139226 21614 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:04.210983 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.213138 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:04.192727 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.235997 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.239617 15324 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:04.241449 15324 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:04.243212 15322 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:05:04.243633 15322 pending_rounds.cc:85] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 12
I20260709 13:05:04.243862 15322 pending_rounds.cc:107] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:05:04.244117 15322 raft_consensus.cc:2889] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:04.244288 21472 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:04.228191 21652 consensus_meta.cc:287] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.002s
I20260709 13:05:04.246644 21652 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.248980 21652 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.217971 21425 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.227945 21504 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:04.162077 21683 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.253072 21425 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:04.227469 21500 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:04.217962 21485 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:04.255664 21485 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.255177 21500 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.259482 21647 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.260649 21609 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:04.217989 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.261327 21609 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:04.218977 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.152289 21696 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.160100 21700 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:04.182017 21387 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:05:04.159806 21660 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:04.225327 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.213882 15395 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:05:04.183358 21636 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:04.197182 21535 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:04.228592 15398 rpcz_store.cc:276] 0709 13:05:02.749009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.759129 (+ 10120us) service_pool.cc:224] Handling call
0709 13:05:02.759418 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:03.348789 (+589371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.227813 (+879024us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54003291d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:04.228033 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246948736}
I20260709 13:05:04.260833 15392 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 20 because replica has last-logged OpId of term: 18 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 7.
I20260709 13:05:04.273509 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.224258 15397 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:04.275210 15395 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:04.275157 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.275775 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.276144 15398 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:04.276432 15397 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.277155 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.273803 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:04.254338 21683 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.280229 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.277946 21535 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:04.281513 21647 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:04.282545 21660 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:04.274200 21636 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:04.302718 21726 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:04.324574 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 247117us
I20260709 13:05:04.317124 15398 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:04.322443 21636 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:04.321694 21535 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:04.336165 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:04.325321 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:04.326390 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.338066 15324 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.337826 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:04.328714 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.342080 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.351051 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:04.352560 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:04.354708 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:04.340258 15398 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:04.355926 21737 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:04.306110 21721 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.325218 21647 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:04.359920 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:04.357151 15316 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3271) took 2611 ms (client timeout 1651 ms). Trace:
I20260709 13:05:04.356842 21726 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:04.323328 21733 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.367079 15396 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:04.384006 21647 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:04.383785 15316 rpcz_store.cc:269] 0709 13:05:01.720868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.722364 (+  1496us) service_pool.cc:224] Handling call
0709 13:05:04.331729 (+2609365us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b54001e6ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:04.331894 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137659648}
I20260709 13:05:04.385854 21733 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:04.386538 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.387645 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:04.388037 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.368216 21721 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:04.359684 21696 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:04.369102 21687 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:04.391074 21624 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:04.373354 15398 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:04.374519 21702 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:04.375993 15395 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:04.376520 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:04.392596 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.381054 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:04.322538 21660 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.382682 21710 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:04.388316 21601 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.517s	user 0.012s	sys 0.000s
I20260709 13:05:04.388864 15316 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:05:04.305868 15397 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:05:04.396086 15999 leader_election.cc:400] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 15 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16.
I20260709 13:05:04.402684 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.403537 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:04.391544 21687 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:04.358731 21614 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.360918 21700 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:04.408524 15397 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:04.409590 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 907) took 1262 ms. Trace:
I20260709 13:05:04.410144 15397 rpcz_store.cc:276] 0709 13:05:03.147553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.407705 (+1260152us) service_pool.cc:224] Handling call
0709 13:05:04.408080 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.409238 (+  1158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.409520 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.403483 15395 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:05:04.394034 15398 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 14: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:04.344135 21652 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:05:04.406317 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.402602 21698 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:04.394932 21624 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:05:04.416739 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:04.413820 15316 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:05:04.406396 21687 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:04.419611 15398 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:04.421116 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.443957 21526 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:04.444564 21526 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:04.445006 21483 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:04.445163 21535 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.445457 21526 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.450531 21521 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:04.451131 21660 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.451093 21521 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.453694 21521 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:04.446494 21483 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:04.454043 21504 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.454978 21483 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:04.455355 21483 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:04.456429 21504 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:04.415433 21698 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.456591 21687 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.457180 21698 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:04.457976 21687 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:04.412533 21702 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:05:04.459676 21737 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:04.460665 21702 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:04.461066 21702 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:04.447849 21589 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:04.462574 21589 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:04.463454 21589 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.464457 21589 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:04.419284 21485 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.462011 21702 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.468955 21702 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:04.469235 15322 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:04.449242 21744 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:05:04.409333 21614 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.472556 21614 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.473074 21700 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:04.468981 21485 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.474083 21700 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.474854 21524 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.407356 21601 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.475371 21524 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.480145 15316 raft_consensus.cc:2410] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:04.420601 21562 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:04.483018 21562 raft_consensus.cc:697] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:04.484043 21562 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.484822 21608 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.483927 21395 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:04.469643 21636 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.416317 21652 consensus_queue.cc:1243] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:05:04.490440 15324 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:04.507318 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:04.508380 16030 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:04.509047 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.508409 21719 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:04.509550 21698 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.498498 21524 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.456156 21483 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.480159 21601 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.503821 21636 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.505671 21535 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.510051 21719 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:04.515172 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 906) took 1392 ms. Trace:
W20260709 13:05:04.518886 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 115413us
I20260709 13:05:04.540879 15393 rpcz_store.cc:276] 0709 13:05:03.122995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.700326 (+577331us) service_pool.cc:224] Handling call
0709 13:05:03.704334 (+  4008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.102071 (+397737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.514889 (+412818us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54001545d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:04.515105 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":912924032}
I20260709 13:05:04.525194 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:04.542995 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:04.544538 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:04.547178 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:04.510478 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.550005 15324 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:04.513947 21681 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:04.488996 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.552567 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:04.551435 15316 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:04.555325 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:04.555990 21614 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:04.558367 21635 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:04.554894 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.568738 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:04.569913 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:04.578539 21737 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:04.578763 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:04.579037 21737 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.579653 21737 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.580647 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.581259 15396 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:04.582463 21710 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:04.582901 21710 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.583258 21710 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.583869 21609 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.584582 15395 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:04.585975 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 908) took 1102 ms. Trace:
I20260709 13:05:04.586311 15395 rpcz_store.cc:276] 0709 13:05:03.483278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.414922 (+931644us) service_pool.cc:224] Handling call
0709 13:05:04.584410 (+169488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.584963 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.585756 (+   793us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400270950. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:04.585914 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388808576}
I20260709 13:05:04.587504 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.588568 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.591989 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:04.593681 21737 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.600030 21609 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.600629 21609 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:04.601537 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.579182 21472 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:04.603552 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:04.606829 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3305) took 1341 ms. Trace:
I20260709 13:05:04.607271 15323 rpcz_store.cc:276] 0709 13:05:03.265397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.522308 (+256911us) service_pool.cc:224] Handling call
0709 13:05:04.606673 (+1084365us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b5400077e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:04.606772 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226424192}
I20260709 13:05:04.608378 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.609171 15323 raft_consensus.cc:2410] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:05:04.611727 21472 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:04.609025 21609 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:04.619768 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.646502 21699 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:04.648023 21512 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:04.648505 21512 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:04.649483 21512 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:04.575908 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 172092us
W20260709 13:05:04.655274 15248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2906) took 1490 ms (client timeout 1541 ms). Trace:
W20260709 13:05:04.656039 15248 rpcz_store.cc:269] 0709 13:05:03.164888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.165059 (+   171us) service_pool.cc:224] Handling call
0709 13:05:04.655013 (+1489954us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b540011add4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:04.655196 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33351936}
I20260709 13:05:04.559470 21478 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:04.624141 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:04.625875 21731 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.628837 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3307) took 1340 ms. Trace:
I20260709 13:05:04.629005 21737 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:04.630054 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:04.551077 21601 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:04.551334 21608 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:04.735499 21698 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.740880 15320 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:04.807689 15320 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:05:04.808215 15320 pending_rounds.cc:85] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 9
I20260709 13:05:04.808502 15320 pending_rounds.cc:107] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:05:04.808763 15320 raft_consensus.cc:2889] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:04.809136 15320 pending_rounds.cc:107] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:05:04.809424 15320 raft_consensus.cc:2889] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:04.746030 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 103388us
W20260709 13:05:04.749383 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.753161 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.551419 21652 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.187s
I20260709 13:05:04.755940 15318 rpcz_store.cc:276] 0709 13:05:03.288783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.609851 (+321068us) service_pool.cc:224] Handling call
0709 13:05:03.610633 (+   782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.599090 (+988457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.599121 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.599161 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:04.599192 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.628598 (+ 29406us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54004047d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:04.628646 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.628766 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272647424}
I20260709 13:05:04.620612 21472 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:04.776899 15396 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:04.571753 21521 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:04.571100 21614 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:04.790037 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 160088us
I20260709 13:05:04.571838 21686 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:04.812040 15393 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.576148 21483 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.756450 15325 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:04.829654 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:04.812954 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:04.814452 21751 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:04.817955 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.567065 21660 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.211s
I20260709 13:05:04.820935 15318 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:04.755388 21478 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.842208 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 892) took 1495 ms. Trace:
I20260709 13:05:04.842928 15319 rpcz_store.cc:276] 0709 13:05:03.346422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.143803 (+797381us) service_pool.cc:224] Handling call
0709 13:05:04.144103 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.144308 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:05:04.408849 (+264541us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.841731 (+432882us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.841806 (+    75us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:04.841878 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.841967 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.842131 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":366497,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":120,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":648778,"threads_started":2}
I20260709 13:05:04.811446 21608 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:04.835608 15325 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:04.791182 21677 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.812551 21524 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:04.818557 21521 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.850463 21704 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:05:04.858146 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45314.5us
I20260709 13:05:04.831786 15320 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:05:04.836437 21687 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:04.876106 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2820) took 1173 ms. Trace:
I20260709 13:05:04.836369 21718 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:04.897078 21718 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.899824 21718 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:04.900180 21500 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:04.847182 21478 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:04.903707 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:04.904573 15248 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:04.856568 21608 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:04.857967 21524 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.856853 21624 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:04.874727 21521 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:04.818686 21719 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.837113 21686 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.914321 21524 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:04.874425 21700 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:04.855786 21751 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:05:04.919668 21624 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.857889 21540 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:05:04.863559 21677 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.900743 21500 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.904115 21687 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.942526 21352 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.916636 21718 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:05:04.951201 15393 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:04.955294 15325 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:04.956487 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.957201 15393 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.944415 21702 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.972822 15319 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:04.954095 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:04.979180 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:04.980756 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.981091 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2824) took 1275 ms. Trace:
W20260709 13:05:04.981827 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.985630 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:04.986593 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 331068us
I20260709 13:05:04.983388 15398 rpcz_store.cc:276] 0709 13:05:03.703618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.486819 (+783201us) service_pool.cc:224] Handling call
0709 13:05:04.490175 (+  3356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.490462 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:04.876474 (+386012us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.979032 (+102558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.979108 (+    76us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:04.979176 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.979267 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.979428 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":360197,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":451,"thread_start_us":454381,"threads_started":2}
I20260709 13:05:04.988087 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.988620 15398 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:04.986506 15249 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:04.970134 21681 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:04.968638 21702 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:04.997581 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:04.991376 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:04.992597 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:04.993319 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:04.971833 21535 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.997792 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:05.002396 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:05.003182 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2822) took 1300 ms. Trace:
I20260709 13:05:05.003583 15392 rpcz_store.cc:276] 0709 13:05:03.703011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.170700 (+467689us) service_pool.cc:224] Handling call
0709 13:05:05.002966 (+832266us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b54002bc0d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:05.003122 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204389120}
I20260709 13:05:05.005203 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:04.953508 21352 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.010775 15392 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:05.011479 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3366) took 1128 ms. Trace:
I20260709 13:05:05.011859 15392 rpcz_store.cc:276] 0709 13:05:03.887226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.010294 (+1123068us) service_pool.cc:224] Handling call
0709 13:05:05.010597 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.011237 (+   640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.011415 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.012807 15392 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: [20.10-20.10]
I20260709 13:05:05.013231 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3367) took 1125 ms. Trace:
I20260709 13:05:05.013417 15392 rpcz_store.cc:276] 0709 13:05:03.887587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.012386 (+1124799us) service_pool.cc:224] Handling call
0709 13:05:05.012640 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:05.013073 (+   433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.013195 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.966120 15396 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:05.014703 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3368) took 1126 ms. Trace:
I20260709 13:05:05.009481 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2090) took 1434 ms. Trace:
I20260709 13:05:04.991422 21609 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:05.009991 21472 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:04.996060 21540 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:05.015703 21609 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.016516 21540 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.007076 21535 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.020390 21535 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:05.003621 21660 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:05.021296 21660 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:05.021683 21660 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:05.025481 21608 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:05.026758 21763 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:05:05.027603 21757 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:05.034118 21660 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:05.028492 21753 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:05:05.028548 21540 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:05.015384 15246 rpcz_store.cc:276] 0709 13:05:03.574780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.574928 (+   148us) service_pool.cc:224] Handling call
0709 13:05:03.575273 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:03.588538 (+ 13265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.009246 (+1420708us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54001a90d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:05.009421 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28282240}
I20260709 13:05:05.036919 21472 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:05.038067 21608 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:05.030282 15392 rpcz_store.cc:276] 0709 13:05:03.887864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.013855 (+1125991us) service_pool.cc:224] Handling call
0709 13:05:05.014059 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.014180 (+   121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.014196 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.014451 (+   255us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:05.014512 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.014565 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.014655 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.038759 15398 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:05.039486 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:05.040524 15398 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: [16.9-18.10]
I20260709 13:05:05.042845 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3369) took 1154 ms. Trace:
I20260709 13:05:05.043260 21710 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.043316 15398 rpcz_store.cc:276] 0709 13:05:03.888178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.039978 (+1151800us) service_pool.cc:224] Handling call
0709 13:05:05.040296 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:05.042535 (+  2239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.042790 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.042048 21660 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:05.045805 21710 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:05.006577 21614 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:05.046777 21614 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.047142 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:05.047878 16029 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:05.049151 21614 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:05.050341 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:05.050689 21687 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:05.052289 21500 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:05.055058 21624 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:05.056735 16029 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:05.047423 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3372) took 1147 ms. Trace:
I20260709 13:05:05.059099 21677 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:05.059530 15398 rpcz_store.cc:276] 0709 13:05:03.900308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.046309 (+1146001us) service_pool.cc:224] Handling call
0709 13:05:05.046927 (+   618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.047111 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.047135 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.047179 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:05.047218 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.047269 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.047370 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.065575 15393 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
W20260709 13:05:05.069681 21762 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:05:05.071071 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2825) took 1367 ms. Trace:
I20260709 13:05:05.071507 15399 rpcz_store.cc:276] 0709 13:05:03.716029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.518417 (+802388us) service_pool.cc:224] Handling call
0709 13:05:04.547262 (+ 28845us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:04.547726 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.547767 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:04.548366 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:05:04.918686 (+370320us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:04.918772 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.918966 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:05.070823 (+151857us) raft_consensus.cc:1685] finished
0709 13:05:05.070852 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.071007 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5466,"raft.queue_time_us":3919,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":11001,"thread_start_us":369283,"threads_started":1,"wal-append.queue_time_us":400904}
I20260709 13:05:05.074955 15399 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:05:05.076203 15399 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:05.077258 21635 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.504s	user 0.004s	sys 0.004s
I20260709 13:05:05.077435 15399 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:05.077821 21272 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.078367 21272 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.078766 15399 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:05.079663 16024 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:05:05.080024 15399 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:05.082468 15399 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:05.083621 15399 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:05.011480 21647 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:05.093192 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 909) took 1222 ms. Trace:
I20260709 13:05:05.101545 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.121591 15318 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:05.122596 15391 rpcz_store.cc:276] 0709 13:05:03.871186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.011560 (+1140374us) service_pool.cc:224] Handling call
0709 13:05:05.089085 (+ 77525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.092704 (+  3619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.092752 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.092818 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:05.092882 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.092966 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.093122 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.103909 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 911) took 1046 ms. Trace:
I20260709 13:05:05.099140 21500 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:05.110435 21609 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:05.112308 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:05.113065 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:05.114751 21702 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:05.115720 21686 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:05.116963 21759 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:05:05.090185 21521 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:04.998502 21681 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.119884 21635 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.125203 21647 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.126561 15398 rpcz_store.cc:276] 0709 13:05:04.057458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.102827 (+1045369us) service_pool.cc:224] Handling call
0709 13:05:05.103243 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.103474 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.103512 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.103571 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:05.103616 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.103687 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.103825 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.128566 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:05.133211 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 274176us
W20260709 13:05:05.102324 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 100700us
I20260709 13:05:05.183804 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:05.164798 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:05.187276 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.178020 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3370) took 1278 ms. Trace:
I20260709 13:05:05.189225 15392 rpcz_store.cc:276] 0709 13:05:03.899671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.040592 (+1140921us) service_pool.cc:224] Handling call
0709 13:05:05.042272 (+  1680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.042508 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:05.043111 (+   603us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.177657 (+134546us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.177712 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:05.177754 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.177814 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.177956 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":186,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":105,"thread_start_us":132506,"threads_started":1,"wal-append.queue_time_us":129002}
I20260709 13:05:05.192199 15398 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:05.133760 21687 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:05.195780 15319 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:05.192876 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:05.181298 21647 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:05.238695 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45921.2us
I20260709 13:05:05.128867 21500 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:05.240962 15324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.031s	sys 0.040s
W20260709 13:05:05.241940 15324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.031s	sys 0.040s
I20260709 13:05:05.177142 21526 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 13:05:05.177498 21686 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:05:05.280448 15391 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:05.277987 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 90911.3us
I20260709 13:05:05.235860 21483 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:05.286389 21764 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:05:05.293196 21773 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:05:05.295923 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3318) took 1346 ms. Trace:
I20260709 13:05:05.299409 21521 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:05.301079 15396 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:05.329481 15396 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:05.180229 21540 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:05:05.186416 21635 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.242671 21720 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:05.246320 21771 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:05.226738 21702 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
W20260709 13:05:05.322430 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.317634 15322 rpcz_store.cc:276] 0709 13:05:03.949116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.245031 (+295915us) service_pool.cc:224] Handling call
0709 13:05:04.245321 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.469826 (+224505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.295634 (+825808us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54001c5cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:05.295851 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514372992}
I20260709 13:05:05.333657 15396 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:05.346393 15363 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:05.353130 15363 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:05.245223 21769 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 13:05:05.355307 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:05:05.364184 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 92140.6us
W20260709 13:05:05.364467 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.350664 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 167196us
I20260709 13:05:05.316305 21483 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.373618 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.374475 15322 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:05.376348 15320 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:05.361820 21609 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:05.371809 15363 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:05.349610 21478 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.375028 21608 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:05:05.373051 21614 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:05:05.374253 21660 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:05.366672 21765 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:05.387379 21540 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:05.387876 21521 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:05.388624 21500 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:05.390244 21512 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:05.391709 21760 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.401s	user 0.001s	sys 0.001s
I20260709 13:05:05.391785 21635 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:05.392539 15395 raft_consensus.cc:2368] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19.
I20260709 13:05:05.350113 21720 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.375208 21766 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:05.393638 21478 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:05.395457 21778 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:05:05.395139 21782 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:05.373268 21710 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:05:05.351050 21687 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:05:05.381099 21483 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:05.398932 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2147) took 1065 ms. Trace:
I20260709 13:05:05.399000 21496 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:05.404088 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.364982 21524 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.411304 21677 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.396623 21637 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:05.429833 15396 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:05:05.410089 21660 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:05.585222 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 904) took 2554 ms. Trace:
I20260709 13:05:05.584952 21660 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.585549 21479 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:05.585673 15390 rpcz_store.cc:276] 0709 13:05:03.030804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.581940 (+551136us) service_pool.cc:224] Handling call
0709 13:05:04.017121 (+435181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.017953 (+   832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.585005 (+1567052us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54002b5a50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:05.585155 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000058624}
I20260709 13:05:05.432837 15324 rpcz_store.cc:276] 0709 13:05:04.333699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.736105 (+402406us) service_pool.cc:224] Handling call
0709 13:05:04.736550 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:04.737000 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.737042 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:04.737607 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:05:05.242923 (+505316us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:05.242966 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.243041 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:05.398695 (+155654us) raft_consensus.cc:1685] finished
0709 13:05:05.398717 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.398869 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6681,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":35148,"thread_start_us":504915,"threads_started":1,"wal-append.queue_time_us":610162}
I20260709 13:05:05.432010 21681 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:05.409242 21765 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.590269 21720 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:05.590387 21765 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:05.404533 21540 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:05.419224 21766 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:05.437822 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.430930 21782 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:04.896889 15397 rpcz_store.cc:276] 0709 13:05:03.702450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.417511 (+715061us) service_pool.cc:224] Handling call
0709 13:05:04.418121 (+   610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.418367 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:04.573305 (+154938us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.875454 (+302149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.875531 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:04.875597 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.875845 (+   248us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.876027 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":411389,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":140,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2479,"thread_start_us":435587,"threads_started":2}
W20260709 13:05:05.465349 21779 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:05:05.436755 21496 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:05.488042 21647 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:05.566128 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 213108us
I20260709 13:05:05.411289 21624 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:05:05.403755 21521 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:05.462788 21677 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.602064 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.603119 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.624842 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:05.625437 15322 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:05.604132 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.605118 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.627388 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.628500 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:05.628999 15319 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:05.599020 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.631042 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.635890 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.636792 15316 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:05:05.639284 15325 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:05:05.594539 21766 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:05.649333 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2831) took 1531 ms. Trace:
I20260709 13:05:05.714365 15393 rpcz_store.cc:276] 0709 13:05:04.117829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.068655 (+950826us) service_pool.cc:224] Handling call
0709 13:05:05.095287 (+ 26632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:05.095683 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.095713 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:05.125804 (+ 30091us) log.cc:844] Serialized 26 byte log entry
0709 13:05:05.242500 (+116696us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:05.243037 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.243108 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:05.649129 (+406021us) raft_consensus.cc:1685] finished
0709 13:05:05.649149 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.649277 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3034,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":24851,"thread_start_us":98149,"threads_started":1,"wal-append.queue_time_us":176536}
I20260709 13:05:05.649760 21787 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:05.650527 21496 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.654865 21782 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.591672 21540 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.717213 21540 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:05.720650 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:05.664847 21754 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.786s	user 0.001s	sys 0.001s
W20260709 13:05:05.667603 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 679868us
I20260709 13:05:05.721052 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:05.723747 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:05.670611 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3288) took 3827 ms. Trace:
I20260709 13:05:05.672291 21696 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:05.676911 15319 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:05.726995 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.728179 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.728694 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:05.729192 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:05.729847 15319 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:05.679024 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56905.1us
I20260709 13:05:05.730211 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.675532 15322 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:05.731822 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:05.732870 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:05.733392 15322 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:05:05.683035 16024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 964) took 1663 ms (client timeout 1763 ms). Trace:
W20260709 13:05:05.734165 16024 rpcz_store.cc:269] 0709 13:05:04.019201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.019355 (+   154us) service_pool.cc:224] Handling call
0709 13:05:05.682734 (+1663379us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400631354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:05.682945 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2362859392}
I20260709 13:05:05.690904 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:05.692027 15399 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:05.694327 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:05.736661 15397 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:05.737572 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:05.695176 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:05.695852 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:05.739205 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:05.740288 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:05.740818 15396 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:05.741603 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:05.696848 15392 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:05.743307 15392 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:05.744545 15392 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:05.745546 15392 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:05.697393 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:05.746160 15398 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:05.699261 21652 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:05.610136 21637 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:05.644702 15213 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:05.702610 21783 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:05.715281 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2842) took 1179 ms. Trace:
I20260709 13:05:05.771715 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:05.772084 15395 rpcz_store.cc:276] 0709 13:05:04.536241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.588352 (+ 52111us) service_pool.cc:224] Handling call
0709 13:05:05.702850 (+1114498us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54000276d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:05.715221 (+ 12371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847395712}
I20260709 13:05:05.655350 21686 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:05.752768 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:05.753393 15390 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:05.755165 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 64347.3us
I20260709 13:05:05.770277 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:05.723147 21579 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:05:05.776535 21521 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.803951 21521 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:05.808456 15316 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:05.802191 21686 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.814141 21665 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:05.817121 21395 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:05.817569 21395 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:05.817718 21133 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:05.818291 21133 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:05.818480 21395 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.819201 21133 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.820479 21133 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:05.762141 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:05.823820 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 179180us
I20260709 13:05:05.764875 15396 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:05.724529 15317 rpcz_store.cc:276] 0709 13:05:01.843049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.878793 (+ 35744us) service_pool.cc:224] Handling call
0709 13:05:01.898915 (+ 20122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.992443 (+1093528us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:03.031911 (+ 39468us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.528626 (+1496715us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b1800420520. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:05:04.899338 (+370712us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.899737 (+   399us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.899792 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:04.899844 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.391098 (+491254us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:05.670277 (+279179us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002edbd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:05.670331 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.670500 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39374,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":4376,"raft.queue_time_us":201,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":165,"spinlock_wait_cycles":2534520832,"thread_start_us":369659,"threads_started":1,"wal-append.queue_time_us":1923004}
I20260709 13:05:05.772667 16027 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:05.722506 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:05.774057 15397 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:05.827261 15320 raft_consensus.cc:2368] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20.
I20260709 13:05:05.775038 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:05.719136 21192 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:05.819778 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.823079 15325 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:05.826133 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.829141 15320 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:05.760682 15392 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:05.644155 21483 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.129s
I20260709 13:05:05.830513 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:05.846374 15320 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:05.762326 21478 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:05.726877 21721 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.752321 21781 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:05.838388 15322 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:05.829928 15395 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:05.822834 21699 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.777091 21720 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:05:05.763479 21700 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:05:05.772966 21774 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.600s	user 0.003s	sys 0.003s
I20260709 13:05:05.922555 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:05.923204 15242 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:05.925104 21647 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:05.727337 21787 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.877521 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:05.726588 21768 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.121s
I20260709 13:05:05.773618 21496 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:05.882899 15323 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:05.933786 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:05.848389 16032 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:05:05.726320 21696 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:05.934715 15245 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:05.773314 21562 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.153s
I20260709 13:05:05.952947 21637 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:05.953931 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.964665 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 197574us
I20260709 13:05:05.968819 15395 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:05.854475 21526 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:05:05.902948 21781 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:05.937471 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:05.978636 15242 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:05.979125 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:05.978502 16028 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:05.981231 21795 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:05.982764 21795 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:05.983278 21795 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:05.984460 21795 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.989022 21272 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:05.991211 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 160784us
I20260709 13:05:05.993647 21811 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:05.898887 15325 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:05.802489 21702 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.905251 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:05.857019 15320 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.910589 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:05.911289 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:05.912667 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:05.913388 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:05.914060 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:05.842533 21525 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.842406 21579 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:05.751550 21718 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
W20260709 13:05:05.859328 21754 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:05:05.980171 21781 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:05.922078 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:06.076148 15394 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:05.751215 21652 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:05.977471 21683 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:05:05.751929 21710 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.927953 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:05.928581 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.093920 15244 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:05.773648 21624 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.113s
I20260709 13:05:05.938329 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:05.823239 21769 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.142s
I20260709 13:05:05.889921 15319 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:05.854967 21192 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.937580 21681 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:05.998199 16024 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:05:06.118376 16024 pending_rounds.cc:85] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 13
I20260709 13:05:06.118701 16024 pending_rounds.cc:107] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:05:06.119004 16024 raft_consensus.cc:2889] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:06.018559 15247 raft_consensus.cc:2410] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:05:05.995237 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:06.018739 15248 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:06.019731 15320 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:06.024786 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:06.028824 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.054268 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:05.929682 21721 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:05.926582 21699 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.979285 21562 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.920828 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.134785 16027 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
W20260709 13:05:06.006500 21512 consensus_meta.cc:287] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.597s	user 0.012s	sys 0.001s
I20260709 13:05:05.986151 21795 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:05.975859 21133 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:05:06.082209 15250 raft_consensus.cc:2410] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:06.140297 15248 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:05:06.081848 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.083613 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.084611 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.085608 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2135) took 2702 ms. Trace:
I20260709 13:05:06.141248 15242 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:06.109799 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 181920us
I20260709 13:05:06.006428 21500 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:06.084594 21790 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:05:05.995121 21635 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
W20260709 13:05:06.123629 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 128505us
I20260709 13:05:06.032693 21686 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.124843 15245 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:06.153056 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:06.127192 15244 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:06.131680 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.155857 16033 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:06.156137 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.157677 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.136919 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.031700 21702 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.155301 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:06.162838 15244 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:06.164285 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.142832 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.144117 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:06.165828 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.168124 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.168177 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:06.102483 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 320774us
I20260709 13:05:06.169150 15248 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:06.145855 15393 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:06.146054 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.057554 21525 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.141286 15321 rpcz_store.cc:276] 0709 13:05:03.383210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.170118 (+786908us) service_pool.cc:224] Handling call
0709 13:05:04.170570 (+   452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:04.172518 (+  1948us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:04.412674 (+240156us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.541104 (+128430us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:04.543425 (+  2321us) log.cc:844] Serialized 26 byte log entry
0709 13:05:04.545645 (+  2220us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:04.545698 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.545793 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:05.664129 (+1118336us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:06.085273 (+421144us) raft_consensus.cc:1685] finished
0709 13:05:06.085391 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.085545 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26823,"prepare.queue_time_us":338521,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":3266,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":36349,"spinlock_wait_cycles":118903680,"thread_start_us":346664,"threads_started":2,"wal-append.queue_time_us":420138}
I20260709 13:05:06.117476 21535 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:06.128134 21521 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.122538 21704 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:06.197536 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:06.133021 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 251268us
I20260709 13:05:06.173236 15249 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:06.175437 21771 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:06.112106 21710 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.185078 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.113660 21718 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:06.198902 15242 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:06.202771 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47542.7us
W20260709 13:05:06.199764 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46784.2us
I20260709 13:05:06.204107 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:06.205096 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:06.086457 21696 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.203833 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.133759 21681 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.158568 21700 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:06.219499 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:06.225232 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:06.210361 21800 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:06.238511 21696 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:06.238862 21799 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:05:06.239838 21525 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.240731 21677 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.241459 21677 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:06.241688 21806 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:06.241945 21677 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:06.238884 21800 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.242914 21526 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:06.245111 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.140034 21562 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.246482 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.247081 15249 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:06.247926 21562 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:06.248064 16028 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
W20260709 13:05:06.249822 21775 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.074s	user 0.005s	sys 0.000s
I20260709 13:05:06.250718 21787 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.251318 21787 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.251780 21787 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.253125 21352 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.253597 21721 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.202757 21771 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:06.248196 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.247931 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.187914 21535 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:06.258348 15242 raft_consensus.cc:2368] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19.
I20260709 13:05:06.258579 15320 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:06.261575 21798 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:06.262501 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 57477.5us
I20260709 13:05:06.151997 21500 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.215137 21719 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.266839 15248 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:06.214732 21686 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:06.222244 21483 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:06.263388 21535 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:06.278625 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.253835 21787 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.260123 21771 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:06.289690 15362 leader_election.cc:400] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20.
I20260709 13:05:06.291731 15362 leader_election.cc:403] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:05:06.206058 21521 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.259012 21800 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:06.256379 21803 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:06.323961 21500 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.212436 21704 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.326509 21704 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.262337 21798 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:06.242928 21677 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.328956 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:06.330638 21700 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.332017 16029 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:06.222265 21718 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.336560 21718 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.305027 21192 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.310698 21721 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20.
I20260709 13:05:06.311314 21479 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:06.313797 21521 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.315269 21702 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.315070 21652 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.316923 21681 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.320034 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:06.322937 21540 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.605s	user 0.017s	sys 0.000s
I20260709 13:05:06.326987 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.338500 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:06.363755 16026 raft_consensus.cc:2368] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:05:06.366861 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.367676 16026 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:06.368860 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.370034 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:06.372040 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.376227 16026 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:06.339174 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.378846 16029 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:06.277421 21719 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.379755 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.337950 15244 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:06.273231 21804 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:06.377187 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:06.383569 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.383709 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:06.340757 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:06.337574 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 169515us
I20260709 13:05:06.386950 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:06.385179 16026 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:06.385912 15248 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:06.388684 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.389671 15248 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:06.381666 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.391494 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.392943 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.396154 21472 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:06.396677 21472 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:06.397063 21472 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:06.399618 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.400393 15250 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:05:06.401319 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.405547 21767 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:06.407817 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.408643 15242 raft_consensus.cc:2368] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19.
I20260709 13:05:06.409284 21681 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:06.409514 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.409919 21681 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:06.406064 21767 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:06.410889 21681 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.411542 21767 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.413128 21767 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:06.392133 21652 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:06.419976 21720 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:06.420459 21720 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:06.420735 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.421305 21720 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.428459 21472 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.430981 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.432219 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.433267 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.439828 21798 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.439971 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.440464 21798 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:05.694217 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:06.443306 21798 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:06.444373 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 914) took 1438 ms. Trace:
I20260709 13:05:06.444772 15391 rpcz_store.cc:276] 0709 13:05:05.005686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.285023 (+279337us) service_pool.cc:224] Handling call
0709 13:05:05.335419 (+ 50396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:05.335819 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.335860 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:05.336392 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:05:05.464216 (+127824us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:05.496047 (+ 31831us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.496335 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.496403 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:06.331148 (+834745us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b1800058720. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:06.442172 (+111024us) spinlock_profiling.cc:243] Waited 9.78 ms on lock 0x7b1800058720. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:06.444168 (+  1996us) raft_consensus.cc:1685] finished
0709 13:05:06.444188 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.444314 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32131,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3738,"raft.queue_time_us":218,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":10529,"spinlock_wait_cycles":34761856,"thread_start_us":92726,"threads_started":1,"wal-append.queue_time_us":154242}
I20260709 13:05:06.448340 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:06.449620 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:06.450452 21478 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:06.450850 21478 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:06.451212 21478 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:06.451989 21710 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.452606 21710 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:06.453110 21710 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:06.453548 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:06.455394 21192 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:06.455842 21192 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:06.456210 21192 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:06.456696 21687 raft_consensus.cc:3055] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:06.457131 21687 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:06.458745 21766 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.705s	user 0.003s	sys 0.007s
I20260709 13:05:06.459839 21719 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.464393 21699 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.457914 21687 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.376155 21721 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:06.466604 21721 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.467048 21721 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:06.467638 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.470767 21751 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:06.473523 21819 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.474058 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:06.474712 15398 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:06.475025 21819 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.476038 15249 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:06.477445 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:06.479584 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:06.480240 15320 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:06.481616 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:06.482473 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:06.483156 15397 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:06.484042 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.484246 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:06.482570 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:06.485934 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.486619 16029 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:06.486882 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:06.487943 15289 leader_election.cc:400] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:05:06.488409 15289 leader_election.cc:403] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:05:06.430874 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.490643 15248 raft_consensus.cc:2376] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16. Re-sending same reply.
I20260709 13:05:06.491145 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:06.491895 15245 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:06.492467 16031 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:06.494567 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.494987 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:06.495638 15396 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:06.495940 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.499697 15397 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:06.500213 15242 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:06.390086 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:06.501240 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.502424 15399 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:05:06.502705 15246 raft_consensus.cc:2368] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:05:06.478983 21512 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:06.503365 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:06.504128 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54593.5us
W20260709 13:05:06.504314 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 114402us
I20260709 13:05:06.492700 16027 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:06.506646 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:06.492863 15318 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:06.487872 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:06.507292 15399 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
W20260709 13:05:06.505898 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 280713us
I20260709 13:05:06.493611 15996 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:06.510028 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:06.510946 15250 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:06.512284 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:06.511678 15242 raft_consensus.cc:2376] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18. Re-sending same reply.
I20260709 13:05:06.513834 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.514585 15242 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:06.511723 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.516316 15248 raft_consensus.cc:2368] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:05:06.524328 15394 raft_consensus.cc:2410] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:05:06.525383 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:06.526664 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:06.527868 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:06.526865 15291 leader_election.cc:400] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19.
I20260709 13:05:06.532799 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:06.535120 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.536633 15998 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:06.536800 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 49009.1us
I20260709 13:05:06.536958 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.537776 15246 raft_consensus.cc:2410] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:05:06.537705 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.538659 21815 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:06.538851 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.540073 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.541158 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.541724 15248 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:06.542620 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.544521 15248 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:06.459188 21766 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.548666 15391 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:06.508984 21782 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:06.543000 21352 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:06.513504 21665 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:06.535627 21500 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:05:06.562129 21500 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:06.562745 21500 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:06.563660 21500 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:06.565478 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.505585 21696 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:06.551599 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.534340 21789 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:06.568005 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.509686 21512 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:06.536172 21720 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:06.570329 15248 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:06.571923 15246 raft_consensus.cc:2410] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:06.525743 21769 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:06.544531 21787 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:06.547851 21768 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:06.552248 21614 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:06.453999 21710 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.620352 16030 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:05:06.628540 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 90887.8us
W20260709 13:05:06.625643 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 115707us
I20260709 13:05:06.633842 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:06.625082 15215 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:06.625506 15246 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:05:06.626390 15248 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:05:06.599022 21805 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:06.638381 15246 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:06.632419 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:06.645931 16027 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:06.568742 21562 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:06.599445 21698 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:06.623610 21809 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:05:06.617475 21751 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:06.653292 15246 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:06.651567 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:06.618073 21798 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:06.568877 21816 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 13:05:06.623894 21614 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.667753 21766 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.620007 21787 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:06.623615 21768 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:06.655305 21699 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:05:06.695137 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 201592us
I20260709 13:05:06.627617 21525 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.693770 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:06.601115 21696 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.709789 16027 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:06.710562 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 177852us
W20260709 13:05:06.725366 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.653337 21562 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.726783 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:06.728600 21637 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:06.729254 21637 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:06.694245 21751 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.617789 21478 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.715061 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:06.627599 21472 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.661686 21702 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:06.670120 21352 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:06.625690 21769 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.693768 15248 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:05:06.695487 21521 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:06.675177 21804 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:06.712376 21614 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:06.725714 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:06.882877 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 157228us
I20260709 13:05:06.883855 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:06.884816 15291 leader_election.cc:400] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:05:06.717433 21768 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:06.717136 21787 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:06.733408 21699 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:06.708578 21798 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:06.731027 21781 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.000s
I20260709 13:05:06.673274 21771 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.732453 21704 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:06.686820 21698 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:06.777776 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 249947us
W20260709 13:05:06.779654 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.897855 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:06.746984 21702 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.901239 21702 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:06.901531 21696 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.819829 21637 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.876554 21521 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.935822 21521 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:06.677768 21512 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:06.939057 21512 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:06.940589 21818 consensus_queue.cc:1175] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" responder_term: 15 status { last_received { term: 15 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 15 index: 10 } }
I20260709 13:05:06.940867 21608 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.941496 21608 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:06.942631 21767 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:05:06.943784 21771 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.946642 21830 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:06.947222 21830 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:06.947683 21830 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:06.897131 21819 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:06.734572 21562 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:06.870291 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:06.966646 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.949828 21829 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:06.642396 21803 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:05:06.878345 15242 raft_consensus.cc:2410] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:05:06.732182 21525 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:06.883103 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 377768us
W20260709 13:05:06.877849 21810 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:05:06.949334 21395 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:06.875017 21681 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:06.896234 21781 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.909271 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:06.992612 15243 raft_consensus.cc:2368] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19.
I20260709 13:05:06.993536 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.994197 15243 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:06.995114 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:06.995690 15243 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:06.996665 15243 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:06.742635 21751 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:06.913977 15250 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:07.000293 15250 pending_rounds.cc:85] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 11
I20260709 13:05:07.000629 15250 pending_rounds.cc:107] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:05:07.000877 15250 raft_consensus.cc:2889] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:06.910310 21535 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.005s
I20260709 13:05:06.917764 21699 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:06.918314 21524 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:06.921999 21698 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:06.923141 21652 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 13:05:06.923760 21687 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:06.925683 21824 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:05:06.932519 21798 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:06.933801 16025 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:06.891319 21816 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:06.891543 21804 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:06.941139 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:07.019397 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78350.4us
I20260709 13:05:07.020495 15365 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:06.939322 21827 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:06.952126 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.969780 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:06.951733 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.025573 16028 raft_consensus.cc:2410] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 13:05:06.972254 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.976194 21769 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:06.979141 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.910456 21704 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.876145 21660 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.981148 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.967638 21829 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:06.989794 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:06.943790 21608 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:07.012719 16033 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:05:07.015724 16032 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
W20260709 13:05:07.014283 21721 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.001s
I20260709 13:05:07.029170 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:07.041249 16025 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:07.029902 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:07.033599 21804 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.042781 16031 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:07.026388 21803 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:07.026804 21798 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:07.007651 21535 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.028616 21816 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:07.037235 21704 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:07.055297 21815 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.000s
I20260709 13:05:07.055871 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 977) took 1479 ms. Trace:
I20260709 13:05:07.060314 16030 rpcz_store.cc:276] 0709 13:05:05.576696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.576855 (+   159us) service_pool.cc:224] Handling call
0709 13:05:05.584471 (+  7616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.624611 (+1040140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.055572 (+430961us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400474d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:07.055776 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2381743872}
I20260709 13:05:07.063047 21614 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.067930 21614 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:07.068936 21525 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:07.072181 21829 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.075990 21535 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.063608 21665 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.095973 21665 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:07.065196 21192 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.609s	user 0.004s	sys 0.007s
I20260709 13:05:07.080343 21787 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.089382 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 1036) took 1007 ms. Trace:
I20260709 13:05:07.045328 21819 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:05:07.101945 21787 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.106029 21816 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.104542 21192 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.108670 21766 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.108789 21192 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:07.259649 21521 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:07.214946 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 490162us
I20260709 13:05:07.004997 15247 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:07.269302 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2129) took 1355 ms. Trace:
I20260709 13:05:06.981638 15289 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:06.971285 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59689us
I20260709 13:05:07.028016 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:07.058451 21478 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:07.271852 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2919) took 1133 ms. Trace:
I20260709 13:05:07.041567 21660 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.272502 15242 rpcz_store.cc:276] 0709 13:05:06.137872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.537479 (+399607us) service_pool.cc:224] Handling call
0709 13:05:07.271289 (+733810us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54000ad054. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:07.271635 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":780293376}
I20260709 13:05:07.045782 21721 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.110517 21766 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:07.278021 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 392295us
I20260709 13:05:07.279805 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:07.280258 21721 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:07.132947 21768 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.282635 16024 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:07.087543 21815 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:07.218386 15214 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:07.169039 21844 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:05:07.285589 21768 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:07.270815 21687 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:07.104593 21562 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.322883 21192 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:07.323861 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 342182us
I20260709 13:05:07.326650 21718 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.326678 21787 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:07.327819 21718 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.276510 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2925) took 1129 ms. Trace:
I20260709 13:05:07.110616 21702 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:07.287994 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 78191.8us
I20260709 13:05:07.288375 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2931) took 1138 ms. Trace:
I20260709 13:05:07.289055 21525 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:07.083204 21781 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:07.340932 21521 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.290856 21819 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:07.291041 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 262985us
I20260709 13:05:07.293260 21816 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.295384 21767 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.298072 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:07.299877 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:07.302604 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:07.305333 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:07.098140 16032 rpcz_store.cc:276] 0709 13:05:06.081796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.083289 (+  1493us) service_pool.cc:224] Handling call
0709 13:05:07.089109 (+1005820us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54001801d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:07.089295 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2011233152}
I20260709 13:05:07.289714 21660 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:07.237767 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2936) took 1042 ms. Trace:
W20260709 13:05:07.350059 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.349797 21767 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.350466 15244 rpcz_store.cc:276] 0709 13:05:06.195366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.995945 (+800579us) service_pool.cc:224] Handling call
0709 13:05:06.996217 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.996416 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:06.996675 (+   259us) log.cc:844] Serialized 14 byte log entry
0709 13:05:07.236643 (+239968us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:07.236775 (+   132us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:07.236943 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.237099 (+   156us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.237476 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":275557,"prepare.queue_time_us":475,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":11099,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":18977,"thread_start_us":239234,"threads_started":1,"wal-append.queue_time_us":239635}
I20260709 13:05:07.321367 21815 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:07.269752 15247 rpcz_store.cc:276] 0709 13:05:05.913694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.130998 (+217304us) service_pool.cc:224] Handling call
0709 13:05:07.268855 (+1137857us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540001e854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:07.269076 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878317440}
I20260709 13:05:07.354575 16024 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:07.355075 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:07.356040 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:07.356690 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:07.356920 15244 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:05:07.357532 15247 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:07.330440 15248 rpcz_store.cc:276] 0709 13:05:06.149930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.887140 (+737210us) service_pool.cc:224] Handling call
0709 13:05:06.887576 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.219694 (+332118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:07.219780 (+    86us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:07.219867 (+    87us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:07.219961 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.287810 (+ 67849us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400448ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:07.287875 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.288127 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760685952}
I20260709 13:05:07.321998 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:07.353637 21767 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.360532 15245 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 14.
I20260709 13:05:07.361728 21815 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:07.361332 21660 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:05:07.362095 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59917us
I20260709 13:05:07.334805 21525 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.366591 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:07.370879 15249 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:07.371331 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:07.372429 15249 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:07.373292 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 830) took 1107 ms. Trace:
I20260709 13:05:07.362277 21815 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.373646 15249 rpcz_store.cc:276] 0709 13:05:06.266186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.371680 (+1105494us) service_pool.cc:224] Handling call
0709 13:05:07.372159 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.372960 (+   801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.373207 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.379806 15248 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: [13.13-15.14]
I20260709 13:05:07.329756 15246 rpcz_store.cc:276] 0709 13:05:06.146408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.703704 (+557296us) service_pool.cc:224] Handling call
0709 13:05:06.704136 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.920829 (+216693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.920888 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:06.921391 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:05:06.988534 (+ 67143us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:06.988571 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.275408 (+286837us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540010ca54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:07.275525 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.275686 (+   161us) raft_consensus.cc:1685] finished
0709 13:05:07.275708 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.276253 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497687296,"thread_start_us":66745,"threads_started":1,"wal-append.queue_time_us":96841}
I20260709 13:05:07.420517 21535 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:07.421315 21535 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.421826 21535 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:07.423699 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 829) took 1164 ms. Trace:
I20260709 13:05:07.424271 15247 rpcz_store.cc:276] 0709 13:05:06.259073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.368657 (+1109584us) service_pool.cc:224] Handling call
0709 13:05:07.422819 (+ 54162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.423228 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:07.423262 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:07.423324 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:07.423364 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.423439 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.423600 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.426728 21681 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:07.374482 21192 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:05:07.427604 21681 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.429116 21192 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:07.374107 21787 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:07.416438 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:07.368440 21525 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:07.410418 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:07.417356 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 137222us
I20260709 13:05:07.431212 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:07.418547 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 96801.2us
I20260709 13:05:07.431145 15247 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:07.378472 21660 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:07.440980 21660 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:07.440815 21704 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.410284 21815 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:07.374714 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:07.435865 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 831) took 1158 ms. Trace:
I20260709 13:05:07.447309 15248 rpcz_store.cc:276] 0709 13:05:06.274579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.378831 (+1104252us) service_pool.cc:224] Handling call
0709 13:05:07.379342 (+   511us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:07.414849 (+ 35507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.433025 (+ 18176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.448702 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 836) took 1047 ms. Trace:
I20260709 13:05:07.377552 21702 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.449280 15247 rpcz_store.cc:276] 0709 13:05:06.395533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.425499 (+1029966us) service_pool.cc:224] Handling call
0709 13:05:07.426057 (+   558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.442764 (+ 16707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.443007 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:07.452615 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 52078.5us
I20260709 13:05:07.453433 21829 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:07.453990 21829 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:07.454435 21829 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:07.454896 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.459076 15246 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:07.417687 21804 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.459401 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:07.459834 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2952) took 1013 ms. Trace:
I20260709 13:05:07.460258 15395 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:07.460065 21804 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.460371 15246 rpcz_store.cc:276] 0709 13:05:06.446699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.435142 (+988443us) service_pool.cc:224] Handling call
0709 13:05:07.458693 (+ 23551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.459556 (+   863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.459775 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.464161 21766 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.429827 21192 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.466768 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:07.467631 15399 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:07.468297 21192 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.469362 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:07.463645 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89407.1us
I20260709 13:05:07.377923 21816 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.470842 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:07.473330 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:07.474802 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.475418 21766 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:07.475888 21766 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.475950 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 822) took 1275 ms. Trace:
I20260709 13:05:07.476413 21766 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:07.476413 15245 rpcz_store.cc:276] 0709 13:05:06.200171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.495675 (+295504us) service_pool.cc:224] Handling call
0709 13:05:07.475687 (+980012us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400139cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:07.475879 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630659456}
I20260709 13:05:07.430802 21681 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.481339 21677 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:07.482743 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:07.483033 15244 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:07.483561 21787 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:07.487020 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 171001us
I20260709 13:05:07.484421 21771 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:05:07.498133 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.475147 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:07.438561 21562 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.502854 21782 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:07.503140 15248 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
W20260709 13:05:07.505020 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 130448us
I20260709 13:05:07.486137 21665 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.507233 16033 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:07.507673 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:07.507952 21720 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:07.508731 21811 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:07.509320 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:07.509675 21811 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:07.510345 21811 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:07.513185 21811 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.514465 21478 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:07.516644 16024 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:07.489406 21787 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.489198 21687 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:07.442471 21660 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.498539 21819 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:07.535025 21819 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.540160 21665 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.541981 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:07.544368 21718 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.518416 21478 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:07.524657 21787 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:07.550585 21816 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:07.524923 21687 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.561985 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2947) took 1214 ms. Trace:
I20260709 13:05:07.562505 15249 rpcz_store.cc:276] 0709 13:05:06.347507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.410613 (+1063106us) service_pool.cc:224] Handling call
0709 13:05:07.426787 (+ 16174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.427178 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:07.440235 (+ 13057us) log.cc:844] Serialized 14 byte log entry
0709 13:05:07.561618 (+121383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:07.561672 (+    54us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:07.561725 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.561790 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.561923 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81741,"prepare.queue_time_us":52193,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":61,"thread_start_us":107396,"threads_started":1}
I20260709 13:05:07.489152 21751 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.566335 21192 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:07.573925 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:07.538089 21819 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:07.579061 15242 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:05:07.556061 21771 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:07.557384 21687 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:07.555074 21681 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:07.580668 15242 pending_rounds.cc:85] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 9
I20260709 13:05:07.595569 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:07.589694 15242 pending_rounds.cc:107] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:05:07.607096 15242 raft_consensus.cc:2889] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:07.609221 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 100100us
I20260709 13:05:07.614516 16027 raft_consensus.cc:2368] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:07.615677 15318 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:07.622593 21840 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:07.623147 21840 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:07.623829 21817 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:07.624579 21817 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:07.624356 21840 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.631199 21660 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:07.631808 21858 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:05:07.634706 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 828) took 1379 ms. Trace:
I20260709 13:05:07.635290 15244 rpcz_store.cc:276] 0709 13:05:06.255640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.357870 (+1102230us) service_pool.cc:224] Handling call
0709 13:05:07.478025 (+120155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.488569 (+ 10544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.634364 (+145795us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400139cd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:07.634616 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275009920}
W20260709 13:05:07.638373 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 164938us
I20260709 13:05:07.640269 15290 leader_election.cc:400] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19.
I20260709 13:05:07.640674 15290 leader_election.cc:403] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:05:07.642088 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 85843.6us
I20260709 13:05:07.642397 21683 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:07.642961 21683 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:07.643412 21683 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:07.644030 21478 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.646787 21771 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:05:07.647363 21855 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:05:07.648690 21771 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19.
I20260709 13:05:07.649819 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 827) took 1437 ms. Trace:
W20260709 13:05:07.651311 21830 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.703s	user 0.015s	sys 0.000s
I20260709 13:05:07.650254 15250 rpcz_store.cc:276] 0709 13:05:06.212124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.999682 (+787558us) service_pool.cc:224] Handling call
0709 13:05:07.000066 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:07.001509 (+  1443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:07.001551 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:07.002093 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 13:05:07.382604 (+380511us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:07.443234 (+ 60630us) log.cc:844] Serialized 14 byte log entry
0709 13:05:07.452228 (+  8994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.452342 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.649457 (+197115us) raft_consensus.cc:1685] finished
0709 13:05:07.649479 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.649646 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50396,"prepare.queue_time_us":52280,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":3681,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":180,"thread_start_us":114393,"threads_started":1,"wal-append.queue_time_us":400634}
I20260709 13:05:07.651844 21830 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.653375 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:07.654815 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:07.655471 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:07.656175 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:07.657606 21710 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:07.658216 21710 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:07.658847 15291 leader_election.cc:400] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19.
I20260709 13:05:07.659264 21710 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.661509 15392 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:07.662503 21721 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:07.662766 15399 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:07.664830 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:07.670688 21609 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:07.671271 21609 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:07.672418 21609 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:07.674338 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.674906 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:07.675756 15323 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:07.677142 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:07.675661 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:07.643229 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:07.596626 21681 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:07.600414 21804 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.697863 15395 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:07.598517 21192 consensus_queue.cc:1243] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:07.719117 15398 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:07.723206 21677 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:07.723742 21677 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:07.724764 21677 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:07.726377 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.726459 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:07.728695 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:07.729516 15390 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:07.729598 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:07.685662 21816 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:05:07.731014 21681 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.731988 21540 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:07.732605 21681 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:07.734015 15324 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:07.734798 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:07.735066 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:07.683964 21704 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.679334 21830 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.691442 21562 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.743438 15394 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:07.706513 21840 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:07.726172 21677 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:07.625787 21817 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.763648 15323 raft_consensus.cc:2410] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:05:07.773412 15245 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:07.692591 21766 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.757004 21815 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:07.789139 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 124469us
I20260709 13:05:07.791844 21815 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.793246 16027 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:07.788125 15318 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:07.796684 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:07.813580 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.813553 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:07.818081 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2938) took 1481 ms. Trace:
I20260709 13:05:07.819064 21751 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:07.784749 21562 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.828213 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:07.818687 15243 rpcz_store.cc:276] 0709 13:05:06.203040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.997377 (+794337us) service_pool.cc:224] Handling call
0709 13:05:06.997620 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.998380 (+   760us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:07.334481 (+336101us) log.cc:844] Serialized 14 byte log entry
0709 13:05:07.569756 (+235275us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:07.575578 (+  5822us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:07.584037 (+  8459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.603518 (+ 19481us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.684435 (+ 80917us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37786,"prepare.queue_time_us":301662,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":104,"raft.queue_time_us":36504,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":180,"thread_start_us":204499,"threads_started":2,"wal-append.queue_time_us":233059}
I20260709 13:05:07.833740 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:07.834537 15242 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
W20260709 13:05:07.837272 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 124634us
I20260709 13:05:07.839494 21811 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:05:07.845399 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 202327us
I20260709 13:05:07.858078 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:07.861712 15324 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:07.863245 21540 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.864113 21540 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.864451 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:07.867731 21719 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:07.868527 21719 consensus_queue.cc:1243] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:05:07.869010 21719 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:07.869354 21719 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.869709 21719 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:07.870857 21540 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.875676 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:07.876549 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:07.877292 15321 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:07.877894 15317 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:07.878213 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:07.878870 15321 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:05:07.879230 15317 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:05:07.879980 15321 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:07.881357 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:07.869709 21579 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:07.886947 21579 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:07.888398 21579 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:07.890442 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:07.890785 21803 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:07.891263 15323 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:07.892056 21803 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:07.893754 15398 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:07.893965 21614 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:07.896011 21819 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:07.891443 21719 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.896528 21819 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:07.890467 21721 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:07.898110 21721 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.851902 21818 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.901883 21535 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.903267 15324 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:07.902833 21818 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.906005 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:07.903982 21579 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:07.916543 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:07.927170 15318 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:07.910583 21766 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:07.931327 21683 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:07.936697 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.937721 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:07.938297 21683 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:07.938648 21782 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:07.939195 21782 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:07.939759 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:07.940124 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:07.940330 21782 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.940963 15391 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:05:07.941972 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:07.942698 15395 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:07.939270 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:07.947883 15319 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:07.806964 15140 catalog_manager.cc:5697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.956799 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:07.959088 21686 raft_consensus.cc:2764] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:05:07.959473 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:07.959722 21665 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:07.960255 15321 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:07.952549 15323 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:07.952852 15397 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:07.953908 15391 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:07.962733 15391 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:07.963814 15391 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:07.964188 21811 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.970130 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:07.961360 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:07.967290 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:07.974329 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:07.982728 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:07.994856 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:07.985536 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:07.998986 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.004092 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:07.980019 21683 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:08.038408 15391 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:07.954698 21829 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.042356 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:07.975668 21562 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.001490 21804 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:05:08.042014 21683 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.988106 21811 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.002909 21766 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:08.054380 21512 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:08.054967 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:08.093942 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:08.068871 15391 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:05:08.065341 16024 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:08.085156 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:08.069451 15321 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:08.097756 15324 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:08.081385 15319 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:08.093943 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 119772us
I20260709 13:05:08.057694 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:08.099170 15242 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:07.993749 21787 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.077055 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:08.107995 15395 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:08.108428 16033 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:08.062954 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:08.048156 15397 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:08.095366 15391 pending_rounds.cc:85] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 10
I20260709 13:05:08.109158 15391 pending_rounds.cc:107] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:05:08.109455 15391 raft_consensus.cc:2889] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:08.062362 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.079701 15318 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:05:08.079499 21525 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.005s
W20260709 13:05:08.117139 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.116420 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:08.065600 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:08.112146 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:08.062875 21683 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:08.122828 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 482841us
I20260709 13:05:08.066041 21829 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.094348 21766 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:08.102460 21804 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.099567 21751 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.054334 21818 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.111559 21614 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.078799 21721 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:08.055783 21535 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.047960 21719 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.137974 15394 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:08.119151 21660 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:08.149111 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:08.150025 15243 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:05:08.151397 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:08.151726 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:08.152283 15242 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:08.127588 21771 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.116071 21687 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.161654 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:08.143630 21665 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:08.157794 15396 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:05:08.166199 15321 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:05:08.169561 16029 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 13:05:08.170377 21866 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:05:08.170958 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:08.172386 21871 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.063627 21819 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.175906 21819 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:08.177281 21687 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.177714 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:08.167862 21579 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:08.182999 21562 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:08.171011 21864 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:05:08.183763 21562 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:08.163102 21771 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.157823 21614 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.124864 21525 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:08.147500 21751 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:08.189716 15244 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:08.190860 21766 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:08.138536 21803 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:05:08.221698 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:08.224671 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 63118.9us
I20260709 13:05:08.179327 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:08.224615 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 159159us
I20260709 13:05:08.252591 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:08.158582 21804 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.240808 21660 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:08.271137 21681 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.008s
I20260709 13:05:08.192458 21872 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:05:08.173094 21871 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.292933 15316 raft_consensus.cc:2410] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
W20260709 13:05:08.304482 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.309979 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:08.311077 15321 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:08.282788 21525 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:08.327914 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.335794 21871 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:08.336879 21876 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:05:08.312085 21787 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.344010 21818 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:08.344725 21818 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:08.346335 21614 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:08.337690 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:08.373986 15247 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:08.380935 15215 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:08.383343 15394 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:08.383726 15318 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:08.384431 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.385260 15398 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 17: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:08.387295 15242 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:08.388258 15324 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:08.389067 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.390992 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.391649 15397 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:08.391547 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:08.398965 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:08.401413 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:08.396757 15391 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:08.389999 21525 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:08.399721 21512 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:05:08.426471 21525 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.426900 21525 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:08.345831 21818 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.418939 16032 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:08.419035 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.435947 15398 raft_consensus.cc:2410] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:05:08.418738 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:08.437139 15324 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:08.419646 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:08.420029 21804 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.407192 21579 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:08.420684 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.418735 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:08.457342 15394 raft_consensus.cc:2368] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:05:08.402001 21719 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:05:08.454890 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 194806us
I20260709 13:05:08.437762 15320 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:05:08.467602 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:08.405229 21562 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.469751 15289 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:08.458211 21579 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.475786 21579 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:08.480919 21751 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:08.507277 21879 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:05:08.508085 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:08.506834 15135 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9e997bc5c2942178cde4c670df97100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 89940175e5444593aab6b3a025624b5b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:08.509953 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.511996 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.521333 16032 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:05:08.523485 21817 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:08.525434 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.526106 21881 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:08.528159 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.528916 15394 raft_consensus.cc:2368] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
W20260709 13:05:08.474407 15213 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.745s (SENT) [suppressed 32 similar messages]
I20260709 13:05:08.526165 15396 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:08.538326 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:08.540470 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.513832 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.542199 15392 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:08.545435 15397 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:08.474838 21719 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:08.548759 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 59872.1us
I20260709 13:05:08.490579 21771 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:08.548633 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 293878us
I20260709 13:05:08.552278 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.556027 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.556727 15391 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:08.537458 21872 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:08.560164 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:08.559340 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 250148us
W20260709 13:05:08.566598 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 107633us
I20260709 13:05:08.566777 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.569660 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.570071 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:08.571108 15394 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:08.574290 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:08.575546 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.581686 15998 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:08.582932 21766 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:08.583441 21766 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.583813 21766 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:08.588295 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:08.589149 15242 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:08.598697 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.601966 15394 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:08.603837 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:08.581596 21525 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.609072 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.599382 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:08.611333 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:08.612504 21872 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.618783 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.620062 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:08.621198 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:08.608421 21771 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:08.624545 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:08.626992 15394 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 16: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:08.608234 21871 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:08.635816 15249 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:08.620105 21872 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:08.635994 21901 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:08.641706 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:08.642683 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48334.1us
I20260709 13:05:08.648967 15243 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:08.637969 21872 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:08.653157 15249 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:08.652649 15325 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:08.623422 21192 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:08.659519 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.663404 15394 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:08.634936 21771 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:08.664700 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:08.673820 15322 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:08.664721 15399 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:08.615957 21681 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:05:08.667994 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:08.666321 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:08.686579 15317 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:08.686946 15248 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:08.680426 15325 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:08.674368 21771 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:08.675320 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.657249 21804 raft_consensus.cc:2764] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:05:08.658062 21829 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.689738 15319 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 13:05:08.616953 21719 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:08.724393 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 252500us
I20260709 13:05:08.725919 15394 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:05:08.723563 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:08.724666 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 116918us
I20260709 13:05:08.729020 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:08.731127 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:08.722673 21579 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.732874 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:08.734324 15249 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:08.734673 21579 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.735349 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:08.735611 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:08.731765 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:08.735951 15243 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:08.740716 15317 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:08.740957 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:08.743183 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68282.9us
I20260709 13:05:08.744583 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:08.745787 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:08.722754 21525 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.749228 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:08.752997 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.753870 15398 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:08.736547 21891 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:08.748054 21665 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:08.758630 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:08.759406 15324 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:08.757386 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:08.748847 21871 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:08.750365 21898 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:08.747409 21829 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.776165 15399 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:08.779692 15996 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:08.764263 21579 raft_consensus.cc:2764] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:05:08.783505 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:08.785892 21901 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:08.789108 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:08.791420 15393 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:08.788089 21901 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:08.792779 21901 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:08.798337 15318 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:08.774780 21871 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:08.799947 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:08.762118 21891 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:08.784677 21898 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:08.815793 21898 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:08.801808 21872 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.818802 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43794 (request call id 839) took 1089 ms. Trace:
I20260709 13:05:08.819455 15324 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:08.808841 15392 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 13:05:08.790874 21893 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:05:08.819348 15244 rpcz_store.cc:276] 0709 13:05:07.729074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.734432 (+  5358us) service_pool.cc:224] Handling call
0709 13:05:08.818574 (+1084142us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540025c6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:08.818722 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1043840768}
I20260709 13:05:08.813486 21829 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:08.825649 15241 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 13:05:08.826958 15143 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49186 (request call id 217) took 48200 ms (client timeout 15000 ms). Trace:
W20260709 13:05:08.832651 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 87980.1us
I20260709 13:05:08.802291 21895 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:08.800204 21811 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:08.837167 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:08.837919 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58309us
I20260709 13:05:08.848872 15214 leader_election.cc:400] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:08.849282 15214 leader_election.cc:403] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:08.871954 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:08.873210 15324 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:08.990638 21871 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:08.839108 21892 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.241s
I20260709 13:05:08.830693 21872 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:09.006034 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 152983us
W20260709 13:05:09.009908 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 165973us
W20260709 13:05:09.015115 21908 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:05:09.021406 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:05:09.015372 21909 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:05:08.844185 21829 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.844885 21895 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:08.994398 15140 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 12 to 15, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 15 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.042959 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:09.045943 21660 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:09.056291 15140 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 11 to 14, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 14 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:09.058037 15324 raft_consensus.cc:2376] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19. Re-sending same reply.
I20260709 13:05:09.059723 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:09.060673 21192 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:09.061146 21192 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:09.061460 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:09.038220 21910 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:05:09.062718 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:09.062217 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 922) took 1273 ms. Trace:
I20260709 13:05:09.067905 15316 rpcz_store.cc:276] 0709 13:05:07.788514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.796196 (+  7682us) service_pool.cc:224] Handling call
0709 13:05:09.061980 (+1265784us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b5400078354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:09.062133 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133129600}
I20260709 13:05:09.073284 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:09.074201 15320 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:05:09.067257 15319 raft_consensus.cc:2376] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19. Re-sending same reply.
I20260709 13:05:09.091684 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:09.094142 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:09.114406 15323 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:09.114470 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:09.116041 15321 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:09.119027 15397 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:05:09.127703 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 284577us
I20260709 13:05:09.127956 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:09.130380 15317 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:09.038477 21829 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:09.137421 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:09.144163 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 358272us
I20260709 13:05:09.146504 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:09.095127 21818 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.150267 15392 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:09.156154 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 146842us
I20260709 13:05:09.116372 21900 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.122435 21478 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.138370 21686 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:09.167833 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.159046 21914 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:09.172758 21871 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.062153 21192 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.164095 21687 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.195662 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:09.153347 21525 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:05:09.203466 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 50352.8us
I20260709 13:05:09.192011 21911 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.202728 21721 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:05:09.210758 21687 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.212857 21665 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:09.213193 21687 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:09.214423 21880 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.679s	user 0.000s	sys 0.003s
I20260709 13:05:09.218951 21923 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:09.218986 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:08.827473 15143 rpcz_store.cc:269] 0709 13:04:20.618174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.618443 (+   269us) service_pool.cc:224] Handling call
0709 13:05:08.818187 (+48199744us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:01.199311 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:01.332393 (+133082us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:01.332467 (+    74us) write_op.cc:435] Acquired schema lock
0709 13:05:01.332497 (+    30us) tablet.cc:662] Decoding operations
0709 13:05:01.369827 (+ 37330us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:01.396676 (+ 26849us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:01.396706 (+    30us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:05:01.397962 (+  1256us) tablet.cc:701] Row locks acquired
0709 13:05:01.398007 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:05:01.398180 (+   173us) write_op.cc:270] Start()
0709 13:05:01.398367 (+   187us) write_op.cc:276] Timestamp: P: 1783602301398111 usec, L: 0
0709 13:05:01.398404 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:05:01.399176 (+   772us) log.cc:844] Serialized 5619 byte log entry
0709 13:05:02.401987 (+1002811us) op_driver.cc:464] REPLICATION: finished
0709 13:05:02.554068 (+152081us) write_op.cc:301] APPLY: starting
0709 13:05:02.561359 (+  7291us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:02.934538 (+373179us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:02.934672 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:03.837029 (+902357us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:03.837407 (+   378us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:05:03.837466 (+    59us) write_op.cc:312] APPLY: finished
0709 13:05:03.837859 (+   393us) log.cc:844] Serialized 129 byte log entry
0709 13:05:04.001332 (+163473us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:04.001495 (+   163us) write_op.cc:454] Released schema lock
0709 13:05:04.001571 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:04.044102 (+ 42531us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:04.046069 (+  1967us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":22207,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":83160,"apply.run_cpu_time_us":59017,"apply.run_wall_time_us":1474699,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62619,"num_ops":14,"prepare.queue_time_us":199466,"prepare.run_cpu_time_us":30712,"prepare.run_wall_time_us":484423,"raft.queue_time_us":131483,"raft.run_cpu_time_us":37666,"raft.run_wall_time_us":195740,"replication_time_us":905868,"thread_start_us":657989,"threads_started":5,"wal-append.queue_time_us":650603,"wal-append.run_cpu_time_us":17381,"wal-append.run_wall_time_us":2452651}]]}
I20260709 13:05:09.219879 21923 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.164479 21818 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:09.230484 15247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2965) took 1168 ms (client timeout 1516 ms). Trace:
I20260709 13:05:09.176844 21478 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:09.232618 15247 rpcz_store.cc:269] 0709 13:05:08.062533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.062687 (+   154us) service_pool.cc:224] Handling call
0709 13:05:09.230283 (+1167596us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400119ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:09.230411 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386368768}
I20260709 13:05:09.222281 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:09.236027 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 843) took 1089 ms. Trace:
I20260709 13:05:09.183347 21900 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.243243 16033 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:09.238642 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:09.240068 15250 rpcz_store.cc:276] 0709 13:05:08.142410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.142685 (+   275us) service_pool.cc:224] Handling call
0709 13:05:08.152211 (+  9526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.164453 (+ 12242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.164487 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.671549 (+507062us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b2c000014c8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:05:08.672042 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:05:08.750748 (+ 78706us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:08.761348 (+ 10600us) log.cc:844] Serialized 14 byte log entry
0709 13:05:09.059164 (+297816us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b180035bb40. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:05:09.059361 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.059434 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.231134 (+171700us) raft_consensus.cc:1685] finished
0709 13:05:09.231155 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.231297 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2382,"prepare.queue_time_us":12277,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":1452,"raft.queue_time_us":305061,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":18925,"spinlock_wait_cycles":18052736,"thread_start_us":78351,"threads_started":1,"wal-append.queue_time_us":128494}
I20260709 13:05:09.232244 21925 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:05:09.202262 21901 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:09.252430 21896 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.614s	user 0.007s	sys 0.003s
I20260709 13:05:09.254098 21901 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:09.255875 21478 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:09.257078 21766 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.001s
I20260709 13:05:09.257010 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:09.257630 21766 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.259452 21924 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:09.259797 21818 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:09.259918 21924 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.162532 21895 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:09.260298 21683 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.115s	user 0.010s	sys 0.014s
I20260709 13:05:09.260475 21924 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:09.260757 21683 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.263742 21925 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:09.236672 21911 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.264238 15245 raft_consensus.cc:2368] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16.
I20260709 13:05:09.264377 21925 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:09.264814 16029 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:05:09.206832 21871 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.271962 21766 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:09.265934 21911 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:09.243757 21912 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
W20260709 13:05:09.280364 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44384.8us
I20260709 13:05:09.284603 15246 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:09.287978 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:09.265614 21925 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.263799 21900 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:09.279871 21872 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:09.301735 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.302783 15244 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
W20260709 13:05:09.309859 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 77231.2us
I20260709 13:05:09.310474 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.303018 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.295400 21926 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:09.294865 21818 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:09.319286 15249 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:09.322043 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.327320 15243 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:09.323747 21931 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:09.331879 15290 leader_election.cc:400] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:05:09.332216 15290 leader_election.cc:403] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:09.302305 15140 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 15 to 17, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 17 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:09.333302 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.329730 15244 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:09.336449 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.317014 21926 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:09.341337 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:09.358716 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:09.334689 15140 catalog_manager.cc:5697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 9 to 18, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 18 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.323035 21818 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.318912 21829 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:09.343667 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:09.363258 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46623.6us
I20260709 13:05:09.363444 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:09.305210 21478 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:05:09.367662 15324 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:09.366341 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.317169 21914 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:09.343410 21687 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:05:09.414186 15290 leader_election.cc:400] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:09.422744 15290 leader_election.cc:403] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260709 13:05:09.412760 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 69508.1us
I20260709 13:05:09.419634 15243 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
W20260709 13:05:09.369176 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 116871us
I20260709 13:05:09.420310 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.416831 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.343941 21872 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20.
I20260709 13:05:09.344694 21683 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:09.413094 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:09.350867 21931 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:09.430596 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 71153.5us
I20260709 13:05:09.410656 21798 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:09.452154 21798 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.452749 21798 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:09.366671 21818 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:09.366328 21924 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.454589 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:09.455142 15319 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:09.455327 16033 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:09.369756 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:09.432196 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:09.456403 21924 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:09.456588 21927 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:05:09.456897 16027 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:09.433300 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.457868 15243 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
W20260709 13:05:09.433825 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 64154us
I20260709 13:05:09.458801 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.434340 21932 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:09.434938 21608 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:09.460098 21608 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:09.460107 21932 consensus_queue.cc:1243] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:09.460943 21932 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:09.436704 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:09.461285 21932 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:05:09.426968 21922 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:05:09.462287 21932 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.463701 21932 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.464985 21687 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:09.438344 21719 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:09.466709 21719 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:09.461305 21608 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.467164 21719 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:09.439132 21804 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:09.468008 21608 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:09.468420 21192 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.468747 21804 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:09.469192 21804 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:09.470057 21804 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.471500 21804 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.471937 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:09.440246 15242 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:09.441103 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:09.473942 15320 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:09.474221 21686 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:09.474314 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.474722 21686 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:09.367323 21525 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:09.475811 21525 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:09.475543 21686 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.476226 21525 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:09.477095 21771 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.000s
I20260709 13:05:09.442345 21925 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:09.443804 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.443714 21872 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:09.445047 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:09.437928 15393 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
I20260709 13:05:09.437878 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.482941 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:09.450732 21914 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.417582 21923 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:09.459620 21924 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:09.472707 15140 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:09.479904 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:09.480669 15289 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:09.477617 21771 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.475584 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.481694 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.414919 21921 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:09.367506 21929 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:09.518054 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:09.511330 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66406.1us
I20260709 13:05:09.431186 21926 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.520100 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.484297 16024 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:09.511941 15393 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:09.513792 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:09.515424 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 145749us
I20260709 13:05:09.521601 15243 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:09.449774 15324 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:09.523607 21921 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.526430 21579 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:09.518509 21687 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:09.515321 21677 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:09.529225 21677 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.529557 21921 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:09.529177 15242 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:09.530687 21686 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.529788 21677 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:09.535084 21926 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.524263 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:09.537704 21721 raft_consensus.cc:2764] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:05:09.538089 21891 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:09.538486 21721 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:09.539049 21721 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:09.540311 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 102525us
I20260709 13:05:09.540812 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:09.542774 15250 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.516760 21478 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:05:09.548833 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 68306.7us
W20260709 13:05:09.548861 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 67261.4us
I20260709 13:05:09.547887 15243 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:05:09.549605 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.550254 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:09.553277 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:09.555409 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.555739 15140 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 16 to 17, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 17 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:09.563217 15243 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 13:05:09.564448 21771 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:09.554102 21924 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:09.565253 21924 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.565649 21924 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:09.567409 21906 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.736s	user 0.002s	sys 0.002s
W20260709 13:05:09.573747 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47128.7us
I20260709 13:05:09.551936 21829 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:09.515347 21719 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.596654 21719 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:09.549119 21687 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:05:09.602615 21579 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:09.603645 21579 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:09.603899 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.604029 21579 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:09.605381 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:09.606241 21687 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:09.606909 21687 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:09.605122 21579 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.608598 21579 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:09.617127 15244 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:09.619266 15242 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:09.622000 21931 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:09.622543 21931 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:09.623494 21931 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:09.624428 15245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 2961) took 1637 ms (client timeout 2094 ms). Trace:
W20260709 13:05:09.624894 15245 rpcz_store.cc:269] 0709 13:05:07.987304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.987439 (+   135us) service_pool.cc:224] Handling call
0709 13:05:09.624206 (+1636767us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54004498d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:09.624357 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2917080448}
I20260709 13:05:09.626435 15245 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:09.563810 15140 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.648484 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2966) took 1585 ms. Trace:
W20260709 13:05:09.651777 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.649137 15241 rpcz_store.cc:276] 0709 13:05:08.062895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.063029 (+   134us) service_pool.cc:224] Handling call
0709 13:05:08.825412 (+762383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.826154 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.640399 (+814245us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b540025c6d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:09.648387 (+  7988us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1739237120}
I20260709 13:05:09.655604 15241 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:09.658016 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:09.661921 15244 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:09.661295 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3432) took 1717 ms. Trace:
I20260709 13:05:09.682353 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.693398 16033 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:09.694196 15244 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:05:09.697680 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.698755 16024 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:09.697917 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.699034 15241 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:05:09.667824 21608 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:09.703262 15393 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:05:09.703926 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45999.8us
I20260709 13:05:09.681622 21931 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:09.706259 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:09.707103 15244 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:09.708356 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:09.708413 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:09.713438 15395 raft_consensus.cc:2410] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 13:05:09.715396 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 57432.9us
I20260709 13:05:09.710737 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:09.722595 15244 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:09.719682 16024 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
W20260709 13:05:09.727608 21919 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.447s	user 0.002s	sys 0.000s
W20260709 13:05:09.734855 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.735437 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.736166 15241 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:09.717830 21677 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.740540 15244 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:09.708427 21608 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.742414 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.743285 15241 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 17: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:09.742084 21677 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:09.743181 21608 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:09.760349 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2174) took 1089 ms. Trace:
I20260709 13:05:09.760864 15318 rpcz_store.cc:276] 0709 13:05:08.671179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.676360 (+  5181us) service_pool.cc:224] Handling call
0709 13:05:08.718741 (+ 42381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:08.798873 (+ 80132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.760020 (+961147us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b540021a7d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:09.760251 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182444416}
I20260709 13:05:09.762501 21946 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:09.763159 21946 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.766312 21947 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:09.766971 21947 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.769265 21947 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:09.770396 21608 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.731846 21686 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:09.770944 21608 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.664275 15390 rpcz_store.cc:276] 0709 13:05:07.938736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.941665 (+  2929us) service_pool.cc:224] Handling call
0709 13:05:07.942043 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.942435 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:08.152091 (+209656us) log.cc:844] Serialized 14 byte log entry
0709 13:05:09.230111 (+1078020us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:09.651452 (+421341us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b18000c0220. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f366d5f23c7 00007f3669c049a7 00007f3669c140bf 00007f3669c14038
0709 13:05:09.653283 (+  1831us) log.cc:844] Serialized 14 byte log entry
0709 13:05:09.654218 (+   935us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:09.654295 (+    77us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:09.654342 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.654411 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.655663 (+  1252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14827,"prepare.queue_time_us":1297357,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":6742,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":10456,"spinlock_wait_cycles":15869696,"thread_start_us":576250,"threads_started":2,"wal-append.queue_time_us":478945}
I20260709 13:05:09.733631 15140 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.796572 15140 catalog_manager.cc:5697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 12 to 15, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 15 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.797372 21871 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:09.799085 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:09.800261 16031 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 17: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:09.779676 21721 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:09.778121 21686 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.804795 21686 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:09.807741 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 2970) took 1205 ms. Trace:
I20260709 13:05:09.808315 15246 rpcz_store.cc:276] 0709 13:05:08.601974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.605468 (+  3494us) service_pool.cc:224] Handling call
0709 13:05:08.613730 (+  8262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:09.285262 (+671532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.807361 (+522099us) spinlock_profiling.cc:243] Waited 671 ms on lock 0x7b540023aad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:09.807651 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1542307584}
I20260709 13:05:09.811828 21923 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:09.813210 21923 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:09.813685 21923 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:09.779973 21798 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.816139 21935 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:09.816776 21935 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:09.817993 21798 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:09.819636 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.825572 15324 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:05:09.825809 15250 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:09.826166 15324 pending_rounds.cc:85] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 10
I20260709 13:05:09.826588 15324 pending_rounds.cc:107] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:05:09.826912 15324 raft_consensus.cc:2889] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:09.827515 21787 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:09.828310 21936 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:09.828413 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:09.828812 21936 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.828078 21787 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.829236 21936 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:09.829622 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:09.830374 15323 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.830907 15318 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:05:09.831136 21787 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:09.833019 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:09.834252 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:09.835008 15317 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:09.836575 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 281246us
I20260709 13:05:09.838500 21929 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:09.839421 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:09.841280 15245 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:05:09.844044 21608 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:09.846827 15362 leader_election.cc:336] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.658s (SENT)
I20260709 13:05:09.846874 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.849737 21925 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:09.854617 15319 raft_consensus.cc:2410] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:09.860282 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:09.861397 16031 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:09.774864 21946 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:09.865702 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:09.866755 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.873952 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:09.874140 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:09.874686 15393 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.875094 15324 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:05:09.875286 21787 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:09.875627 15324 pending_rounds.cc:85] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 10
I20260709 13:05:09.875986 15324 pending_rounds.cc:107] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:05:09.876269 15324 raft_consensus.cc:2889] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:09.879433 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.814093 21923 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:09.882012 15393 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:09.785852 21818 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.911092 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:09.912176 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.930728 15390 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:09.870460 21932 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:09.931346 15390 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:09.879065 21946 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:09.932881 15242 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:09.923329 21947 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:09.935477 15390 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.858996 21924 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.944118 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.896323 15323 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:09.943850 15390 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:09.927284 21925 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:09.949082 21871 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:09.947870 21579 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:09.953560 15317 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:09.951947 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:09.962584 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:09.963433 15397 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:09.964776 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:09.965384 15396 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:09.966635 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.967866 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.967279 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:09.818048 21935 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:09.969300 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:09.971006 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 247141us
I20260709 13:05:09.975689 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:09.976693 15245 raft_consensus.cc:2368] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20.
I20260709 13:05:09.977769 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:09.978590 15399 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.979713 15998 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:09.982359 21925 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:09.982736 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:09.983029 15363 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:09.982402 21192 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:09.983486 15246 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:09.983811 21192 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:09.984792 21192 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.985718 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:09.988921 15242 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:09.992614 21677 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.993245 21677 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.994211 21891 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:09.994978 21891 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:09.995621 21677 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:09.996132 21891 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.000412 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.003237 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:09.997268 21677 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.005348 21677 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.006898 15323 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:05:10.007426 21935 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.968171 21932 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:05:10.011322 15396 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:10.013058 21677 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:09.943372 21946 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.023294 21946 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:09.951202 21947 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.024168 21946 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:10.025686 21946 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:10.026093 21947 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:10.026724 21947 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:10.027064 21947 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.027392 21947 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:10.029060 21924 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:10.030448 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:10.031235 21771 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:10.031684 21771 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:10.031915 21818 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:09.968348 21952 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:10.034843 21721 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:10.035286 21721 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:10.036159 21525 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.001s
I20260709 13:05:10.036089 21721 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.036603 21525 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:09.966876 21579 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.024107 21914 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:10.040242 21914 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.041318 21579 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:10.033288 21952 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.044013 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:10.044617 16029 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:10.045053 21952 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:10.045467 21915 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:10.046152 21915 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.047269 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:10.049423 21721 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:09.972944 15140 catalog_manager.cc:5697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 13 to 16, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:10.050005 21915 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:10.051772 15140 catalog_manager.cc:5697] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 5 to 15. New cstate: current_term: 15 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.052399 21771 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.053406 21771 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:10.056301 21923 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.058739 21525 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:10.060456 15321 raft_consensus.cc:2410] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:05:10.064181 15390 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:05:10.071235 21914 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:10.071790 15396 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:10.072063 15391 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:10.152326 16029 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:10.076777 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:10.077903 15397 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:10.071964 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:10.089067 15399 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:10.092473 21686 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.095191 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.156189 15321 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:10.096396 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.157763 15323 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:10.098122 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.158260 15319 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:10.098784 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.098912 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.099318 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.099757 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:10.099874 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.160619 15324 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:10.053857 15140 catalog_manager.cc:5697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.159651 15316 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:10.109898 21923 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:10.110105 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:10.123653 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 395868us
I20260709 13:05:10.130038 21936 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.105957 16031 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
W20260709 13:05:10.148941 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:10.149309 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 212423us
W20260709 13:05:10.150596 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 599508us
I20260709 13:05:10.075917 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:10.154109 15393 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:10.155278 15214 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:10.165429 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:10.134136 21925 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:10.178644 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 195728us
I20260709 13:05:10.184587 15320 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:10.192180 15323 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:10.192410 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:10.193234 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:10.193372 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.193838 15246 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:10.194533 21525 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:10.194872 21936 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:10.195564 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:10.196151 15320 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:10.198727 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:10.199133 15213 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:10.141880 15390 pending_rounds.cc:85] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 14
I20260709 13:05:10.201474 21936 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:10.202322 15319 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:10.202184 15390 pending_rounds.cc:107] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:05:10.196095 21686 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:10.202560 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:10.202904 15390 raft_consensus.cc:2889] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:10.203419 15245 raft_consensus.cc:2368] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17.
I20260709 13:05:10.203811 15319 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:10.204265 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:10.204849 15248 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:05:10.205554 21579 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:10.206256 15291 leader_election.cc:400] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16.
I20260709 13:05:10.206995 15291 leader_election.cc:403] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:05:10.201534 15317 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:10.207962 21936 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16.
I20260709 13:05:10.194054 15323 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:10.189442 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:10.212468 15247 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:10.186666 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:10.246475 15248 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
W20260709 13:05:10.248258 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 61673.1us
I20260709 13:05:10.228889 21936 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:05:10.251965 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:10.252259 21936 consensus_queue.cc:1243] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:05:10.252789 21936 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:10.253182 21936 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:10.253931 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:10.229550 21915 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:05:10.254602 15243 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:10.255172 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:10.256031 21915 raft_consensus.cc:2764] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:05:10.177697 21872 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.257516 21872 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.257648 21721 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:05:10.134662 21892 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.042s	sys 0.011s
W20260709 13:05:10.259886 21892 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.043s	sys 0.011s
I20260709 13:05:10.185238 21931 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:10.254491 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:10.262686 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:10.266067 15247 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:10.267953 15243 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:10.271926 21798 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:10.274562 21525 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:05:10.274776 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 85468.2us
I20260709 13:05:10.275300 21525 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:10.275991 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:10.276407 21525 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:10.277783 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 78868.9us
I20260709 13:05:10.280774 15213 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:10.282689 21961 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:05:10.284163 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:10.267580 21936 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.285766 21936 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:10.288764 21721 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:10.282572 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:10.290274 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:10.291791 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:10.230124 21949 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:10.293219 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:10.297516 15393 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:10.295212 21579 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:10.300642 21953 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:10.300850 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.301189 21953 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:10.301662 21953 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:10.229988 21959 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.300953 21683 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:10.302479 21959 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.305441 21959 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:10.306115 21721 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:10.295177 21950 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:10.307149 21950 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:10.307549 21950 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:10.308797 21719 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:10.310348 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 327375us
I20260709 13:05:10.311373 15320 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:10.311896 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:10.229832 21818 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:05:10.293511 21931 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:10.329556 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.330026 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:10.327420 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:10.327844 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47146.9us
I20260709 13:05:10.332587 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:10.334625 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:10.293382 15246 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:10.310797 21579 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:10.313352 21683 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:10.370697 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:10.370841 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:10.328007 21965 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:10.347606 21478 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:10.346727 21946 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:10.329597 21949 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:10.385556 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.348589 21798 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:10.387924 21798 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.315395 21947 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.375211 21939 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:10.327453 21719 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.394372 15363 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:10.397226 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.398907 15291 leader_election.cc:400] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17.
I20260709 13:05:10.399365 15291 leader_election.cc:403] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:05:10.385524 21478 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:10.414556 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 165622us
I20260709 13:05:10.411756 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:10.420936 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:10.430940 21916 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:10.431443 21916 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:05:10.432236 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.432554 21916 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.434684 21914 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:10.435268 21914 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:10.436192 21914 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.438117 15363 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:10.443162 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:10.444597 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:10.405094 21939 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:10.403551 21787 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17.
W20260709 13:05:10.477924 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:10.539994 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 210045us
I20260709 13:05:10.410472 21946 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:10.501664 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 51696.1us
I20260709 13:05:10.409597 21478 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:10.538097 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 79026.3us
I20260709 13:05:10.558444 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:10.445654 21192 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:10.439636 21687 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.563709 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:10.434180 21916 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:10.563522 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:10.543776 21929 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:10.454881 21608 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:10.413719 21923 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.142s
I20260709 13:05:10.411197 21972 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.157s
I20260709 13:05:10.446787 21889 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:10.455348 21960 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:10.646663 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.575251 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:10.408161 21931 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.452339 21751 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.118s
W20260709 13:05:10.626124 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:10.626938 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 63499.7us
W20260709 13:05:10.642704 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 79078.3us
I20260709 13:05:10.545070 21956 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:05:10.569685 21771 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:10.452791 21579 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.703671 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:10.542868 21683 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.624116 21965 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:10.627399 21952 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:10.748898 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45314.8us
I20260709 13:05:10.627995 21798 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:10.712419 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:10.734908 21946 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.623519 21687 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.776687 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:10.754114 21970 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.308s	user 0.000s	sys 0.000s
I20260709 13:05:10.758349 15242 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:10.710306 21192 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:10.773713 15393 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:05:10.775753 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:10.767568 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 435777us
I20260709 13:05:10.703564 21978 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:10.778002 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:10.803474 15395 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:10.644572 21973 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.121s
I20260709 13:05:10.645231 21677 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:10.803902 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:10.849694 21192 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.713243 15249 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:10.836370 15242 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:10.837973 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:10.765564 21959 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:10.839474 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:10.864310 15250 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:10.763681 21771 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:10.568048 21949 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.877164 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:10.894862 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:10.897068 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:10.793802 21721 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:10.903630 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.908259 15399 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:05:10.923885 15320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.011s	sys 0.006s
I20260709 13:05:10.764606 21952 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:10.782130 21980 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
I20260709 13:05:10.751442 21965 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.871850 21925 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:10.933460 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 355083us
I20260709 13:05:10.777768 21946 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.881855 21677 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:10.798161 21686 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.119s
I20260709 13:05:10.849660 21525 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.129s
I20260709 13:05:10.906167 21959 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:10.916265 21889 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:10.917254 21719 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:10.939725 21914 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.022s
I20260709 13:05:10.766847 21939 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:10.947000 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:10.962976 15318 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:05:10.958963 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3393) took 1111 ms. Trace:
I20260709 13:05:10.939502 21947 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:10.934418 21818 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:05:10.997267 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:10.955258 21891 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:10.998059 15318 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:10.981964 21914 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.000s	sys 0.022s
W20260709 13:05:10.929388 15320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.011s	sys 0.007s
W20260709 13:05:10.997943 21975 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:05:10.991485 15325 rpcz_store.cc:276] 0709 13:05:09.847748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.847934 (+   186us) service_pool.cc:224] Handling call
0709 13:05:09.850149 (+  2215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:09.852682 (+  2533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:09.852722 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:09.853280 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:05:10.247729 (+394449us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:10.952875 (+705146us) spinlock_profiling.cc:243] Waited 907 us on lock 0x7b180003b1a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f366d5f23c7 00007f3669c049a7 00007f3669c140bf
0709 13:05:10.953097 (+   222us) log.cc:844] Serialized 14 byte log entry
0709 13:05:10.953808 (+   711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:10.953997 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:10.954081 (+    84us) raft_consensus.cc:1685] finished
0709 13:05:10.958572 (+  4491us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:10.958866 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2042,"prepare.queue_time_us":145168,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":5944,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":69625,"spinlock_wait_cycles":2086784,"thread_start_us":454872,"threads_started":2,"wal-append.queue_time_us":540710}
W20260709 13:05:10.993729 21936 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.708s	user 0.013s	sys 0.000s
W20260709 13:05:11.008705 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 129190us
I20260709 13:05:10.956493 21925 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.028576 15317 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:11.001855 21891 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:05:11.026346 21953 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.004s
I20260709 13:05:11.011647 21948 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:11.053001 21984 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:05:11.058401 21959 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:11.049695 21986 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:05:11.050117 21677 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.051659 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.083283 15325 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:11.049402 21965 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:11.071905 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.074862 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 195656us
I20260709 13:05:10.969326 21889 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.086426 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:10.993412 21771 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:11.083472 21975 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:05:11.103085 15318 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:11.073513 21686 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.109589 15365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.013s	sys 0.029s
I20260709 13:05:11.109579 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:11.110497 15365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.013s	sys 0.029s
W20260709 13:05:11.111871 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 777320us
I20260709 13:05:11.112624 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:11.105319 21936 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.119364 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:11.054008 21953 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.108556 21980 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:11.108865 21924 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.107288 21687 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:11.114675 21950 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.805s	user 0.014s	sys 0.000s
I20260709 13:05:11.126470 21925 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:11.114346 21579 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:11.133349 15395 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:11.123044 21608 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:05:11.143088 21981 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:11.144100 21981 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:11.144407 21608 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:11.145648 21981 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:11.146894 21925 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.122148 21798 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:11.111153 21686 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.131112 16031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abb86a150e844b848bc103f128d39a82"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:51484
I20260709 13:05:11.182718 16031 raft_consensus.cc:606] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:11.183184 16031 raft_consensus.cc:614] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:11.146898 21993 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:11.189191 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.123436 21936 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.182866 21946 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:11.131440 21924 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:11.201862 22006 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:05:11.200554 21525 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:11.115221 21891 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.132193 21950 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.210091 21889 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:11.212508 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.214201 21719 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.205420 22009 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.184710 21925 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.226791 15321 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:11.225658 21719 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.229893 21936 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:11.231897 21929 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:11.245476 21929 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:11.246796 21925 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:11.227129 21686 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:11.246717 15241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
W20260709 13:05:11.235013 21974 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.458s	user 0.001s	sys 0.002s
I20260709 13:05:11.249498 15241 raft_consensus.cc:606] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:11.270736 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 141986us
I20260709 13:05:11.276763 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.277845 15321 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:05:11.280579 21940 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.281414 21940 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.283705 21719 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:11.285650 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.259951 21891 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:11.237893 21525 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.247359 22009 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.285384 21950 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:11.276155 21997 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.277336 21916 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.003s
I20260709 13:05:11.299016 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:11.301093 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:11.301375 21950 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:05:11.303879 21950 consensus_queue.cc:1243] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:05:11.306078 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:11.308701 21953 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:11.307700 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:11.296403 21952 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:11.310034 21924 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:11.311543 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:11.312224 21478 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.004s
I20260709 13:05:11.312814 21478 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.313444 22009 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:11.315109 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.315671 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.317248 21924 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:11.317833 21951 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:05:11.302202 22014 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:05:11.371492 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.372375 15318 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:11.373122 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.373464 15318 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:05:11.373870 15324 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:11.374621 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.375247 15325 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:11.322008 21978 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.376109 21978 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.322616 21579 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:11.378343 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.378635 21579 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:11.378955 22007 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
I20260709 13:05:11.379042 15395 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:11.380117 22009 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.380836 21579 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:11.380636 22009 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.325402 21951 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:11.317888 21924 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.327215 21952 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:11.330022 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:11.334916 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.343775 21525 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:11.354269 21892 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:11.288905 21940 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:11.360248 21964 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.031s	user 0.000s	sys 0.017s
I20260709 13:05:11.433964 21892 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:05:11.366892 21979 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.467s	user 0.007s	sys 0.000s
I20260709 13:05:11.293733 21997 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.437566 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 1052) took 1493 ms. Trace:
I20260709 13:05:11.369503 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.438653 15320 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:11.383708 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:11.442605 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58976.9us
I20260709 13:05:11.444468 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:11.400640 22009 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:11.401476 21978 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:11.402055 21951 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:11.404160 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 74223.4us
I20260709 13:05:11.454540 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2211) took 1116 ms. Trace:
I20260709 13:05:11.427424 21959 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:11.428334 21719 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:11.430662 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:11.435271 21892 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.397977 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.438023 16024 rpcz_store.cc:276] 0709 13:05:09.944454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.944630 (+   176us) service_pool.cc:224] Handling call
0709 13:05:09.948806 (+  4176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:09.949159 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:09.949493 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:05:10.039663 (+ 90170us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b1800228760. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:10.176816 (+137153us) log.cc:844] Serialized 14 byte log entry
0709 13:05:10.187974 (+ 11158us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:10.188543 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:05:10.188702 (+   159us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:10.188733 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:10.188802 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:10.426076 (+237274us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b1800228760. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:11.190364 (+764288us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800228760. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d522 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:11.359500 (+169136us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:11.437290 (+ 77790us) raft_consensus.cc:1685] finished
0709 13:05:11.437317 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:11.437479 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22341,"prepare.queue_time_us":873,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":23606,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":24670,"spinlock_wait_cycles":76285696,"thread_start_us":214423,"threads_started":1,"wal-append.queue_time_us":349972}
I20260709 13:05:11.478289 15395 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:11.417372 21929 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.371555 21478 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:11.449630 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:11.483155 15365 leader_election.cc:400] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20.
I20260709 13:05:11.528899 21192 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:11.529400 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46389.4us
I20260709 13:05:11.425906 21981 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:11.530189 21965 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:11.530629 21948 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:11.531448 21948 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:11.531677 21959 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:11.532202 21959 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:11.533031 21959 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.533730 21924 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:11.446106 21872 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:11.502034 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.522723 21892 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:11.523270 21997 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:11.523705 22009 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:11.525162 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3397) took 1343 ms. Trace:
I20260709 13:05:11.527805 21525 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:11.530198 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:11.534732 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.455530 21952 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:11.500775 15393 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:05:11.528899 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 79394.3us
I20260709 13:05:11.544694 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:11.548034 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:11.537701 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.535271 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:11.548883 15397 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:11.549216 15391 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:11.456383 15323 rpcz_store.cc:276] 0709 13:05:10.338676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.338883 (+   207us) service_pool.cc:224] Handling call
0709 13:05:10.371212 (+ 32329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:10.371622 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:10.371653 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:10.372103 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:05:10.464239 (+ 92136us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:10.464303 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:10.464406 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:11.365541 (+901135us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:11.438416 (+ 72875us) raft_consensus.cc:1685] finished
0709 13:05:11.438438 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:11.454452 (+ 16014us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4594,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":1867,"spinlock_wait_cycles":25127680,"thread_start_us":84829,"threads_started":1,"wal-append.queue_time_us":379983}
I20260709 13:05:11.540000 15395 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:11.540688 21987 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:05:11.551900 21987 consensus_queue.cc:1243] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:11.553136 21987 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:11.553503 21987 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.553818 21987 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:11.546829 15392 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:11.540369 21959 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:11.543668 15390 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:11.448880 21980 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:11.549335 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:11.549546 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:11.558681 21980 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:11.559001 21929 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:11.559101 21980 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.559659 21980 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:11.559790 15215 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:11.545578 15316 rpcz_store.cc:276] 0709 13:05:10.181872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.182006 (+   134us) service_pool.cc:224] Handling call
0709 13:05:10.194145 (+ 12139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:10.194376 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:10.250932 (+ 56556us) log.cc:844] Serialized 14 byte log entry
0709 13:05:11.234400 (+983468us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:11.524153 (+289753us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b18003edca0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f366d5f23c7 00007f3669c049a7 00007f3669c140bf 00007f3669c14038
0709 13:05:11.524521 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:05:11.524758 (+   237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:11.524814 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:11.524874 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:11.524948 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:11.525092 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77062,"prepare.queue_time_us":1217245,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":1658,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":6763,"spinlock_wait_cycles":47764480,"thread_start_us":280567,"threads_started":2,"wal-append.queue_time_us":451959}
I20260709 13:05:11.551394 21683 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:11.561371 21683 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.530719 21965 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:11.530627 21951 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:11.561749 21683 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:11.561105 22023 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:11.600481 15390 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:11.601572 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.602753 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.573192 21478 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:11.603787 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.605240 15390 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:05:11.605561 15390 pending_rounds.cc:85] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 9
I20260709 13:05:11.605764 15390 pending_rounds.cc:107] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:05:11.565451 21952 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.606573 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.607161 15392 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:11.608331 15392 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:11.608676 21952 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:11.609814 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:11.610739 15393 raft_consensus.cc:2368] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17.
I20260709 13:05:11.611476 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.605997 15390 raft_consensus.cc:2889] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:11.612681 15390 pending_rounds.cc:107] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:05:11.613039 15390 raft_consensus.cc:2889] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:11.567087 21965 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:11.614503 15390 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:11.567838 21687 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:11.566030 21929 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.626770 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:11.628854 15393 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:11.579789 21981 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:11.577059 22023 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.680258 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.680799 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.680989 15243 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:11.682157 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.683439 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:11.684413 15246 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:11.686230 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.687111 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.687350 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.687863 15249 raft_consensus.cc:2376] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17. Re-sending same reply.
I20260709 13:05:11.688325 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.689258 15246 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:11.692152 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.692440 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:11.693297 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 128472us
I20260709 13:05:11.694778 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.695490 15241 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:11.696069 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.695883 15390 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:11.701472 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:11.700634 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 140921us
I20260709 13:05:11.576387 21686 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:05:11.667387 21929 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.667423 21687 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.706861 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.700261 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:11.709919 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.715286 15390 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:11.599232 21953 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 13:05:11.707231 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.711792 15325 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:11.716720 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:11.718600 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.703120 21872 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:11.720630 15393 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:11.725136 15241 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:11.698505 22023 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:11.701208 21981 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:11.728368 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.735795 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.737625 15390 raft_consensus.cc:2410] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:05:11.732474 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.739101 15394 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:11.718796 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:11.742540 15394 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:11.722433 21687 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:11.746654 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.724123 21771 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:11.760496 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.768921 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.769274 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:11.770408 15316 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:11.770895 15323 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:11.771574 15325 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 16: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:05:11.772761 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 54038.6us
W20260709 13:05:11.773456 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.773603 15324 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:11.772882 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:11.773686 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:11.737402 21721 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.801524 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:11.796669 15317 pending_rounds.cc:85] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 9
I20260709 13:05:11.806537 15317 pending_rounds.cc:107] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:05:11.806958 15317 raft_consensus.cc:2889] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:11.797310 15320 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:11.760186 21871 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:11.809716 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:11.809648 21871 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.795866 21925 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:11.759876 21192 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.748519 21924 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:11.751112 21957 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.834551 15248 pending_rounds.cc:85] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 12
I20260709 13:05:11.837888 15248 pending_rounds.cc:107] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:05:11.838290 15248 raft_consensus.cc:2889] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:11.835632 15245 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:11.845578 15316 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:11.752653 21872 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.813861 21721 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.872553 15322 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:11.834995 21192 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.867107 21931 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:11.840905 21924 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.845307 21957 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.916127 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:11.933670 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:11.849241 21981 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:11.975509 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:11.977662 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3409) took 1108 ms. Trace:
W20260709 13:05:11.978605 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.982928 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:11.935774 21929 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:11.984522 22014 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:05:12.007072 22016 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.019081 21965 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:11.970151 22046 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:12.025282 15250 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
W20260709 13:05:12.026815 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44096.6us
W20260709 13:05:11.987174 22038 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:05:12.121042 15397 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:12.048296 21953 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:12.098838 21872 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:11.978205 15319 rpcz_store.cc:276] 0709 13:05:10.869571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.869703 (+   132us) service_pool.cc:224] Handling call
0709 13:05:10.870188 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:10.870532 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:05:11.543357 (+672825us) log.cc:844] Serialized 14 byte log entry
0709 13:05:11.797693 (+254336us) log.cc:844] Serialized 14 byte log entry
0709 13:05:11.977266 (+179573us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:11.977333 (+    67us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:11.977388 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:11.977467 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:11.977602 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665137,"prepare.queue_time_us":709987,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":81,"raft.queue_time_us":85481,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":30327,"thread_start_us":432894,"threads_started":3,"wal-append.queue_time_us":146982}
I20260709 13:05:11.987519 21889 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:12.100365 22035 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:05:12.007670 21996 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:05:12.090814 22037 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:05:12.113071 15392 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:12.113550 15395 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:12.008466 21871 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.118535 15365 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:12.126969 21804 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:12.127789 21192 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.129796 15391 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:05:12.122805 21987 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.007s
I20260709 13:05:12.156275 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:12.154294 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:12.162719 21804 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.140503 21929 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:12.166370 22050 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:12.165264 21951 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
I20260709 13:05:12.174696 22050 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.176362 22042 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:12.176998 22042 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.177701 22050 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.179196 22042 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.180079 21579 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:12.180763 22042 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.180554 21579 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.181233 22042 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.182614 22047 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:12.183452 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:12.184214 15242 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:12.185032 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:12.185582 15242 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:12.050696 22016 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.187534 21804 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.141144 21889 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:12.188301 21889 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:12.188494 22016 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:12.189169 22016 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:12.189857 22016 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:12.183176 22047 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.187978 22023 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.157544 21677 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.153419 21953 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:12.195060 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:12.205399 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 431762us
W20260709 13:05:12.225835 21683 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
I20260709 13:05:12.226447 22054 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
W20260709 13:05:12.226958 22021 log.cc:927] Time spent T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Append to log took a long time: real 0.136s	user 0.005s	sys 0.005s
I20260709 13:05:12.251235 22016 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:12.252038 21965 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:12.251925 22016 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:12.255210 22048 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:05:12.193233 21719 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:12.259945 21719 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.260309 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:12.261296 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 1.31444e+06us
W20260709 13:05:12.264629 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.269351 21998 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:12.269927 21998 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:12.270388 21998 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:12.274451 21914 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.275131 21914 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.276889 21957 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:12.277578 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.277650 21914 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.117247 22046 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.156997 21872 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:12.208321 21892 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.000s
I20260709 13:05:12.192691 21192 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:12.235765 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 64413.3us
W20260709 13:05:12.236531 21948 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.000s
I20260709 13:05:12.173086 21987 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.280922 22047 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.284403 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:12.227254 21721 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:12.284458 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:12.302906 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:12.373818 16033 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:12.232349 21677 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.403199 15320 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:12.230258 22044 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.279364 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:12.242136 21924 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.356045 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:12.367846 15319 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:05:12.415452 15319 pending_rounds.cc:85] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 13
I20260709 13:05:12.355002 21579 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.283280 21683 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:12.313227 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 62764.8us
I20260709 13:05:12.213501 21929 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.383078 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:12.333243 21995 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:12.355628 21871 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.354811 21192 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:12.415776 15319 pending_rounds.cc:107] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:05:12.491518 15319 raft_consensus.cc:2889] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:12.371083 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:12.238062 21953 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.403237 21956 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 13:05:12.372604 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 71695us
I20260709 13:05:12.507421 15242 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:12.419740 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:12.421208 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 141913us
I20260709 13:05:12.508931 15999 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:12.323802 22050 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
W20260709 13:05:12.451911 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 295706us
I20260709 13:05:12.379774 22016 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.248939 21889 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.408304 21994 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:12.338301 21872 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.417994 21947 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.366506 21948 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.490566 15247 raft_consensus.cc:2368] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18.
I20260709 13:05:12.492347 15248 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:12.493044 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:12.550966 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:12.493289 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 110329us
I20260709 13:05:12.415493 16031 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:12.426620 21957 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:12.444759 21751 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:12.514621 15324 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:12.511869 15215 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:12.495330 21687 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.722s	user 0.013s	sys 0.009s
I20260709 13:05:12.507141 21721 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:12.534574 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.494756 21192 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:12.553792 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44997.5us
W20260709 13:05:12.553817 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.559648 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47894.3us
I20260709 13:05:12.418843 22044 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.511668 22054 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:12.467523 21924 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
W20260709 13:05:12.565068 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48734.8us
I20260709 13:05:12.492492 21871 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.566143 21957 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:12.566771 22059 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:05:12.527755 21965 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:12.565582 21889 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:12.561493 21914 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:12.574676 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:12.486193 21995 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.565625 21953 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.548234 21994 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:12.597584 22058 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:05:12.575362 22054 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.599347 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:12.600045 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:12.568078 21579 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:12.567553 22023 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.574707 15245 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:12.615767 21997 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:12.621618 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:12.571835 22053 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.629253 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:12.558923 21947 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.589314 22016 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.645460 22032 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:12.646096 21921 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:12.646978 22026 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.909s	user 0.006s	sys 0.000s
I20260709 13:05:12.647960 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:12.648679 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:12.650478 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:12.599999 21990 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.571426 21721 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.653756 22016 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.642017 21953 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:12.631505 21980 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.067s	user 0.014s	sys 0.001s
I20260709 13:05:12.657716 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:12.573045 21687 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.634084 21579 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.599764 21965 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.629407 22054 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:12.651670 22053 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.658571 21921 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:12.665748 21987 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:12.666559 22062 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:05:12.671654 22032 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:12.679617 22068 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:05:12.683396 22051 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:05:12.685226 22046 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.589763 21949 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:05:12.658303 22056 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:05:12.690770 22072 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:12.670465 21956 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
W20260709 13:05:12.735270 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 113728us
W20260709 13:05:12.735177 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 103859us
I20260709 13:05:12.634644 21891 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:05:12.753659 15250 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:12.754345 21992 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:12.835098 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 343515us
I20260709 13:05:12.736045 21981 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:12.777607 15241 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:05:12.773839 21915 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:12.763252 22023 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:12.779474 21921 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:12.781121 22016 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:12.757979 22036 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:05:12.848097 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:12.820746 21929 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.769404 21579 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:12.772259 21677 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:12.797977 21925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.052s	sys 0.087s
W20260709 13:05:12.767465 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 109821us
I20260709 13:05:12.836308 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:12.820523 21683 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.843832 21992 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.867719 21948 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.869225 21994 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.869784 21872 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.871217 21965 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.872663 22071 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:12.878608 22053 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.758575 21990 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.880204 22032 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.881246 22044 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.867753 21987 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:05:12.911458 21677 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:12.895341 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:12.935117 15324 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:12.897650 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:12.893802 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 119087us
W20260709 13:05:12.904403 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 68180.5us
I20260709 13:05:12.936795 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:12.937101 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:12.938735 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:12.839660 21981 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.817662 16033 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:12.840173 22023 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.909817 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:12.895474 21525 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:05:12.960942 21687 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.943372 22032 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.962476 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:12.963330 15325 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:12.962924 22032 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.965736 22032 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.966562 21994 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:12.898450 22051 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:05:12.966776 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 71516.9us
I20260709 13:05:12.972438 21721 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:12.913213 21957 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:12.906308 21871 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:12.974807 22057 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:05:12.976740 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2181) took 1270 ms. Trace:
I20260709 13:05:12.977111 15246 rpcz_store.cc:276] 0709 13:05:11.705992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.706217 (+   225us) service_pool.cc:224] Handling call
0709 13:05:11.710639 (+  4422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:11.883689 (+173050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:11.883722 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:11.913683 (+ 29961us) log.cc:844] Serialized 26 byte log entry
0709 13:05:12.125212 (+211529us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:12.128783 (+  3571us) log.cc:844] Serialized 14 byte log entry
0709 13:05:12.493077 (+364294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.493182 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:12.976480 (+483298us) raft_consensus.cc:1685] finished
0709 13:05:12.976504 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.976668 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20747,"prepare.queue_time_us":2987,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":176098,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":19240,"thread_start_us":713526,"threads_started":3,"wal-append.queue_time_us":667418}
I20260709 13:05:12.979331 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:12.980036 21990 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:12.981251 22042 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.981738 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:12.982065 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:12.982425 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:12.920239 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:12.982784 16029 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:12.983100 16031 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:12.928356 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:12.847277 21924 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:05:12.983889 15396 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:12.984256 21924 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:12.984660 21924 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:12.985431 21924 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.986639 21924 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:12.911110 21929 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.988077 21929 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.990439 21929 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:12.930631 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:12.905284 22065 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:05:12.904125 21947 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:12.841295 22066 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:05:12.992182 22066 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:12.992512 22066 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:12.993224 22066 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:12.932231 15321 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:05:12.994383 15321 pending_rounds.cc:85] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 11
I20260709 13:05:12.994652 15321 pending_rounds.cc:107] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 17.12
W20260709 13:05:12.994395 21948 consensus_queue.cc:1175] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" responder_term: 19 status { last_received { term: 19 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 19 index: 11 } }
I20260709 13:05:12.994984 15321 raft_consensus.cc:2889] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:12.995555 22066 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:12.770915 21980 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:12.997427 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2184) took 1271 ms. Trace:
I20260709 13:05:12.936115 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:12.894877 21925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.052s	sys 0.087s
I20260709 13:05:13.004922 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:12.997807 21980 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:13.006968 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.007225 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2192) took 1121 ms. Trace:
I20260709 13:05:12.982726 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.008241 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.007721 15241 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:12.943552 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:12.945152 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:12.948701 16030 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:12.949487 21992 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:12.953189 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:12.955049 22072 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.007404 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:12.959211 21998 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.688s	user 0.012s	sys 0.001s
I20260709 13:05:12.967010 21994 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:12.919646 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:13.009760 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3484) took 1305 ms. Trace:
I20260709 13:05:13.010753 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:12.917220 21995 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:13.010803 15393 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:13.007798 15245 rpcz_store.cc:276] 0709 13:05:11.886293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.886441 (+   148us) service_pool.cc:224] Handling call
0709 13:05:13.006968 (+1120527us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b540025bcd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:13.007155 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509360896}
I20260709 13:05:13.028038 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:12.941068 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:12.997951 15247 rpcz_store.cc:276] 0709 13:05:11.726525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.726673 (+   148us) service_pool.cc:224] Handling call
0709 13:05:12.997179 (+1270506us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b540011a3d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:12.997352 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696264576}
I20260709 13:05:12.966854 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:13.015650 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.031287 15394 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:13.015836 15323 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:12.957507 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:13.030371 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 463468us
I20260709 13:05:13.032840 15391 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:05:13.033893 15398 raft_consensus.cc:2410] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 21 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:05:13.022756 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.023227 15246 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
W20260709 13:05:13.018601 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 363471us
I20260709 13:05:13.022912 15390 rpcz_store.cc:276] 0709 13:05:11.704597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.753806 (+ 49209us) service_pool.cc:224] Handling call
0709 13:05:11.754164 (+   358us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:11.798302 (+ 44138us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:11.832366 (+ 34064us) log.cc:844] Serialized 14 byte log entry
0709 13:05:11.931011 (+ 98645us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:05:11.938467 (+  7456us) log.cc:844] Serialized 78 byte log entry
0709 13:05:11.938616 (+   149us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:11.938659 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:11.938744 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.009509 (+1070765us) raft_consensus.cc:1685] finished
0709 13:05:13.009538 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.009705 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33821,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":52,"raft.queue_time_us":18032,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":45101,"thread_start_us":57712,"threads_started":1,"wal-append.queue_time_us":392953}
I20260709 13:05:13.026954 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:12.927420 22071 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.035707 15390 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:13.036394 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.040758 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:13.012868 22053 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.015571 22050 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:13.041465 15395 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:12.947940 21981 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:13.012498 22023 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:13.042057 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 412893us
I20260709 13:05:13.050657 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:13.046751 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 105751us
I20260709 13:05:13.015558 21947 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:13.019189 21925 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:13.040007 15396 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:13.052577 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:13.030903 21994 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:13.060958 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:13.065631 16033 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:13.068198 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:13.069687 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:13.032505 21998 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.075170 21998 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:13.076054 21966 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:13.077086 21871 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:13.026746 22072 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.079427 22072 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:13.081746 22071 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:13.067574 21947 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.050850 22076 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:13.083727 22076 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.084069 22076 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:13.084314 21947 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:13.084690 15325 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:13.060751 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:12.978125 22054 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.104789 22054 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:13.105365 22054 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:13.107086 21931 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:13.111752 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.113500 21804 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:13.113631 21995 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:13.114416 21992 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.115451 15248 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:05:13.095777 16032 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:13.073038 21192 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.064729 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:13.131852 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 67262.5us
I20260709 13:05:13.090001 21965 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:13.090176 21921 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:13.092939 22069 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.262s	user 0.003s	sys 0.000s
I20260709 13:05:13.062477 21771 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:05:13.149592 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.062732 21925 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:13.071139 22032 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:05:13.152532 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.095737 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.096536 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.153460 16031 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:13.153931 15244 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:13.154120 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.154392 21931 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.096868 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.097488 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.098541 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.155085 21931 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.099301 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.100073 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.156740 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.157044 16024 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:13.157536 21931 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:13.156741 16029 raft_consensus.cc:2410] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:05:13.160080 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.160795 15323 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:13.102012 21579 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.102603 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.173009 16033 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:13.078011 15391 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:13.120179 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.114020 21804 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:13.178195 22067 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:13.178742 21804 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.116297 21889 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.180207 21804 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:13.180402 21677 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.174437 22054 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:05:13.181504 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.136742 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:13.116959 21721 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:13.182530 21721 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.182956 21721 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:13.138247 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.184238 15393 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:13.184388 15245 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:05:13.138950 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.111883 21998 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:05:13.142072 21921 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:13.142855 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:13.189163 15395 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:13.189673 15248 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:05:13.144802 21954 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:13.145793 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.145977 21965 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:13.146539 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.138981 15325 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:13.191016 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.147594 21957 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:13.147840 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.149631 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2183) took 1426 ms. Trace:
I20260709 13:05:13.152863 21924 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:13.175698 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:13.177569 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.217021 15250 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:13.178879 22067 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.140058 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.239434 15321 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:13.223642 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.185899 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.186393 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.223274 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:13.242081 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.242545 15325 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:13.242816 15391 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:13.222509 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:13.244069 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:13.191761 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46045.2us
I20260709 13:05:13.191761 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.190464 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.208998 15243 rpcz_store.cc:276] 0709 13:05:11.722975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.723102 (+   127us) service_pool.cc:224] Handling call
0709 13:05:11.723404 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:11.847821 (+124417us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:11.868371 (+ 20550us) log.cc:844] Serialized 14 byte log entry
0709 13:05:12.103039 (+234668us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b18000c7300. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:05:12.490831 (+387792us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:12.499288 (+  8457us) log.cc:844] Serialized 26 byte log entry
0709 13:05:12.499479 (+   191us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:12.499533 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.499635 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.092167 (+592532us) spinlock_profiling.cc:243] Waited 4.76 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:13.149436 (+ 57269us) raft_consensus.cc:1685] finished
0709 13:05:13.149457 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.149579 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59959,"prepare.queue_time_us":20434,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2864,"raft.queue_time_us":164361,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":37118,"spinlock_wait_cycles":17349760,"thread_start_us":442590,"threads_started":2,"wal-append.queue_time_us":878754}
I20260709 13:05:13.246068 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.192163 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:13.192399 15249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.026s	sys 0.047s
W20260709 13:05:13.248250 15249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.027s	sys 0.047s
I20260709 13:05:13.215538 15322 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:13.248623 15243 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:13.211601 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:13.249481 15215 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:13.251114 15248 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:13.072839 21872 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:05:13.161998 22023 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.151175 21925 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.230089 16029 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:05:13.208074 21981 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.228720 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.233994 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:13.234680 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.231920 21954 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:13.232448 21957 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.297979 22050 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.181933 22054 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:13.255470 15245 raft_consensus.cc:2368] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
I20260709 13:05:13.256064 15250 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:05:13.190798 21965 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:13.260614 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.365535 15244 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:05:13.210776 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:13.366003 15391 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:05:13.263783 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:13.366674 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 155993us
I20260709 13:05:13.266465 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.207837 21995 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.267316 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.369756 15322 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:13.267331 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3015) took 1132 ms. Trace:
I20260709 13:05:13.268159 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.265017 21818 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:13.229246 22064 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.229313 21192 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:13.279117 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.281279 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:13.264617 21992 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.283797 22067 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:13.284049 22085 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:13.293270 15324 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:13.262997 22056 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:13.262871 21953 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:13.296432 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 325528us
I20260709 13:05:13.431926 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:13.300733 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 385755us
I20260709 13:05:13.229007 22076 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.309751 16029 pending_rounds.cc:85] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 14
I20260709 13:05:13.263144 21921 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 13:05:13.439781 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.305966 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:13.313293 15393 raft_consensus.cc:2368] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17.
I20260709 13:05:13.240921 16025 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:13.441090 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:13.375373 22078 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:05:13.423939 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 142776us
W20260709 13:05:13.365046 22074 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:05:13.424613 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:13.424818 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45729.9us
I20260709 13:05:13.329918 22050 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:13.446285 15317 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:13.326417 22054 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:13.430059 22085 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:13.435308 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.435866 16029 pending_rounds.cc:107] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:05:13.436946 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.455132 16029 raft_consensus.cc:2889] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:13.455446 15322 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
W20260709 13:05:13.437196 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 226636us
I20260709 13:05:13.263222 21924 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.370610 15242 rpcz_store.cc:276] 0709 13:05:12.135038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.571089 (+436051us) service_pool.cc:224] Handling call
0709 13:05:12.588748 (+ 17659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.837100 (+248352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.837146 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.837207 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:12.837266 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.267028 (+429762us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400448ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:13.267093 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.267259 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570583936}
W20260709 13:05:13.377547 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 113834us
I20260709 13:05:13.411773 21818 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.318934 21929 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.113s
W20260709 13:05:13.427623 22098 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:05:13.446146 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.430685 21525 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:13.451148 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.420202 21915 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:13.459115 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 153259us
I20260709 13:05:13.460263 15320 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:05:13.311973 22084 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.136s
I20260709 13:05:13.460908 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:13.462946 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:13.475059 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:13.443878 21871 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:13.476064 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.466260 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.388715 21994 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.445555 22078 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.443768 21940 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.444380 22056 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:13.487211 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.425400 22064 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.459730 21686 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:13.488852 15317 raft_consensus.cc:2410] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:13.503387 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:13.472512 21995 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.497095 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:13.502331 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.528378 16031 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:13.460579 21998 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.528410 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.529874 16025 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:13.530664 16024 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:13.481578 15289 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.486282 22009 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:13.533030 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.532135 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.508116 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:13.440888 21953 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.498585 22078 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:13.512765 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.532101 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:13.470135 22032 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:05:13.527086 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:13.532349 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:13.509443 21686 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:13.524792 21872 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.562482 21686 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.556664 21998 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.495971 21989 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:13.563547 21989 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:13.524380 22067 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:13.505386 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:13.524034 22066 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:13.467528 21677 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:05:13.485805 21871 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:13.573633 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 46641.8us
I20260709 13:05:13.553751 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.557214 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:13.549383 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:13.500499 22053 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:13.558063 16033 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:13.557937 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 111861us
I20260709 13:05:13.503156 21992 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.506709 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:13.578953 16026 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:13.508409 21997 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:13.564237 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:13.567945 22098 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:05:13.568506 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 87027.6us
I20260709 13:05:13.563951 21989 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:13.461551 21965 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.493407 21525 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.661643 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.662464 15393 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:13.663722 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.664043 21525 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:13.574913 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:13.664635 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.665282 15247 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:05:13.666471 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.667517 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.668531 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.669513 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.571439 22063 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:13.636261 21992 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.672607 21992 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:13.679436 22097 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 13:05:13.681118 22082 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 13:05:13.682168 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.682931 15394 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:13.683881 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.684923 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.685818 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2182) took 1972 ms. Trace:
I20260709 13:05:13.686221 15249 rpcz_store.cc:276] 0709 13:05:11.713463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.713590 (+   127us) service_pool.cc:224] Handling call
0709 13:05:11.713936 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:11.878530 (+164594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:11.878561 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:12.191654 (+313093us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b2c000014c8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:05:12.192109 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.248620 (+1056511us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:13.264573 (+ 15953us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.264797 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.264925 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.685503 (+420578us) raft_consensus.cc:1685] finished
0709 13:05:13.685613 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.685751 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15841,"prepare.queue_time_us":43472,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":90075,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":19185,"spinlock_wait_cycles":8450816,"thread_start_us":1196146,"threads_started":2,"wal-append.queue_time_us":1114565}
I20260709 13:05:13.570356 22083 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:13.703927 16033 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:13.584862 15243 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:13.532732 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.467106 21954 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.509210 22086 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:05:13.635372 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.723752 15399 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:05:13.566075 22016 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.523948 22031 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:05:13.638018 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:13.737767 15248 raft_consensus.cc:2368] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22.
I20260709 13:05:13.639395 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.523118 21980 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.529521 21931 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:13.658375 15289 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.639029 21192 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:13.705801 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 152146us
I20260709 13:05:13.747655 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:13.709414 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 134553us
I20260709 13:05:13.586594 22065 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:13.577054 21871 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:13.722819 21891 raft_consensus.cc:2764] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:05:13.586318 21997 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:13.557906 21995 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.579751 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:13.661721 21965 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:13.728196 16026 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:13.707410 22083 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.734733 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:13.708933 22036 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.706586 22023 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:13.711910 22053 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:13.715237 22009 raft_consensus.cc:2764] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:05:13.765470 21953 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:13.753620 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 95394.3us
W20260709 13:05:13.767406 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 187715us
I20260709 13:05:13.782397 15289 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:13.782797 15290 leader_election.cc:400] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17.
I20260709 13:05:13.640594 22056 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.788837 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:13.755040 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:13.523433 22054 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.757021 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.759063 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.729419 21981 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:13.764600 22079 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.391s	user 0.001s	sys 0.000s
I20260709 13:05:13.765242 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:13.568449 22085 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.758548 22072 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.800765 16029 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:05:13.759491 22065 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:13.802577 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45626.9us
W20260709 13:05:13.809268 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 311659us
I20260709 13:05:13.767084 21997 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:13.758352 21686 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.756132 21525 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:13.754673 21980 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.784871 22083 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:13.809903 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:13.823208 22036 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:13.823597 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:13.824669 22036 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:13.825204 15213 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:13.810492 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:13.775763 21677 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.754386 21931 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.826431 22009 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.826690 21677 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:13.827131 21677 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.827636 21677 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:13.828593 21931 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:13.829236 21931 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:13.825232 22036 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:13.830569 22036 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:13.832430 21931 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.835757 21931 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.841835 21981 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:13.797650 22110 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:13.799401 22032 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:13.847991 15365 leader_election.cc:400] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18.
I20260709 13:05:13.849150 15365 leader_election.cc:403] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:13.762542 22044 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:05:13.757009 21192 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.800606 21924 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:13.812372 22065 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:13.809975 22023 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:05:13.865638 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.812968 22054 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:13.870376 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:13.816855 22076 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:13.874264 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 85519.7us
I20260709 13:05:13.877175 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.877836 16030 raft_consensus.cc:2376] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23. Re-sending same reply.
I20260709 13:05:13.855893 22110 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:13.886123 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.887540 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:13.888106 15322 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:13.884402 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.891207 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:13.891817 15318 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:13.892781 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:13.918483 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:13.873394 22032 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:13.873095 21947 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18.
I20260709 13:05:13.876395 21924 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:13.866565 22064 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:13.921150 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.925478 15324 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
W20260709 13:05:13.926797 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56566.5us
W20260709 13:05:13.928762 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 291306us
I20260709 13:05:13.844262 21525 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:13.874879 21994 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:13.935739 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:13.938644 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 982) took 1307 ms. Trace:
W20260709 13:05:13.927559 22106 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.214s	user 0.001s	sys 0.001s
I20260709 13:05:13.947407 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:13.943024 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.945201 21686 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:13.946513 21931 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:13.951087 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:13.951215 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:13.951766 16025 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:13.947036 21889 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:13.895035 22110 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.956913 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:13.956913 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:13.962160 15318 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:13.928604 22076 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:13.964474 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:13.967034 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:13.971275 15248 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
W20260709 13:05:13.938000 22100 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
I20260709 13:05:13.972302 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:13.933418 21924 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.939075 15392 rpcz_store.cc:276] 0709 13:05:12.631307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.631460 (+   153us) service_pool.cc:224] Handling call
0709 13:05:12.643649 (+ 12189us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:12.644166 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.644207 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:12.644944 (+   737us) log.cc:844] Serialized 52 byte log entry
0709 13:05:13.037018 (+392074us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:13.414266 (+377248us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.418083 (+  3817us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.418164 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.938412 (+520248us) raft_consensus.cc:1685] finished
0709 13:05:13.938432 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.938583 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3443,"prepare.queue_time_us":141806,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":8353,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":7068,"thread_start_us":742820,"threads_started":2,"wal-append.queue_time_us":627754}
I20260709 13:05:13.966216 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:13.962527 21889 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:13.979189 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3490) took 1142 ms. Trace:
I20260709 13:05:13.979465 21889 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:13.979728 15397 rpcz_store.cc:276] 0709 13:05:12.837170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.837328 (+   158us) service_pool.cc:224] Handling call
0709 13:05:12.837637 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:12.837964 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.837991 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.115311 (+277320us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b2c0012d858. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:05:13.115762 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.413906 (+298144us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:13.413965 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.414062 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.972836 (+558774us) raft_consensus.cc:1685] finished
0709 13:05:13.972857 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.979113 (+  6256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":8086,"spinlock_wait_cycles":8963456,"thread_start_us":297199,"threads_started":1,"wal-append.queue_time_us":446071}
I20260709 13:05:13.985255 15397 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: [19.10-19.10]
W20260709 13:05:13.986167 22115 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:05:13.990520 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.948496 22064 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:13.962944 22031 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:14.022432 15399 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 13:05:14.018792 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46571us
I20260709 13:05:14.019786 15397 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:13.919516 22053 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:13.981912 21924 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:14.031035 15365 leader_election.cc:400] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22.
I20260709 13:05:14.031415 15365 leader_election.cc:403] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:05:13.995241 21951 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:13.995816 21525 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:14.039072 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 51069.7us
I20260709 13:05:13.976339 22076 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.042809 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:14.045845 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.046954 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.049993 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.050014 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.031260 21947 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:14.051792 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.066635 16030 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:14.070955 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:14.072561 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.071169 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.069355 22124 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:14.078766 21719 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.079514 15399 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:14.077060 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.053094 21951 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:14.077402 22131 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:14.107832 21889 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.111699 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.112272 15245 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.073690 21947 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:14.085654 21931 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:14.122516 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 75696.8us
I20260709 13:05:14.110015 21889 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.123773 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.038280 22032 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.089210 21980 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:14.130502 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.137562 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.141036 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.121439 21931 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.148267 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.130858 21192 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.135522 22117 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:14.137166 22124 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22.
I20260709 13:05:14.163384 15245 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:05:14.144423 22129 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:14.153443 21931 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:14.191673 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 43499.7us
I20260709 13:05:14.152395 22131 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:14.194901 15322 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:14.199249 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.204701 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.205525 22117 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:14.210078 15250 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 13:05:14.231498 22134 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:14.232822 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3516) took 1017 ms. Trace:
I20260709 13:05:14.234458 22110 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.233209 15392 rpcz_store.cc:276] 0709 13:05:13.214918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.983586 (+768668us) service_pool.cc:224] Handling call
0709 13:05:14.025636 (+ 42050us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:14.040616 (+ 14980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.040646 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:14.066967 (+ 26321us) log.cc:844] Serialized 26 byte log entry
0709 13:05:14.131579 (+ 64612us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:14.131619 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.131687 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.232559 (+100872us) raft_consensus.cc:1685] finished
0709 13:05:14.232586 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.232757 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14521,"raft.queue_time_us":16788,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":17227,"thread_start_us":37615,"threads_started":1,"wal-append.queue_time_us":51520}
I20260709 13:05:14.237918 21771 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:14.161062 21951 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.239802 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.130151 21677 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.231292 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.245333 15322 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
W20260709 13:05:14.192821 21721 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.009s	user 0.011s	sys 0.003s
I20260709 13:05:14.250160 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.253708 15319 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:14.189085 21192 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:14.238767 21771 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:05:14.268504 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.200585 22131 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:14.270423 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.149992 22036 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:14.257731 21804 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.077s	user 0.015s	sys 0.001s
I20260709 13:05:14.280077 15323 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:14.262076 21192 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.299794 21966 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:14.300312 21966 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:14.300447 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.301792 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:14.302356 22133 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:14.302630 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 863) took 1140 ms. Trace:
I20260709 13:05:14.302981 15244 rpcz_store.cc:276] 0709 13:05:13.162293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.163252 (+   959us) service_pool.cc:224] Handling call
0709 13:05:13.163589 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.366061 (+202472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.302312 (+936251us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54001a7cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:14.302568 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463836544}
W20260709 13:05:14.306557 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 99480us
I20260709 13:05:14.190150 21947 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.283780 22131 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:14.342875 21957 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:14.345870 22033 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:05:14.309649 21871 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.004s
W20260709 13:05:14.329586 22114 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.454s	user 0.001s	sys 0.000s
I20260709 13:05:14.301154 21966 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.261317 21721 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.348439 21818 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:14.349128 22050 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.883s	user 0.007s	sys 0.002s
W20260709 13:05:14.349949 22096 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.654s	user 0.004s	sys 0.000s
I20260709 13:05:14.350780 22036 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:14.356469 21995 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:14.334542 22138 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:14.309319 21683 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:05:14.315791 22132 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:05:14.336247 22130 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:05:14.331717 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1036) took 1228 ms. Trace:
I20260709 13:05:14.404111 16024 rpcz_store.cc:276] 0709 13:05:13.103330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.443500 (+340170us) service_pool.cc:224] Handling call
0709 13:05:13.463716 (+ 20216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.531153 (+ 67437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.331414 (+800261us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b540067edd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:14.331647 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153443072}
I20260709 13:05:14.312263 21579 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:14.338160 22121 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:05:14.295897 21192 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:14.368666 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 61135.6us
I20260709 13:05:14.393883 22076 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:14.308144 22078 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.739s	user 0.011s	sys 0.001s
I20260709 13:05:14.371193 15365 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:14.418114 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47015.2us
I20260709 13:05:14.413990 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.382265 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:14.398152 15395 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:14.383790 22054 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 13:05:14.400403 21677 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.401497 21683 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.382952 21871 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.399397 22138 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:14.395290 22050 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.420383 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.410975 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3515) took 1196 ms. Trace:
I20260709 13:05:14.433337 15393 rpcz_store.cc:276] 0709 13:05:13.214610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.868733 (+654123us) service_pool.cc:224] Handling call
0709 13:05:13.872424 (+  3691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.969865 (+ 97441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.969911 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.970568 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:05:14.155218 (+184650us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:14.155257 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.155343 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.410656 (+255313us) raft_consensus.cc:1685] finished
0709 13:05:14.410686 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.410884 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54766,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":5311,"thread_start_us":201443,"threads_started":2,"wal-append.queue_time_us":294385}
W20260709 13:05:14.440265 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58126.6us
I20260709 13:05:14.441133 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:14.442139 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:14.442860 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:14.432080 21965 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.643s	user 0.013s	sys 0.000s
I20260709 13:05:14.447021 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3508) took 1429 ms. Trace:
I20260709 13:05:14.445099 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.423293 21889 raft_consensus.cc:2804] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:14.447508 15396 rpcz_store.cc:276] 0709 13:05:13.018036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.063526 (+ 45490us) service_pool.cc:224] Handling call
0709 13:05:13.074389 (+ 10863us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:13.074751 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.074780 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:13.075392 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 13:05:13.409115 (+333723us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:13.409174 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.409289 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.349201 (+939912us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:14.439130 (+ 89929us) raft_consensus.cc:1685] finished
0709 13:05:14.439164 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.446935 (+  7771us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2038,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":20006656,"thread_start_us":333295,"threads_started":1,"wal-append.queue_time_us":430931}
I20260709 13:05:14.451634 21981 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:14.452153 21981 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.452525 21981 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:14.451706 22111 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:14.454922 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.455535 15250 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:14.456552 22083 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.005s
I20260709 13:05:14.457046 22083 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.449488 15394 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:05:14.458752 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.459578 22126 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:14.460109 21871 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.460712 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.462409 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.463855 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:14.463950 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:14.464560 21981 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:14.467365 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.468111 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.437243 22054 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.469614 21677 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.469913 22126 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:14.469575 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.470112 22054 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.470484 22126 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.471438 22126 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:14.446059 21957 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:14.473340 22138 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.462595 15393 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:14.474541 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:14.476425 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.478214 21925 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:14.470242 21677 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.486863 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3446) took 1469 ms. Trace:
I20260709 13:05:14.487255 15316 rpcz_store.cc:276] 0709 13:05:13.017429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.017707 (+   278us) service_pool.cc:224] Handling call
0709 13:05:13.031986 (+ 14279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.032262 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:13.408621 (+376359us) log.cc:844] Serialized 14 byte log entry
0709 13:05:14.486313 (+1077692us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b18003a0fc0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a
0709 13:05:14.486531 (+   218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:14.486579 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:14.486626 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.486689 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.486809 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":421469,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":40237440,"thread_start_us":421355,"threads_started":2,"wal-append.queue_time_us":255853}
I20260709 13:05:14.488554 21981 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:14.415122 21924 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.492062 15324 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:14.437026 22076 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:14.492669 22083 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:14.430918 21683 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:14.486698 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:14.495719 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:14.498741 22065 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.000s
I20260709 13:05:14.499329 21889 raft_consensus.cc:697] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:14.439204 21989 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.777s	user 0.011s	sys 0.003s
W20260709 13:05:14.436807 21997 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.000s
I20260709 13:05:14.433566 22064 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.447602 22016 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:14.423858 22078 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.489758 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.449054 22122 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:14.513019 15242 raft_consensus.cc:1240] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:14.514307 15250 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:14.520450 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 1005) took 1021 ms. Trace:
I20260709 13:05:14.523689 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.526517 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.521020 16029 rpcz_store.cc:276] 0709 13:05:13.499173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.499305 (+   132us) service_pool.cc:224] Handling call
0709 13:05:13.532594 (+ 33289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.804725 (+272131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.520146 (+715421us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b540066eed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:14.520377 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615877504}
I20260709 13:05:14.527172 15247 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:14.528985 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68342.5us
I20260709 13:05:14.530072 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.533383 15317 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:14.534741 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:14.535341 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.535966 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.536198 15316 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:05:14.536005 15318 raft_consensus.cc:2368] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17.
I20260709 13:05:14.505465 22065 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.551337 21924 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.553776 22078 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.554867 22054 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:14.554648 21889 consensus_queue.cc:237] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.556396 21677 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:14.507859 21997 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.560550 21997 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.518711 21721 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.510995 22016 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:14.563650 22016 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:14.514418 22076 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:05:14.509071 22064 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.569248 22064 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:14.551573 22065 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:14.573036 22127 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.500s	user 0.002s	sys 0.000s
I20260709 13:05:14.505290 21931 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.576159 21931 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:14.507339 21989 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.578613 21989 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:14.579417 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.580322 21939 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.580869 21939 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:14.581235 15395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2914) took 1346 ms (client timeout 1757 ms). Trace:
W20260709 13:05:14.581663 15395 rpcz_store.cc:269] 0709 13:05:13.235040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.246645 (+ 11605us) service_pool.cc:224] Handling call
0709 13:05:14.581014 (+1334369us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400195fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:14.581148 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2362199808}
I20260709 13:05:14.584908 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.585389 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.586087 15396 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 14.
I20260709 13:05:14.585390 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:14.587520 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:14.588173 16026 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:14.592880 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:14.598757 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:14.561887 21871 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.599393 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.599416 15393 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:14.601545 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.601766 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:14.602469 15396 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:14.603927 15289 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.600131 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:14.606694 15316 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:14.607367 15392 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:14.613816 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:14.614042 16029 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:14.617389 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.618635 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.619426 15244 raft_consensus.cc:2368] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22.
I20260709 13:05:14.620651 16026 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
W20260709 13:05:14.621312 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 91348.4us
I20260709 13:05:14.622041 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.624217 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:14.618683 22046 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:14.635649 22046 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:14.636876 22046 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.614383 21871 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.589572 21998 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:14.640522 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:14.640587 21871 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:14.626078 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.643615 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:14.645198 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.626181 21924 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:14.626088 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.646893 21981 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:14.647655 21981 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:14.648279 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.634624 21939 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:14.648545 21947 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:14.609917 21721 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.649425 21947 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:14.650108 22116 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:14.649852 21721 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.651871 21924 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:14.652292 21924 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.652396 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.652688 21924 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:14.653365 21721 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:14.649866 21947 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:14.622680 22083 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:05:14.655279 21947 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.657193 21939 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:14.657898 21939 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.654120 15999 leader_election.cc:400] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18.
I20260709 13:05:14.666668 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.660846 21916 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:14.615578 21677 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:14.674922 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:14.681773 21677 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.682240 16025 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 13.
I20260709 13:05:14.682906 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:14.683614 15321 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:14.683307 21192 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.678274 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:14.679508 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:14.684441 15325 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:05:14.684867 16028 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:05:14.685194 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3510) took 1472 ms. Trace:
I20260709 13:05:14.685578 15394 rpcz_store.cc:276] 0709 13:05:13.212987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.684685 (+471698us) service_pool.cc:224] Handling call
0709 13:05:14.685045 (+1000360us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b540009a6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:14.685143 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1756989184}
I20260709 13:05:14.686163 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.686995 15325 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 13.
W20260709 13:05:14.687647 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.687959 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.679447 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.679695 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:14.684463 16027 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:14.690416 16024 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:14.690326 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:14.681500 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:14.672113 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:14.691380 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 67279.9us
I20260709 13:05:14.693607 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:14.681202 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.694680 16030 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:14.695171 15395 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:14.687987 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:14.682430 21677 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.696942 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:14.684521 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:14.699626 16033 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:14.700634 16027 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:14.700660 15321 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:14.698033 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.705854 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.706593 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:14.706799 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.708703 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:14.712893 22055 raft_consensus.cc:2764] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:05:14.713290 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.714066 15243 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:14.716423 21721 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:14.717005 21721 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.719249 21721 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.719748 21721 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:14.720275 21721 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.720621 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:14.721550 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:14.720655 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:14.722716 15318 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:14.724025 21891 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:14.724437 22110 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:14.726316 22133 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.726819 21916 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:14.727252 21916 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.727633 21916 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:14.728847 21192 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:14.730382 22124 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:14.733222 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.736379 15291 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.710793 15999 leader_election.cc:400] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22.
I20260709 13:05:14.740252 15999 leader_election.cc:403] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:05:14.743057 15393 raft_consensus.cc:2410] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:05:14.742169 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.741925 15318 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:14.743305 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.761512 15316 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:14.731912 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:14.762282 21721 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.745738 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.746456 15242 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:14.748490 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:14.764935 15320 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:14.765985 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.766217 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.766294 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:14.755125 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:14.676841 21965 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:14.758163 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.757085 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:14.767604 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.772588 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:14.698099 21939 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.773473 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.774674 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.775390 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.776175 15318 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:14.776328 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:14.777616 15318 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:14.762831 21957 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:14.779634 21957 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:14.781728 21957 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:14.726850 22133 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.676420 21914 consensus_queue.cc:1059] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:05:14.784706 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.731734 22033 raft_consensus.cc:2764] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 13:05:14.788461 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:14.671999 21998 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
I20260709 13:05:14.774360 15242 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:14.786906 15390 raft_consensus.cc:2368] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:14.744438 22078 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:14.674571 21989 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
I20260709 13:05:14.721782 21995 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
W20260709 13:05:14.792237 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 95935.2us
I20260709 13:05:14.816432 15289 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:14.757302 21966 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:14.787883 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:14.756074 22084 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:14.801621 16024 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:14.759871 21818 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:14.755816 22065 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:14.803162 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.803980 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.804363 15392 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:14.804931 15321 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:14.762519 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.807265 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:14.808703 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:14.809814 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.802778 22110 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:14.771039 21997 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.823369 15241 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:05:14.798080 21192 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:14.839793 22084 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.881135 15320 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:14.883199 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:14.886294 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:14.869385 15316 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
I20260709 13:05:14.889254 15316 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:14.868806 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:14.871387 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 64212.8us
I20260709 13:05:14.873313 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:14.867849 15390 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:14.862910 21965 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:14.863162 22078 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:14.819943 21721 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:14.896700 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:14.870604 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:14.887428 21957 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:14.885601 21818 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:14.897805 15321 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:14.871891 21192 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:14.882040 22084 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:14.915328 15242 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:14.900293 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:14.812713 22120 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.084s
I20260709 13:05:14.901305 21871 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:14.918066 15320 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:14.833011 15393 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:14.862452 22065 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:14.923170 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 301511us
I20260709 13:05:14.950614 16027 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
W20260709 13:05:14.922621 22032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.000s	sys 0.046s
I20260709 13:05:14.928642 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:14.917109 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:14.813048 22131 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:14.948215 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48018.4us
I20260709 13:05:14.889103 21683 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.879177 21997 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:14.925691 21965 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:14.972787 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:14.925063 21957 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:14.937856 21818 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:14.979153 15363 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:14.914745 22126 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:14.956647 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 233013us
W20260709 13:05:14.988682 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60184.6us
I20260709 13:05:14.946767 21192 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:14.938053 21721 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:14.962973 22032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.000s	sys 0.046s
I20260709 13:05:14.934582 22111 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:14.999691 15317 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:05:14.952811 22065 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:14.975566 21889 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:15.004757 15394 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:14.996127 21957 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:14.993528 22063 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.993302 22076 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.996315 22125 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:15.020638 15399 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:15.033811 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 323182us
I20260709 13:05:14.993024 22116 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:05:15.045655 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3463) took 1047 ms. Trace:
I20260709 13:05:15.046211 15323 rpcz_store.cc:276] 0709 13:05:13.997904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.250977 (+253073us) service_pool.cc:224] Handling call
0709 13:05:15.045406 (+794429us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b540021a2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:15.045580 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14828416}
I20260709 13:05:15.049691 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:15.069931 16027 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:05:15.055527 22142 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:05:15.013574 21925 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:05:15.037573 22125 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:15.039399 22111 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.032826 22152 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22.
W20260709 13:05:15.076637 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 334532us
W20260709 13:05:15.084692 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.055761 22148 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:15.158674 22148 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:15.159150 22148 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:15.070456 22146 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:05:15.162559 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:15.158849 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:15.037106 22076 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.039650 22063 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.069628 22158 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:15.074357 21989 raft_consensus.cc:3055] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:15.123504 22067 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:15.156188 22125 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:15.192533 22131 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:15.187587 21998 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:15.207298 15321 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:05:15.209597 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 230514us
I20260709 13:05:15.193377 21989 raft_consensus.cc:740] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:15.071717 21965 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.220600 16031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 1010) took 1342 ms. Trace:
I20260709 13:05:15.166270 22111 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.205273 21998 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:15.221210 16031 rpcz_store.cc:276] 0709 13:05:13.877811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.878621 (+   810us) service_pool.cc:224] Handling call
0709 13:05:13.879045 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.879519 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.879560 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.880138 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:05:14.480798 (+600660us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b18004a40a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:05:14.748111 (+267313us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:14.748166 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.748269 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:15.213170 (+464901us) raft_consensus.cc:1685] finished
0709 13:05:15.213192 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:15.220505 (+  7313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5021,"raft.queue_time_us":92,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":118,"spinlock_wait_cycles":55081856,"thread_start_us":267093,"threads_started":1,"wal-append.queue_time_us":1018699}
I20260709 13:05:15.160535 21721 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.215966 21579 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:05:15.221020 21924 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.002s
W20260709 13:05:15.262075 22150 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:05:15.221592 21771 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.262935 22063 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:15.263466 22167 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:05:15.264149 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51189.8us
I20260709 13:05:15.223759 22158 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:15.229764 21914 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:15.266491 21997 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:15.262583 22126 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:15.260334 21954 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:15.296487 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:15.296723 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:15.297420 15393 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
W20260709 13:05:15.380980 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 88670.1us
I20260709 13:05:15.270546 21683 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:15.291790 21889 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:15.286149 21579 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:15.386610 22145 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:05:15.414968 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:15.445990 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:15.446336 15393 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:15.448310 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:15.448518 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 445307us
I20260709 13:05:15.285145 21924 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.262131 21989 consensus_queue.cc:260] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.454248 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:15.406948 22151 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.350s	user 0.000s	sys 0.001s
I20260709 13:05:15.294247 21771 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:15.462991 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 413347us
W20260709 13:05:15.407982 22147 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.379s	user 0.001s	sys 0.001s
I20260709 13:05:15.472937 15323 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:15.421113 21871 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:15.477828 15244 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.006s	sys 0.008s
W20260709 13:05:15.485321 15244 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.006s	sys 0.009s
I20260709 13:05:15.442667 22067 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:15.489523 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.499305 15393 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:15.380724 22158 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.507282 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3460) took 1577 ms. Trace:
I20260709 13:05:15.415341 22159 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.105s
I20260709 13:05:15.412103 21998 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.475670 22174 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.489289 21989 raft_consensus.cc:3060] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:15.500406 21997 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:15.544729 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 52213us
I20260709 13:05:15.512833 22126 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:15.515022 21914 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:15.533787 22151 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:15.533761 22076 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:15.516443 15322 rpcz_store.cc:276] 0709 13:05:13.929473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.728501 (+799028us) service_pool.cc:224] Handling call
0709 13:05:14.728753 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.728948 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:14.729269 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 13:05:15.477526 (+748257us) log.cc:844] Serialized 14 byte log entry
0709 13:05:15.506752 (+ 29226us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:15.506839 (+    87us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:15.506912 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.507014 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:15.507195 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80018,"prepare.queue_time_us":172331,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":172466,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":33309,"thread_start_us":696353,"threads_started":3,"wal-append.queue_time_us":558267}
W20260709 13:05:15.556299 21916 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.828s	user 0.006s	sys 0.006s
I20260709 13:05:15.554587 21924 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:15.556234 15320 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:15.586483 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2244) took 1113 ms. Trace:
I20260709 13:05:15.578931 16024 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:15.553067 21997 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.487480 21889 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.587011 15320 rpcz_store.cc:276] 0709 13:05:14.473272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.555724 (+1082452us) service_pool.cc:224] Handling call
0709 13:05:15.556061 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.586106 (+ 30045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.586406 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:15.585806 21916 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.511920 15215 leader_election.cc:400] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:15.594265 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 968) took 1110 ms. Trace:
W20260709 13:05:15.636125 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 124420us
I20260709 13:05:15.640090 15322 rpcz_store.cc:276] 0709 13:05:14.483530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.581903 (+1098373us) service_pool.cc:224] Handling call
0709 13:05:15.584489 (+  2586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.585433 (+   944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:15.588735 (+  3302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:15.589010 (+   275us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:15.589417 (+   407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.589813 (+   396us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:15.593864 (+  4051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:15.564545 21914 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.527732 21579 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.546614 22174 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.657431 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3470) took 1061 ms. Trace:
I20260709 13:05:15.583276 21804 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:15.662673 16027 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:15.559814 22126 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.659659 15320 rpcz_store.cc:276] 0709 13:05:14.596360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.652747 (+1056387us) service_pool.cc:224] Handling call
0709 13:05:15.656427 (+  3680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.656869 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:15.656950 (+    81us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:15.657020 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:15.657082 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.657161 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:15.657350 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:15.599336 22172 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:15.658420 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:15.598771 22171 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:05:15.653801 15322 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:15.591677 22196 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:15.670200 15395 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:15.673461 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3471) took 1070 ms. Trace:
I20260709 13:05:15.673579 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:15.659350 22169 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:05:15.675732 15397 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:05:15.663863 22153 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:05:15.702521 15397 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:15.677302 15322 rpcz_store.cc:276] 0709 13:05:14.603248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.652895 (+1049647us) service_pool.cc:224] Handling call
0709 13:05:15.653471 (+   576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.672484 (+ 19013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.673302 (+   818us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:15.702103 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:15.674521 21683 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:15.733816 15397 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:15.715262 15320 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:15.674450 21677 consensus_meta.cc:287] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.929s	user 0.011s	sys 0.002s
I20260709 13:05:15.704659 22165 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.663329 22009 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:05:15.712126 22161 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:15.757339 21940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.012s	sys 0.027s
I20260709 13:05:15.701968 22111 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:15.706455 22196 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.784675 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 965) took 1573 ms. Trace:
I20260709 13:05:15.784809 22050 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:15.746212 22036 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:15.767511 22171 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:05:15.790648 22016 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.226s	user 0.011s	sys 0.003s
W20260709 13:05:15.791644 22183 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
W20260709 13:05:15.792279 22141 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.167s	user 0.009s	sys 0.002s
I20260709 13:05:15.595110 22067 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.794636 22138 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:15.836434 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.866355 15316 rpcz_store.cc:276] 0709 13:05:14.211559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.891281 (+679722us) service_pool.cc:224] Handling call
0709 13:05:14.891662 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:14.938052 (+ 46390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.938087 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:14.950578 (+ 12491us) log.cc:844] Serialized 52 byte log entry
0709 13:05:15.212554 (+261976us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:15.278272 (+ 65718us) log.cc:844] Serialized 14 byte log entry
0709 13:05:15.294656 (+ 16384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.294917 (+   261us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:15.784393 (+489476us) raft_consensus.cc:1685] finished
0709 13:05:15.784420 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:15.784604 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37684,"prepare.queue_time_us":66189,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":44660,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":98990,"thread_start_us":212947,"threads_started":1,"wal-append.queue_time_us":483937}
I20260709 13:05:15.767733 22032 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:05:15.868497 22036 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:15.869609 21997 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:15.674496 22187 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.115s
I20260709 13:05:15.870507 22036 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.763443 22160 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:05:15.845777 22126 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:15.871815 22143 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.011s	user 0.001s	sys 0.001s
I20260709 13:05:15.875981 22174 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:15.844221 22186 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:15.839790 22203 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:15.877869 15324 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:05:15.700765 21804 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:15.798601 22148 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.002s
W20260709 13:05:15.837533 21957 consensus_meta.cc:287] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.798s	user 0.006s	sys 0.003s
W20260709 13:05:15.868664 22065 consensus_meta.cc:287] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.834s	user 0.011s	sys 0.000s
W20260709 13:05:15.882812 21818 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.856s	user 0.000s	sys 0.013s
W20260709 13:05:15.845342 22125 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.000s
W20260709 13:05:15.946327 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 202609us
I20260709 13:05:15.775215 21677 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:15.918370 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 149805us
W20260709 13:05:15.842785 22189 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:05:15.878710 22084 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.882s	user 0.008s	sys 0.001s
I20260709 13:05:15.956985 22194 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:15.843101 22197 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:05:15.789273 22201 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:15.961510 22157 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.842527 21771 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:15.957818 22194 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.957250 22084 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:15.968473 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.962656 22157 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.962952 22160 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:15.969650 15396 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:15.970906 22157 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:15.785404 22165 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:15.973723 15998 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.979s (SENT) [suppressed 15 similar messages]
I20260709 13:05:15.967862 22194 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:15.977005 22160 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.962126 22201 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:15.986204 22084 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:15.988353 22160 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:15.799767 22161 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:15.805035 21940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.012s	sys 0.028s
I20260709 13:05:16.016342 15393 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
W20260709 13:05:16.004240 15244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.026s	sys 0.035s
W20260709 13:05:16.016923 15244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.026s	sys 0.036s
I20260709 13:05:16.017724 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3062) took 1161 ms. Trace:
W20260709 13:05:15.946689 21966 consensus_meta.cc:287] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.107s	user 0.014s	sys 0.000s
I20260709 13:05:15.963567 22148 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.942937 22126 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.939055 21914 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.032390 15325 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:05:16.042378 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 68677.1us
I20260709 13:05:15.898806 22016 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.910842 22203 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.016748 22161 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:16.017855 22158 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:15.912758 22186 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:15.948449 21957 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.951671 21818 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:15.952330 22065 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.016530 22160 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
W20260709 13:05:16.236663 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 173817us
I20260709 13:05:16.011186 22125 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.248883 15390 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:16.063751 22067 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:16.117195 21916 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:16.144687 22157 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:16.277443 15391 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:16.035964 21965 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.166203 21771 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:16.303110 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 421479us
I20260709 13:05:16.304982 15316 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:16.310005 15316 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:05:16.239075 22194 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:16.239564 22138 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:16.315222 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:16.322804 15322 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:16.043061 22126 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.316540 15320 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:16.277616 22110 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:16.331777 22198 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:16.343935 22198 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.350162 22198 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:16.367296 16028 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:16.293099 22050 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:16.301168 22180 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:16.387993 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44988.5us
I20260709 13:05:16.392561 22165 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.062382 22201 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.393934 22201 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:16.396104 22148 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.396749 22148 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:16.397228 22148 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.310647 21965 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.329818 22194 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.403208 22194 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.317620 21771 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.404045 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3461) took 2455 ms. Trace:
I20260709 13:05:16.405612 21771 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.293876 22157 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.279348 22067 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.381662 22110 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.333406 22138 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.427014 15245 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:05:16.420688 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.425992 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:16.420555 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3523) took 1647 ms. Trace:
I20260709 13:05:16.418350 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 994) took 1535 ms. Trace:
I20260709 13:05:16.419899 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3522) took 1650 ms. Trace:
I20260709 13:05:16.431592 15395 rpcz_store.cc:276] 0709 13:05:14.882575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.884085 (+  1510us) service_pool.cc:224] Handling call
0709 13:05:14.901345 (+ 17260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.677048 (+775703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.418008 (+740960us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54003cc154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:16.418268 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1767768320}
I20260709 13:05:16.404467 15319 rpcz_store.cc:276] 0709 13:05:13.948783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.742090 (+793307us) service_pool.cc:224] Handling call
0709 13:05:14.763820 (+ 21730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:14.784289 (+ 20469us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:14.784323 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:15.787024 (+1002701us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b2c0012b498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:05:15.802430 (+ 15406us) log.cc:844] Serialized 26 byte log entry
0709 13:05:16.024787 (+222357us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:16.024823 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.024893 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:16.403763 (+378870us) raft_consensus.cc:1685] finished
0709 13:05:16.403785 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.403986 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":412,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":16962,"spinlock_wait_cycles":6194944,"thread_start_us":186224,"threads_started":1,"wal-append.queue_time_us":503447}
I20260709 13:05:16.432462 15394 rpcz_store.cc:276] 0709 13:05:14.769431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.769547 (+   116us) service_pool.cc:224] Handling call
0709 13:05:16.419751 (+1650204us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400026cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:16.419850 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279894912}
I20260709 13:05:16.435143 15396 rpcz_store.cc:276] 0709 13:05:14.773494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.773615 (+   121us) service_pool.cc:224] Handling call
0709 13:05:14.773912 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.971870 (+1197958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.420329 (+448459us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540009bad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:16.420498 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2749378432}
I20260709 13:05:16.387770 15322 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:16.311347 22084 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:16.436803 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:16.430064 15247 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:16.423250 22213 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:05:16.414044 21957 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.408957 21818 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.443498 21818 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:16.444029 21818 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.444643 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:16.445562 15248 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:16.408023 22065 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.411628 22126 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:16.413147 22157 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:16.410727 21192 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.398s	user 0.013s	sys 0.000s
I20260709 13:05:16.418673 22138 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.447582 21192 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.416857 22110 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.450872 22084 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.414981 22050 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.452495 15246 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:16.453289 22050 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.453760 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3468) took 2040 ms. Trace:
I20260709 13:05:16.454140 15321 rpcz_store.cc:276] 0709 13:05:14.413858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.997784 (+583926us) service_pool.cc:224] Handling call
0709 13:05:15.015629 (+ 17845us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.207738 (+192109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.453526 (+1245788us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54001c61d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:16.453683 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439622016}
I20260709 13:05:16.462587 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:16.463399 15246 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:16.459033 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:16.469177 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:16.472249 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:16.480700 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:16.481539 15241 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:05:16.413154 22125 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.406543 21804 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.406806 21677 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.406204 21771 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.494616 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:16.416723 22067 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.498380 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:16.412289 22016 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.510291 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:16.444823 22165 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:16.468775 22050 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:16.434553 22180 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.450156 21192 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.456658 21818 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.525893 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:16.468477 22138 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.520588 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.547525 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:16.419036 22083 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:05:16.472749 22110 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.536494 15246 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:16.460371 22194 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:16.519544 21989 consensus_meta.cc:287] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.970s	user 0.006s	sys 0.006s
I20260709 13:05:16.525933 22215 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:16.577096 22214 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:05:16.578967 22084 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:16.580019 22210 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 13:05:16.582314 22194 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.584457 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.586422 22110 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.588558 22209 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:16.589203 22209 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.588801 22110 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.590588 22219 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:16.591286 16031 raft_consensus.cc:1275] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:16.591806 22219 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:16.592247 22219 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:16.592537 22215 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.593242 22219 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.586125 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:16.595036 21947 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:16.595445 15395 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:16.596621 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:16.597647 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.592195 21995 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:16.461333 22202 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.107s
I20260709 13:05:16.535619 21966 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:16.538290 21677 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.538546 22125 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:16.620239 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 91377us
W20260709 13:05:16.622943 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:16.623847 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 91263.5us
I20260709 13:05:16.598057 22203 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:16.602747 21995 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:16.591837 21954 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:16.636742 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:16.630837 15213 connection.cc:256] RPC call timeout handler was delayed by -1.033470493999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260709 13:05:16.616200 22219 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:16.641991 15213 leader_election.cc:400] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17.
I20260709 13:05:16.537829 21771 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.548259 22050 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.544370 22165 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.618522 22196 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.646559 21804 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:16.573873 22138 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.634413 21683 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.643364 21954 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:16.630550 22126 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:05:16.635344 22055 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:16.657925 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:16.638521 22157 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:16.628032 22125 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.618319 21966 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.712509 21966 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:16.717073 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:16.717749 15397 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.719296 22180 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:16.722046 15324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2240) took 2250 ms (client timeout 2089 ms). Trace:
W20260709 13:05:16.722517 15324 rpcz_store.cc:269] 0709 13:05:14.471986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.494707 (+ 22721us) service_pool.cc:224] Handling call
0709 13:05:16.721806 (+2227099us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400374954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:16.721944 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3161592704}
I20260709 13:05:16.723470 22084 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:16.723964 22084 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.724313 22084 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:16.724402 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3456) took 2835 ms. Trace:
I20260709 13:05:16.724800 15317 rpcz_store.cc:276] 0709 13:05:13.889029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.650835 (+761806us) service_pool.cc:224] Handling call
0709 13:05:14.651233 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:15.011387 (+360154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.724119 (+1712732us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54003e30d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:16.724325 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800684928}
I20260709 13:05:16.670257 15245 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
W20260709 13:05:16.726835 22217 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:05:16.673700 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.728860 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.729710 21804 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:16.730607 21804 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:16.731420 21804 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.732435 22157 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.018126 15244 rpcz_store.cc:276] 0709 13:05:14.856321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.856637 (+   316us) service_pool.cc:224] Handling call
0709 13:05:14.886452 (+ 29815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.886709 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:05:15.485785 (+599076us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.017390 (+531605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:16.017448 (+    58us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:16.017489 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.017547 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.017671 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60812,"prepare.queue_time_us":390266,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":7166,"raft.queue_time_us":98,"thread_start_us":1072110,"threads_started":2}
I20260709 13:05:16.734599 22157 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.659425 22186 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:16.666186 22148 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:16.674255 22156 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:16.735905 22156 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:16.736513 22152 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:16.736914 22152 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:16.736830 22156 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:16.739197 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.680218 22055 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.741794 22055 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.695474 22215 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:16.696743 22209 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:16.669700 21683 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.743711 21965 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:16.744712 21683 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:16.745206 15325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2249) took 2071 ms (client timeout 2131 ms). Trace:
W20260709 13:05:16.745645 15325 rpcz_store.cc:269] 0709 13:05:14.674327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.687697 (+ 13370us) service_pool.cc:224] Handling call
0709 13:05:16.745000 (+2057303us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54004047d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:16.745144 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3089773312}
I20260709 13:05:16.747746 22165 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.691500 22050 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.706856 21995 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.750691 21995 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:16.753933 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 997) took 1801 ms. Trace:
I20260709 13:05:16.754371 15390 rpcz_store.cc:276] 0709 13:05:14.952838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.953016 (+   178us) service_pool.cc:224] Handling call
0709 13:05:14.953371 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.264146 (+1310775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.753654 (+489508us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54001955d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:16.753867 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2963519872}
I20260709 13:05:16.707477 22138 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.627852 21677 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.759617 21677 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.700565 21771 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.760322 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 998) took 1780 ms. Trace:
I20260709 13:05:16.760744 15391 rpcz_store.cc:276] 0709 13:05:14.979571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.987509 (+  7938us) service_pool.cc:224] Handling call
0709 13:05:14.987905 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.277990 (+1290085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.760090 (+482100us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54000c0154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:16.760263 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2965093248}
I20260709 13:05:16.766989 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:16.769745 22133 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.773365 16024 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:16.774910 15250 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:16.775295 15250 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:16.775997 15250 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.776855 15250 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:16.780773 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:16.782733 15247 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:16.678100 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:16.785744 15397 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:05:16.786362 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.786690 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:16.787039 15395 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:16.787237 15397 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:16.787659 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 109643us
I20260709 13:05:16.787914 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.738039 22156 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:16.790696 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:16.793699 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:16.792706 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:16.788560 15395 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:16.820008 15397 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
W20260709 13:05:16.821873 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.810268 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:16.836906 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.851116 15397 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
W20260709 13:05:16.796077 22161 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.002s
I20260709 13:05:16.861646 15250 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:05:16.748521 22125 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:16.807523 22165 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:16.798890 21951 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:05:16.737854 22152 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.881891 22152 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:16.864029 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:16.863186 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.864951 21966 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:16.870630 21947 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:05:16.880817 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.797159 22185 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:16.895732 22222 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:05:16.906544 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.807210 22186 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 13:05:16.883492 22165 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.907445 15397 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:16.863564 22203 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:16.896549 21966 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.917155 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.924518 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.925144 15397 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:16.925942 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:16.926638 15398 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:16.927007 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.927143 22200 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.795085 22209 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:05:16.927738 22200 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:16.895565 22124 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:16.929042 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 286202us
I20260709 13:05:16.929270 22124 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:16.929718 22124 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:16.928882 22126 consensus_queue.cc:1048] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:16.927760 15397 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:16.933637 21683 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:16.927182 15215 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:16.934628 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:16.935478 21951 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:16.936040 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:16.936404 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:16.935779 21818 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:16.937553 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:16.937834 22065 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:16.938154 21818 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:16.939688 22065 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:16.936424 21951 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.940301 22065 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:16.940424 21951 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:16.938884 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:16.939731 21818 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:16.944150 21683 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:16.944555 21683 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:16.944921 21683 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:16.945144 15325 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:16.947321 21818 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.948585 21818 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:16.951159 15325 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:16.953090 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:16.953688 15325 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:16.957530 22133 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.958678 22133 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.960857 15317 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:16.961329 21771 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.960922 22133 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.962193 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:16.961819 21771 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.964521 21771 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.969136 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:16.969822 15317 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:16.970607 21951 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.971894 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:16.935238 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:16.979809 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44645.4us
I20260709 13:05:16.866252 22161 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:16.982980 15321 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:16.916554 22125 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.918128 22165 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:16.999646 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.012202 15321 raft_consensus.cc:2410] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:05:16.980847 21966 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:16.974191 21683 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.022135 21683 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:16.984426 22071 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:16.978552 15317 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:16.977027 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:16.978732 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:17.029652 15324 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:16.976295 15325 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:17.037694 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3534) took 1634 ms. Trace:
W20260709 13:05:17.037566 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54370.3us
I20260709 13:05:17.038357 15393 rpcz_store.cc:276] 0709 13:05:15.403049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.515862 (+112813us) service_pool.cc:224] Handling call
0709 13:05:15.518855 (+  2993us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.016852 (+497997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.037401 (+1020549us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54001da954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:17.037625 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143603968}
I20260709 13:05:17.041556 22055 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:17.043566 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.009454 22160 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:16.977975 21771 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:17.045002 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:17.042089 22055 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:17.062602 21818 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:17.063759 21818 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:17.064864 21818 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:17.065748 21818 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.068039 21818 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:17.071748 22161 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:17.015501 22125 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.075659 22055 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.076831 22125 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:17.077139 22055 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:16.981801 22203 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.079272 15320 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:17.080972 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:17.081913 15393 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:17.030915 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52263.8us
I20260709 13:05:17.042681 22133 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:17.069654 21954 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.109071 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:17.046747 22160 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:17.115749 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 443571us
W20260709 13:05:17.121640 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.132776 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:17.151755 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.134789 22124 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:17.107364 21889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.032s	sys 0.054s
W20260709 13:05:17.140589 15216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.020s	sys 0.055s
W20260709 13:05:17.159847 15216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.020s	sys 0.055s
I20260709 13:05:17.148938 15393 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
W20260709 13:05:17.138983 22046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.489s	user 0.016s	sys 0.029s
I20260709 13:05:17.162051 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:17.195206 15325 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:17.197288 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:17.198088 15393 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:17.085790 21683 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:05:17.209463 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.210723 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.107160 21940 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:05:17.148761 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:17.160897 21889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.032s	sys 0.055s
I20260709 13:05:17.211649 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:17.192428 22046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.543s	user 0.016s	sys 0.029s
I20260709 13:05:17.159412 22133 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:17.204276 22084 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.218770 15246 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:17.221060 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:17.212419 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 63762.4us
I20260709 13:05:17.192606 22208 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.227026 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:17.227698 15325 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:05:17.228150 15325 pending_rounds.cc:85] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 10
I20260709 13:05:17.228371 15325 pending_rounds.cc:107] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:05:17.228603 15325 raft_consensus.cc:2889] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:17.205112 22163 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.230312 15397 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:17.233695 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3464) took 3208 ms. Trace:
I20260709 13:05:17.220512 15393 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:17.235149 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3531) took 2384 ms. Trace:
I20260709 13:05:17.234145 15318 rpcz_store.cc:276] 0709 13:05:14.018006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.783149 (+765143us) service_pool.cc:224] Handling call
0709 13:05:14.783449 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.793645 (+ 10196us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:14.830491 (+ 36846us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.905949 (+2075458us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b180048dd20. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:05:17.226332 (+320383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:17.226393 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:17.226433 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.226565 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.226673 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36554,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":8853,"raft.queue_time_us":92,"spinlock_wait_cycles":89914624,"thread_start_us":320139,"threads_started":1}
I20260709 13:05:17.235548 15399 rpcz_store.cc:276] 0709 13:05:14.847308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.847591 (+   283us) service_pool.cc:224] Handling call
0709 13:05:14.847929 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.037366 (+189437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.230636 (+2193270us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001540d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:17.230832 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396577152}
I20260709 13:05:17.224387 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:17.224010 22219 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.004s
I20260709 13:05:17.223480 21579 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:17.237249 22230 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:17.218829 22133 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.213176 22126 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:17.237236 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:17.222837 21954 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:17.240419 21771 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:17.247502 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.227775 22187 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:17.251107 22185 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:17.235980 22224 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:17.234778 21951 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:17.255090 22203 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:17.238330 15399 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:17.219496 22228 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:05:17.276775 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.230209 22160 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.320374 15318 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:17.222934 22208 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.325809 15399 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:17.326437 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.328747 15318 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:17.331224 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.273497 22133 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:17.278855 22230 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:17.337005 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.337927 22230 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.339604 22160 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:17.280670 22180 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:17.341650 22180 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.280686 21889 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:17.342607 21889 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.343945 22180 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:17.280436 21771 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:17.347637 21889 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:17.327600 21966 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.351289 22208 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:17.281069 22187 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:17.385522 15318 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:17.387427 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:17.279094 22125 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:17.391706 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:17.391985 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 69428.4us
I20260709 13:05:17.392525 15318 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:17.280509 22165 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.396937 15247 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:17.238945 22163 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.276611 21579 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.350142 22071 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:17.383157 21771 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:17.404842 15399 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:17.407006 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:17.410398 15317 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:17.404596 22226 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:05:17.329532 22224 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.411832 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:17.416843 15324 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:17.414034 15318 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:17.279371 22126 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.333004 22065 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.402026 22125 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:05:17.411767 22152 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.009s
I20260709 13:05:17.424778 21965 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.421211 21966 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:17.453542 22084 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:17.456403 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:17.457564 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.444393 22163 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:17.444399 22165 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:17.446879 21965 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.461462 22152 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.432896 22187 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.489950 22187 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:17.490793 22228 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:17.494421 22228 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:17.531378 22237 log.cc:927] Time spent T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:05:17.533244 22235 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:05:17.535084 22233 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:05:17.539485 22194 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:17.543989 22200 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:17.547138 22224 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:17.548144 22222 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:17.548764 22222 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:17.549989 22222 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:17.597891 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.601071 15241 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
W20260709 13:05:17.423038 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 261085us
W20260709 13:05:17.609607 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.612946 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:17.616322 15242 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:05:17.616779 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.618127 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.619274 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.622460 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:17.622478 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.623556 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.627995 15250 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 21: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:17.627894 15242 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:17.628338 15289 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:17.631515 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:17.633463 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 358073us
I20260709 13:05:17.623008 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.647867 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.649058 15316 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:17.650643 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.652001 15316 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:17.653014 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.654539 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.656288 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:17.656977 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.658389 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.657752 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:17.658795 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:17.660010 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.660298 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.662325 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.701107 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:17.720503 22116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.649s	user 0.023s	sys 0.037s
I20260709 13:05:17.725020 15321 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 13:05:17.726414 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 86786.2us
W20260709 13:05:17.727998 22116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.659s	user 0.024s	sys 0.037s
I20260709 13:05:17.751796 15250 raft_consensus.cc:2368] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18.
I20260709 13:05:17.752465 15249 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:17.756781 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:17.758441 15317 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:17.759248 22063 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:17.760921 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.760473 22063 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.762385 15250 raft_consensus.cc:2393] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:17.762751 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.763738 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.764480 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.765715 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.489092 22152 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.765715 15321 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 16: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:17.764678 15250 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
W20260709 13:05:17.772840 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 141655us
I20260709 13:05:17.484586 22124 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:17.774384 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:17.775439 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.776888 15319 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:17.778451 22194 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:17.479951 22125 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.780797 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:17.782183 15391 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:17.806807 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.781941 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:17.814843 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.833412 15246 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:17.817353 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:17.792790 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.797075 15322 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:17.775468 15325 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:17.809518 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.839893 15249 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:17.840350 22207 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:17.841257 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.783493 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:17.815932 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:17.843227 15392 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:17.815114 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:17.844120 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2951) took 1368 ms. Trace:
I20260709 13:05:17.807565 21579 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:17.820760 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:17.786724 22241 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:05:17.796643 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3542) took 1840 ms. Trace:
I20260709 13:05:17.812451 22190 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.847383 22201 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:17.848007 22190 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.848665 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.848462 22201 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.787029 22126 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:17.850373 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.850804 15319 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:17.804611 21965 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:17.844682 15392 rpcz_store.cc:276] 0709 13:05:16.475834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.756214 (+280380us) service_pool.cc:224] Handling call
0709 13:05:17.783010 (+1026796us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:05:17.843984 (+ 60974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77293824}
I20260709 13:05:17.855261 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:17.887820 15321 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:17.856765 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2953) took 1353 ms. Trace:
I20260709 13:05:17.809737 15362 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:17.889298 15391 rpcz_store.cc:276] 0709 13:05:16.476389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.761708 (+285319us) service_pool.cc:224] Handling call
0709 13:05:17.780261 (+1018553us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:05:17.829811 (+ 49550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64743168}
I20260709 13:05:17.894286 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.894829 15396 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:17.895357 15321 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:17.896552 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:17.897317 15321 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:17.792416 22163 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.899296 22163 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:17.900928 15248 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:17.794911 22071 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.795948 22245 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.923617 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:17.922866 15319 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:17.789333 21940 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.800087 22065 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:17.927863 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.805073 22242 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:05:17.854329 22160 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.003s
I20260709 13:05:17.782351 21683 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:17.929518 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 194339us
W20260709 13:05:17.934417 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 152845us
I20260709 13:05:17.811380 22228 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.114s
I20260709 13:05:17.935866 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:17.804764 22224 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:17.783521 22238 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.156s
I20260709 13:05:17.951373 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.901834 22194 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:17.954002 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:17.944319 22242 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:17.965132 22152 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:17.966336 22190 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:17.967037 22250 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
W20260709 13:05:17.969712 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.847234 15395 rpcz_store.cc:276] 0709 13:05:15.955555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.806696 (+851141us) service_pool.cc:224] Handling call
0709 13:05:16.807129 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.846586 (+ 39457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.846617 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.847113 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.265757 (+418644us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:17.265800 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.265874 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.730612 (+464738us) raft_consensus.cc:1685] finished
0709 13:05:17.733390 (+  2778us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.796328 (+ 62938us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51970,"raft.queue_time_us":41105,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":418359,"threads_started":1,"wal-append.queue_time_us":587931}
I20260709 13:05:17.972728 22063 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:17.973305 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:17.974115 15391 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:17.977258 22055 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.899s	user 0.010s	sys 0.009s
W20260709 13:05:17.982402 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 82546.4us
I20260709 13:05:17.984656 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:17.985818 16031 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:17.986143 22163 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:17.987603 22194 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.991027 22201 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:17.991858 15319 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:17.991895 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:17.989936 22231 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:17.993131 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:17.993288 22231 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:17.994076 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 82720us
W20260709 13:05:17.994800 15324 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.002s
I20260709 13:05:17.994558 22231 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:17.995226 15324 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:17.996480 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:17.997532 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:17.997884 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:17.998458 15395 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:17.998811 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:17.999548 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:17.999742 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.000314 15395 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:18.000473 16027 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:05:18.001309 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:18.001560 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:18.002300 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:18.003247 16024 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:18.004655 16027 raft_consensus.cc:2410] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:05:18.005493 22231 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:18.006577 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1061) took 1269 ms. Trace:
I20260709 13:05:18.006975 16028 rpcz_store.cc:276] 0709 13:05:16.622833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.623389 (+   556us) service_pool.cc:224] Handling call
0709 13:05:16.635748 (+ 12359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.650648 (+ 14900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.650686 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.651195 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.136820 (+485625us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:17.136882 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.137069 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.731262 (+594193us) raft_consensus.cc:1685] finished
0709 13:05:17.733025 (+  1763us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.891811 (+158786us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111660,"raft.queue_time_us":9041,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":2248,"thread_start_us":457597,"threads_started":1,"wal-append.queue_time_us":784834}
I20260709 13:05:18.011703 22245 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.016758 22124 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:05:18.020083 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 210734us
I20260709 13:05:17.993927 15319 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:18.021104 22071 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.022059 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.023047 15319 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:18.024266 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.025164 15319 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:18.027294 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.028086 15317 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:18.032346 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:18.037271 15392 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:18.038193 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:18.021106 22124 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:18.039069 22124 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.039479 22124 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:18.039876 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:18.040670 16025 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:18.046754 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.047380 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2239) took 3575 ms. Trace:
I20260709 13:05:18.047811 15394 raft_consensus.cc:2410] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:05:18.048610 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.048848 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:18.049572 15390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2959) took 1552 ms (client timeout 2042 ms). Trace:
W20260709 13:05:18.050007 15390 rpcz_store.cc:269] 0709 13:05:16.498366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.755255 (+256889us) service_pool.cc:224] Handling call
0709 13:05:18.048213 (+1292958us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:05:18.049512 (+  1299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79139584}
I20260709 13:05:18.023073 21940 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.051270 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.025508 21916 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:18.052779 21940 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:18.052881 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:18.053818 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3557) took 1135 ms. Trace:
I20260709 13:05:18.047681 22071 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:18.052783 22123 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:18.054939 22123 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:18.054706 22208 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:18.054003 15392 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 23: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:18.047851 15323 rpcz_store.cc:276] 0709 13:05:14.471699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.047500 (+575801us) service_pool.cc:224] Handling call
0709 13:05:15.061815 (+ 14315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.479238 (+417423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.046866 (+2567628us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400085054. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:18.047171 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945011456}
I20260709 13:05:18.055853 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.074976 15325 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 13:05:18.075700 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 105089us
I20260709 13:05:18.054366 15393 rpcz_store.cc:276] 0709 13:05:16.898655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.277173 (+378518us) service_pool.cc:224] Handling call
0709 13:05:17.277501 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.279268 (+  1767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.279300 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.326580 (+ 47280us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.736118 (+409538us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:17.736244 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.736438 (+   194us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.952636 (+216198us) raft_consensus.cc:1685] finished
0709 13:05:17.952655 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.033574 (+ 80919us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71281,"raft.queue_time_us":631,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":42596,"thread_start_us":328304,"threads_started":1,"wal-append.queue_time_us":477962}
I20260709 13:05:18.070516 21916 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:18.067595 22201 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:18.014168 22245 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:18.092198 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.090401 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.100018 15324 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:05:18.099407 15323 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:18.006345 21683 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.105650 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:18.103452 15321 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:05:18.104682 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.073287 22163 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:05:18.106405 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:18.113991 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:18.114675 15323 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:18.117686 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:18.118744 22161 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:05:18.119253 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:18.142306 15398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 995) took 3244 ms (client timeout 1979 ms). Trace:
I20260709 13:05:18.120110 21916 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.121188 21683 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:18.121670 21818 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.047s	user 0.009s	sys 0.009s
I20260709 13:05:18.122367 15322 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:18.124596 22187 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:18.126741 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.121196 22123 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:18.130664 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 146144us
I20260709 13:05:18.134677 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.135372 22163 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:18.137176 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.138664 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:18.117743 22242 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:18.139954 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58958.5us
I20260709 13:05:18.140229 15323 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:18.144177 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:18.105394 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:18.149482 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:18.150482 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.152128 15391 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:18.155241 15394 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
W20260709 13:05:18.148106 15398 rpcz_store.cc:269] 0709 13:05:14.898057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.898245 (+   188us) service_pool.cc:224] Handling call
0709 13:05:18.141881 (+3243636us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b54001545d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:18.142082 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4349424896}
I20260709 13:05:18.109620 15319 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.160121 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.160658 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.170475 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:18.171800 16027 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:18.174055 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:18.186290 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:18.187485 16029 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:05:18.188253 16031 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:18.191850 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:18.185968 15250 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:18.197907 15324 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:18.198609 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.160212 22116 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:18.201490 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:18.209306 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:18.167665 22163 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:05:18.211562 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 139033us
I20260709 13:05:18.211149 15242 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:18.216869 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:18.217572 15324 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:18.218276 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:18.220970 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:18.220830 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68790.8us
I20260709 13:05:18.220752 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:18.222739 15322 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:05:18.252175 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.252983 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.210765 22123 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:18.251669 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:18.255861 15325 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:18.258026 21771 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.750s	user 0.004s	sys 0.009s
I20260709 13:05:18.258668 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:18.258860 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48138us
I20260709 13:05:18.259758 15396 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:18.261287 15396 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:18.262609 22245 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:18.263031 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:18.263696 15249 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:18.264575 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:18.265064 22156 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 1.413s	user 0.011s	sys 0.015s
I20260709 13:05:18.265518 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:18.194701 22063 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:18.214709 22201 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.267144 22256 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:05:18.268021 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.268805 15398 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
W20260709 13:05:18.268951 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 108951us
W20260709 13:05:18.270330 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 61924.1us
I20260709 13:05:18.270959 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:18.272197 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.272723 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:18.280400 16025 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
W20260709 13:05:18.282634 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 165085us
I20260709 13:05:18.209250 22187 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.286944 22187 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:18.287608 22187 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:18.287941 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1008) took 1361 ms. Trace:
I20260709 13:05:18.288323 15399 rpcz_store.cc:276] 0709 13:05:16.926690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.416216 (+489526us) service_pool.cc:224] Handling call
0709 13:05:17.416468 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:17.438918 (+ 22450us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:17.440300 (+  1382us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.973255 (+532955us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:17.973357 (+   102us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:17.973487 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.287542 (+314055us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b54002b5f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:18.287598 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.287764 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80099,"prepare.queue_time_us":1978,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2038,"raft.queue_time_us":80779,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":243,"spinlock_wait_cycles":50915584,"thread_start_us":438483,"threads_started":1,"wal-append.queue_time_us":428647}
I20260709 13:05:18.290468 22257 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:18.291980 22190 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:18.292410 22190 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:18.292529 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:18.293387 22190 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.258597 21771 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.295090 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.297251 15248 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:18.262979 15321 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:18.265144 15249 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:18.261969 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:18.314034 15319 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:18.258590 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:18.331961 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:18.334504 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 77547.2us
I20260709 13:05:18.335954 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:18.337196 15322 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:05:18.337425 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:18.339416 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:18.340277 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 252950us
W20260709 13:05:18.341131 15291 connection.cc:256] RPC call timeout handler was delayed by -1.0433322499999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260709 13:05:18.335983 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:18.348543 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.321382 22228 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.349177 15242 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 23: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:18.334589 22238 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:05:18.354601 22228 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.349735 15395 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:18.356717 21771 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:18.357736 15316 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:05:18.359169 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 97368.6us
I20260709 13:05:18.359953 22182 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.360208 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:18.362586 22247 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:18.362991 15247 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:18.267195 22201 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.364405 22124 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.366775 22201 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:18.359323 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3478) took 1406 ms. Trace:
I20260709 13:05:18.362778 22190 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:18.361909 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:18.369509 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:18.367411 15320 rpcz_store.cc:276] 0709 13:05:16.952747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.958317 (+  5570us) service_pool.cc:224] Handling call
0709 13:05:16.958716 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:17.079781 (+121065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.358782 (+1279001us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400374e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:18.359136 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276307712}
W20260709 13:05:18.388722 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53433.8us
W20260709 13:05:18.359210 22133 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.972s	user 0.011s	sys 0.011s
I20260709 13:05:18.391260 15322 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:18.373523 22238 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.410779 15290 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:18.401319 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.414377 15325 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:05:18.416381 15319 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:05:18.390374 22201 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:18.414827 15325 pending_rounds.cc:85] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 9
W20260709 13:05:18.420614 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.331776 22156 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260709 13:05:18.423231 15395 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:18.400574 22247 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:18.426179 15324 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:18.413676 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:18.428377 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.419023 15325 pending_rounds.cc:107] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:05:18.429355 15325 raft_consensus.cc:2889] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:18.429535 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 90251.3us
I20260709 13:05:18.434175 22139 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:18.434495 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.435438 15321 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:18.436482 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.438149 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:18.438433 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:18.431474 22124 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:18.439936 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:18.440240 22124 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:18.440465 22125 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:18.440696 22124 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.441011 22125 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.441224 22124 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:18.441512 22125 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:18.446708 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 146642us
I20260709 13:05:18.434732 22139 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.447609 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:18.447783 22139 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:18.448113 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:18.428305 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.433197 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:18.439133 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 182507us
W20260709 13:05:18.455361 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 123755us
I20260709 13:05:18.456000 15249 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:18.457806 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:18.463450 15319 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:18.396952 22238 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.465857 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.466852 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.470875 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.438622 21804 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:18.480185 15322 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:18.482443 15323 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:18.478788 22208 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:18.483559 22148 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:18.486330 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 124510us
I20260709 13:05:18.487187 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:18.487665 22055 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:18.488169 22055 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:18.489228 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:18.478796 15399 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:18.491252 15319 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:18.493054 22270 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:18.493446 22201 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:18.493875 22201 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:18.483075 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:18.494822 22201 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.496258 22201 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.496614 21965 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:18.497102 21965 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:18.497579 21965 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:18.497634 22247 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:18.458690 22224 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:05:18.410400 22133 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.451752 22116 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:18.507156 22224 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:05:18.510735 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60416.5us
I20260709 13:05:18.516326 15320 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
W20260709 13:05:18.517784 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 148069us
I20260709 13:05:18.518869 22133 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:18.519467 22032 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:18.520217 15318 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:05:18.477048 22063 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:18.522048 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:18.523257 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49438.4us
I20260709 13:05:18.473989 22242 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:18.498207 22247 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.480990 22256 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:18.614423 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:18.522140 22063 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.616439 15390 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:05:18.513902 22224 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:18.583407 22156 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:18.641866 22032 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:18.642681 15396 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:18.644331 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:18.646800 21981 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:05:18.642673 15397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3561) took 1718 ms (client timeout 2064 ms). Trace:
I20260709 13:05:18.647496 21981 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:18.648022 15397 rpcz_store.cc:269] 0709 13:05:16.924295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.937272 (+ 12977us) service_pool.cc:224] Handling call
0709 13:05:18.642196 (+1704924us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54001554d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:18.642486 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671080832}
I20260709 13:05:18.648882 21981 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.654373 15243 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:18.656069 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:18.613222 22256 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:18.605927 22208 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:18.645916 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 122581us
I20260709 13:05:18.609673 22247 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:18.513846 21818 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
W20260709 13:05:18.655712 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 133770us
I20260709 13:05:18.692030 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:18.706913 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 85386.8us
I20260709 13:05:18.628309 22063 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:18.707804 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:18.708374 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 52372.7us
W20260709 13:05:18.709570 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 204818us
I20260709 13:05:18.489279 22055 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.725049 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.726704 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.639164 22156 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:18.727766 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55736.1us
I20260709 13:05:18.667145 22256 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:18.734205 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:18.734786 22255 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:18.738219 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:18.740290 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 123206us
I20260709 13:05:18.744912 22016 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:18.746205 22209 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:18.746719 22209 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:18.747098 22209 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:18.748296 21998 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:18.751072 22252 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:18.751682 22252 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:18.752643 22157 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:18.754891 15398 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:18.706542 22159 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:18.763852 22159 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.721179 22187 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:18.761849 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46173.9us
I20260709 13:05:18.731212 22156 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:18.780042 22274 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:18.781308 22274 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:18.782083 22274 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:18.780817 15398 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:18.783108 15395 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:18.788177 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:18.766201 22159 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:18.800806 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:18.721769 22208 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.771591 22124 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.825325 22159 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:18.846740 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 85775.6us
I20260709 13:05:18.773715 22148 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
W20260709 13:05:18.849494 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:18.858978 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 242522us
I20260709 13:05:18.834808 22055 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:18.863771 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.865130 22252 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.866653 22252 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:18.870348 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 134583us
W20260709 13:05:18.870534 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 69846us
I20260709 13:05:18.849162 22123 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:18.832216 22139 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.878511 22123 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:18.923928 22272 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:18.924383 22268 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:05:18.924682 22273 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.925091 22165 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:05:18.926381 22067 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:18.933167 22139 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:18.937381 22125 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:18.938797 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54210.5us
I20260709 13:05:18.877173 22265 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:05:18.883258 22238 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:18.939707 22222 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.837037 22224 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.944984 22272 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.880249 22187 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:05:18.872437 22159 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:18.952245 15291 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:18.942529 22123 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:18.903010 22182 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.007s
I20260709 13:05:18.943832 22016 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:18.995695 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:18.972168 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:18.972394 22067 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.977661 22245 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.980058 21965 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:18.982982 21997 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:18.984153 22154 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.985015 22124 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:18.985164 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3500) took 1562 ms. Trace:
W20260709 13:05:18.969777 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 169440us
I20260709 13:05:19.008994 15246 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:18.974923 22228 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:18.987062 22272 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:19.016806 15318 rpcz_store.cc:276] 0709 13:05:17.423003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.423151 (+   148us) service_pool.cc:224] Handling call
0709 13:05:17.423566 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.520792 (+1097226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.984840 (+464048us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001c61d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:18.985100 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2521050496}
I20260709 13:05:18.974932 22209 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.030217 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.024838 22285 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:19.031368 22125 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.031323 22285 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.031761 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.007447 22182 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:19.011231 22224 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:19.024612 22154 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.033880 16028 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:19.024602 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.008460 22245 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:19.020133 22190 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.002s
I20260709 13:05:18.986285 22273 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.012611 21997 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:19.017091 22139 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:19.062248 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 90134.6us
I20260709 13:05:19.019591 22201 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:19.041657 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:19.040688 22228 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:19.079041 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 155563us
I20260709 13:05:19.079350 16026 raft_consensus.cc:2410] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:05:19.078950 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:19.073642 22279 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:05:19.067847 21997 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:19.029735 22156 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.073596 21771 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:19.073436 22125 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.080919 22165 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.104635 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.111711 16029 raft_consensus.cc:2410] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:05:19.074400 22208 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.095878 22238 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:19.114212 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.115056 16033 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:19.115447 22165 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.116084 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.116731 16033 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:19.117601 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:19.118474 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.092268 22187 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:19.118127 16033 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:19.007040 21981 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:19.117762 22165 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:19.078163 22256 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.130957 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:19.133270 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.087308 22228 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.158905 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:19.162451 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 47036.8us
I20260709 13:05:19.199442 15391 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:19.163537 22209 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:19.131472 22016 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.164539 15394 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:19.165562 22156 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.167496 22256 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.169094 22273 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.104848 22201 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.170296 22124 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:19.170977 22286 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:19.224967 22124 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:19.225140 22286 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.225551 22124 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:19.225716 22286 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:19.171137 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.174437 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.175011 21965 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:19.122650 22187 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:19.175323 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2255) took 1044 ms. Trace:
I20260709 13:05:19.176301 22291 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:19.177731 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:19.180001 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 163424us
W20260709 13:05:19.182322 22284 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:05:19.181913 22067 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:19.190689 15249 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:19.190761 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2967) took 1086 ms. Trace:
I20260709 13:05:19.190578 22247 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.097337 22274 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.246583 15213 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.134590 22125 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.162883 21981 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.160224 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.199380 16029 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:19.205572 15246 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:19.251828 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:19.252386 15246 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:19.207692 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:19.206296 15317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2282) took 1363 ms (client timeout 1589 ms). Trace:
I20260709 13:05:19.210983 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:19.215564 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:19.221580 22282 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:05:19.224386 22201 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.217129 22222 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:19.242980 15390 rpcz_store.cc:276] 0709 13:05:18.104681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.112166 (+  7485us) service_pool.cc:224] Handling call
0709 13:05:19.190522 (+1078356us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b54002b5a54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:19.190699 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023559040}
I20260709 13:05:19.243590 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:19.244114 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.244582 15398 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:19.236264 15247 rpcz_store.cc:276] 0709 13:05:18.130404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.363874 (+233470us) service_pool.cc:224] Handling call
0709 13:05:18.364247 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.391334 (+ 27087us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.391366 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.416215 (+ 24849us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.708656 (+292441us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:18.708704 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.708904 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.174997 (+466093us) raft_consensus.cc:1685] finished
0709 13:05:19.175031 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.175238 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23009,"raft.queue_time_us":27426,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":6131,"thread_start_us":280520,"threads_started":1,"wal-append.queue_time_us":424680}
I20260709 13:05:19.246258 22247 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:19.253283 15248 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:19.250020 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2263) took 1117 ms. Trace:
I20260709 13:05:19.264308 16033 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:19.249161 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:19.252949 15317 rpcz_store.cc:269] 0709 13:05:17.798073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.888612 (+ 90539us) service_pool.cc:224] Handling call
0709 13:05:19.143401 (+1254789us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b54002a7bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:19.161655 (+ 18254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228257536}
I20260709 13:05:19.261971 16027 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:19.266192 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:19.266435 22256 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:19.272611 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:19.273151 22124 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.274456 15249 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:19.276661 22125 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:19.276654 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:19.277457 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:19.278440 22228 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.277606 15247 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:19.237841 22187 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:19.279735 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.286399 15399 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:19.286732 16029 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:19.217662 22063 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.289841 15393 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:19.264415 15242 rpcz_store.cc:276] 0709 13:05:18.132919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.367851 (+234932us) service_pool.cc:224] Handling call
0709 13:05:18.397593 (+ 29742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.430920 (+ 33327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.430958 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.461886 (+ 30928us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.890059 (+428173us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:18.892210 (+  2151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.892445 (+   235us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.249813 (+357368us) raft_consensus.cc:1685] finished
0709 13:05:19.249834 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.249962 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1591,"raft.queue_time_us":2121,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5790,"thread_start_us":367118,"threads_started":1,"wal-append.queue_time_us":467751}
I20260709 13:05:19.291131 22124 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:19.289846 22256 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:19.291922 22298 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.292517 22067 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:05:19.295795 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 76779.5us
I20260709 13:05:19.293643 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:19.294929 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 176595us
W20260709 13:05:19.295699 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.301007 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:19.305186 15246 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:19.306968 22298 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.309621 15392 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
I20260709 13:05:19.310640 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:19.312079 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:19.282907 21981 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:19.258198 22159 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:19.318492 22182 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:19.329746 22285 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:19.331888 22182 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:19.320266 22301 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:05:19.330219 22067 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:19.332870 22182 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.333045 22067 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.319310 22272 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.321065 22228 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:19.334985 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 195887us
I20260709 13:05:19.336508 15248 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:19.339231 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 60490.3us
I20260709 13:05:19.339836 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.345082 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:19.336001 22247 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:19.285622 22055 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:05:19.310041 22245 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.354983 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:19.357187 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.362198 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:19.364451 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:19.364697 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:19.346179 22123 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.354651 22256 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:19.368474 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.367592 15248 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:19.318154 22286 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.360296 22063 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:19.374161 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.377938 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.380540 22298 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:19.381685 15399 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:19.382316 21981 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:19.382615 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:19.383499 15246 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:19.386655 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:19.387588 22286 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.388110 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:19.388809 15140 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 139) took 19996 ms (client timeout 15000 ms). Trace:
I20260709 13:05:19.390627 22292 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:19.388839 15397 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:19.391302 22292 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.391748 22292 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:19.392284 15998 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:19.393338 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44179.2us
I20260709 13:05:19.393697 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.394598 22159 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:19.395051 22159 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.395411 22159 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:19.395839 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.397617 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 1079) took 1466 ms. Trace:
I20260709 13:05:19.368572 22165 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:05:19.398175 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:19.399137 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.403116 15397 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:05:19.398030 16026 rpcz_store.cc:276] 0709 13:05:17.938345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.943290 (+  4945us) service_pool.cc:224] Handling call
0709 13:05:19.397366 (+1454076us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540065e354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:19.397534 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2567537024}
W20260709 13:05:19.420729 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.423664 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.424651 15399 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:19.433288 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58111.5us
I20260709 13:05:19.434645 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.436170 15215 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.372231 22247 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:19.399808 22224 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:19.447214 15398 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:19.446208 21804 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:19.451435 22163 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.453047 22163 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:19.454427 22306 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:19.389261 15140 rpcz_store.cc:269] 0709 13:04:59.392648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.392932 (+   284us) service_pool.cc:224] Handling call
0709 13:04:59.866273 (+473341us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b64090 00007f3669c02f3a 00007f366f9b91cc 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc 00007f366df77392 00007f3667f3548c 00007f3667f348c6
0709 13:05:19.388557 (+19522284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:10.997220 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:10.998057 (+   837us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:10.998120 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:05:10.998139 (+    19us) tablet.cc:662] Decoding operations
0709 13:05:11.063432 (+ 65293us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:11.063541 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:11.063569 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:05:11.064753 (+  1184us) tablet.cc:701] Row locks acquired
0709 13:05:11.064795 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:05:11.064971 (+   176us) write_op.cc:270] Start()
0709 13:05:11.065129 (+   158us) write_op.cc:276] Timestamp: P: 1783602311064901 usec, L: 0
0709 13:05:11.065161 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:05:11.065942 (+   781us) log.cc:844] Serialized 5232 byte log entry
0709 13:05:12.023268 (+957326us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b180030fdc0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:12.775540 (+752272us) op_driver.cc:464] REPLICATION: finished
0709 13:05:13.365796 (+590256us) write_op.cc:301] APPLY: starting
0709 13:05:13.421306 (+ 55510us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:14.563074 (+1141768us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:14.563137 (+    63us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:15.534135 (+970998us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:15.713547 (+179412us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:05:15.760993 (+ 47446us) write_op.cc:312] APPLY: finished
0709 13:05:15.840220 (+ 79227us) log.cc:844] Serialized 121 byte log entry
0709 13:05:16.257489 (+417269us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:16.293318 (+ 35829us) write_op.cc:454] Released schema lock
0709 13:05:16.322518 (+ 29200us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:16.413287 (+ 90769us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:16.413318 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1317957,"reported_tablets":27,"spinlock_wait_cycles":8081152,"child_traces":[["op",{"apply.queue_time_us":517650,"apply.run_cpu_time_us":55904,"apply.run_wall_time_us":3071684,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58441,"num_ops":13,"prepare.queue_time_us":241216,"prepare.run_cpu_time_us":38294,"prepare.run_wall_time_us":305547,"raft.queue_time_us":402853,"raft.run_cpu_time_us":51693,"raft.run_wall_time_us":594664,"replication_time_us":1669796,"spinlock_wait_cycles":114457472,"thread_start_us":1142178,"threads_started":5,"wal-append.queue_time_us":915206,"wal-append.run_cpu_time_us":58231,"wal-append.run_wall_time_us":2542139}]]}
I20260709 13:05:19.455688 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.456331 15397 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:19.456554 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.457140 15398 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:19.452082 22245 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.458725 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:19.460354 22272 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:19.462991 22307 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:05:19.463577 22240 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:19.477588 21997 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.465343 22312 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:19.479187 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 110815us
I20260709 13:05:19.479315 22313 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.484117 22313 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.485625 22187 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.488610 22313 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.469081 15398 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
W20260709 13:05:19.465932 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66886.6us
I20260709 13:05:19.475335 22123 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:19.474884 22247 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.477079 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.480209 21997 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:19.454948 22306 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:19.480469 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:19.481139 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.444056 22063 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:19.500846 15399 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:05:19.507954 15394 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:19.518615 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 82512.8us
I20260709 13:05:19.519515 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:19.494499 21804 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.528085 15398 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:05:19.530059 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49709.9us
I20260709 13:05:19.502140 22154 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:19.536119 21804 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.540982 21804 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.542418 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.544075 22033 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:19.544266 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.556749 22253 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.557469 22033 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:19.557391 22253 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.534266 22055 raft_consensus.cc:2764] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:05:19.559243 15398 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:19.559365 22272 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.560010 22272 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.562180 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1011) took 1158 ms. Trace:
I20260709 13:05:19.562640 15391 rpcz_store.cc:276] 0709 13:05:18.403807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.403990 (+   183us) service_pool.cc:224] Handling call
0709 13:05:19.199265 (+795275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:19.200007 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.561940 (+361933us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54002b5a50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:19.562085 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1785431296}
I20260709 13:05:19.564215 15391 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:19.565757 15391 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:19.566731 22292 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.566809 22159 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.569217 22292 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.570586 22159 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.570820 22312 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:19.571766 22272 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.573264 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.573997 16024 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:19.521035 22306 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:19.578362 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 83361.1us
I20260709 13:05:19.579739 22055 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:19.580013 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.580533 22182 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:19.581490 22139 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:19.581692 15291 leader_election.cc:400] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18.
I20260709 13:05:19.583380 22187 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.582103 15291 leader_election.cc:403] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:05:19.586758 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:19.587298 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:19.531189 22123 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:19.593771 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.594166 15399 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:19.600170 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:19.597847 15394 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
W20260709 13:05:19.595810 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 207281us
I20260709 13:05:19.606108 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:19.569926 22292 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:05:19.609160 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.610576 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.615561 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:19.616257 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.616887 22272 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:19.617034 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.618465 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.619493 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:19.619819 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.620143 15321 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:19.620674 22245 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:19.621825 22272 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:19.611491 22238 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:05:19.622762 22272 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.618378 15320 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:19.611552 22154 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:19.625034 22154 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:19.612432 22178 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:19.626062 22154 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.625025 22306 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.598711 22139 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18.
I20260709 13:05:19.629648 22306 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:19.593596 22187 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:19.636025 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.636699 15391 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:19.631139 16026 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:19.642105 15394 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:19.643939 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.644719 22253 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:19.639055 22187 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.645798 22187 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:19.646556 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:19.644765 15396 raft_consensus.cc:2368] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:19.650168 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:19.653688 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:19.651078 15320 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:05:19.612871 22123 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:19.639545 22067 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:19.639348 21997 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:19.660138 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.604194 22240 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:05:19.661132 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:19.661108 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:19.611614 22165 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:05:19.643093 22290 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:19.669481 15394 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:19.678632 22083 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:19.679263 22083 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.681511 22083 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:19.665678 22209 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:05:19.671352 22253 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:19.683254 22253 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.683643 22253 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:19.665963 22238 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:05:19.687458 22238 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:19.687840 22238 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:19.688974 22272 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:19.666002 22067 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:19.690050 22067 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:19.692237 22200 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:19.692830 22200 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:19.693759 22200 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:19.694360 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47894.2us
I20260709 13:05:19.694900 16033 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:05:19.695242 15291 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.696462 16033 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:19.697750 22242 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:19.697535 22123 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.698596 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:19.699209 15318 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:19.697153 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:19.701982 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.688788 22238 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.702016 15397 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:19.704020 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:19.710728 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:19.711608 15397 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:19.710912 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.715225 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:19.716956 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:19.719597 15396 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:19.723985 15391 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:19.719605 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:19.710527 22283 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:05:19.708913 22247 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:19.726572 15320 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:05:19.725904 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65868.6us
I20260709 13:05:19.729740 15391 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:19.659528 22299 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 13:05:19.734978 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.717751 22148 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:19.736272 15396 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:19.735409 15397 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:19.741520 15394 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:19.729178 22245 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:19.745208 15316 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:05:19.731711 22247 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:19.749333 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:19.750344 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:19.757611 15319 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:19.736533 22139 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.742116 22238 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:19.764705 22304 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:05:19.767170 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.749595 22313 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:19.744061 22200 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:05:19.767771 21771 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:19.770963 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.770851 22312 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:19.777014 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:19.812840 15250 raft_consensus.cc:2410] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:05:19.777845 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:19.778788 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:19.780694 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:19.779665 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:19.816182 15246 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:19.758153 22247 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:19.797250 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:19.798276 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:19.799396 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56012.1us
W20260709 13:05:19.799515 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 59538.5us
I20260709 13:05:19.805991 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:19.809465 15289 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:19.808252 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.822566 15319 raft_consensus.cc:2368] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:19.811331 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:19.811712 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:19.825125 15249 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 14: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:19.796674 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58197.2us
I20260709 13:05:19.817121 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.820492 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:19.824265 15318 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
W20260709 13:05:19.844676 15243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2257) took 1690 ms (client timeout 1968 ms). Trace:
W20260709 13:05:19.846866 15243 rpcz_store.cc:269] 0709 13:05:18.131023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.219888 (+ 88865us) service_pool.cc:224] Handling call
0709 13:05:19.821092 (+1601204us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400398ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:19.821202 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830217984}
I20260709 13:05:19.823786 16028 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:19.825055 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:19.849550 15242 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:19.801622 22139 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:19.851734 15395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 1013) took 1419 ms (client timeout 1805 ms). Trace:
I20260709 13:05:19.852268 22240 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:05:19.852182 15395 rpcz_store.cc:269] 0709 13:05:18.432250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.455433 (+ 23183us) service_pool.cc:224] Handling call
0709 13:05:19.851568 (+1396135us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400270954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:19.851677 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714789120}
I20260709 13:05:19.852910 22240 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:19.853370 22240 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:19.802762 22304 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:19.854439 22304 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:19.802065 22313 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:19.855645 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44894us
I20260709 13:05:19.812551 22318 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:19.855449 16032 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:19.826668 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:19.867712 15242 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
W20260709 13:05:19.870785 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53753.5us
I20260709 13:05:19.874212 15246 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
W20260709 13:05:19.871272 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 61928.4us
I20260709 13:05:19.811393 21771 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:19.875285 15999 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.852092 22139 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:19.879829 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3503) took 1794 ms. Trace:
W20260709 13:05:19.879585 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 159990us
W20260709 13:05:19.905349 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:19.910140 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:19.920630 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 94037us
I20260709 13:05:19.926990 15323 rpcz_store.cc:276] 0709 13:05:18.085075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.336171 (+251096us) service_pool.cc:224] Handling call
0709 13:05:18.476167 (+139996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:18.482922 (+  6755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.879579 (+1396657us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400218ed0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:19.879747 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321215872}
I20260709 13:05:19.879091 15247 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:19.878751 22163 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:19.879590 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.923717 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:19.924327 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 118417us
I20260709 13:05:19.855191 22315 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:19.860131 22201 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:19.920922 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 160295us
W20260709 13:05:19.932447 22329 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:05:19.931977 22313 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.934916 21916 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:05:19.934780 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 55252.5us
I20260709 13:05:19.922053 22272 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:19.937290 16029 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:19.937959 22165 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:05:19.923046 22322 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:05:19.939050 22286 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:19.943230 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:19.877871 22245 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:19.878949 22063 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:19.954996 22165 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:19.957161 22311 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:05:19.970008 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:19.968039 22240 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.972024 22238 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:19.974068 15998 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:19.974923 22163 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:19.975447 22163 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:19.976087 22292 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:19.976490 22163 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.958211 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:19.963132 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.968231 22313 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:19.960153 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:19.926875 22290 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:19.952348 15289 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:19.980279 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.996946 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:19.989033 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:19.998925 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:20.000768 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:19.987437 22200 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:20.004302 22200 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:19.945724 22315 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:20.005600 22315 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:20.005396 22200 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:19.950755 21916 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:05:20.006183 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 46134.7us
I20260709 13:05:20.006773 22290 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:20.007459 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 135584us
I20260709 13:05:20.007807 22187 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.035269 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:19.963853 22063 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.949893 21804 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:05:20.038029 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:20.001974 22139 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:19.965792 22165 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:19.951082 22201 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:20.071306 16026 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:05:20.044718 22272 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:19.985473 22067 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.038813 22208 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:05:20.124863 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55493.9us
I20260709 13:05:20.041873 22311 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:20.068022 22139 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.062584 22159 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:20.050621 22063 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:20.118541 22255 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:20.145421 15391 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:20.145011 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.149361 22187 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:20.149211 21916 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:20.150379 21916 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:20.151888 22187 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:20.152436 22187 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.152848 22187 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:20.127406 22272 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:20.128055 22208 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:20.158133 22311 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:20.140470 22165 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:20.135301 22240 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:20.140944 22312 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:20.158442 22139 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:20.062892 21771 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.136665 22209 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:05:20.138392 22182 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:05:20.138207 22300 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 13:05:20.214483 22154 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.014s	sys 0.029s
I20260709 13:05:20.171856 22208 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:20.168666 22272 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.229424 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:20.235901 16031 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
W20260709 13:05:20.235900 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 197955us
I20260709 13:05:20.240396 22067 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:20.231813 22154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.014s	sys 0.029s
W20260709 13:05:20.246623 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 247768us
I20260709 13:05:20.293442 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:20.245415 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:20.250711 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 259687us
W20260709 13:05:20.295830 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:20.296870 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:20.302819 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 57488.5us
I20260709 13:05:20.332341 16033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:51484
I20260709 13:05:20.334844 22067 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:20.335464 22067 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.337646 22067 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:20.338856 22311 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.217365 21997 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
W20260709 13:05:20.348013 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:20.361337 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:20.367125 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 151743us
I20260709 13:05:20.281167 22123 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:20.373571 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:20.374851 15242 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:20.379360 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:20.385869 15244 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:20.386615 15323 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:20.388164 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:20.388906 15323 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
W20260709 13:05:20.389075 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 408835us
I20260709 13:05:20.390625 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:20.365774 22238 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.347602 22312 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:20.365990 22351 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.402809 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:20.403438 15320 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
W20260709 13:05:20.403617 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.400354 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:20.401264 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:20.401587 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:20.399912 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:20.404935 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:20.408850 15248 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:20.229687 22290 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:20.407050 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 485308us
I20260709 13:05:20.424971 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:20.429069 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 135761us
I20260709 13:05:20.378041 22240 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:20.430919 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:20.433084 15248 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:20.433431 15213 leader_election.cc:400] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:20.433738 15213 leader_election.cc:403] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:05:20.433956 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:20.437558 15316 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:20.437764 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:20.439555 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:20.445436 15244 raft_consensus.cc:2368] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:20.446570 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:20.448144 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 203000us
I20260709 13:05:20.443912 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:05:20.450671 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 56187.6us
I20260709 13:05:20.477145 15248 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:20.484272 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:20.485122 15245 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:20.486018 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:20.437335 22285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.050s	user 0.000s	sys 0.031s
I20260709 13:05:20.487237 15242 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:05:20.487879 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44086.1us
I20260709 13:05:20.485697 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:20.498122 15248 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:05:20.496729 22285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.000s	sys 0.031s
I20260709 13:05:20.434445 22350 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:20.405525 22238 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.456911 22349 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:20.533185 16027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.017s	sys 0.025s
I20260709 13:05:20.494789 22312 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:20.547008 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:20.533582 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:20.563902 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:20.445267 22240 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.557613 15242 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:20.558701 16027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.017s	sys 0.025s
I20260709 13:05:20.438019 22313 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:05:20.518978 22354 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:20.430482 22351 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:20.579931 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 147958us
I20260709 13:05:20.556314 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:20.564023 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 1026) took 1550 ms. Trace:
I20260709 13:05:20.486114 22342 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 13:05:20.531260 22154 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:20.580760 16029 rpcz_store.cc:276] 0709 13:05:19.013296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.298177 (+284881us) service_pool.cc:224] Handling call
0709 13:05:19.937112 (+638935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:19.953165 (+ 16053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.563837 (+610672us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54006fe5d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:20.563967 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380870528}
I20260709 13:05:20.584911 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:20.586587 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:20.586953 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:20.590672 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:20.591354 15323 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:20.585403 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:20.595498 15244 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:20.561790 22363 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:20.532140 22252 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:05:20.603160 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:20.604099 15242 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:20.606154 15247 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:05:20.639189 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51074us
W20260709 13:05:20.598095 22315 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.004s
I20260709 13:05:20.643419 15996 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:20.711099 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67745us
I20260709 13:05:20.712108 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:20.592869 22163 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:20.647032 22123 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:20.650343 22336 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.443s	user 0.001s	sys 0.000s
I20260709 13:05:20.652935 22274 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:20.608670 22253 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.918s	user 0.010s	sys 0.003s
I20260709 13:05:20.658493 15245 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:20.658641 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:20.726078 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:20.733166 15244 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:20.659077 15317 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:20.659226 15316 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:20.660089 22240 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:20.594461 21997 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:20.666872 15393 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: []
W20260709 13:05:20.614552 22304 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.757s	user 0.012s	sys 0.000s
W20260709 13:05:20.668818 22357 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:05:20.669750 22343 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:05:20.577721 22349 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:20.671187 22341 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:05:20.671744 22368 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.672147 22363 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:20.683715 15998 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:20.730362 22318 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.864s	user 0.006s	sys 0.006s
I20260709 13:05:20.685084 22238 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:20.685467 22067 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:20.688333 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:20.774528 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 86294.5us
I20260709 13:05:20.691578 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:20.777297 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 85807.5us
I20260709 13:05:20.778504 15999 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:20.692126 22247 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.840s	user 0.009s	sys 0.000s
I20260709 13:05:20.599947 22285 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:05:20.694213 21771 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:20.698726 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:20.701857 22185 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:20.723743 22123 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.593174 22354 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:20.719866 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 204856us
I20260709 13:05:20.726649 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:20.812384 15399 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:20.727530 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:20.729664 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:20.734102 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 148792us
I20260709 13:05:20.560842 22350 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:20.739081 15245 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:20.740650 15390 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:20.730755 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:20.817332 15396 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:20.742326 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:20.743353 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:20.670480 22340 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:05:20.718086 21916 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:20.715795 22163 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:20.774075 22274 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:20.684331 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 99495.1us
I20260709 13:05:20.737154 22253 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:20.737378 22187 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.006s
W20260709 13:05:20.771972 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88351.4us
I20260709 13:05:20.772420 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:20.612041 22358 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.156s
I20260709 13:05:20.739089 21997 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:20.744719 22272 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.005s
I20260709 13:05:20.719473 22315 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:20.786870 15242 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:20.787760 15291 leader_election.cc:400] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:20.713196 15250 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:20.858021 15291 leader_election.cc:403] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:05:20.745113 22359 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.819231 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:20.819690 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.730597 22355 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:20.781065 22292 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:20.787251 22318 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:20.773636 22370 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:20.781347 22067 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:20.745304 22304 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.852398 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3518) took 1138 ms. Trace:
I20260709 13:05:20.852437 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:20.788873 22185 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:20.860810 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:20.878355 15324 rpcz_store.cc:276] 0709 13:05:19.714454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.714725 (+   271us) service_pool.cc:224] Handling call
0709 13:05:19.715032 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.728071 (+ 13039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.728113 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.741989 (+ 13876us) log.cc:844] Serialized 26 byte log entry
0709 13:05:20.001403 (+259414us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:20.001467 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.001596 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.649414 (+647818us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:20.847841 (+198427us) raft_consensus.cc:1685] finished
0709 13:05:20.847865 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.852320 (+  4455us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":955,"raft.queue_time_us":13326,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":8634,"spinlock_wait_cycles":22859520,"thread_start_us":183345,"threads_started":1,"wal-append.queue_time_us":381045}
I20260709 13:05:20.839027 22163 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:20.852108 21997 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:20.858997 22272 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:20.866545 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 47411.7us
I20260709 13:05:20.873477 15392 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:05:20.891206 15215 leader_election.cc:400] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:20.892412 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:20.864054 22355 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:20.877674 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 897) took 1071 ms. Trace:
I20260709 13:05:20.881830 15399 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:20.855180 22187 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:20.863292 21916 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:05:20.867156 22286 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.006s	sys 0.017s
I20260709 13:05:20.861307 22252 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:20.867123 22240 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:20.866273 21804 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.774923 22368 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:20.858438 22165 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.000s
I20260709 13:05:20.851186 22291 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:05:20.937650 15249 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:20.924252 22286 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.007s	sys 0.017s
I20260709 13:05:20.883133 15242 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:05:20.790755 22247 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:20.909632 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 131189us
I20260709 13:05:20.921414 22242 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:20.945451 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:20.877430 21818 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.877771 22067 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:20.886469 22292 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:05:20.889492 22245 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.927s	user 0.010s	sys 0.001s
I20260709 13:05:20.885272 22371 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
W20260709 13:05:20.922371 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.932732 22351 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:20.908766 15321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.010s	sys 0.011s
W20260709 13:05:20.924508 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 136936us
I20260709 13:05:20.957067 15291 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:20.885957 22370 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:20.887478 22209 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:05:20.887517 22255 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.016s	sys 0.013s
I20260709 13:05:20.907511 22355 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:20.870651 22359 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:20.893903 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:21.006753 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 112934us
W20260709 13:05:21.008261 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 287582us
I20260709 13:05:20.909770 22372 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:21.009740 15242 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:05:20.936350 22063 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.770s	user 0.013s	sys 0.000s
I20260709 13:05:20.933444 21916 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:05:20.941227 22208 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.714s	user 0.008s	sys 0.005s
I20260709 13:05:20.936997 21804 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.903857 15241 rpcz_store.cc:276] 0709 13:05:19.800639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.800855 (+   216us) service_pool.cc:224] Handling call
0709 13:05:19.814657 (+ 13802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.814893 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.814916 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.815383 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:05:20.138550 (+323167us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:20.138587 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.138660 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.871633 (+732973us) raft_consensus.cc:1685] finished
0709 13:05:20.871665 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.871870 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":322784,"threads_started":1,"wal-append.queue_time_us":623805}
W20260709 13:05:20.957736 15321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.011s	sys 0.011s
W20260709 13:05:20.997295 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 181259us
I20260709 13:05:21.022894 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:21.000416 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 154119us
I20260709 13:05:20.933202 22252 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:20.935266 22240 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:20.958660 22245 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:05:21.002151 22255 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.017s	sys 0.013s
I20260709 13:05:21.027206 22255 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:21.028900 15319 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:21.028508 22255 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.888343 22363 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.047398 15250 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:20.952387 21818 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.050920 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:21.005369 22209 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:21.014617 22371 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:21.008839 22238 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:20.912058 22354 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:20.982824 22182 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:05:21.015879 22372 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.068193 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:21.017604 22349 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.069519 15244 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:20.997977 22242 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.060s
W20260709 13:05:21.064774 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 174163us
I20260709 13:05:21.052179 22352 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:05:21.052388 22139 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.823s	user 0.006s	sys 0.006s
W20260709 13:05:21.071946 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 61778.9us
I20260709 13:05:21.007645 22292 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:05:21.076011 15243 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:05:21.061532 22253 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.069686 15392 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: []
W20260709 13:05:21.098558 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89570.9us
W20260709 13:05:21.081063 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 135668us
W20260709 13:05:21.051419 22365 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:05:21.049150 22208 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.058429 22290 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:05:21.023402 22063 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.095007 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.115274 15318 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.079454 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:21.086519 15324 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 13:05:21.105747 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 76044us
I20260709 13:05:21.053339 22311 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:05:21.017870 22351 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
W20260709 13:05:21.096662 22256 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.719s	user 0.002s	sys 0.019s
I20260709 13:05:21.082685 22291 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.083638 22123 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.083420 22350 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.078416 22372 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:21.104477 22315 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.072046 22318 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:05:21.114466 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.127558 22385 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:21.128682 22374 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:21.130388 22375 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:21.132696 22337 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.945s	user 0.002s	sys 0.006s
I20260709 13:05:21.183601 22375 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.185046 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3596) took 1540 ms. Trace:
I20260709 13:05:21.185302 22247 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.185482 15397 rpcz_store.cc:276] 0709 13:05:19.644302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.742832 (+ 98530us) service_pool.cc:224] Handling call
0709 13:05:19.751561 (+  8729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.825748 (+ 74187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.825780 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.849879 (+ 24099us) log.cc:844] Serialized 26 byte log entry
0709 13:05:20.036649 (+186770us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:20.036710 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.036806 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:21.131978 (+1095172us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:21.184715 (+ 52737us) raft_consensus.cc:1685] finished
0709 13:05:21.184736 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:21.184983 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21801,"raft.queue_time_us":22279,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5342,"spinlock_wait_cycles":121956224,"thread_start_us":186017,"threads_started":1,"wal-append.queue_time_us":284642}
I20260709 13:05:21.187242 22391 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:21.188216 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:21.188465 22187 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.188974 15397 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:21.188791 22391 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:21.191233 21818 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.191988 21916 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.195489 21804 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.067552 22245 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
I20260709 13:05:21.196979 22245 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:21.197366 22245 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:21.197803 22178 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:21.108124 22349 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:21.149639 16033 raft_consensus.cc:606] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:21.113077 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.155894 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.157061 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:21.159391 15322 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 24: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:21.199097 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 2989) took 1865 ms. Trace:
I20260709 13:05:21.212296 15398 rpcz_store.cc:276] 0709 13:05:19.334003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.560244 (+226241us) service_pool.cc:224] Handling call
0709 13:05:19.560568 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:20.685700 (+1125132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:20.685741 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:20.686257 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:05:20.890130 (+203873us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:20.890169 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.198695 (+308526us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540009bfd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:21.198740 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:21.198789 (+    49us) raft_consensus.cc:1685] finished
0709 13:05:21.198801 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:21.199036 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5479,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":2586692992,"thread_start_us":203437,"threads_started":1,"wal-append.queue_time_us":314166}
I20260709 13:05:21.213359 15318 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
W20260709 13:05:21.203460 16032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 1024) took 2190 ms (client timeout 1796 ms). Trace:
I20260709 13:05:21.204182 16025 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:21.204667 16033 raft_consensus.cc:614] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:21.216787 16024 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
W20260709 13:05:21.142259 22256 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.748s	user 0.002s	sys 0.020s
I20260709 13:05:21.164789 22382 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:05:21.166896 22379 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:21.149124 22291 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.169976 22359 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.112270 22383 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:21.170790 22209 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.171746 22350 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:21.173322 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:21.139859 22304 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:21.143586 22373 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:05:21.110116 22370 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.176700 22312 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:21.178184 22272 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.098991 22139 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.182411 22385 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.137219 22185 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:21.214555 16032 rpcz_store.cc:269] 0709 13:05:19.012726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.170837 (+158111us) service_pool.cc:224] Handling call
0709 13:05:21.203257 (+2032420us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54000d98d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:21.203382 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434742016}
I20260709 13:05:21.233721 15242 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:21.238037 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 138510us
I20260709 13:05:21.293197 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:21.248008 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:21.221068 22391 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.298612 22391 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.200843 22154 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:21.301990 22154 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:21.198201 22178 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:21.307039 22178 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.308316 22178 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:21.309556 22159 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 1.151s	user 0.008s	sys 0.004s
I20260709 13:05:21.310025 22159 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:21.262972 15396 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:05:21.235653 22382 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.311118 22382 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:21.271409 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.220119 22256 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:21.277004 22312 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:21.238945 22187 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:21.243003 22368 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.268060 22242 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:21.297873 22185 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:21.186115 22375 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.198263 22245 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.265228 22163 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.331223 16026 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:21.363989 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:21.408820 16032 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:21.410600 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.346669 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:21.270068 22350 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.364078 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:21.381218 22148 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.318859 21818 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:21.368171 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:21.371688 22187 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:21.366716 16031 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:21.365981 21771 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:21.351321 22274 consensus_meta.cc:287] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 13:05:21.325968 22391 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.351778 22359 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.436995 22359 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.439424 22359 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.440024 22359 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.440510 22359 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.441395 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:21.442796 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:21.443230 22397 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:05:21.443909 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:21.445031 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:21.445292 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1098) took 1294 ms. Trace:
I20260709 13:05:21.445689 16025 rpcz_store.cc:276] 0709 13:05:20.150831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.151348 (+   517us) service_pool.cc:224] Handling call
0709 13:05:21.203792 (+1052444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.215705 (+ 11913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.445101 (+229396us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000d98d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:21.445238 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419534208}
I20260709 13:05:21.447077 22152 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:21.447463 22152 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:21.448721 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51484 (request call id 4) took 1143 ms. Trace:
I20260709 13:05:21.448400 22152 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.449108 16033 rpcz_store.cc:276] 0709 13:05:20.313602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.314149 (+   547us) service_pool.cc:224] Handling call
0709 13:05:21.448494 (+1134345us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b540041d2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf4853 00007f366ebc260a 00007f36681487d4 00007f3668148762 00007f3668148691 00007f366814860c 00007f36681478c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:21.448630 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877789056}
I20260709 13:05:21.449513 22382 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.382097 22182 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
W20260709 13:05:21.412518 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65939.1us
I20260709 13:05:21.373071 22067 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.416101 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.413393 16027 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:21.368717 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.381453 22299 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:21.388273 21916 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:21.388119 22368 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:21.429774 16032 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:21.389555 22242 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.466838 22242 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.467458 21916 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.379307 15142 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 4 to 15, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 15 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.431900 21771 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.405416 22285 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:21.393077 22371 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:21.446103 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:21.422874 22315 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:21.284817 22383 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:21.422878 22286 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.462524 22368 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.499488 22371 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.501857 22368 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.484367 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.504215 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.505543 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.425391 22312 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:21.510317 22401 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:05:21.513078 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:21.514201 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.518882 22285 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.521246 22285 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.523239 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.524142 15318 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:21.457228 22245 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:21.434557 22208 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.494678 15392 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:05:21.494932 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.528720 15324 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:21.453143 22274 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:21.497924 22407 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.497790 22187 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.498529 22383 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.498881 22315 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:21.498206 15142 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 7 to 14, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 14 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.499420 22286 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.459492 22133 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.502499 21771 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.513875 15397 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:21.457728 22238 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.562474 16030 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:21.460856 22063 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.542587 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:21.450404 22300 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:05:21.542122 22368 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:21.550413 16027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:51484
I20260709 13:05:21.506152 22123 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.454068 22148 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:21.562114 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 149230us
I20260709 13:05:21.566959 15325 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:21.567592 15318 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:21.474913 22256 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.469758 22299 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.547209 22352 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:05:21.549491 21916 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:21.589259 15996 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 2.019s (SENT) [suppressed 15 similar messages]
I20260709 13:05:21.566448 22394 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:21.579146 21997 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.000s
I20260709 13:05:21.582836 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:21.594661 15397 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:21.570464 22139 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.562498 22133 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.548051 22407 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.574609 22123 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:21.588999 22393 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:05:21.573009 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.649863 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.650962 15318 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:21.652066 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.593250 15395 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:21.653797 21916 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:21.654623 21916 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.593942 15324 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:21.568238 22291 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.569126 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:21.603119 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:21.658811 16031 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:21.659052 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 90017.5us
I20260709 13:05:21.603444 22306 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:21.659695 22306 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:21.659849 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:21.660732 22247 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:21.660676 22306 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.661499 22247 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:21.661788 22306 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:21.665194 22291 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.607673 22148 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.665781 22291 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.609293 22201 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.610466 22313 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:21.666846 22313 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:21.668046 22291 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.566572 22238 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.667711 22313 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.647447 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:21.669373 22313 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:21.671062 22291 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:21.671622 22291 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.680984 15363 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:21.681993 22148 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:21.682432 22148 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.682765 22148 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:21.684084 22291 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.590210 22182 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:21.598094 22400 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:05:21.610785 15142 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 8 to 16, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 16 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:21.570288 22368 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.691642 15318 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:21.698043 16027 raft_consensus.cc:606] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:21.698567 16027 raft_consensus.cc:614] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:21.648265 22359 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.704479 22383 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.705065 22407 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:21.707273 22408 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:05:21.707661 22133 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.707852 22382 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.716163 15397 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:05:21.688972 22416 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:21.615049 21997 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.712273 22123 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.702406 22385 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.620895 22315 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.702986 22154 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:21.740718 22411 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:05:21.781555 22154 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:21.747048 22405 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:05:21.782569 15998 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:21.755107 22417 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:21.689059 22415 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.088s
I20260709 13:05:21.761996 21997 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.764348 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:21.785095 16025 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:21.785336 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:21.786191 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:21.786486 22359 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:21.786875 15396 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:21.788021 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:21.788206 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:21.789331 15396 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:21.692672 22182 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.765786 22222 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:21.791070 22222 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:21.767284 15246 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:05:21.791285 22182 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.792671 15246 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:21.792749 21916 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.767869 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:21.768676 15289 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:21.793502 21916 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:21.793835 15244 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 16: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:21.794430 22412 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:05:21.795056 15289 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:21.796216 22133 raft_consensus.cc:2764] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:05:21.768162 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:21.797379 22350 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.797783 22133 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:21.769492 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.798206 22133 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:21.798653 22133 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:21.799307 22368 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.774863 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2284) took 1387 ms. Trace:
I20260709 13:05:21.786908 22359 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.621778 22394 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.800169 15248 rpcz_store.cc:276] 0709 13:05:20.387630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.511675 (+124045us) service_pool.cc:224] Handling call
0709 13:05:20.512260 (+   585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:20.597821 (+ 85561us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:20.639582 (+ 41761us) log.cc:844] Serialized 14 byte log entry
0709 13:05:20.911184 (+271602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:20.911252 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:20.911301 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.774614 (+863313us) spinlock_profiling.cc:243] Waited 85.3 ms on lock 0x7b5400449dd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:21.774663 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:21.774803 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7532,"prepare.queue_time_us":64377,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":8695,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":11638,"spinlock_wait_cycles":196254080,"thread_start_us":263102,"threads_started":1,"wal-append.queue_time_us":379019}
I20260709 13:05:21.796154 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.817574 15323 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:21.734018 22355 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.714s	user 0.009s	sys 0.004s
I20260709 13:05:21.791364 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:21.804741 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 215498us
I20260709 13:05:21.805780 15390 raft_consensus.cc:2368] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17.
I20260709 13:05:21.809327 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:21.809458 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:21.818485 16025 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:21.800494 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:21.833500 15247 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:21.833698 22380 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:21.833389 22148 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.785392 22240 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.793890 21916 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:21.821244 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.822968 22222 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.824533 22238 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.819743 15142 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.767395 22299 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:21.834215 22380 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.845266 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:21.853999 15320 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:21.816519 22359 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:21.837756 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:21.879357 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 993) took 1478 ms. Trace:
W20260709 13:05:21.880878 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 45856.4us
I20260709 13:05:21.879846 15319 rpcz_store.cc:276] 0709 13:05:20.401193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.401359 (+   166us) service_pool.cc:224] Handling call
0709 13:05:21.879186 (+1477827us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54004038d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:21.879293 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1426464640}
I20260709 13:05:21.882970 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2288) took 1426 ms. Trace:
I20260709 13:05:21.885917 15243 rpcz_store.cc:276] 0709 13:05:20.456731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.854293 (+397562us) service_pool.cc:224] Handling call
0709 13:05:20.875779 (+ 21486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.096203 (+220424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.878859 (+782656us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54000ada54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:21.882897 (+  4038us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444073728}
I20260709 13:05:21.887467 22256 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:21.887684 22299 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:21.887954 22256 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.888381 22299 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:21.888916 15142 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 14 to 18, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 18 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.890928 15142 catalog_manager.cc:5697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 10 to 14, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 14 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:05:21.891746 22394 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.845932 22355 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.892640 15142 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:05:21.894054 22355 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:21.880143 22380 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:21.896229 22338 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.711s	user 0.019s	sys 0.000s
I20260709 13:05:21.850925 21916 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:21.898124 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.898150 16033 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:21.888468 22256 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.898830 15319 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:21.906759 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3595) took 2260 ms. Trace:
I20260709 13:05:21.834851 22382 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:05:21.883189 22222 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:21.907509 15391 rpcz_store.cc:276] 0709 13:05:19.639539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.739508 (+ 99969us) service_pool.cc:224] Handling call
0709 13:05:19.751680 (+ 12172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:20.146981 (+395301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.899802 (+1752821us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b540009a6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:21.900056 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":904954240}
I20260709 13:05:21.919494 15323 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:21.925058 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.897257 22342 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:21.926529 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.889603 22299 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.930968 15323 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:21.894016 15142 catalog_manager.cc:5697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 4 to 13. New cstate: current_term: 13 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:05:21.933777 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.942541 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.925267 22055 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:21.943495 21818 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.945082 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3514) took 2292 ms. Trace:
I20260709 13:05:21.951162 15142 catalog_manager.cc:5697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 8 to 13, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 13 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.931701 22342 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:21.956086 15323 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:21.956730 15321 rpcz_store.cc:276] 0709 13:05:19.654842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.660089 (+  5247us) service_pool.cc:224] Handling call
0709 13:05:19.668445 (+  8356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:19.725585 (+ 57140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.725624 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:19.733835 (+  8211us) log.cc:844] Serialized 52 byte log entry
0709 13:05:19.951209 (+217374us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:20.366408 (+415199us) log.cc:844] Serialized 14 byte log entry
0709 13:05:21.022394 (+655986us) log.cc:844] Serialized 14 byte log entry
0709 13:05:21.050274 (+ 27880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.050351 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:21.895495 (+845144us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:21.944804 (+ 49309us) raft_consensus.cc:1685] finished
0709 13:05:21.944836 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:21.945004 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48891,"prepare.queue_time_us":243034,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":8265,"raft.queue_time_us":235805,"raft.run_cpu_time_us":477,"raft.run_wall_time_us":32991,"spinlock_wait_cycles":113247488,"thread_start_us":1160438,"threads_started":3,"wal-append.queue_time_us":366201}
I20260709 13:05:21.954923 15319 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:21.960646 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 1098) took 1654 ms. Trace:
I20260709 13:05:21.964833 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.965619 15319 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:21.966194 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.966506 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.964085 16024 rpcz_store.cc:276] 0709 13:05:20.306591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.307015 (+   424us) service_pool.cc:224] Handling call
0709 13:05:20.307400 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.217238 (+909838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.960384 (+743146us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b540041d2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:21.960583 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2090850560}
W20260709 13:05:21.958667 22349 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.760s	user 0.013s	sys 0.000s
I20260709 13:05:21.976750 22349 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:21.977038 22252 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.967381 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.978730 15323 raft_consensus.cc:2368] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15.
I20260709 13:05:21.979820 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:21.941143 22313 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:05:21.972424 15319 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:21.973443 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3107) took 1286 ms. Trace:
I20260709 13:05:21.951222 22148 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:21.967804 15247 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:21.980329 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.980798 15323 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:21.982901 15249 rpcz_store.cc:276] 0709 13:05:20.687468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.926174 (+238706us) service_pool.cc:224] Handling call
0709 13:05:20.926494 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:20.938497 (+ 12003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.973220 (+1034723us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b540044a2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:21.973387 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23751424}
W20260709 13:05:21.979249 22372 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.790s	user 0.011s	sys 0.002s
I20260709 13:05:21.958276 21818 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.995362 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.959249 22055 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:21.991674 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:21.998319 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:21.999145 15319 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:22.005226 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.005482 15321 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:22.005875 15319 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:21.999991 15323 raft_consensus.cc:2368] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18.
I20260709 13:05:22.007040 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.018977 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.025760 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.026607 15319 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:22.027393 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.020714 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:22.029616 15323 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:22.055009 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.055804 15319 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:22.056663 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.066840 15321 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:21.987097 22407 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 13:05:22.071705 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 98159.6us
I20260709 13:05:22.073565 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:21.992605 22387 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.161s
I20260709 13:05:22.070302 22313 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:22.065894 22315 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:22.078905 22313 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:22.079276 22315 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.079983 21818 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:22.068504 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.082687 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:22.085530 16030 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:22.082260 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:22.002102 22372 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.113075 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:22.113806 16024 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:05:22.117374 15323 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:22.081844 15142 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 12 to 14, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 14 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:22.121836 22245 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
W20260709 13:05:22.122893 22425 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:05:22.122496 15142 catalog_manager.cc:5697] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:22.125058 22431 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:05:22.124414 15142 catalog_manager.cc:5697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.004484 22133 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:22.126120 22423 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:05:22.118955 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:22.127280 22429 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:05:22.127342 16029 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:22.127978 22133 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:22.128690 15319 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:22.071024 22358 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.129520 22358 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.081977 22313 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:22.131618 22358 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:22.132117 15142 catalog_manager.cc:5697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 7 to 10, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 10 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.081840 22315 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:22.121953 22426 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:05:22.139596 16029 raft_consensus.cc:2410] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:05:22.120651 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:22.140259 16024 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:22.145079 22055 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:22.148613 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.152686 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.153527 15322 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 21 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:05:22.150568 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.154577 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:22.156047 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3536) took 1028 ms. Trace:
I20260709 13:05:22.156116 15316 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:22.156316 15213 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:22.156987 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3538) took 1028 ms. Trace:
I20260709 13:05:22.157222 22315 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:22.158587 15325 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:22.134106 15142 catalog_manager.cc:5697] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 13 to 15, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 15 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.159869 15325 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:05:22.157505 15316 rpcz_store.cc:276] 0709 13:05:21.128814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.155487 (+1026673us) service_pool.cc:224] Handling call
0709 13:05:22.155879 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.156712 (+   833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.156883 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:22.154579 15322 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:22.164721 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3534) took 1037 ms. Trace:
I20260709 13:05:22.165047 15322 rpcz_store.cc:276] 0709 13:05:21.127409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.154099 (+1026690us) service_pool.cc:224] Handling call
0709 13:05:22.154420 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.164469 (+ 10049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.164668 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:22.165899 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.166428 22313 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:22.167361 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.167783 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.172775 15245 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:22.173095 15244 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:22.173280 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.173884 15246 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:22.176384 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.180218 22312 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:22.182705 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2296) took 1263 ms. Trace:
I20260709 13:05:22.183161 15242 rpcz_store.cc:276] 0709 13:05:20.919532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.081834 (+162302us) service_pool.cc:224] Handling call
0709 13:05:21.095343 (+ 13509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.297167 (+201824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.182428 (+885261us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540010c554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:22.182633 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317767552}
I20260709 13:05:22.185508 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2293) took 1637 ms. Trace:
I20260709 13:05:22.185935 15250 rpcz_store.cc:276] 0709 13:05:20.548495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.902569 (+354074us) service_pool.cc:224] Handling call
0709 13:05:20.923681 (+ 21112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.048083 (+124402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.185254 (+1137171us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000ad554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:22.185442 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283887872}
I20260709 13:05:22.161072 15142 catalog_manager.cc:5697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.189854 15142 catalog_manager.cc:5697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 12 to 16, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.162243 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2297) took 1149 ms. Trace:
I20260709 13:05:22.192998 15241 rpcz_store.cc:276] 0709 13:05:21.012375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.049592 (+ 37217us) service_pool.cc:224] Handling call
0709 13:05:22.162016 (+1112424us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b540025bcd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:22.162157 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831136640}
I20260709 13:05:22.193081 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:22.194130 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:22.162927 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 2999) took 1116 ms. Trace:
I20260709 13:05:22.149842 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.197012 15321 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:22.196743 15392 rpcz_store.cc:276] 0709 13:05:21.046533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.119949 (+ 73416us) service_pool.cc:224] Handling call
0709 13:05:22.162724 (+1042775us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54001dae54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:22.162867 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650665856}
I20260709 13:05:22.198125 15291 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:22.198042 15320 rpcz_store.cc:276] 0709 13:05:21.128181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.155315 (+1027134us) service_pool.cc:224] Handling call
0709 13:05:22.155575 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.155744 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.155768 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:22.155809 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:22.155839 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.155889 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:22.155982 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:22.199875 15320 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:22.201438 15213 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:22.161166 15325 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:05:22.208343 22382 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.208976 22382 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:22.209339 22133 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:22.210122 22133 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.211299 22382 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:22.151670 22255 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:22.214746 16024 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:22.216499 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:22.218503 15321 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:22.223727 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:22.228379 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 244653us
I20260709 13:05:22.230489 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:22.231160 15395 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:22.233305 15398 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:22.237705 16028 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:22.213006 22311 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:22.248786 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:22.226132 15323 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:05:22.257010 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:22.260637 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 59279.2us
I20260709 13:05:22.261435 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:22.208887 22152 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:22.151693 22359 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.274559 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:22.275192 15391 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 14.
I20260709 13:05:22.276472 22359 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:22.252394 22148 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:05:22.280287 22394 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:22.263865 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:22.268421 15323 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:22.227998 22383 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:22.229732 22255 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:22.302346 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:22.256443 22358 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:22.258920 22185 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:22.294044 21916 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:22.250598 22311 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:22.288558 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:05:22.343995 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 55561.4us
I20260709 13:05:22.268886 22407 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:22.287577 15323 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:22.251974 22352 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:05:22.345228 15397 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:22.360989 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:22.361821 16028 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:22.377111 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.379403 16025 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:22.399115 16026 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:22.399899 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:22.400835 16031 raft_consensus.cc:2393] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:22.296355 22290 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:05:22.304893 22394 consensus_queue.cc:1243] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:05:22.402320 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:22.408252 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:22.400846 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.353190 22407 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:22.377138 22432 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:22.364670 22342 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:22.375370 22274 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:22.400343 16025 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:22.376744 22369 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.147s
I20260709 13:05:22.417029 22407 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:22.478121 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:22.478510 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:22.478822 15391 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:22.441337 22342 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:22.483716 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.486711 15241 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:22.481423 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:22.440940 22274 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:22.465323 22359 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:22.493873 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:22.433791 22383 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.047s
W20260709 13:05:22.480685 22380 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.006s
I20260709 13:05:22.497459 15391 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:22.486220 22342 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:22.509534 15317 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.003s
I20260709 13:05:22.518654 15317 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:22.509315 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:22.521399 16024 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:22.496533 22359 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.525734 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.526465 15246 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:22.528570 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:22.528856 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.529250 15242 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 14.
I20260709 13:05:22.531374 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.531937 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:22.532305 15250 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 22 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:05:22.532541 15246 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:22.498438 22382 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:22.500161 22315 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:22.536818 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:22.535392 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 274028us
I20260709 13:05:22.524042 22342 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:22.556861 15247 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:22.564014 15246 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:22.526255 22383 consensus_queue.cc:1243] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:05:22.473253 22311 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.551718 22083 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.530385 22359 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:22.533722 22372 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:22.535262 22306 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.508162 22380 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.535571 22382 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.574267 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.576599 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.582468 15244 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:22.600390 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:22.573709 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 308234us
I20260709 13:05:22.578495 22055 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:22.605432 22055 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:22.574455 22425 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:05:22.582409 22083 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.609859 22083 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:22.612161 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2309) took 1360 ms. Trace:
I20260709 13:05:22.612608 15322 rpcz_store.cc:276] 0709 13:05:21.252031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.165758 (+913727us) service_pool.cc:224] Handling call
0709 13:05:22.166106 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.166567 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.166598 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.167106 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:05:22.351150 (+184044us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:22.373167 (+ 22017us) log.cc:844] Serialized 14 byte log entry
0709 13:05:22.373442 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.373525 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:22.611930 (+238405us) raft_consensus.cc:1685] finished
0709 13:05:22.611952 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:22.612088 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1532,"prepare.queue_time_us":21729,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":3221,"raft.queue_time_us":1412,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":26203,"thread_start_us":183621,"threads_started":1,"wal-append.queue_time_us":332696}
I20260709 13:05:22.550961 15142 catalog_manager.cc:5697] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 2 to 16, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.616276 15142 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 11 to 13, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 13 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.624902 22440 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:22.627053 22437 consensus_queue.cc:1059] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:05:22.627352 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.631194 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:22.635705 16031 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
W20260709 13:05:22.649003 16030 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.000s
I20260709 13:05:22.649665 16030 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:22.651289 16029 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:22.658010 15365 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:22.659554 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.592144 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1106) took 1183 ms. Trace:
I20260709 13:05:22.660257 16032 rpcz_store.cc:276] 0709 13:05:21.409026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.409631 (+   605us) service_pool.cc:224] Handling call
0709 13:05:21.425081 (+ 15450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.463454 (+ 38373us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.591804 (+1128350us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b54007c1d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:22.592058 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10367744}
I20260709 13:05:22.697036 22442 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:05:22.586393 22274 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:22.593200 21916 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:22.701248 22304 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:22.701771 22304 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:22.702751 22304 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:22.704167 22448 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.697072 22342 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.704752 22448 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:22.706488 22342 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:22.706702 15317 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3527) took 1620 ms (client timeout 1994 ms). Trace:
W20260709 13:05:22.707186 15317 rpcz_store.cc:269] 0709 13:05:21.086030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.094662 (+  8632us) service_pool.cc:224] Handling call
0709 13:05:22.706512 (+1611850us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b5400412654. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:22.706642 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769368832}
I20260709 13:05:22.670502 15142 catalog_manager.cc:5697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 7 to 14. New cstate: current_term: 14 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.708454 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:22.709226 15317 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:05:22.585096 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 178886us
I20260709 13:05:22.714968 15316 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:05:22.691140 15322 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:22.597186 22443 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.676882 15250 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:22.663160 22433 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:22.717468 15216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.011s
I20260709 13:05:22.696545 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1107) took 1120 ms. Trace:
I20260709 13:05:22.739195 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1000) took 1354 ms. Trace:
W20260709 13:05:22.711063 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48637.9us
I20260709 13:05:22.739312 16033 rpcz_store.cc:276] 0709 13:05:21.576076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.576286 (+   210us) service_pool.cc:224] Handling call
0709 13:05:21.588094 (+ 11808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.899323 (+311229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.696193 (+796870us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54004844d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:22.696453 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":712441088}
I20260709 13:05:22.719096 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3543) took 1391 ms. Trace:
I20260709 13:05:22.710019 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:22.739777 15322 rpcz_store.cc:276] 0709 13:05:21.385279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.658840 (+1273561us) service_pool.cc:224] Handling call
0709 13:05:22.690682 (+ 31842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.732646 (+ 41964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.739128 (+  6482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:22.740835 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:22.742038 15317 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:22.744450 16028 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:22.742128 15365 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:22.745317 16024 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 13:05:22.733471 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.745046 15289 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:22.747269 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:22.740847 15216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.011s
I20260709 13:05:22.752526 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.757802 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:22.658860 22369 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:22.590600 22382 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:22.680722 22256 consensus_meta.cc:287] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.756s	user 0.007s	sys 0.003s
I20260709 13:05:22.681319 22222 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:22.785791 15289 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:22.762742 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:22.658000 22372 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:22.743273 15325 rpcz_store.cc:276] 0709 13:05:21.327804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.232566 (+904762us) service_pool.cc:224] Handling call
0709 13:05:22.268816 (+ 36250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.269051 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:22.291390 (+ 22339us) log.cc:844] Serialized 14 byte log entry
0709 13:05:22.718544 (+427154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:22.718622 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:22.718725 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.718849 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:22.719021 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":26578,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":1884,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":6365,"thread_start_us":426080,"threads_started":1}
I20260709 13:05:22.772578 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.790518 15242 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:22.773248 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:22.772293 22152 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:22.775696 15241 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:22.802106 15317 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:22.802733 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:22.803238 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.804107 15317 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:22.791497 15244 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:05:22.756119 22200 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:22.755394 22443 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.805481 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:22.661496 22182 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.103s
I20260709 13:05:22.589275 22306 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:22.810799 15246 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:05:22.816138 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.816303 15317 raft_consensus.cc:2376] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22. Re-sending same reply.
I20260709 13:05:22.771209 22381 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:22.817618 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:22.709713 15142 catalog_manager.cc:5697] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 11. New cstate: current_term: 11 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.822328 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:22.826840 15322 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:22.839915 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.778250 22222 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.853935 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:22.859066 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 117002us
I20260709 13:05:22.860664 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.897197 15247 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:22.897459 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.865432 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.898218 15241 raft_consensus.cc:2368] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21.
I20260709 13:05:22.898535 15246 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:22.867089 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.807119 22352 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:05:22.898293 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.804387 22372 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.801527 22245 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:22.867278 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.903864 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:22.904629 15248 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:22.899518 15244 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:05:22.900556 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:22.906363 15317 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:22.901096 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.910063 15246 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:22.902199 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 48385us
I20260709 13:05:22.911227 22372 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:22.911482 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:22.911728 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:22.912376 15391 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:22.808789 22415 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:22.913185 15243 raft_consensus.cc:2410] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:05:22.913312 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.815737 22200 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.764106 22450 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.131s
I20260709 13:05:22.813125 22435 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:22.756309 22433 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:22.920791 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:22.932042 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:22.950734 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:22.802258 22256 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:22.953682 15393 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:05:22.978513 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 57812.3us
I20260709 13:05:22.960985 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:22.903007 22222 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:22.953351 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 214927us
I20260709 13:05:22.965898 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:22.822000 22033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.016s	sys 0.016s
I20260709 13:05:22.776695 22369 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:22.913806 22274 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:22.979354 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:22.922119 22415 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:22.927434 22200 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:22.934665 21916 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.016434 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:23.016639 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:23.025031 15399 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:22.994697 15317 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:22.988636 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:23.028456 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:23.029460 15325 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:22.962208 22381 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:23.028589 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:23.023447 22456 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:23.036028 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:23.037086 15394 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:22.986217 22033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.017s	sys 0.016s
I20260709 13:05:23.027706 15391 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:23.031968 15399 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:23.031031 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:23.018428 22448 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:23.017261 22415 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:23.026219 22312 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:23.047489 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:23.056893 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.027285 22274 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:23.060957 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:23.080050 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 221718us
W20260709 13:05:23.092206 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.061612 22448 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:23.113201 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:23.121726 15317 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:23.030673 21916 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:22.981587 22435 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.036176 22370 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 13:05:23.125679 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.037176 22381 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:23.165978 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 174891us
I20260709 13:05:23.063813 22033 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:23.163461 15325 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
W20260709 13:05:23.166023 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 186650us
I20260709 13:05:23.150707 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:23.182075 15394 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:23.074105 22464 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:23.182538 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:23.183498 15214 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:23.134702 22448 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.193228 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:23.115231 22463 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:23.196730 15317 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:23.129936 22352 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:23.153578 21916 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:23.201045 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:23.202296 15393 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:23.139240 22443 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.205077 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:23.115520 22359 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.185070 22462 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.197618 22245 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:23.197124 22448 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:23.216612 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:23.217859 15291 leader_election.cc:400] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21.
I20260709 13:05:23.226540 15291 leader_election.cc:403] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:23.201116 22182 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.193969 22456 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:23.062282 15142 catalog_manager.cc:5697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 5 to 10, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 10 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:05:23.200340 22318 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:23.228086 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:23.259917 22318 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:23.226549 16033 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:05:23.232684 22460 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:05:23.260988 22318 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.209811 15317 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
W20260709 13:05:23.242699 22459 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 13:05:23.266650 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.247056 22349 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:23.248764 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3548) took 1442 ms. Trace:
I20260709 13:05:23.269352 15319 rpcz_store.cc:276] 0709 13:05:21.805937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.056416 (+250479us) service_pool.cc:224] Handling call
0709 13:05:23.248600 (+1192184us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b5400078354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:23.248703 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164333440}
I20260709 13:05:23.250330 22133 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.208554 22455 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:23.229761 22467 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:05:23.210376 22370 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:05:23.251631 22452 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:05:23.199622 22454 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
W20260709 13:05:23.216873 22407 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.729s	user 0.007s	sys 0.004s
I20260709 13:05:23.254052 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:23.257239 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.298038 15246 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:23.258852 15245 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:05:23.260022 16028 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:23.242259 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:23.302690 16032 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:23.193598 22312 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:05:23.217410 22306 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:23.243256 22458 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 13:05:23.264770 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:23.311718 15398 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:23.311787 15393 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:23.227886 22256 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:23.272271 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.209163 22450 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:23.274690 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:23.265784 22435 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:23.317984 15244 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:23.318186 15317 raft_consensus.cc:2376] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22. Re-sending same reply.
I20260709 13:05:23.267385 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:23.275581 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 205144us
I20260709 13:05:23.198629 22464 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.304351 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:05:23.324700 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 57400.6us
I20260709 13:05:23.202732 22274 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.206449 22463 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.264076 22182 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.293512 22370 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:23.318542 22441 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.341912 15996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.000s	sys 0.007s
I20260709 13:05:23.225530 22462 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.342476 15317 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 13:05:23.336691 15322 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.001s
W20260709 13:05:23.347177 15996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.001s	sys 0.007s
I20260709 13:05:23.317991 22456 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.331939 22387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.005s
I20260709 13:05:23.353425 15322 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
W20260709 13:05:23.353662 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 590996us
I20260709 13:05:23.353720 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3546) took 1737 ms. Trace:
I20260709 13:05:23.361871 15317 rpcz_store.cc:276] 0709 13:05:21.616550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.327279 (+1710729us) service_pool.cc:224] Handling call
0709 13:05:23.342135 (+ 14856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:23.353328 (+ 11193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.353644 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:23.365682 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.310326 22133 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:05:23.366899 22387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.005s
I20260709 13:05:23.342324 22256 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:23.310446 22471 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:05:23.342554 22467 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:23.348179 22349 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:23.341147 22369 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:23.330196 22468 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21.
I20260709 13:05:23.327136 22450 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.317624 22407 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.377097 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2301) took 1206 ms. Trace:
I20260709 13:05:23.394120 15249 rpcz_store.cc:276] 0709 13:05:22.170577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.170735 (+   158us) service_pool.cc:224] Handling call
0709 13:05:22.171175 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.377470 (+206295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.377500 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.406944 (+ 29444us) log.cc:844] Serialized 26 byte log entry
0709 13:05:22.809172 (+402228us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:22.809227 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.809307 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:23.376826 (+567519us) raft_consensus.cc:1685] finished
0709 13:05:23.376890 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:23.377038 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17424,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":571398,"threads_started":2,"wal-append.queue_time_us":642829}
W20260709 13:05:23.393458 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 175720us
I20260709 13:05:23.356246 22433 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.398011 22450 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.384545 21965 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.390974 22349 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:23.384824 22256 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:23.348452 16028 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:05:23.307576 22455 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.406036 22455 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.391798 22306 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:23.389457 22467 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.393828 22286 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.311322 22352 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.399019 21965 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.355160 22245 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.356853 22441 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:23.383728 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.406114 22380 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.423316 15996 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:23.427802 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.428684 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.401304 22256 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:23.427820 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1001) took 2042 ms. Trace:
I20260709 13:05:23.444609 15324 rpcz_store.cc:276] 0709 13:05:21.385568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.249365 (+1863797us) service_pool.cc:224] Handling call
0709 13:05:23.249715 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:23.250105 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:23.250133 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:23.266600 (+ 16467us) log.cc:844] Serialized 26 byte log entry
0709 13:05:23.387275 (+120675us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:23.387330 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.387400 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:23.427594 (+ 40194us) raft_consensus.cc:1685] finished
0709 13:05:23.427615 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:23.427760 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87218,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":17418,"thread_start_us":57969,"threads_started":1,"wal-append.queue_time_us":118613}
I20260709 13:05:23.398190 22407 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.432042 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.451812 15247 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:23.400998 22381 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.422991 15249 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:23.436618 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:23.437090 15393 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:23.437515 22455 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.437986 22392 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 2.215s	user 0.004s	sys 0.003s
I20260709 13:05:23.438536 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:23.458952 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.367686 22456 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.443801 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.419544 22477 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:05:23.447849 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:23.453435 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:23.454784 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:23.462934 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:23.455128 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 128433us
I20260709 13:05:23.432904 22359 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.417785 22344 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 13:05:23.444685 22152 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.011s	sys 0.013s
I20260709 13:05:23.433207 22306 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:23.394910 22370 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.454020 22154 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:23.485049 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:23.447873 22441 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.488101 15321 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:23.489655 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:23.490643 22467 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.490757 22370 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:23.502429 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:23.458750 22470 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:23.483853 22152 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.012s	sys 0.013s
I20260709 13:05:23.454031 22387 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:23.462301 22433 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:23.487778 22154 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:23.506800 15393 raft_consensus.cc:2368] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21.
I20260709 13:05:23.507544 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:23.435752 22349 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.481633 22471 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:23.517377 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.532740 15321 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:23.518321 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 55800us
W20260709 13:05:23.534430 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 70060.5us
I20260709 13:05:23.491626 21965 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:23.501524 22344 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:23.567842 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:23.484563 22286 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
W20260709 13:05:23.610008 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.610616 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:23.611820 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:23.611390 16032 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:23.613341 16026 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:23.614918 22462 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:23.512338 22152 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:23.535892 22154 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:23.620121 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 52413.6us
I20260709 13:05:23.632833 15321 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:23.577682 22471 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.462049 22455 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.577811 22464 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:23.626626 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:23.533944 22482 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.208s
I20260709 13:05:23.758831 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:23.624662 22349 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:23.737807 22485 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:05:23.763636 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 137136us
W20260709 13:05:23.752959 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.536041 22433 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.535260 22387 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.655136 22182 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:23.767302 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:23.738142 22471 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:23.742442 22462 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:23.776942 22462 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.777391 22462 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:23.778808 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 3110) took 1026 ms. Trace:
I20260709 13:05:23.779209 15243 rpcz_store.cc:276] 0709 13:05:22.752111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.752239 (+   128us) service_pool.cc:224] Handling call
0709 13:05:23.778607 (+1026368us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400398ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:23.778746 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367391616}
I20260709 13:05:23.512158 22470 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.787904 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:23.796082 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:23.656311 22306 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.743916 22484 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:05:23.805415 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:23.784610 22482 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:23.786018 22182 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:23.798153 22355 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:23.834731 15319 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:23.848047 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:23.813398 22482 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.813598 22182 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:23.855796 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:23.856941 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 75688.3us
I20260709 13:05:23.856892 15393 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:23.829425 22456 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.862159 15243 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:23.865142 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.865832 15241 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:23.856710 22482 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:23.870141 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.870893 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:23.872551 16032 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:05:23.876061 15247 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: [22.10-22.10]
I20260709 13:05:23.806341 22152 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:23.878216 15243 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:23.888741 22387 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.843349 22355 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:23.892405 22372 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.960s	user 0.012s	sys 0.002s
I20260709 13:05:23.878523 22490 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:23.873026 22503 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.892115 22455 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:23.910873 22490 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:23.935119 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 107805us
I20260709 13:05:23.938298 15363 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:23.914324 22372 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.947978 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:23.949519 22494 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:05:23.958710 22470 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:23.969015 22415 consensus_meta.cc:287] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.900s	user 0.004s	sys 0.006s
W20260709 13:05:23.973526 22448 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.000s
I20260709 13:05:23.976626 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:23.908195 22182 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:23.942905 22495 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:05:23.924299 22503 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:23.984495 22200 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.951s	user 0.013s	sys 0.000s
I20260709 13:05:23.969563 22415 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:23.974622 22433 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:24.001657 15390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 1032) took 2839 ms (client timeout 1908 ms). Trace:
W20260709 13:05:24.002206 15390 rpcz_store.cc:269] 0709 13:05:21.162348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.173036 (+ 10688us) service_pool.cc:224] Handling call
0709 13:05:24.000173 (+2827137us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54002bdc54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.001576 (+  1403us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253810560}
I20260709 13:05:24.007457 15395 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:24.008347 15362 connection.cc:256] RPC call timeout handler was delayed by -1.6958447129999286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
I20260709 13:05:24.004742 22182 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:23.974089 22448 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:24.016711 22507 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:05:24.017459 22501 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:05:24.018200 22500 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:05:24.018985 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1120) took 1490 ms. Trace:
I20260709 13:05:24.023628 22503 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:24.024988 22372 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:24.015076 22382 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 1.208s	user 0.013s	sys 0.001s
I20260709 13:05:24.025513 22463 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:24.005554 22490 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:24.012020 22222 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.995s	user 0.005s	sys 0.009s
I20260709 13:05:23.993395 22200 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.047844 22382 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.033267 22355 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:24.037721 22496 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:05:24.040011 22482 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.041514 22415 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:24.041841 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 1039) took 1681 ms. Trace:
I20260709 13:05:24.051294 16029 rpcz_store.cc:276] 0709 13:05:22.360129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.360319 (+   190us) service_pool.cc:224] Handling call
0709 13:05:22.651048 (+290729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.651774 (+   726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.041625 (+1389851us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400632c50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.041770 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630969728}
I20260709 13:05:24.044878 16024 rpcz_store.cc:276] 0709 13:05:22.528476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.549922 (+ 21446us) service_pool.cc:224] Handling call
0709 13:05:22.745090 (+195168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.755134 (+ 10044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.018747 (+1263613us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400550ad0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.018901 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447899904}
I20260709 13:05:24.050866 16026 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:24.059875 22187 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:24.060108 22154 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.062690 22490 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:24.060961 22482 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:24.072996 22462 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.073707 22245 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.074352 22245 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.074743 16028 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:24.055570 22256 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.001s
I20260709 13:05:24.076211 22256 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.076529 22245 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:24.077605 22245 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.055694 22222 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.079523 15392 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:24.078848 22245 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.080457 22222 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:24.081346 22200 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:24.083716 22245 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:24.075459 22462 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:24.105887 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:24.106858 16024 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:24.110674 22154 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:24.113425 16030 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:24.116063 22471 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.120676 22448 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:24.107174 22256 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:24.111760 22382 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:24.123258 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:24.123967 16029 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:24.126842 22471 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:24.127211 22252 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:24.127590 22252 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:24.128511 22252 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.129472 22252 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.141274 16024 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:24.144680 16029 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
W20260709 13:05:24.146186 15290 connection.cc:256] RPC call timeout handler was delayed by -1.3930803289999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:05:24.147358 15290 connection.cc:256] RPC call timeout handler was delayed by -1.0892185320000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 13:05:24.147962 15290 connection.cc:256] RPC call timeout handler was delayed by -1.0451185320000604s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
I20260709 13:05:24.147995 22471 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:24.149959 22382 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.151768 22255 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.153803 22471 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.151059 22382 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:24.155755 15397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3621) took 1923 ms (client timeout 1824 ms). Trace:
W20260709 13:05:24.156196 15397 rpcz_store.cc:269] 0709 13:05:22.232121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.232480 (+   359us) service_pool.cc:224] Handling call
0709 13:05:24.155496 (+1923016us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b5400153bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.155683 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143570304}
I20260709 13:05:24.156797 22471 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:24.157704 22255 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:24.157994 22439 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.607s	user 0.010s	sys 0.006s
I20260709 13:05:24.159368 15396 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:24.161146 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3006) took 1245 ms. Trace:
I20260709 13:05:24.161489 15396 rpcz_store.cc:276] 0709 13:05:22.916148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.916283 (+   135us) service_pool.cc:224] Handling call
0709 13:05:24.159169 (+1242886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.159808 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.160911 (+  1103us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400153bd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.161083 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2844952320}
I20260709 13:05:24.156898 22382 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:24.162580 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3553) took 1962 ms. Trace:
I20260709 13:05:24.163050 15322 rpcz_store.cc:276] 0709 13:05:22.200084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.360881 (+1160797us) service_pool.cc:224] Handling call
0709 13:05:23.361290 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:23.441492 (+ 80202us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:23.480763 (+ 39271us) log.cc:844] Serialized 14 byte log entry
0709 13:05:23.747432 (+266669us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:23.747567 (+   135us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:23.747693 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.037188 (+289495us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:24.162333 (+125145us) spinlock_profiling.cc:243] Waited 80 ms on lock 0x7b54003e35d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:24.162388 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:24.162526 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39488,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":180,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":7609,"spinlock_wait_cycles":189274752,"thread_start_us":266046,"threads_started":1,"wal-append.queue_time_us":349078}
I20260709 13:05:24.165189 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:24.166709 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:24.167062 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:24.167354 15322 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:24.168401 15242 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:24.168980 22440 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.169103 22382 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:24.169466 22440 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.187206 15322 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:24.190958 15996 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:24.197170 22163 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:24.198935 15242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 3119) took 1381 ms (client timeout 1716 ms). Trace:
I20260709 13:05:24.199036 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:24.199277 15242 rpcz_store.cc:269] 0709 13:05:22.818186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.839516 (+ 21330us) service_pool.cc:224] Handling call
0709 13:05:24.198776 (+1359260us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540001e854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.198879 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3029643136}
I20260709 13:05:24.199546 15322 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:24.200462 22382 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:24.202116 22382 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:24.202493 22350 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:05:24.202832 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.202948 22350 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:05:24.203385 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.203099 22382 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.203886 22350 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.205485 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 3010) took 1241 ms. Trace:
I20260709 13:05:24.206732 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2308) took 2960 ms. Trace:
I20260709 13:05:24.207109 15316 rpcz_store.cc:276] 0709 13:05:21.251664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.164181 (+912517us) service_pool.cc:224] Handling call
0709 13:05:22.714593 (+550412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.733502 (+ 18909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.206540 (+1473038us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b5400412650. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.206673 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262551424}
I20260709 13:05:24.205862 15392 rpcz_store.cc:276] 0709 13:05:22.963762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.983604 (+ 19842us) service_pool.cc:224] Handling call
0709 13:05:24.205294 (+1221690us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001540d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.205427 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2405715840}
I20260709 13:05:24.209103 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.209720 15316 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:24.210981 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.211601 15316 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:24.212499 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.213321 15316 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:24.213491 22440 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:24.214365 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.214672 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:24.218550 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.215551 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.221094 22253 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:24.223217 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.228571 15322 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:24.230515 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:24.230917 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.231730 15322 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:24.232056 15316 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:24.229826 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.233103 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:24.234030 15322 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:24.234675 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.235829 22245 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:24.235777 22253 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:24.227882 22154 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:24.225967 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.237406 15320 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:24.238684 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.242436 15320 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:24.243505 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.239719 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.240202 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.240674 22154 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.240759 22253 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:24.241291 22245 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:24.225291 22187 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:05:24.255681 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.209750 22471 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.258267 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:24.258916 22371 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:24.259727 22067 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:24.260028 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.261229 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.279814 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:24.280630 15316 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 24: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:24.263283 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3004) took 1358 ms. Trace:
I20260709 13:05:24.280992 15395 rpcz_store.cc:276] 0709 13:05:22.905058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.915412 (+ 10354us) service_pool.cc:224] Handling call
0709 13:05:22.915745 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.009732 (+1093987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.262882 (+253150us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001950d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:24.263189 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506884992}
I20260709 13:05:24.283114 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.283972 22383 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:24.284416 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.254556 15322 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:24.286012 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.270028 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:24.270687 15242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:24.287783 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.273375 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:24.256353 22154 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:24.288100 15249 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:24.291122 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.276367 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:24.288128 15242 raft_consensus.cc:606] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:24.291344 15322 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:05:24.277738 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.292181 15242 raft_consensus.cc:614] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:24.292466 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3558) took 1557 ms. Trace:
I20260709 13:05:24.292833 15322 rpcz_store.cc:276] 0709 13:05:22.734989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.286942 (+1551953us) service_pool.cc:224] Handling call
0709 13:05:24.287358 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.292205 (+  4847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.292412 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:24.264946 22187 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:24.268683 22394 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:24.296096 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.298584 15322 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:24.300812 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3560) took 1219 ms. Trace:
I20260709 13:05:24.301703 15322 rpcz_store.cc:276] 0709 13:05:23.081728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.294662 (+1212934us) service_pool.cc:224] Handling call
0709 13:05:24.296420 (+  1758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.300420 (+  4000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.300734 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:24.299263 22383 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.290378 22371 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:24.289366 22385 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:24.289330 22253 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:24.304621 22252 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:24.293823 22352 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:24.308208 22252 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:24.308041 22187 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.308816 22252 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:24.295432 22445 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:24.316154 15317 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:24.316934 22349 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.317566 22349 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.306965 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.304735 15322 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:05:24.335951 22240 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:24.336063 22355 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:24.336683 22240 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.338845 22448 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:24.339838 22491 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.340411 22491 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:24.341490 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.344005 22304 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:24.346446 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 408219us
I20260709 13:05:24.347819 22148 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:24.347980 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:24.348376 22148 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.348905 22148 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:24.348954 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:24.350484 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:24.350797 15362 connection.cc:256] RPC call timeout handler was delayed by -1.5725447129999566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 13:05:24.351109 15241 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:24.351176 15362 connection.cc:256] RPC call timeout handler was delayed by -1.5491447129999187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 13:05:24.351706 15362 connection.cc:256] RPC call timeout handler was delayed by -1.4753447129999131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 13:05:24.352028 15362 connection.cc:256] RPC call timeout handler was delayed by -1.4645447129998956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 13:05:24.352293 15362 connection.cc:256] RPC call timeout handler was delayed by -1.4627447129998927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 13:05:24.352574 15362 connection.cc:256] RPC call timeout handler was delayed by -1.3709447129999717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
I20260709 13:05:24.352932 22222 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:24.352468 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:24.354333 15243 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:24.352945 15362 connection.cc:256] RPC call timeout handler was delayed by -1.2908447129999558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 13:05:24.353777 22222 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.357214 22482 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.357913 22482 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.363148 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:24.280009 22471 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.363539 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 1111) took 1115 ms. Trace:
I20260709 13:05:24.349007 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:24.372599 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:24.335763 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:24.374961 15396 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:24.378082 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:24.377478 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:24.378058 15395 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:24.380231 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:24.382385 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:24.373307 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:24.384936 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:24.385632 15249 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:24.387281 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:24.388485 15245 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:24.389173 15242 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:24.375886 16030 rpcz_store.cc:276] 0709 13:05:23.248319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.248501 (+   182us) service_pool.cc:224] Handling call
0709 13:05:23.248842 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.113959 (+865117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.363269 (+249310us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b540041d2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:24.363468 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987905280}
I20260709 13:05:24.392541 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:24.393628 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:24.390740 22484 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:24.390964 22502 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:05:24.400254 22482 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:24.401799 22222 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:24.403158 15244 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:05:24.404335 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:05:24.405212 22457 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:24.406301 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:24.407061 22315 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:24.409036 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:24.410051 15394 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:24.390898 22407 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:24.417567 15243 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:24.415426 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:24.418576 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:24.419577 15392 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:24.420990 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:24.421746 15399 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:24.423645 16032 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:24.386368 22182 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:24.427212 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:24.430513 15320 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:24.437040 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:24.437726 15249 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:05:24.438954 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:24.439759 16030 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:24.444350 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.446547 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:24.447640 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.417337 22484 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:24.449704 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 158688us
I20260709 13:05:24.436507 22355 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:24.429570 22457 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:24.476617 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:24.423874 22256 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:24.429872 22306 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:24.431035 22504 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:05:24.478343 15323 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:24.455818 22491 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:24.480130 16030 raft_consensus.cc:1217] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Deduplicated request from leader. Original: 17.14->[19.15-19.15]   Dedup: 19.15->[]
I20260709 13:05:24.466648 22355 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.459537 22163 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:24.430963 22222 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:05:24.484620 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:24.485689 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 71983.1us
W20260709 13:05:24.451869 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 69603.1us
I20260709 13:05:24.486133 16024 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:24.534914 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:24.539076 16032 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:24.541316 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:24.531575 22350 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:24.457015 22407 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:24.493903 16030 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:05:24.468667 22351 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:24.457185 22315 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:24.503176 22358 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:24.503979 22457 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.506940 22252 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.508359 22154 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.496172 22163 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:24.511770 22415 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:24.513260 22055 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:24.517838 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.518738 15998 leader_election.cc:400] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21.
I20260709 13:05:24.608171 15998 leader_election.cc:403] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:05:24.522500 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:24.526315 22504 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:24.609088 16033 raft_consensus.cc:2393] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:05:24.527132 16025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 1115) took 2553 ms (client timeout 2117 ms). Trace:
W20260709 13:05:24.610181 16025 rpcz_store.cc:269] 0709 13:05:21.973968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.974103 (+   135us) service_pool.cc:224] Handling call
0709 13:05:24.526830 (+2552727us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b5400474d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.527003 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864045312}
I20260709 13:05:24.490360 22306 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.473357 22477 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:24.472921 22387 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.531080 22256 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:24.531647 15241 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
W20260709 13:05:24.541220 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 134308us
I20260709 13:05:24.517356 15320 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
W20260709 13:05:24.486770 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 71469.1us
I20260709 13:05:24.544149 15249 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:24.631403 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:24.632476 16025 raft_consensus.cc:2368] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:24.547348 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.549961 22407 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.538743 22491 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.634490 22245 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:24.634584 22491 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:24.636463 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89214us
W20260709 13:05:24.552893 15325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 1008) took 1854 ms (client timeout 1790 ms). Trace:
I20260709 13:05:24.638306 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:24.638418 15325 rpcz_store.cc:269] 0709 13:05:22.698686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.790407 (+ 91721us) service_pool.cc:224] Handling call
0709 13:05:24.552659 (+1762252us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400083c54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.552804 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390412032}
I20260709 13:05:24.497428 22355 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:24.555111 15362 leader_election.cc:400] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15.
W20260709 13:05:24.599400 15250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2313) took 2063 ms (client timeout 2116 ms). Trace:
I20260709 13:05:24.640712 15362 leader_election.cc:403] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:24.551769 22482 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:05:24.640779 15250 rpcz_store.cc:269] 0709 13:05:22.535804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.536606 (+   802us) service_pool.cc:224] Handling call
0709 13:05:24.599132 (+2062526us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b540011b2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:24.599302 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181086080}
I20260709 13:05:24.561683 22370 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:24.616050 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 97494.1us
I20260709 13:05:24.642984 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.638137 22255 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:05:24.644948 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.562661 22182 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.646160 22182 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:24.649200 22182 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:24.617930 15246 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 15: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:24.553320 22351 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:24.651222 22351 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.652721 22351 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:24.598853 22152 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.654410 22355 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.654624 22152 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:24.556066 22358 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.657572 22358 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:24.662607 16031 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 19. Ops: []
I20260709 13:05:24.666764 22347 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:24.667913 22347 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:24.672220 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:24.673177 15241 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:24.673523 15250 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:24.675453 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:24.676136 15245 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:24.676473 22445 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:24.677191 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:24.678611 22445 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:24.679173 22445 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:24.679704 22445 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:24.682403 22255 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:24.683054 22255 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:24.684273 22255 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:24.698634 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 60459.9us
I20260709 13:05:24.700006 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:24.701148 22370 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:24.701711 22370 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:24.702194 22370 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:24.709569 22255 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:24.710358 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65523.6us
I20260709 13:05:24.711181 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:24.711961 21916 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:24.607002 22163 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:24.770363 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 143720us
W20260709 13:05:24.779910 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.606362 22315 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:24.607355 22415 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:24.617188 22306 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:24.613499 22504 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:24.637773 22491 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:24.769625 22387 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:24.945189 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.946260 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.040563 15316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.037s	sys 0.118s
I20260709 13:05:24.552014 22521 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.227s
W20260709 13:05:25.114840 15316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.038s	sys 0.119s
I20260709 13:05:25.100113 22370 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.101882 22055 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:25.102290 22154 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:25.057610 15365 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.033s	sys 0.057s
W20260709 13:05:25.410284 15365 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.033s	sys 0.061s
W20260709 13:05:25.410689 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 855493us
I20260709 13:05:24.555545 22385 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:05:24.619568 22382 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21.
I20260709 13:05:24.556397 22484 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:25.106102 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 381222us
I20260709 13:05:25.131160 15999 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:25.417846 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 286773us
I20260709 13:05:25.105430 22033 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.137501 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:25.422325 15392 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:25.137665 15397 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:25.122262 22055 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.423838 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.425191 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.425725 22055 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:25.146343 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 599059us
I20260709 13:05:25.425774 15397 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:25.426801 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:25.427474 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:25.428589 15362 leader_election.cc:400] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18.
W20260709 13:05:25.123680 22148 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.774s	user 0.018s	sys 0.014s
I20260709 13:05:25.433213 22148 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.434484 22542 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:25.435452 22148 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:25.435672 22542 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:25.120016 22222 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.436056 22542 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:25.436272 22222 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.436983 22542 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.438539 22222 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:25.162762 22383 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.859s	user 0.004s	sys 0.016s
I20260709 13:05:25.180641 22387 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:25.181505 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 262245us
I20260709 13:05:25.182332 22466 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:25.440335 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.440451 22466 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.442212 22385 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.442808 22349 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:25.442730 22385 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.184422 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1011) took 2484 ms. Trace:
I20260709 13:05:25.443811 15317 rpcz_store.cc:276] 0709 13:05:22.699639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.363327 (+663688us) service_pool.cc:224] Handling call
0709 13:05:23.374733 (+ 11406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.316703 (+941970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.184122 (+867419us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b54001c57d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:25.184339 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2163804288}
I20260709 13:05:25.120267 22480 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 14. Current term is 15.
I20260709 13:05:25.186462 22256 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.188795 22370 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:25.190903 22358 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.004s
I20260709 13:05:25.191107 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2319) took 3656 ms. Trace:
W20260709 13:05:25.191957 22304 consensus_meta.cc:287] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.847s	user 0.002s	sys 0.015s
W20260709 13:05:25.192798 22350 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.003s
I20260709 13:05:25.206642 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.104094 22315 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:25.221236 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 116724us
I20260709 13:05:25.133884 22471 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:25.170162 22415 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.254391 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1016) took 1740 ms. Trace:
I20260709 13:05:25.264680 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2318) took 3778 ms. Trace:
I20260709 13:05:25.459939 15323 rpcz_store.cc:276] 0709 13:05:21.486008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.251497 (+1765489us) service_pool.cc:224] Handling call
0709 13:05:23.251826 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.492034 (+1240208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.264401 (+772367us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400219dd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:25.264614 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2819752320}
I20260709 13:05:25.176882 22504 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 22.10, Last appended by leader: 10, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.251718 22437 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.273113 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3556) took 2538 ms. Trace:
W20260709 13:05:25.316090 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 122953us
I20260709 13:05:25.463317 22437 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.465478 22437 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:25.319730 15214 leader_election.cc:400] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:25.320629 15242 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:05:25.463347 15316 rpcz_store.cc:276] 0709 13:05:22.734331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.282434 (+1548103us) service_pool.cc:224] Handling call
0709 13:05:24.282829 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.283030 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:24.446509 (+163479us) log.cc:844] Serialized 14 byte log entry
0709 13:05:25.272724 (+826215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:25.272781 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:25.272835 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.272902 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.273047 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":238489,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":116550,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6593,"spinlock_wait_cycles":16154496,"thread_start_us":988774,"threads_started":3,"wal-append.queue_time_us":799021}
I20260709 13:05:25.466106 15214 leader_election.cc:403] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:25.466696 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 147119us
I20260709 13:05:25.467074 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:25.467268 15316 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:25.449362 22382 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:25.322369 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:25.467908 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2330) took 1314 ms. Trace:
I20260709 13:05:25.468238 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:25.468673 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:25.469419 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:25.321973 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:25.323439 15247 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:25.323714 15248 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:05:25.445600 22033 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.323493 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:25.472721 15244 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:25.474198 22437 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:25.474627 15242 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:25.476433 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:25.476979 22355 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:25.321040 22351 consensus_meta.cc:287] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.007s
I20260709 13:05:25.349944 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:25.347069 22163 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.004s
I20260709 13:05:25.477876 16033 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:25.478076 15321 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:25.371315 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3575) took 1248 ms. Trace:
I20260709 13:05:25.479153 15320 rpcz_store.cc:276] 0709 13:05:24.122802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.257929 (+135127us) service_pool.cc:224] Handling call
0709 13:05:25.371132 (+1113203us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400078354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:25.371249 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":369993984}
I20260709 13:05:25.372268 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2330) took 1025 ms. Trace:
I20260709 13:05:25.349359 22187 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:25.375577 22541 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:25.376794 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.485628 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.382365 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2310) took 4109 ms. Trace:
I20260709 13:05:25.487579 15318 rpcz_store.cc:276] 0709 13:05:21.272820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.176580 (+903760us) service_pool.cc:224] Handling call
0709 13:05:22.176887 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.177230 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.177258 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.177706 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:05:22.434560 (+256854us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:22.525536 (+ 90976us) log.cc:844] Serialized 14 byte log entry
0709 13:05:22.527821 (+  2285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.527893 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:24.033486 (+1505593us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b180004a680. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1
0709 13:05:25.280972 (+1247486us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b180004a680. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:25.382115 (+101143us) raft_consensus.cc:1685] finished
0709 13:05:25.382137 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.382300 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13456,"prepare.queue_time_us":90998,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":22175,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":7966,"spinlock_wait_cycles":18280064,"thread_start_us":256431,"threads_started":1,"wal-append.queue_time_us":370402}
I20260709 13:05:25.376437 22538 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.499447 22538 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.326090 22306 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:25.390043 22527 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:05:25.394361 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.504005 22306 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:25.506631 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:25.132890 15394 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:25.419937 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.420687 22545 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:25.421203 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:25.423471 22535 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:25.501982 22538 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.528589 15398 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:25.431787 22347 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.439832 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:25.184291 22445 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 13:05:25.447403 15392 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:25.530915 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:25.531638 15394 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:25.447307 15319 rpcz_store.cc:276] 0709 13:05:21.534928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.270352 (+1735424us) service_pool.cc:224] Handling call
0709 13:05:23.270642 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:23.835419 (+564777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.190826 (+1355407us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b5400084154. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:25.191041 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296677632}
W20260709 13:05:25.448370 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.533550 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.455634 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3569) took 1714 ms. Trace:
I20260709 13:05:25.534906 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:25.535547 15392 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:25.535125 15317 rpcz_store.cc:276] 0709 13:05:23.741342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.444826 (+1703484us) service_pool.cc:224] Handling call
0709 13:05:25.454871 (+ 10045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.455130 (+   259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.455170 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:25.455222 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:25.455278 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.455353 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.455553 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.451751 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.536605 15397 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:25.456790 15399 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:25.440409 22540 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:25.439281 22383 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:25.458151 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:25.461975 15323 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:05:25.438212 22542 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:25.450467 22358 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.322655 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:25.544696 15243 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:25.471436 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:25.459756 15325 rpcz_store.cc:276] 0709 13:05:23.513671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.639705 (+1126034us) service_pool.cc:224] Handling call
0709 13:05:24.640032 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.640226 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:05:25.103109 (+462883us) log.cc:844] Serialized 14 byte log entry
0709 13:05:25.253765 (+150656us) log.cc:844] Serialized 14 byte log entry
0709 13:05:25.253936 (+   171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:25.253989 (+    53us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:25.254049 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.254136 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.254310 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":462192,"prepare.queue_time_us":465114,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":137786,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":8575,"thread_start_us":149728,"threads_started":2,"wal-append.queue_time_us":142913}
I20260709 13:05:25.468271 15316 rpcz_store.cc:276] 0709 13:05:24.153571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.466624 (+1313053us) service_pool.cc:224] Handling call
0709 13:05:25.466917 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.467656 (+   739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.467853 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.482412 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:25.478154 22163 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.480537 15246 rpcz_store.cc:276] 0709 13:05:24.346682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.347716 (+  1034us) service_pool.cc:224] Handling call
0709 13:05:25.372075 (+1024359us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540010bb54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:25.372208 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618804992}
I20260709 13:05:25.547771 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.484478 15241 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:25.473922 22033 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.494729 15318 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:25.496002 15249 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:25.498649 22385 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:25.467914 22382 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:25.498401 22541 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:25.415690 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.487160 15213 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:25.531057 22067 raft_consensus.cc:2764] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 13:05:25.511706 15321 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:25.575623 15320 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:25.506078 22311 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:25.481777 22522 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.854s	user 0.005s	sys 0.007s
I20260709 13:05:25.430868 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:25.530090 16031 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:25.538858 22546 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:05:25.534837 22445 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.552871 22437 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.512557 22466 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.548102 15392 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
W20260709 13:05:25.549907 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 67590.9us
I20260709 13:05:25.551671 15317 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:05:25.626911 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.560565 15243 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:25.490849 22350 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:05:25.531659 22200 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:25.572695 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 85674.3us
I20260709 13:05:25.573143 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3578) took 1234 ms. Trace:
I20260709 13:05:25.636137 15318 rpcz_store.cc:276] 0709 13:05:24.338592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.494005 (+1155413us) service_pool.cc:224] Handling call
0709 13:05:25.494465 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.572826 (+ 78361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.573073 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.510731 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:25.573493 15316 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:05:25.574550 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:25.572208 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:25.555310 22471 raft_consensus.cc:2764] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:05:25.577981 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3579) took 1193 ms. Trace:
I20260709 13:05:25.581750 15394 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
W20260709 13:05:25.595559 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 164780us
I20260709 13:05:25.642720 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:25.642874 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:25.644126 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:25.643673 15394 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:25.629624 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:25.645311 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:25.595055 22033 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:25.562028 22055 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:25.633109 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.635615 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:25.647361 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:25.638295 15248 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:25.640151 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 68054.6us
I20260709 13:05:25.644606 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:25.632216 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:25.642164 15325 rpcz_store.cc:276] 0709 13:05:24.384572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.548671 (+1164099us) service_pool.cc:224] Handling call
0709 13:05:25.577477 (+ 28806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.577666 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.577699 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:25.577739 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:25.577776 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.577828 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.577931 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.648712 15244 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:05:25.540395 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3571) took 1738 ms. Trace:
I20260709 13:05:25.649397 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:25.649295 15323 rpcz_store.cc:276] 0709 13:05:23.802105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.461342 (+1659237us) service_pool.cc:224] Handling call
0709 13:05:25.461640 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.540071 (+ 78431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.540316 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.539439 22347 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.644133 22154 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.650915 22536 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:25.651458 22154 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.651798 22536 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:25.648391 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:25.653959 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:25.653298 16026 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:25.655455 15213 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:25.654341 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:25.624397 22123 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:25.625694 22286 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.634119 22547 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.544068 22540 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.570850 22441 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:05:25.652750 22347 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.639477 22437 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.675925 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:25.676626 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.678783 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:25.640275 22385 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.644016 22182 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:25.679670 22154 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.658936 22480 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:25.796685 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2335) took 1166 ms. Trace:
I20260709 13:05:25.797180 15249 rpcz_store.cc:276] 0709 13:05:24.639802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.664299 (+ 24497us) service_pool.cc:224] Handling call
0709 13:05:24.664755 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.572502 (+907747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.796384 (+223882us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b5400315e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:25.796610 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1911265664}
I20260709 13:05:25.663818 22304 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:25.798573 22304 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:25.799403 22541 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:25.799526 22304 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.663523 22148 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:25.802572 22148 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:25.803035 22148 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:25.803156 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:25.772540 22407 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.048s	sys 0.082s
W20260709 13:05:25.804315 22407 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.048s	sys 0.082s
I20260709 13:05:25.679785 22370 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:25.804893 22370 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:25.805794 22370 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.676177 22222 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:25.806878 22222 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:25.807821 22222 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.812242 22445 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.815636 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.675594 22350 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:25.675346 22510 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:25.645654 22200 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.653038 22383 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.691846 22532 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:25.772099 15394 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:25.663036 22055 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.777370 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:25.829672 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 169782us
I20260709 13:05:25.832790 15392 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:25.777824 22385 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.779331 22252 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.780427 22187 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:25.675521 22491 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:05:25.783025 22437 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.784396 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:25.785527 22441 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:25.785983 22358 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.794260 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.828905 22154 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:05:25.693482 22547 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.851917 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.845589 22055 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.853996 22547 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.836023 22383 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.855414 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.856189 15393 raft_consensus.cc:2368] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:25.856794 22383 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:25.857106 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.857565 15391 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:05:25.857867 15393 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:25.858502 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.859163 15391 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:25.832995 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:25.859990 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:25.861228 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.861742 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.862450 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:25.823900 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 164128us
I20260709 13:05:25.862630 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:25.826417 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:25.828305 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.741039 22382 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:25.695109 22123 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260709 13:05:25.678570 22503 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:05:25.681425 22286 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:25.836179 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:25.869210 15393 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:25.887622 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:25.873391 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:25.861685 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:25.871763 15998 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:25.835686 22445 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:25.873898 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:25.889003 16032 raft_consensus.cc:2376] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21. Re-sending same reply.
I20260709 13:05:25.834399 22532 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:25.849727 22529 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.598s	user 0.000s	sys 0.001s
I20260709 13:05:25.888742 15390 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:25.930948 15390 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:05:25.877041 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44173.4us
I20260709 13:05:25.932154 15365 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:25.836053 22510 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:25.931813 15390 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:25.968432 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 313026us
I20260709 13:05:25.970268 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:25.971336 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:25.843963 22385 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:25.873489 22154 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:25.978493 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:25.982926 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:25.929447 22182 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:25.927754 22535 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:25.887502 22187 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:25.927196 22441 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:25.988790 22342 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:25.989086 22560 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.999632 15324 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:26.002517 22521 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:26.003765 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:26.006270 22083 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:25.929052 22445 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.009827 22503 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:26.010990 22152 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:25.982836 22437 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:25.982394 22055 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:26.015376 22200 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:25.991247 22187 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.008529 22255 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:25.990098 22182 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.991403 22535 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.030546 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3577) took 1794 ms. Trace:
I20260709 13:05:26.035864 22240 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:26.036180 22525 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.923s	user 0.000s	sys 0.004s
I20260709 13:05:26.103281 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:26.104640 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:26.105978 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:26.106961 15243 raft_consensus.cc:2393] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:26.055886 22437 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:26.038707 22448 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:26.115477 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 222028us
I20260709 13:05:26.114151 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:26.039659 22163 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:25.938956 22532 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:25.940238 22347 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:25.934473 22033 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:26.008476 22286 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:26.047176 15395 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:26.047108 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 175219us
I20260709 13:05:26.131798 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:26.132977 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:26.042016 22529 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:05:25.902400 22306 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
I20260709 13:05:26.044816 22545 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.041049 22154 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:25.988428 22491 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 13:05:26.045120 22537 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.046706 22521 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:26.052420 22503 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.097815 15320 rpcz_store.cc:276] 0709 13:05:24.236480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.479989 (+1243509us) service_pool.cc:224] Handling call
0709 13:05:25.480275 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.576083 (+ 95808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.030167 (+454084us) spinlock_profiling.cc:243] Waited 95.2 ms on lock 0x7b54002ed6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:26.030455 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218880768}
I20260709 13:05:26.050083 22342 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:26.105275 15244 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:26.111016 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.109423 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:26.116618 15318 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:26.117625 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:26.036819 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53969.2us
W20260709 13:05:26.119189 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 187115us
I20260709 13:05:26.129753 22350 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.096704 22182 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:26.164716 22342 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.138110 21965 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:26.167002 21965 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:26.167423 21965 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:26.046547 22560 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.129132 22347 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.171977 22560 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:26.174201 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1021) took 1831 ms. Trace:
I20260709 13:05:26.112929 22441 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.174639 15319 rpcz_store.cc:276] 0709 13:05:24.342489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.533274 (+1190785us) service_pool.cc:224] Handling call
0709 13:05:25.533737 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.535599 (+  1862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.535633 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:25.536085 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:05:25.911299 (+375214us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:05:25.911355 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.911455 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:26.173985 (+262530us) raft_consensus.cc:1685] finished
0709 13:05:26.174006 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.174140 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3563,"raft.queue_time_us":2338,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":21890,"thread_start_us":336943,"threads_started":1,"wal-append.queue_time_us":590280}
I20260709 13:05:26.090379 22255 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:26.123440 15243 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:05:26.100548 22535 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:26.126912 15325 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:05:26.115144 22564 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:05:26.125029 15363 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:26.115357 22437 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:26.110972 22055 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:26.135664 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:26.137744 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3634) took 1020 ms. Trace:
I20260709 13:05:26.200611 15395 rpcz_store.cc:276] 0709 13:05:25.117141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.118167 (+  1026us) service_pool.cc:224] Handling call
0709 13:05:26.003536 (+885369us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:05:26.137677 (+134141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26059520}
I20260709 13:05:26.109663 22152 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:05:26.122102 22540 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:26.119935 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:26.145936 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:26.149842 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:26.203275 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 57437.9us
I20260709 13:05:26.148262 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:26.082772 22510 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.143654 22545 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.172011 22347 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:26.154784 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1015) took 2659 ms. Trace:
I20260709 13:05:26.141306 22286 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:26.162449 22033 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.162669 22154 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.145179 22503 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:26.137985 22490 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:26.183527 15318 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
W20260709 13:05:26.194845 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 69912us
I20260709 13:05:26.238129 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:26.238626 16024 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:26.239857 16032 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:26.205518 22542 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:26.150892 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.246292 15320 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
W20260709 13:05:26.203411 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53640us
I20260709 13:05:26.185845 22350 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.206987 15322 rpcz_store.cc:276] 0709 13:05:23.495414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.332182 (+836768us) service_pool.cc:224] Handling call
0709 13:05:24.332618 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:24.333122 (+   504us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:24.482799 (+149677us) log.cc:844] Serialized 14 byte log entry
0709 13:05:25.099629 (+616830us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:25.119859 (+ 20230us) log.cc:844] Serialized 52 byte log entry
0709 13:05:25.120047 (+   188us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:25.120551 (+   504us) log.cc:844] Serialized 14 byte log entry
0709 13:05:25.365808 (+245257us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b18003983e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f36697a24bc 00007f3666af048b 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287
0709 13:05:25.366172 (+   364us) log.cc:844] Serialized 14 byte log entry
0709 13:05:25.376625 (+ 10453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.378775 (+  2150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:25.848954 (+470179us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:26.154541 (+305587us) raft_consensus.cc:1685] finished
0709 13:05:26.154562 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.154716 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183962,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":5483,"raft.queue_time_us":412751,"raft.run_cpu_time_us":586,"raft.run_wall_time_us":8134,"spinlock_wait_cycles":19231744,"thread_start_us":491673,"threads_started":3,"wal-append.queue_time_us":651350}
W20260709 13:05:26.223981 15247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.015s	sys 0.022s
I20260709 13:05:26.226518 22370 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:26.234321 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 689974us
I20260709 13:05:26.205809 22200 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:26.243000 22148 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.244390 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:26.269788 16028 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:26.205175 22560 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:26.145500 22537 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.204603 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:26.273058 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:26.246030 22542 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:26.209455 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 61274.4us
I20260709 13:05:26.235657 22540 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:05:26.253706 15247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.016s	sys 0.023s
W20260709 13:05:26.282349 15215 connection.cc:256] RPC call timeout handler was delayed by -1.3083051549999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25880000000000003s for a response
W20260709 13:05:26.283056 15215 connection.cc:256] RPC call timeout handler was delayed by -1.2291051549999565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2676s for a response
I20260709 13:05:26.176577 22521 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.258725 15248 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:05:26.260438 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:26.285343 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:26.287222 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:26.238112 22490 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:26.273763 15242 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
W20260709 13:05:26.201108 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65581.9us
I20260709 13:05:26.204207 22569 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:26.284525 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:26.257477 22200 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:26.277678 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 73158.4us
I20260709 13:05:26.290076 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.303807 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.293426 15249 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:26.236384 22286 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.306192 22286 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:26.279245 22542 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:26.295957 22575 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:26.279865 22540 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.312418 22540 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:26.315768 15390 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.317019 15390 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:26.317523 22542 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:26.320874 15324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3567) took 2879 ms (client timeout 2001 ms). Trace:
W20260709 13:05:26.321339 15324 rpcz_store.cc:269] 0709 13:05:23.441179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.454531 (+ 13352us) service_pool.cc:224] Handling call
0709 13:05:26.320637 (+2866106us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b54001c6bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:26.320757 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5832353664}
W20260709 13:05:26.323958 15398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 1038) took 2887 ms (client timeout 1795 ms). Trace:
I20260709 13:05:26.324303 15391 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:05:26.324385 15398 rpcz_store.cc:269] 0709 13:05:23.436179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.436344 (+   165us) service_pool.cc:224] Handling call
0709 13:05:26.323766 (+2887422us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54001955d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:26.323889 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4597179776}
I20260709 13:05:26.325678 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.326115 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.326480 22542 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:26.326886 15391 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:26.327961 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.329357 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.330060 15391 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15.
I20260709 13:05:26.331113 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.328241 22540 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.331877 15391 raft_consensus.cc:2368] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:26.300992 15395 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:26.333678 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:26.335142 15391 raft_consensus.cc:2376] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20. Re-sending same reply.
I20260709 13:05:26.336632 16026 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:05:26.338961 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1022) took 1877 ms. Trace:
I20260709 13:05:26.337177 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:26.342510 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:26.342746 22542 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.343351 22542 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.343986 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:26.341539 15391 raft_consensus.cc:2376] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 15. Re-sending same reply.
I20260709 13:05:26.345335 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:26.345512 22542 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:26.273985 22560 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.360324 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.363181 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:26.286728 22387 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:26.366405 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.349086 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:26.361248 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 57195.3us
I20260709 13:05:26.370056 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:26.371198 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:26.386111 15244 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:26.386543 15243 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:26.335258 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.371804 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:26.387691 15395 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:26.387704 15247 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:26.388893 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:26.372932 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 125486us
I20260709 13:05:26.339355 15316 rpcz_store.cc:276] 0709 13:05:24.461207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.549540 (+1088333us) service_pool.cc:224] Handling call
0709 13:05:25.573175 (+ 23635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.637296 (+ 64121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.338779 (+701483us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b5400077e50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:26.338905 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53623040}
I20260709 13:05:26.382968 15242 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:05:26.286324 22445 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:26.395915 15391 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:26.361608 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:26.293080 22490 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:26.405963 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:26.444198 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58014.8us
I20260709 13:05:26.445393 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:26.439940 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.437647 15249 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:26.406482 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.407469 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.354720 22200 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:26.271921 22370 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.361222 22560 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:26.445281 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:26.455404 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.456424 22445 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:26.404412 22448 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:26.268301 22255 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.300745 22240 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
W20260709 13:05:26.471364 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.472101 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:26.473950 15244 raft_consensus.cc:2468] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:26.362520 22569 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:26.405627 22538 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:05:26.457244 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 62744.6us
I20260709 13:05:26.452344 22382 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.278369 22055 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.453263 22547 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.461602 22245 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:26.500856 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 217307us
W20260709 13:05:26.482710 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 191295us
W20260709 13:05:26.486845 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.488690 15392 raft_consensus.cc:2393] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 15: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:26.489547 15395 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:26.384495 22407 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260709 13:05:26.480158 22256 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:26.527912 22256 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:26.528504 22256 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:26.530018 22585 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:26.533874 15390 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:26.441296 22286 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:05:26.453635 22083 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:05:26.542950 22083 consensus_queue.cc:1243] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:05:26.454486 22572 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 13:05:26.478731 22445 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.544345 22445 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:26.461807 22440 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:05:26.549710 22440 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:26.550109 22440 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:26.550915 22440 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.552117 22440 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:26.552765 22567 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:05:26.505616 22182 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:26.554934 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.554986 22182 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:26.557821 22286 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.559165 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1056) took 1032 ms. Trace:
I20260709 13:05:26.559687 15390 rpcz_store.cc:276] 0709 13:05:25.526873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.930380 (+403507us) service_pool.cc:224] Handling call
0709 13:05:25.930776 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:26.315418 (+384642us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b54001255a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b7806f 00007f3669bf0f60 00007f3669bf27de 00007f3669bfcb49 00007f3669bfd416 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62
0709 13:05:26.558899 (+243481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.559108 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43014016}
W20260709 13:05:26.506166 22571 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:05:26.505637 22545 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:26.507675 22480 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:26.509631 21965 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.498644 22382 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.512084 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:26.502758 22547 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.512921 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:26.513345 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.513600 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.513989 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.514334 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.514672 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.515044 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:26.595352 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.596014 15325 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:26.597278 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.515375 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.515699 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:26.517849 22315 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:26.486807 22542 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:05:26.518931 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:26.487723 22448 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.503683 22540 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:26.526602 22569 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.540405 22535 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:26.495328 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 50016.8us
I20260709 13:05:26.557992 22311 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.561417 22240 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.598107 15319 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:26.643734 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:26.644474 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.558413 22286 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.602209 15322 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:26.608439 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:26.614703 15323 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:26.598677 15320 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:05:26.654881 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:26.655236 15320 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:26.655445 15318 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:26.657202 15316 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 15.
W20260709 13:05:26.616832 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 97991.7us
I20260709 13:05:26.657902 15323 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:05:26.659256 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:26.660912 15215 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:26.529153 22200 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.560524 22387 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:26.502976 22245 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:26.590898 22347 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 13:05:26.687033 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:26.687937 16033 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:26.688570 22504 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:26.689419 16026 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:05:26.694463 22383 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:26.696687 22547 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:26.698323 15391 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:05:26.561416 22536 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:26.646431 15317 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:26.662678 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:26.632591 22575 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:26.667156 22595 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.669313 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:26.670284 22387 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:26.670313 22245 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:26.663647 22540 raft_consensus.cc:2764] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
W20260709 13:05:26.743116 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 80548.1us
I20260709 13:05:26.671007 21965 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:26.672161 22200 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:26.756507 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 87282.9us
I20260709 13:05:26.757423 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:26.759058 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:26.675639 15394 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:26.759819 15394 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:26.667881 22563 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:26.598045 15325 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:26.706653 15318 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:26.708722 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:26.645016 22350 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:26.734059 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:05:26.735571 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 424130us
I20260709 13:05:26.658445 22587 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.743935 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:26.771027 15215 leader_election.cc:400] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:26.745766 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:26.748054 16025 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:26.760632 15394 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.775117 15394 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:26.733523 22575 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:26.749262 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:26.664529 22148 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:26.756251 16024 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:05:26.778577 16032 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:26.747665 22315 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:26.800895 16033 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:05:26.792336 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 489634us
I20260709 13:05:26.763815 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:26.657996 22240 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.651811 22311 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.769064 22563 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:26.812839 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49096.8us
W20260709 13:05:26.748798 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 114194us
I20260709 13:05:26.769593 22306 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:26.781522 22055 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:26.826838 15996 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:26.779085 22182 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:26.829906 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.830502 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:26.828568 15394 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:05:26.776873 22502 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:26.833360 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:26.780689 22540 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:26.748651 22387 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.790951 22575 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:26.790427 22350 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.827739 22067 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:26.746392 22536 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:26.854266 22154 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:26.783214 22587 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.831290 22563 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:26.864059 22240 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:26.781934 22351 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.074s
I20260709 13:05:26.866556 22448 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:26.867610 22382 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:26.834569 22055 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:26.869777 22387 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:26.875191 15999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.554s (SENT) [suppressed 26 similar messages]
W20260709 13:05:26.879225 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45958.1us
I20260709 13:05:26.828537 15291 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:26.748507 22595 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:26.856289 22532 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
I20260709 13:05:26.879559 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:26.835515 22182 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.898751 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:26.909271 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 78871.3us
I20260709 13:05:26.826076 22585 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
W20260709 13:05:26.874980 22584 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:05:26.856823 22540 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:26.891672 22437 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
W20260709 13:05:26.961931 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 133486us
I20260709 13:05:26.965317 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:26.965966 15244 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
I20260709 13:05:26.967424 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:26.968114 15247 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:26.969309 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:26.874888 22315 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
I20260709 13:05:26.950172 15394 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:26.967078 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:26.970017 15325 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:26.920102 22148 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:05:26.977350 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 197127us
I20260709 13:05:26.951310 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:26.933146 22382 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:05:26.942974 22484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.471s	user 0.014s	sys 0.011s
I20260709 13:05:26.884995 22350 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.927898 22055 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:26.959200 22540 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:26.981092 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:26.920743 22502 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
W20260709 13:05:27.050684 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 69707.7us
I20260709 13:05:27.051563 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:26.973384 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:26.981912 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:26.984894 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.053102 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.985648 15215 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:26.950898 22182 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:26.904657 22256 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.972115 22385 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:26.967070 22387 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:26.966982 22304 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.023s	sys 0.018s
I20260709 13:05:26.939527 22532 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:27.087900 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 212722us
W20260709 13:05:27.037562 22484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.566s	user 0.015s	sys 0.011s
I20260709 13:05:26.995549 22569 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:05:27.092679 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 107144us
I20260709 13:05:26.994342 22382 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:26.970964 22491 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.100s
W20260709 13:05:27.125275 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 73835.3us
I20260709 13:05:26.968844 22437 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:26.961639 22200 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
W20260709 13:05:27.079454 22445 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.001s
I20260709 13:05:27.128803 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:27.069741 22148 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:27.125820 22315 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:27.073124 22067 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:27.091053 22154 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:27.193408 22586 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.225s
I20260709 13:05:27.194612 22596 raft_consensus.cc:2804] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:27.185197 22382 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:27.203727 22598 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:05:27.213044 22595 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.215101 22350 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.216058 22532 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.091684 22385 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:27.073395 22304 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.024s	sys 0.018s
W20260709 13:05:27.235606 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.236572 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 263288us
I20260709 13:05:27.097805 22387 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.173167 22569 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.296190 22437 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.219017 22570 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:27.264374 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:27.228263 22256 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:27.269124 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 140396us
I20260709 13:05:27.299923 22535 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.242799 22547 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:27.242465 22536 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.275985 22200 consensus_queue.cc:1243] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:05:27.274012 22342 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:27.280496 22542 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:27.268750 22445 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.264889 22358 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:27.275637 22067 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.265102 22311 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.282413 22602 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:27.305193 22490 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.833s	user 0.008s	sys 0.003s
I20260709 13:05:27.282847 22154 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.360247 22385 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.270644 22286 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.226639 22245 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.218113 22589 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.056s
W20260709 13:05:27.295549 15396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3635) took 2168 ms (client timeout 2588 ms). Trace:
W20260709 13:05:27.403216 15396 rpcz_store.cc:269] 0709 13:05:25.126888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.127050 (+   162us) service_pool.cc:224] Handling call
0709 13:05:25.802988 (+675938us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebc00a0 00007f366ebbf984 00007f366813a6d4 00007f366813a662
0709 13:05:27.295333 (+1492345us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b5400270954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:27.295485 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2178998272}
I20260709 13:05:27.403882 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:05:27.317495 15214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.013s	sys 0.011s
W20260709 13:05:27.404624 15214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.013s	sys 0.012s
W20260709 13:05:27.294898 22600 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:05:27.291559 22537 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.336900 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:27.285331 22587 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.294772 22581 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.294384 22579 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:05:27.228247 22560 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.746s	user 0.011s	sys 0.000s
I20260709 13:05:27.339869 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:27.341188 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:27.412024 15243 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:27.412140 15244 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 25 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:05:27.341702 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:27.342190 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:27.414292 15248 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:27.345835 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:27.347807 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 83563.2us
I20260709 13:05:27.347787 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:27.416445 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:27.329679 22540 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:27.345000 22504 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.650s	user 0.013s	sys 0.000s
I20260709 13:05:27.363066 22387 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:27.366528 22542 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.440346 15321 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:27.344504 22569 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:27.339010 22596 raft_consensus.cc:697] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:27.442790 15397 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 23 because replica has last-logged OpId of term: 22 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 9.
I20260709 13:05:27.328804 22575 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.330498 22563 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.356320 22547 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.356920 22304 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:27.363602 22055 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.379228 22602 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:27.280546 22503 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.035s	user 0.012s	sys 0.000s
W20260709 13:05:27.383618 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 142014us
I20260709 13:05:27.389333 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:27.465888 15398 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:27.389652 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:27.408041 22240 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:05:27.471248 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:27.401750 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:27.470125 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:27.303969 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.407215 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.473165 15398 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:27.437644 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:27.440203 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:27.357821 22570 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:27.444461 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:27.485095 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.473958 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:27.486580 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:27.487767 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:27.375046 22358 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.381541 22490 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.383219 22532 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.059s
I20260709 13:05:27.454221 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:27.456954 15250 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:27.492280 16025 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:27.448709 22579 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:27.497023 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:27.459102 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65937.9us
I20260709 13:05:27.363194 22182 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.472515 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:27.418618 15291 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:27.498633 15391 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:05:27.498756 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 80223.7us
W20260709 13:05:27.476944 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.410246 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:27.478071 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.458557 22547 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.480273 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:27.515331 15322 raft_consensus.cc:2368] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:27.515580 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.468954 22304 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:27.440127 22586 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:27.438891 22560 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.479487 15318 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
W20260709 13:05:27.518355 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 171762us
I20260709 13:05:27.523316 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:27.524334 15213 leader_election.cc:400] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:27.471104 22387 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:27.443959 22581 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.516177 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:27.501084 22256 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:27.517167 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.543314 15325 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:27.544234 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:27.491284 22587 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.517454 22351 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.492290 22286 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.520206 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:27.524422 15318 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:27.524961 15213 leader_election.cc:403] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:05:27.555186 15391 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:27.509261 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:27.556020 15398 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.558419 22359 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:27.539003 15322 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:27.492527 15242 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:27.471626 22503 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.569006 22503 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:27.518325 15390 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:27.570408 15393 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:27.521175 22606 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:27.571062 22606 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.571487 22606 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:27.573137 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.521121 22536 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:27.519393 22586 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:27.514596 22385 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:05:27.538262 22387 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.537380 22350 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.621496 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:27.605891 22342 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:27.587270 15318 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:27.555687 22570 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.589767 22602 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.631978 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.590342 22445 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.575872 22351 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.592160 22560 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:27.542467 22256 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:27.643006 15322 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:27.596315 22563 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.597679 22441 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.647828 22441 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.598248 22616 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:27.650552 22616 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:27.651396 22621 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:05:27.595187 22382 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.553977 22587 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.578981 22286 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.653824 22382 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:27.579360 22536 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.602792 22245 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.603966 22581 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:27.607568 22182 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.650573 22628 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:05:27.609205 22067 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:27.610993 22562 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:27.611603 22055 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.552706 22596 consensus_queue.cc:237] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.614313 22575 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.615697 22358 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.678887 22256 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.680326 22256 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:27.681819 15397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3642) took 2450 ms (client timeout 2049 ms). Trace:
I20260709 13:05:27.617285 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:27.617779 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.624549 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:27.626123 15398 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
W20260709 13:05:27.629189 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54282.7us
I20260709 13:05:27.521179 22617 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.121s
I20260709 13:05:27.632970 15318 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:27.595160 22540 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.618091 22586 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:27.662961 22536 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:27.646476 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:27.655120 16028 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:27.655616 15321 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:27.619184 22504 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.619128 22387 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:27.608184 22579 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.671058 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:27.632616 22585 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.631834 22595 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:27.644675 22385 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.688287 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:27.723297 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:27.751138 15318 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:27.723106 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.724411 16029 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:27.754799 15316 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:27.674991 22542 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:27.682281 15397 rpcz_store.cc:269] 0709 13:05:25.231467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.784135 (+552668us) service_pool.cc:224] Handling call
0709 13:05:27.681583 (+1897448us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54002bc0d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:27.681744 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3615228288}
W20260709 13:05:27.724009 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 99677.9us
I20260709 13:05:27.759327 15397 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:27.759807 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:27.650113 22441 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.653828 22587 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.760731 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:27.728924 15998 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:27.685309 22535 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:05:27.680330 22593 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.705s	user 0.002s	sys 0.000s
I20260709 13:05:27.734519 22575 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:27.734989 22616 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.774780 22545 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:27.775444 22351 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.747504 22504 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.776845 22545 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:27.777693 22504 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:27.645360 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.779275 15397 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 22 index: 10. Preceding OpId from leader: term: 23 index: 10. (term mismatch)
I20260709 13:05:27.673015 22245 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.761716 22385 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.672382 22562 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:27.683799 22448 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:27.789491 22448 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:27.789274 22245 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.790431 22448 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:27.791607 22630 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:05:27.791734 22245 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.791914 22448 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:27.753809 22595 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.753545 22585 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.799674 22286 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.745321 22581 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.742728 22182 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:27.801851 22562 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.774047 22441 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:27.779734 15397 pending_rounds.cc:85] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 9
I20260709 13:05:27.786692 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:27.627290 22350 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:27.773319 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 44531.3us
I20260709 13:05:27.806870 15322 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:27.661558 22304 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.804927 16026 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:05:27.805176 15397 pending_rounds.cc:107] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 22.10
I20260709 13:05:27.808554 15318 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
W20260709 13:05:27.809540 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 45389.7us
I20260709 13:05:27.823462 15397 raft_consensus.cc:2889] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:27.803020 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:27.810501 16029 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:27.764039 22540 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:27.800541 22585 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.830506 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.773007 22535 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:27.831275 15316 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:27.787528 22490 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:27.829093 16030 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:05:27.804859 22441 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.831926 15318 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:27.774811 22575 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:27.804949 22562 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:27.802196 22359 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:27.816643 22182 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.864109 22545 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.839565 15322 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 25.
I20260709 13:05:27.866050 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.860917 22441 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:27.866889 15322 raft_consensus.cc:2376] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22. Re-sending same reply.
I20260709 13:05:27.867583 22350 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.868132 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.868908 15322 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:27.869112 22569 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.870548 15395 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:27.874521 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:27.877203 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.857558 22540 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:27.874464 22182 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.879261 22540 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.882650 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.883577 15321 raft_consensus.cc:2410] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:05:27.878405 15322 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:27.885519 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:27.857854 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:27.893137 22575 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.900734 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:27.903818 15316 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:27.909500 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:27.813912 22581 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.894193 22521 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:27.914114 15316 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
W20260709 13:05:27.914639 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.896595 21965 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:27.895584 22370 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:27.906749 22182 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:27.919113 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:27.919621 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:27.932894 15398 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:27.917337 22569 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:27.902318 22606 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.917651 21965 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:27.920382 22536 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:27.951413 22502 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:27.898087 22535 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.938108 22607 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:27.913492 22490 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:05:27.938804 22182 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:27.951901 22502 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:27.964318 22490 consensus_queue.cc:1243] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:05:27.964704 22535 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:27.988556 22581 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:27.989701 22619 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.525s	user 0.002s	sys 0.000s
I20260709 13:05:27.989771 22586 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:27.990206 22606 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:27.992345 22591 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.071s	user 0.000s	sys 0.003s
I20260709 13:05:28.032038 15317 raft_consensus.cc:2368] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
W20260709 13:05:28.038968 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.029922 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:28.048887 22123 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:28.049219 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:27.964170 21965 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.050194 22123 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.052970 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3171) took 1088 ms. Trace:
I20260709 13:05:28.053669 15242 rpcz_store.cc:276] 0709 13:05:26.964610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.964786 (+   176us) service_pool.cc:224] Handling call
0709 13:05:26.965249 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.566815 (+601566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.052093 (+485278us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54001a8bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:28.052630 (+   537us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212126464}
I20260709 13:05:28.056452 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:28.057744 15318 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:28.052974 21965 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:28.069243 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:28.075697 15397 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:05:28.099867 15393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3656) took 1807 ms (client timeout 1504 ms). Trace:
W20260709 13:05:28.100544 15393 rpcz_store.cc:269] 0709 13:05:26.293498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.303561 (+ 10063us) service_pool.cc:224] Handling call
0709 13:05:28.099344 (+1795783us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54000267d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:28.099612 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2910988160}
I20260709 13:05:28.104471 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:28.109360 15398 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:28.112135 22033 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:28.112921 22033 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:28.114442 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 60335.8us
I20260709 13:05:28.114543 22033 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.116196 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:28.117699 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:28.118086 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:28.120568 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.121198 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.128461 15318 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:28.131227 15318 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:28.133652 15318 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:05:28.135149 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2348) took 1618 ms. Trace:
I20260709 13:05:28.135752 15318 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:28.135775 15320 rpcz_store.cc:276] 0709 13:05:26.516915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.656150 (+139235us) service_pool.cc:224] Handling call
0709 13:05:26.656472 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:26.798921 (+142449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:26.798960 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:26.799522 (+   562us) log.cc:844] Serialized 52 byte log entry
0709 13:05:26.993720 (+194198us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:27.094282 (+100562us) log.cc:844] Serialized 14 byte log entry
0709 13:05:27.094649 (+   367us) log.cc:844] Serialized 14 byte log entry
0709 13:05:28.067323 (+972674us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b1800013600. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:05:28.134214 (+ 66891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.134350 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:28.134522 (+   172us) raft_consensus.cc:1685] finished
0709 13:05:28.134546 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:28.134788 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":209904,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":3873,"raft.queue_time_us":411949,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":222,"spinlock_wait_cycles":71760768,"thread_start_us":331666,"threads_started":3,"wal-append.queue_time_us":442149}
I20260709 13:05:28.138953 15318 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:05:28.140852 15318 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:28.140902 15320 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:05:28.148548 15317 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 24. Current term is 25. Ops: [24.14-24.14]
I20260709 13:05:28.149397 22123 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:28.150929 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:28.151530 15249 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:28.152278 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:27.974797 22387 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.154991 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:28.156136 15243 raft_consensus.cc:2376] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19. Re-sending same reply.
I20260709 13:05:27.994948 22618 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:28.157776 22618 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:28.158789 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:28.159921 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:28.159488 22502 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.160840 15242 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:28.159547 22618 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.163895 22441 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.149845 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:28.165724 22182 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.164482 15249 raft_consensus.cc:1240] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:05:28.167182 15241 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:28.168742 22441 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:28.170840 15246 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 16.
W20260709 13:05:28.172473 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.981928 22536 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:27.992352 22586 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:28.166174 22618 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:28.153726 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:28.190584 15290 connection.cc:256] RPC call timeout handler was delayed by -1.1041689729999007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
I20260709 13:05:28.192487 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.148054 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:28.194595 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:28.195353 15248 raft_consensus.cc:2468] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 15.
I20260709 13:05:28.196259 22606 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:27.982717 22547 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.194370 22304 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.199944 22547 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:28.200096 22304 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.200870 22148 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:28.201733 22148 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.202955 22315 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:28.203457 22315 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:28.203897 22315 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:28.209498 15242 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:28.162134 22502 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:28.226940 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:28.226795 22628 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:05:28.235868 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.248159 15325 raft_consensus.cc:2368] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16.
I20260709 13:05:28.208577 22148 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:28.276921 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 127319us
W20260709 13:05:28.277424 15394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 1070) took 1398 ms (client timeout 1853 ms). Trace:
I20260709 13:05:28.273866 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:28.277923 15394 rpcz_store.cc:269] 0709 13:05:26.878468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.879178 (+   710us) service_pool.cc:224] Handling call
0709 13:05:28.277011 (+1397833us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b54001545d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:28.277215 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20168448}
I20260709 13:05:28.278774 15393 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:05:28.281877 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.278797 22441 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:28.285557 22441 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.285741 16033 raft_consensus.cc:3055] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:28.285954 22441 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:28.286109 16033 raft_consensus.cc:740] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:28.287395 16033 consensus_queue.cc:260] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.288719 16033 raft_consensus.cc:3060] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:28.290452 22628 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:05:28.290880 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.291090 22628 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:28.291949 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3169) took 1327 ms. Trace:
W20260709 13:05:28.292354 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.292686 22628 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.295092 22586 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.296087 22586 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.298837 22256 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:28.299724 22256 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:28.300065 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.302933 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:28.292367 15250 rpcz_store.cc:276] 0709 13:05:26.964055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.964488 (+   433us) service_pool.cc:224] Handling call
0709 13:05:26.992681 (+ 28193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.492262 (+499581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.291423 (+799161us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54003985d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:28.291769 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067293440}
I20260709 13:05:28.307070 22484 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:28.289748 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.323931 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:28.324316 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.330756 22615 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:28.331336 22615 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:28.331872 22615 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:28.334518 22596 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.336923 22255 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:28.338788 15213 leader_election.cc:400] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:28.339294 15213 leader_election.cc:403] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:05:28.335255 22596 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.338683 22370 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:28.342772 22370 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.345620 22370 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:28.348510 22359 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:28.349773 22547 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:28.349963 22350 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:28.350630 22304 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:28.351353 22304 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.351596 22547 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:28.352272 22547 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:28.352988 22448 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:28.354573 22448 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:28.355077 22448 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:28.356312 22448 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.357574 22570 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:28.359848 22575 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:28.360463 15325 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:28.364284 15325 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:28.367221 22415 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:28.370398 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:28.371857 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.373682 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:28.374630 22387 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:28.374886 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.376502 22033 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:05:28.379372 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.351994 22304 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.357858 22448 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:28.380784 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 188964us
I20260709 13:05:28.422757 22545 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:28.341984 22596 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:28.420809 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.441162 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:28.410326 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.411278 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:28.397286 22304 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:28.428603 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:28.430827 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.418440 22437 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:05:28.427268 22033 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:28.427505 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3680) took 1035 ms. Trace:
I20260709 13:05:28.426391 22586 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:28.408368 22562 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.508s	user 0.015s	sys 0.001s
I20260709 13:05:28.444983 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:28.410372 22652 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.103s	user 0.000s	sys 0.004s
I20260709 13:05:28.461786 22565 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:28.463236 22565 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:28.463313 22385 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:28.463769 22565 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:28.301311 22256 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.464893 22565 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.449337 15393 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:28.460739 22568 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:05:28.461030 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 87568.7us
I20260709 13:05:28.467902 16033 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 13:05:28.469525 16033 pending_rounds.cc:85] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 14
I20260709 13:05:28.457821 15396 rpcz_store.cc:276] 0709 13:05:27.392158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.289135 (+896977us) service_pool.cc:224] Handling call
0709 13:05:28.427231 (+138096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:28.353860 22547 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.488766 15394 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:28.486294 22628 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:28.491045 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:28.497864 15395 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:05:28.498536 15395 pending_rounds.cc:85] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 13
I20260709 13:05:28.498916 15395 pending_rounds.cc:107] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:05:28.498595 22437 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:28.499259 15395 raft_consensus.cc:2889] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:28.501041 22437 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:05:28.508143 22521 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.574s	user 0.014s	sys 0.000s
I20260709 13:05:28.456672 22033 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:28.509656 15399 raft_consensus.cc:2410] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:05:28.509925 22033 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.510408 22299 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.510445 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:28.511188 22299 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.511580 22033 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.512647 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:28.514540 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:28.515926 15392 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:05:28.516654 22387 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:28.517191 22387 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.517930 22387 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:28.518553 22616 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:28.518991 22616 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:28.520030 22616 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.521140 15319 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:28.526829 16031 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:28.527920 22565 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:28.515766 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:28.520566 15391 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:05:28.511698 22545 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:28.538550 16033 pending_rounds.cc:107] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 13:05:28.539077 16033 raft_consensus.cc:2889] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:28.517251 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.555830 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1035) took 1018 ms. Trace:
I20260709 13:05:28.558688 15392 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:28.562029 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.565558 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 74696.1us
W20260709 13:05:28.568262 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 52680us
I20260709 13:05:28.556309 15322 rpcz_store.cc:276] 0709 13:05:27.537052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.134433 (+597381us) service_pool.cc:224] Handling call
0709 13:05:28.134976 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:28.135527 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:05:28.237764 (+102237us) log.cc:844] Serialized 14 byte log entry
0709 13:05:28.555273 (+317509us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:28.555352 (+    79us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:05:28.555409 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.555498 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:28.555643 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92187,"prepare.queue_time_us":126869,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":93,"thread_start_us":297622,"threads_started":1}
I20260709 13:05:28.570246 22152 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:28.556309 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:28.571699 15397 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:28.585846 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:28.594172 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:28.594919 15390 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:28.600380 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:28.605705 22538 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.606325 22538 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.607147 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:28.619868 15397 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:28.631539 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.632835 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.634002 15391 raft_consensus.cc:2410] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:28.651927 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:28.652817 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:28.534668 22575 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:28.674173 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:28.674599 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:28.673609 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.675143 15390 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:28.672833 22585 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:05:28.626121 22545 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:05:28.707090 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.719515 22595 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:28.722503 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:28.722962 15392 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:28.752079 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:28.772746 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.625397 22415 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.115s
I20260709 13:05:28.785492 15246 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:28.799306 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:28.807390 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:28.786656 22502 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.787339 22152 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:28.704744 22575 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:28.827003 15396 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.823594 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.840960 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:28.809015 22148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.011s	sys 0.038s
W20260709 13:05:28.851348 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.860769 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 367090us
W20260709 13:05:28.867161 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.857477 22148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.012s	sys 0.038s
I20260709 13:05:28.873224 15391 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:28.855193 22585 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.886340 15213 leader_election.cc:400] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16.
I20260709 13:05:28.886765 15213 leader_election.cc:403] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:05:28.886332 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:28.887116 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.870358 22347 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:05:28.890496 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.850677 22502 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:28.882803 22359 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.533s	user 0.019s	sys 0.018s
I20260709 13:05:28.899137 16032 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:05:28.903829 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:28.873867 22610 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.183s
I20260709 13:05:28.888525 22350 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.895299 22597 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.005s	sys 0.042s
I20260709 13:05:28.912993 15391 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
W20260709 13:05:28.918023 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 285521us
I20260709 13:05:28.921211 22540 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:05:28.921641 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.901664 22359 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20.
I20260709 13:05:28.863027 22545 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.928320 15394 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
W20260709 13:05:28.915016 22597 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.006s	sys 0.043s
I20260709 13:05:28.933336 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.915676 22385 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.938850 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:28.938948 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:28.941555 22299 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:28.948112 15392 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
W20260709 13:05:28.932497 22615 consensus_meta.cc:287] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.598s	user 0.013s	sys 0.000s
I20260709 13:05:28.950158 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.901376 22585 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.923290 22667 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.939082 22639 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:05:28.957461 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.958757 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.954487 15322 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:05:28.915889 22350 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:28.956453 22660 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:05:28.979112 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.952383 22385 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:28.972623 15317 raft_consensus.cc:2368] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21.
W20260709 13:05:29.034044 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 102195us
I20260709 13:05:29.039844 15250 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:29.042338 22535 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.944s	user 0.016s	sys 0.020s
I20260709 13:05:29.043125 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:29.044420 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.049952 22585 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:29.053284 22315 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.849s	user 0.008s	sys 0.004s
W20260709 13:05:29.055423 22666 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:29.057271 15320 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:29.058609 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:29.060019 15321 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:05:29.060145 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:29.060799 22385 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:29.061142 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.062348 22667 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.062932 22502 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:29.063371 15317 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: [19.11-20.12]
I20260709 13:05:29.064666 22667 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:28.931807 22152 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:29.071935 22570 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.001s
I20260709 13:05:29.074200 22350 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:29.042378 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.076184 15248 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:29.076161 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.076705 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:29.077082 15392 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:29.039852 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:29.058815 22441 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.772s	user 0.012s	sys 0.000s
I20260709 13:05:29.060858 15325 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:29.082415 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:29.085628 15246 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:29.115347 15390 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:29.039430 15394 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:29.118793 15242 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
W20260709 13:05:29.121656 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.124630 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.113597 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.124702 15244 raft_consensus.cc:1275] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:05:29.127530 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:29.130678 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:29.131503 15390 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:29.125844 15249 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:29.110757 15396 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:29.137504 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.138566 15320 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:05:29.080250 22618 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.858s	user 0.011s	sys 0.000s
I20260709 13:05:29.152771 16026 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:29.156991 15318 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:05:28.952701 22615 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.193768 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.193933 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.194561 15247 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:29.053799 22315 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.166654 15392 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:29.167009 15321 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:05:29.146669 22350 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:29.168632 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.169413 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:29.175064 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:29.177443 22668 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
W20260709 13:05:29.181772 15397 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.551s	user 0.029s	sys 0.037s
I20260709 13:05:29.219851 15397 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:29.220968 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.222292 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.223495 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.224221 15397 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:29.225447 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:28.967453 22628 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.161s
I20260709 13:05:29.226257 15397 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:29.202451 15325 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:29.215616 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.227667 22586 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:29.228106 22586 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:29.228365 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:29.229091 22586 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.245440 22586 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:29.218952 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:29.191028 15319 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2346) took 2677 ms (client timeout 2278 ms). Trace:
I20260709 13:05:29.228447 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.246467 15318 raft_consensus.cc:2393] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:29.230190 15325 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:29.247244 15322 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:05:29.230886 22661 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:05:29.120972 22441 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.204747 22575 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:29.233673 22615 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:29.235657 22653 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:29.216106 15320 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
W20260709 13:05:29.216982 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 140536us
I20260709 13:05:29.242334 22350 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.242825 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.243556 22311 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:29.217463 22347 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:29.258699 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:29.246217 15319 rpcz_store.cc:269] 0709 13:05:26.513838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.643415 (+129577us) service_pool.cc:224] Handling call
0709 13:05:29.190656 (+2547241us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54002a6cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:29.190895 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4315533184}
I20260709 13:05:29.259724 15317 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:29.263737 15250 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:29.262621 15241 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:29.272812 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.280431 15396 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:29.291990 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 94553.7us
I20260709 13:05:29.277889 15392 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 25 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:05:29.262634 22653 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:29.308092 15397 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:05:29.308727 15397 pending_rounds.cc:85] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 13
I20260709 13:05:29.315083 15397 pending_rounds.cc:107] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:05:29.315469 15397 raft_consensus.cc:2889] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:29.276539 22347 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:29.309672 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:29.317544 15395 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:29.276695 22667 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16.
W20260709 13:05:29.321465 15399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 1058) took 3779 ms (client timeout 2058 ms). Trace:
I20260709 13:05:29.287992 22441 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:29.324617 15321 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:29.325080 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.325866 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:29.308847 22033 consensus_meta.cc:287] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.797s	user 0.009s	sys 0.013s
W20260709 13:05:29.323947 15399 rpcz_store.cc:269] 0709 13:05:25.532331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.851634 (+319303us) service_pool.cc:224] Handling call
0709 13:05:29.297242 (+3445608us) spinlock_profiling.cc:243] Waited 2.66 s on lock 0x7b54001d9f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:29.311735 (+ 14493us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6109393152}
I20260709 13:05:29.336874 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.337918 15392 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:29.341137 15395 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
W20260709 13:05:29.341478 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.277213 22350 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.345906 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.361166 22315 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:29.364120 22653 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.364779 22547 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:29.365468 22653 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:29.368950 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.370090 15392 raft_consensus.cc:2410] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 13:05:29.379561 15393 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.009s	sys 0.007s
W20260709 13:05:29.373113 15999 leader_election.cc:336] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.554s (SENT)
I20260709 13:05:29.349009 22545 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.377460 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1082) took 1152 ms. Trace:
W20260709 13:05:29.385088 22387 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.866s	user 0.011s	sys 0.006s
I20260709 13:05:29.382726 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.386703 15391 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:29.390275 22538 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:29.391966 15320 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:05:29.393618 15395 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:29.394049 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.405978 15321 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
W20260709 13:05:29.395854 15393 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.009s	sys 0.007s
W20260709 13:05:29.410638 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 93786.5us
I20260709 13:05:29.388616 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:29.399144 15390 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
W20260709 13:05:29.381771 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 457988us
I20260709 13:05:29.403992 15399 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:29.412498 15394 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:05:29.412705 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.402076 15398 rpcz_store.cc:276] 0709 13:05:28.220023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.220160 (+   137us) service_pool.cc:224] Handling call
0709 13:05:28.226931 (+  6771us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:28.276597 (+ 49666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:28.276643 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:28.277400 (+   757us) log.cc:844] Serialized 26 byte log entry
0709 13:05:28.767553 (+490153us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:28.767623 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.767734 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:29.372016 (+604282us) raft_consensus.cc:1685] finished
0709 13:05:29.372041 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:29.372196 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46354,"raft.queue_time_us":50701,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":158,"thread_start_us":489633,"threads_started":1,"wal-append.queue_time_us":630516}
I20260709 13:05:29.413735 15317 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
W20260709 13:05:29.414633 15290 connection.cc:256] RPC call timeout handler was delayed by -1.2399361230000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 13:05:29.415390 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.416086 15390 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:29.418360 15399 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:05:29.426643 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 58321.4us
I20260709 13:05:29.432672 15395 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:29.434543 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.442690 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:29.446400 22670 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:29.447371 22670 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.450870 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:29.450984 22347 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.453611 22347 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:29.456297 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.456511 22152 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:29.457086 15245 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
W20260709 13:05:29.458133 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 584166us
I20260709 13:05:29.460680 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:29.410643 22568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.028s	sys 0.069s
W20260709 13:05:29.463832 22568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.028s	sys 0.070s
I20260709 13:05:29.466074 15245 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: [22.10-22.10]
I20260709 13:05:29.467505 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:29.468381 15250 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:29.471029 15250 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:29.471583 22350 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:29.472676 15250 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:29.407861 22387 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.474697 22616 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:29.475800 22387 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:29.476939 16031 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
W20260709 13:05:29.432693 22565 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.902s	user 0.010s	sys 0.003s
I20260709 13:05:29.478624 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:29.447402 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 1159) took 1130 ms. Trace:
I20260709 13:05:29.481163 16026 rpcz_store.cc:276] 0709 13:05:28.318864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.370036 (+ 51172us) service_pool.cc:224] Handling call
0709 13:05:29.447168 (+1077132us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54007c1d54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:29.447313 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1347375360}
W20260709 13:05:29.486724 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49832us
W20260709 13:05:29.487512 15290 connection.cc:256] RPC call timeout handler was delayed by -1.1446979510000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 13:05:29.492606 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:29.500972 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:29.404997 22545 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.539021 15320 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:05:29.546159 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 235618us
W20260709 13:05:29.491618 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53238.9us
W20260709 13:05:29.506690 15290 connection.cc:256] RPC call timeout handler was delayed by -1.0602472490000991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:05:29.547832 15290 connection.cc:256] RPC call timeout handler was delayed by -1.0392361230000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 13:05:29.506850 15322 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
W20260709 13:05:29.515341 22674 log.cc:927] Time spent T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:05:29.518443 15365 connection.cc:256] RPC call timeout handler was delayed by -1.9244345179998845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2116s for a response
W20260709 13:05:29.551232 15365 connection.cc:256] RPC call timeout handler was delayed by -1.4621937529999514s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 13:05:29.551663 15365 connection.cc:256] RPC call timeout handler was delayed by -1.3370937529998628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 13:05:29.551960 15365 connection.cc:256] RPC call timeout handler was delayed by -1.3235937529999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:05:29.552353 15365 connection.cc:256] RPC call timeout handler was delayed by -1.3073937529999284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:05:29.552712 15365 connection.cc:256] RPC call timeout handler was delayed by -1.1993937529998675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 13:05:29.519405 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:29.520270 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:29.523435 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:29.524938 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:29.554200 15246 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
W20260709 13:05:29.553074 15365 connection.cc:256] RPC call timeout handler was delayed by -1.1894937529999652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18380000000000002s for a response
W20260709 13:05:29.525784 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.529534 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.531003 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:29.531834 15248 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:29.555352 15249 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
W20260709 13:05:29.532455 22659 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.034s	user 0.004s	sys 0.000s
I20260709 13:05:29.532737 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:29.534441 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.545588 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:29.553432 15245 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:29.554917 15365 connection.cc:256] RPC call timeout handler was delayed by -1.1714937529999361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
W20260709 13:05:29.555354 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.558823 15244 raft_consensus.cc:2368] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21.
W20260709 13:05:29.562552 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.532109 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.564965 22570 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.581604 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.590076 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:29.593173 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:29.594274 15249 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 25. Ops: []
I20260709 13:05:29.594592 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:29.594789 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.597380 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.598721 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.601311 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.602131 15246 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:29.603068 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.605664 15318 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:29.553071 22616 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:29.612664 15248 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:29.603977 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:29.614167 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.619144 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 138754us
I20260709 13:05:29.620669 15291 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:29.616422 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.624408 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:29.621752 15320 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:29.616398 15245 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:29.615162 22547 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:29.634577 22547 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.616173 22350 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:29.634629 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.636236 15243 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:29.636319 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:29.619078 22538 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:29.637740 22538 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.637810 22653 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:29.635046 22547 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:29.637266 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.635603 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:29.637214 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:29.641350 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.643061 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.638206 22538 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:29.642117 22653 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:05:29.645241 22255 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.308s	user 0.018s	sys 0.004s
I20260709 13:05:29.645179 22653 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.646610 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.647235 15248 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:29.648989 22311 consensus_queue.cc:1048] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:29.650440 22663 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:29.650847 22663 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:29.651257 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.651337 22663 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:29.651678 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.653555 15289 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:29.654983 15324 raft_consensus.cc:2410] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:05:29.655557 22537 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.656054 22537 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.618381 22581 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:05:29.658502 22370 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:29.650878 15246 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:29.659092 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:29.662322 15318 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:29.666095 15245 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:29.667371 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:29.667554 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 51714.8us
I20260709 13:05:29.668249 15244 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:29.665886 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.604803 22570 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.673955 16028 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:29.655581 22350 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:29.679620 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:29.677011 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:29.711566 22670 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:29.718480 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.667101 22616 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:29.736976 15318 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:29.746511 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.675654 22597 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:05:29.780735 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 57360.4us
W20260709 13:05:29.782924 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 106027us
I20260709 13:05:29.692224 22568 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:29.784900 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 97809.7us
W20260709 13:05:29.785645 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 90841.9us
I20260709 13:05:29.700027 22359 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:29.798907 22671 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:05:29.800204 22671 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:29.800669 22671 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:29.802469 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:29.803668 22570 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:29.804283 22359 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.804955 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:29.805910 22545 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:29.806540 22359 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:29.791983 22568 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.806718 22350 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.807456 22669 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:29.809163 22568 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:29.809342 22537 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:29.812983 16031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 1130) took 1282 ms. Trace:
I20260709 13:05:29.819535 22311 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:29.820143 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:29.823186 22256 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:29.823923 22256 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:29.825374 22679 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:29.825798 22679 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:29.826754 16029 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 1131) took 1296 ms (client timeout 1521 ms). Trace:
I20260709 13:05:29.827185 22565 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:29.827365 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:29.827549 22575 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:29.828469 22568 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:29.828912 22568 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:29.829839 22255 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:29.831343 22437 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:29.834853 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:29.827193 16029 rpcz_store.cc:269] 0709 13:05:28.530606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.555907 (+ 25301us) service_pool.cc:224] Handling call
0709 13:05:29.826565 (+1270658us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b540073fad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:29.826696 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729526528}
I20260709 13:05:29.826774 22679 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.836795 22669 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:29.837303 22679 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:29.838927 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:29.839757 15247 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:29.815186 16031 rpcz_store.cc:276] 0709 13:05:28.530218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.555433 (+ 25215us) service_pool.cc:224] Handling call
0709 13:05:28.555894 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:29.477490 (+921596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.812711 (+335221us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b540066eed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:29.812893 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2117488896}
W20260709 13:05:29.842614 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.845378 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:29.850419 15321 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:29.858603 15318 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:29.860659 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:29.862478 22359 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:29.865398 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 409527us
I20260709 13:05:29.863888 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:29.866878 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 62034.2us
I20260709 13:05:29.868134 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:29.870457 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.871402 15321 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
W20260709 13:05:29.865983 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.873430 15290 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:29.875209 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.877521 22537 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:29.872442 22448 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:29.876394 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:29.878638 22448 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:29.879853 22311 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:29.879685 22448 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.863144 22359 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.883846 22681 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:29.884222 22359 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:29.884513 22681 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.879673 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:29.801839 22671 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:29.892946 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 54119.4us
W20260709 13:05:29.893677 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.865278 22597 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.864164 22545 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:29.881677 22538 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.829978 22568 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:29.867093 22033 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:29.922567 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.921387 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:29.866731 22575 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
W20260709 13:05:29.924862 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.867290 22670 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:29.885916 22540 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:29.866802 22347 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:29.895913 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:29.925472 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 359525us
I20260709 13:05:29.965608 15318 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:29.917315 22671 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:29.897621 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:05:29.969118 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 73722.7us
I20260709 13:05:29.924767 22618 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:05:29.942612 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 367496us
I20260709 13:05:29.870164 22669 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.060s
I20260709 13:05:29.924466 22681 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:29.926544 22616 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:05:29.961305 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:29.958644 22033 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:30.027120 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:30.028010 15321 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:30.028867 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:29.967908 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:29.895757 22547 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.031054 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:30.031877 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:30.033207 22537 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:30.033668 22537 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.034060 22537 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:30.034839 22686 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:05:29.958668 22597 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.022936 22653 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:30.039535 22538 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:30.040511 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1048) took 1115 ms. Trace:
I20260709 13:05:30.031944 22547 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:30.027068 22033 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:30.044296 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:30.045740 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:30.040917 15316 rpcz_store.cc:276] 0709 13:05:28.925319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.450902 (+525583us) service_pool.cc:224] Handling call
0709 13:05:29.451290 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:29.451691 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.451723 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:29.452282 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.840691 (+388409us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:29.840729 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.840794 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:30.038669 (+197875us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:30.040054 (+  1385us) raft_consensus.cc:1685] finished
0709 13:05:30.040072 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.040308 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4114,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":18167552,"thread_start_us":388039,"threads_started":1,"wal-append.queue_time_us":526387}
I20260709 13:05:30.047616 22586 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:30.048146 22586 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:30.048496 15316 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 23 index: 10. (index mismatch)
I20260709 13:05:30.049055 22586 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.049818 15316 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:30.050762 15322 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:05:30.052007 15322 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:05:30.053257 15322 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:05:30.053495 22033 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.054678 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:30.056458 15322 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:05:30.058645 15318 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:30.059935 15316 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:29.991132 22568 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:30.061266 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3699) took 1557 ms. Trace:
I20260709 13:05:29.973845 22387 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:29.960754 22545 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:29.965029 22570 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:30.041443 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:29.965251 22540 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.050071 22255 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:29.976480 22347 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:30.080732 15392 rpcz_store.cc:276] 0709 13:05:28.503808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.370890 (+867082us) service_pool.cc:224] Handling call
0709 13:05:29.385909 (+ 15019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:29.406454 (+ 20545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.406486 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:29.412165 (+  5679us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.679242 (+267077us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:29.679302 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.679407 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:30.060958 (+381551us) raft_consensus.cc:1685] finished
0709 13:05:30.060987 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.061191 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3803,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2177,"thread_start_us":218573,"threads_started":1,"wal-append.queue_time_us":457593}
W20260709 13:05:30.085551 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 164279us
I20260709 13:05:30.087025 15242 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:30.084363 22370 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:30.073895 22437 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:30.098421 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:30.060842 22597 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:30.083214 22540 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:30.101392 15321 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
W20260709 13:05:30.131985 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 306449us
I20260709 13:05:30.083657 22387 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:30.160867 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 193046us
W20260709 13:05:30.162818 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 64538.3us
I20260709 13:05:30.163746 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:30.163805 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 3187) took 1295 ms. Trace:
I20260709 13:05:30.165438 15241 rpcz_store.cc:276] 0709 13:05:28.840313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.840551 (+   238us) service_pool.cc:224] Handling call
0709 13:05:30.134900 (+1294349us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b540011add4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:30.135074 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":967410944}
I20260709 13:05:30.121990 22670 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:30.133708 22547 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:30.179157 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.188913 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 230911us
I20260709 13:05:30.202828 22347 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:30.206734 22663 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.001s
I20260709 13:05:30.207298 22663 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.209661 22663 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:30.178624 22255 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:30.220721 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:30.220906 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 174825us
W20260709 13:05:30.211611 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47960.8us
I20260709 13:05:30.212774 15322 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:30.215922 15323 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
W20260709 13:05:30.218606 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46898.1us
I20260709 13:05:30.132058 22570 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:30.232301 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.224411 15323 pending_rounds.cc:85] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 14
I20260709 13:05:30.243283 15323 pending_rounds.cc:107] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:05:30.243595 15323 raft_consensus.cc:2889] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:30.245440 15291 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:30.247478 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.213747 15324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2337) took 3702 ms (client timeout 2496 ms). Trace:
I20260709 13:05:30.267211 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:30.267896 15242 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:30.268639 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:30.269270 15245 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:30.270058 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:30.270663 15247 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:30.166368 22387 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:30.260435 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:30.262025 15324 rpcz_store.cc:269] 0709 13:05:26.511372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.515478 (+  4106us) service_pool.cc:224] Handling call
0709 13:05:30.213472 (+3697994us) spinlock_profiling.cc:243] Waited 3.04 s on lock 0x7b5400218ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:30.213680 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6991754496}
I20260709 13:05:30.280086 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:30.281183 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.280086 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:30.281394 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:30.213234 22653 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:30.287194 15999 leader_election.cc:336] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.604s (SENT)
I20260709 13:05:30.287804 15244 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 26 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 13.
I20260709 13:05:30.289263 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:30.292296 15247 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
W20260709 13:05:30.294564 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 239952us
I20260709 13:05:30.275926 22255 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:30.296344 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:30.219472 22610 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 13:05:30.282693 22616 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:30.217161 22681 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
W20260709 13:05:30.300956 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 139089us
I20260709 13:05:30.210165 22537 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:30.298030 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 77409.2us
I20260709 13:05:30.313448 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:30.305908 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 298146us
I20260709 13:05:30.320283 15245 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:30.300817 22707 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.280262 22669 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:05:30.295759 22437 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:05:30.325827 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.328835 15242 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:30.285876 22676 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:05:30.213608 22370 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.289651 22565 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
W20260709 13:05:30.352165 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 65013.5us
I20260709 13:05:30.312752 22547 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:30.361164 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:30.357798 15362 leader_election.cc:400] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21.
I20260709 13:05:30.362593 15362 leader_election.cc:403] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 13:05:30.358515 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 62256us
W20260709 13:05:30.347110 22679 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.003s
I20260709 13:05:30.365334 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:30.362438 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:30.367899 15318 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:30.369464 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:30.370183 15394 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:30.372990 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:30.300257 22680 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
W20260709 13:05:30.374729 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 131648us
I20260709 13:05:30.311848 22315 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.048s
I20260709 13:05:30.346722 22033 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:30.379784 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3703) took 1874 ms. Trace:
I20260709 13:05:30.382146 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:30.388193 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 74827us
I20260709 13:05:30.361164 22547 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.394922 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:30.367791 22437 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:30.350132 22707 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.384848 15391 rpcz_store.cc:276] 0709 13:05:28.504868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.407723 (+902855us) service_pool.cc:224] Handling call
0709 13:05:29.414203 (+  6480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:29.472780 (+ 58577us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:29.871673 (+398893us) log.cc:844] Serialized 14 byte log entry
0709 13:05:30.378889 (+507216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:30.378988 (+    99us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:30.379426 (+   438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.379544 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.379706 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44404,"prepare.queue_time_us":5568,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":45523,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":807730,"threads_started":3,"wal-append.queue_time_us":369821}
I20260709 13:05:30.393623 22670 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:05:30.399554 22698 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 13:05:30.430277 22664 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.155s	user 0.005s	sys 0.001s
I20260709 13:05:30.396994 22547 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:30.464558 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:30.466818 15245 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:30.468878 15242 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:30.407986 22653 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:30.469518 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 87468.9us
I20260709 13:05:30.473752 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:30.474623 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 99191.1us
I20260709 13:05:30.383849 22540 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.399837 22675 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:05:30.452603 22670 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:30.473165 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 84188.9us
W20260709 13:05:30.450222 22661 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 13:05:30.458864 22701 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:05:30.459394 22711 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:30.460059 22545 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:30.404523 22679 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:30.484119 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:30.484091 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:30.487887 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.479348 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:30.495906 22692 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.476786 22538 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:05:30.523670 22671 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.002s
I20260709 13:05:30.497687 22707 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:30.490535 22670 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:30.471089 22724 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:30.479694 22350 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:05:30.573885 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.573051 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 92788us
W20260709 13:05:30.573989 15999 leader_election.cc:336] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.675s (SENT)
I20260709 13:05:30.576920 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:30.585404 22679 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.586429 22669 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.587189 22669 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.590656 22679 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.594869 22679 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:30.595861 22669 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:30.540697 22570 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:30.604890 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 120834us
I20260709 13:05:30.524309 22715 raft_consensus.cc:2764] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 13:05:30.553661 22699 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
W20260709 13:05:30.617765 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 260093us
I20260709 13:05:30.620604 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:30.597570 22537 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:30.621135 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:30.561203 22033 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:30.657271 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54782.3us
I20260709 13:05:30.654834 15319 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:30.508281 22711 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.659369 22586 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:30.660507 15316 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:30.663228 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:30.663405 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.609978 22708 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21.
I20260709 13:05:30.666569 22736 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:30.666980 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:30.550479 22692 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:30.660351 22703 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.301s	user 0.001s	sys 0.001s
I20260709 13:05:30.643996 22570 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:30.687322 22725 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:05:30.688030 22713 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:05:30.709923 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 135964us
I20260709 13:05:30.711067 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3615) took 1220 ms. Trace:
I20260709 13:05:30.711522 15325 rpcz_store.cc:276] 0709 13:05:29.490992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.491101 (+   109us) service_pool.cc:224] Handling call
0709 13:05:29.491445 (+   344us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:29.503245 (+ 11800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.503301 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:29.503905 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 13:05:29.874158 (+370253us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b18001929a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:05:30.085567 (+211409us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:30.294004 (+208437us) log.cc:844] Serialized 14 byte log entry
0709 13:05:30.308931 (+ 14927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.309025 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:30.710746 (+401721us) raft_consensus.cc:1685] finished
0709 13:05:30.710851 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.711004 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43058,"prepare.queue_time_us":132499,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":26982,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":5373,"spinlock_wait_cycles":13786880,"thread_start_us":339035,"threads_started":2,"wal-append.queue_time_us":673166}
I20260709 13:05:30.659965 22565 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:30.653887 22718 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:30.703341 22570 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.715632 22570 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:30.717921 22700 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
W20260709 13:05:30.719242 22568 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.634s	user 0.002s	sys 0.009s
I20260709 13:05:30.721748 22692 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:30.723016 22540 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:30.560652 22437 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.726610 22387 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.728240 22711 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:30.661463 22671 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.729470 22387 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:30.729569 22671 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.667570 22033 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:30.731089 22586 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:30.677380 22715 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:30.731482 22033 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.732481 22715 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:30.732877 22715 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:30.733389 22671 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:30.733989 22671 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.733698 22715 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.734484 22671 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.735122 22715 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:30.737174 22670 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.738670 22540 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:30.739310 22540 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.740427 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:30.741401 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:30.743144 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2352) took 4225 ms. Trace:
I20260709 13:05:30.743562 15323 rpcz_store.cc:276] 0709 13:05:26.518033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.658983 (+140950us) service_pool.cc:224] Handling call
0709 13:05:30.215368 (+3556385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.267349 (+ 51981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.742926 (+475577us) spinlock_profiling.cc:243] Waited 3.56 s on lock 0x7b5400218ed0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:30.743068 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8178115456}
I20260709 13:05:30.744959 22735 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.745522 22735 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.746876 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:30.747864 22735 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:30.748360 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:30.755695 22359 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:30.756351 22359 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:30.764351 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:30.765173 15399 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:30.767221 22255 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.767465 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:30.767913 22255 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:30.770696 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:30.770787 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:30.771641 15391 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:30.771641 15322 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:30.772589 15321 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:05:30.747889 16024 raft_consensus.cc:2368] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:30.672397 22736 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:30.775851 15999 leader_election.cc:336] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.710s (SENT)
I20260709 13:05:30.777019 22736 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.778167 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:30.706813 22741 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:30.710956 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 52621.7us
I20260709 13:05:30.779032 15399 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:30.779196 22741 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.781035 22723 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:30.704175 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:30.782980 15319 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:05:30.783092 22723 consensus_queue.cc:1243] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:05:30.783740 22723 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:30.783908 15214 leader_election.cc:400] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:30.784155 22723 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:30.781297 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:30.784795 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:30.785450 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:30.784307 15214 leader_election.cc:403] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:30.785115 22723 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.775015 15393 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:30.786617 22729 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:30.786788 22565 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:30.786645 22717 raft_consensus.cc:2764] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:05:30.787647 22565 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.788319 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:30.788614 15365 leader_election.cc:400] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21.
I20260709 13:05:30.774721 22547 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:30.790460 22724 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:30.791091 22724 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.791147 15324 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: [23.10-23.10]
I20260709 13:05:30.791728 22724 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:30.794301 22723 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:30.792161 22547 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:30.759545 22540 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:30.790118 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:30.641939 22370 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:05:30.679870 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 323362us
W20260709 13:05:30.705780 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 419282us
I20260709 13:05:30.809495 15322 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
W20260709 13:05:30.822893 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.823961 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:30.835505 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:30.838671 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:30.845151 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:30.829545 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:30.847136 15393 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:30.847759 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:30.790413 22692 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:30.852756 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 175446us
I20260709 13:05:30.856524 15245 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:30.856760 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:30.857626 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:30.855317 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:30.810175 22671 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:30.814029 22741 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:30.867523 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:30.860065 15249 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:30.757525 22359 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.815411 22538 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:30.828068 22721 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:30.836035 22315 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:05:30.835633 22711 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:30.868415 15242 raft_consensus.cc:2376] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20. Re-sending same reply.
I20260709 13:05:30.871126 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:30.871904 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:30.869555 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:30.848112 22370 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:30.914907 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:30.914748 22370 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:30.904969 15244 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
W20260709 13:05:30.918848 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78730.3us
I20260709 13:05:30.919637 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:30.919962 22717 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:30.920615 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:30.921542 22717 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:30.917294 15244 pending_rounds.cc:85] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 10
I20260709 13:05:30.922307 15244 pending_rounds.cc:107] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:05:30.922592 15244 raft_consensus.cc:2889] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:30.922703 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:30.850063 22680 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:30.851500 22350 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:30.855082 22565 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:30.835494 22568 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:05:30.912922 15246 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:30.911813 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:30.934365 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.916353 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:30.930677 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:30.935655 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:30.931874 15320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.025s	sys 0.011s
W20260709 13:05:30.937456 15363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.011s	sys 0.013s
W20260709 13:05:30.937836 15363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.011s	sys 0.013s
W20260709 13:05:30.936738 15320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.025s	sys 0.011s
W20260709 13:05:30.940313 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 626796us
W20260709 13:05:30.957762 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.906486 22547 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:30.912886 22359 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:30.963459 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:30.968053 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:30.932706 22699 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:30.970026 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:30.933451 22692 raft_consensus.cc:2764] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:05:30.958714 22729 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:30.985056 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:30.985482 16029 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:30.990981 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:30.990617 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 74353.4us
I20260709 13:05:31.006896 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:30.962738 22667 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:05:31.009895 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 535081us
I20260709 13:05:30.964766 22387 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:31.009951 16028 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:31.015187 16026 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:30.978063 22711 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:31.031147 15244 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 18: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:31.016502 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:31.020361 22610 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.029492 22670 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:31.031030 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46372.3us
W20260709 13:05:31.019884 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 84356.1us
I20260709 13:05:30.958271 22739 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:05:31.008642 22708 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:30.976785 22690 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:31.040982 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:30.979135 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 67329.4us
I20260709 13:05:31.008867 22729 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.992458 22680 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:31.036785 15399 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:31.061455 22690 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.058791 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:31.064358 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:31.034416 22735 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:31.058935 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46586.4us
I20260709 13:05:31.030424 22387 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:31.090927 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:31.076668 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 218513us
I20260709 13:05:31.015655 22667 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:31.147164 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:31.140303 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:31.134131 15290 leader_election.cc:336] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.679s (SENT)
I20260709 13:05:31.136231 15244 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:31.150739 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:31.129755 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:31.136947 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.151957 15399 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
W20260709 13:05:31.138818 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 97926.9us
I20260709 13:05:31.153601 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:31.127660 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 61787.1us
I20260709 13:05:31.058952 22311 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:31.162055 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.163281 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.163853 15399 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:31.164703 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.165197 15399 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:31.168469 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:31.187372 15246 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:31.188918 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:31.191195 15323 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:31.046304 22547 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.097s
W20260709 13:05:31.214692 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 175705us
I20260709 13:05:31.215056 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:31.215274 15999 leader_election.cc:336] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.094s (SENT)
W20260709 13:05:31.158727 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 70950.7us
I20260709 13:05:31.215791 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:31.215781 15316 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:31.149590 22387 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:31.128155 22545 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:31.149861 22670 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:31.129120 22729 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:31.220557 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:31.129532 22616 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:31.129185 22741 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.170198 22568 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:31.030366 22538 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.063886 22707 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.106s
I20260709 13:05:31.225768 15365 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:31.227334 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 87169.2us
I20260709 13:05:31.052668 22745 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.174s
I20260709 13:05:31.239631 22545 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.256529 22545 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.059798 22350 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.162050 22437 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:31.260330 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.261695 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:31.222779 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.232736 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:31.233458 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:31.230656 15244 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:31.045730 22610 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.221108 22315 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:31.241732 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:31.245888 22734 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:05:31.246712 22727 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:31.250699 22743 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:05:31.250952 22752 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:05:31.251122 22750 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:05:31.251643 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 117547us
I20260709 13:05:31.251883 22730 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.240869 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:31.147687 22735 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.230937 22670 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:31.289798 15250 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:31.169873 22570 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.229837 22751 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:31.271872 15399 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:31.239413 22616 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.294806 22315 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.234602 22692 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:31.297585 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 156033us
I20260709 13:05:31.297958 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:31.301260 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.314558 22727 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:31.354419 22727 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:31.354928 22727 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:31.354986 22729 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.357286 22729 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:31.231343 22581 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:31.321346 15323 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:31.293726 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:31.334910 15244 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:31.311535 22707 consensus_queue.cc:1243] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:05:31.239430 22741 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:31.340857 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 108199us
W20260709 13:05:31.342514 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 126954us
W20260709 13:05:31.363682 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 70039.2us
I20260709 13:05:31.326411 22670 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:31.373383 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:31.376973 22748 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:05:31.382684 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1092) took 1031 ms. Trace:
I20260709 13:05:31.383093 15398 rpcz_store.cc:276] 0709 13:05:30.351619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.352955 (+  1336us) service_pool.cc:224] Handling call
0709 13:05:30.374435 (+ 21480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.454029 (+ 79594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.468332 (+ 14303us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.482304 (+ 13972us) log.cc:844] Serialized 26 byte log entry
0709 13:05:30.815515 (+333211us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:30.815554 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.815617 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.382413 (+566796us) raft_consensus.cc:1685] finished
0709 13:05:31.382439 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.382616 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16762,"raft.queue_time_us":230287,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":30241,"thread_start_us":291052,"threads_started":1,"wal-append.queue_time_us":490093}
I20260709 13:05:31.385304 15398 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:05:31.385703 15398 pending_rounds.cc:85] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 10
I20260709 13:05:31.385960 15398 pending_rounds.cc:107] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:05:31.386416 22728 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:31.387341 22771 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:31.388171 22771 consensus_queue.cc:1243] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:05:31.388743 22771 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:31.260318 22437 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.407117 15323 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
W20260709 13:05:31.392980 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.397574 22741 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.403194 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3619) took 1852 ms. Trace:
W20260709 13:05:31.417258 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 120050us
I20260709 13:05:31.408560 15250 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:31.332260 22730 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.420753 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1089) took 1070 ms. Trace:
I20260709 13:05:31.421298 15397 rpcz_store.cc:276] 0709 13:05:30.349994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.353919 (+  3925us) service_pool.cc:224] Handling call
0709 13:05:30.369502 (+ 15583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.542523 (+173021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.542566 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.544068 (+  1502us) log.cc:844] Serialized 26 byte log entry
0709 13:05:30.810537 (+266469us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:30.810607 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.810715 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.420561 (+609846us) raft_consensus.cc:1685] finished
0709 13:05:31.420580 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.420697 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20565,"raft.queue_time_us":184704,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":47579,"spinlock_wait_cycles":39040,"thread_start_us":410648,"threads_started":2,"wal-append.queue_time_us":307819}
I20260709 13:05:31.422509 22730 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.423235 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.423432 22570 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:31.424548 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.425452 15397 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:31.425535 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:31.388242 22670 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:31.428925 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.429668 15244 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:31.397903 22707 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:31.430660 22707 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:31.431701 22707 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.434410 22708 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:31.310228 22680 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.426548 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.437520 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.445779 22610 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:31.446592 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 158121us
I20260709 13:05:31.418902 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:31.386219 15398 raft_consensus.cc:2889] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:31.425949 22437 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:31.447602 15324 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:31.413283 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:31.451251 15291 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:31.450034 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:31.456662 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.375453 22695 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:31.417340 15320 rpcz_store.cc:276] 0709 13:05:29.550510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.640099 (+ 89589us) service_pool.cc:224] Handling call
0709 13:05:29.664592 (+ 24493us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:30.130823 (+466231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.130872 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:30.170276 (+ 39404us) log.cc:844] Serialized 52 byte log entry
0709 13:05:30.962210 (+791934us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:31.020924 (+ 58714us) log.cc:844] Serialized 14 byte log entry
0709 13:05:31.053129 (+ 32205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.053213 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.402930 (+349717us) raft_consensus.cc:1685] finished
0709 13:05:31.402962 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.403127 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69566,"prepare.queue_time_us":63276,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":139610,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":78921,"thread_start_us":1078164,"threads_started":2,"wal-append.queue_time_us":1131085}
I20260709 13:05:31.319274 22667 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.428870 22670 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.481961 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:31.481801 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 56385.3us
I20260709 13:05:31.482913 15250 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:31.459280 15397 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:31.484477 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.420889 22616 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:31.487082 22747 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:05:31.459308 22724 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.004s
I20260709 13:05:31.502547 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:31.501763 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 50626.6us
I20260709 13:05:31.419684 22728 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:31.499491 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:31.525352 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.507861 15245 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:31.375126 22692 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.531843 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:31.532811 15250 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:31.526958 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.487823 22747 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.537122 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:31.538077 15320 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
W20260709 13:05:31.544582 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45240.1us
I20260709 13:05:31.545779 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:31.455796 22570 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:05:31.557955 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.578104 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.579118 15397 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:31.517764 22663 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:31.580638 22750 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:31.577227 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:05:31.592643 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 179474us
I20260709 13:05:31.529404 22744 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:31.606429 15323 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:05:31.531510 22708 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:31.543058 22747 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:05:31.590534 22255 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.822s	user 0.013s	sys 0.004s
I20260709 13:05:31.554586 22570 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:31.481882 22695 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.623045 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.590939 22667 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:31.510196 22724 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.644014 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.628059 15398 raft_consensus.cc:2368] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:31.657421 15250 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:31.622723 22545 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:31.547264 22727 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.660209 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:31.624145 22663 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:05:31.650311 22754 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
W20260709 13:05:31.629097 22721 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.712s	user 0.009s	sys 0.002s
I20260709 13:05:31.663429 15242 raft_consensus.cc:2368] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 25. Current term is 26.
I20260709 13:05:31.626840 22570 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:31.664861 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:31.669859 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.670564 15396 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:31.661839 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:31.671445 15247 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:31.623026 22741 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.622167 22387 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.675805 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:31.662904 22545 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.626564 22255 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.679777 15250 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:31.676451 22347 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:31.680823 22347 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:31.682158 22347 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.683640 22545 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:31.683965 22347 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:31.686765 22735 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:31.688021 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:31.692055 22255 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:31.695573 22772 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:05:31.696573 22724 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:31.697305 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 88143.6us
I20260709 13:05:31.698405 22581 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:31.699026 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:31.699890 22707 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:31.700392 22707 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:31.700618 22716 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 1.177s	user 0.004s	sys 0.000s
I20260709 13:05:31.700860 22707 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:31.701367 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:31.702405 22739 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:31.703086 22739 consensus_queue.cc:1243] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:31.703161 22692 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:31.703646 22739 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:31.707013 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.709254 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.713361 16026 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:31.713455 22565 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:31.713999 22565 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:31.714557 22387 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.714931 22565 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 23.10, Last appended by leader: 10, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.715468 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:31.716336 15318 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:31.716306 22565 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:31.717765 15319 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:05:31.718014 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:31.718777 15324 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:31.718930 22768 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:31.720395 22750 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:31.721205 22727 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:31.724295 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 51297.2us
I20260709 13:05:31.726902 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:31.665794 22315 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.670132 22721 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21.
I20260709 13:05:31.728922 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3638) took 1131 ms. Trace:
I20260709 13:05:31.739082 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.739363 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:31.740478 15250 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:31.740597 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:31.738902 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 115471us
I20260709 13:05:31.743438 15391 raft_consensus.cc:2368] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:31.752912 15324 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:05:31.736440 15317 rpcz_store.cc:276] 0709 13:05:30.597926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.598722 (+   796us) service_pool.cc:224] Handling call
0709 13:05:30.599172 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:30.929285 (+330113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.929323 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:31.007403 (+ 78080us) log.cc:844] Serialized 52 byte log entry
0709 13:05:31.499052 (+491649us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:31.556823 (+ 57771us) log.cc:844] Serialized 14 byte log entry
0709 13:05:31.557089 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.557190 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.728606 (+171416us) raft_consensus.cc:1685] finished
0709 13:05:31.728638 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.728844 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":122638,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":1047,"raft.queue_time_us":125432,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":22740,"thread_start_us":789500,"threads_started":2,"wal-append.queue_time_us":551383}
I20260709 13:05:31.758041 15250 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:31.758886 15249 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:31.763367 15250 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:31.765566 15250 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:05:31.767772 22783 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:31.768100 22663 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.750377 22708 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:31.746369 22750 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:05:31.769640 22783 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:31.773860 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.705399 22741 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.778759 15398 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:31.669337 22728 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.799393 15246 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:31.760802 22581 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:31.785130 22779 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:31.791908 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.798892 22717 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:31.811403 22786 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.812042 22786 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.814602 22786 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:31.819653 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92828.3us
I20260709 13:05:31.821517 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.823215 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:31.823225 15391 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:31.826829 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.828640 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.827590 15391 raft_consensus.cc:2376] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19. Re-sending same reply.
I20260709 13:05:31.809398 22717 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:31.808058 22779 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:31.829713 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:31.838403 22751 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:31.839520 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:31.840451 22751 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:31.840850 22751 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.841181 22751 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.841928 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.842828 16026 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:31.843097 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:31.844134 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:31.844383 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:31.845271 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:31.845427 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:31.846154 22709 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.450s	user 0.000s	sys 0.011s
I20260709 13:05:31.846805 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:31.847020 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:31.847667 22782 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:05:31.847743 16028 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:31.847995 15365 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:31.848651 22715 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:31.849025 22715 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:31.849907 22715 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.851203 22715 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:31.851742 22692 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:31.852593 22708 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:31.852948 22708 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.853274 22708 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:31.855449 15290 leader_election.cc:400] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:31.855297 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:31.856986 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:31.855957 15290 leader_election.cc:403] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:31.828915 22786 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:31.865731 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:31.866494 16026 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:31.866807 16030 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: [22.18-22.18]
I20260709 13:05:31.867444 22736 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:31.867844 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:31.868988 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:31.819593 22581 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.829710 15398 raft_consensus.cc:2376] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23. Re-sending same reply.
I20260709 13:05:31.871342 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:31.863112 22761 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:31.854923 22779 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:31.872896 22256 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:31.875524 22545 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.875547 22751 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.886811 22545 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.887415 22741 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.873318 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.889173 15391 raft_consensus.cc:2376] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21. Re-sending same reply.
I20260709 13:05:31.890511 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.877878 22747 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.859403 22739 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:05:31.895327 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.895552 22717 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.896325 15398 raft_consensus.cc:2376] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20. Re-sending same reply.
I20260709 13:05:31.897068 22717 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.898392 22783 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:05:31.899636 22256 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:31.900895 22256 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:31.886085 22751 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.906478 22575 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:31.906921 22575 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:31.907299 22575 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.910728 22747 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.897709 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.913897 15398 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:31.915412 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:31.916869 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:31.919370 22723 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.125s	user 0.013s	sys 0.001s
I20260709 13:05:31.920914 15395 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:05:31.921360 15395 pending_rounds.cc:85] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 11
I20260709 13:05:31.921638 15395 pending_rounds.cc:107] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:05:31.921918 15395 raft_consensus.cc:2889] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:31.923650 15397 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:31.924934 22581 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:31.928246 22695 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:31.859633 22750 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:05:31.932863 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 58461.8us
I20260709 13:05:31.861809 22667 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:31.941607 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:31.859247 22729 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 13:05:31.859037 22711 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:05:31.936023 22750 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:31.983742 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 47239.1us
W20260709 13:05:31.986402 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 131064us
I20260709 13:05:31.987551 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:31.990060 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:31.974601 22692 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:31.992304 22692 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:31.994417 22695 raft_consensus.cc:2764] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:05:31.996142 22783 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:31.974895 22618 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:31.978420 22750 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:31.937062 22761 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.047s
I20260709 13:05:31.980370 22711 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:32.002660 22783 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:05:32.018997 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:32.019598 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.019851 22575 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:32.021888 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.022157 22575 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:32.023283 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:32.023872 16032 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:32.030716 22778 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 13:05:32.039974 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.048988 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:32.055480 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.007294 22711 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:32.059094 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:32.059823 15324 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:32.057339 15290 leader_election.cc:400] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:32.060889 15290 leader_election.cc:403] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:05:32.069839 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:32.070631 15325 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:32.054097 22761 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.073645 16030 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:32.072808 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:32.075817 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:32.076979 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:32.078076 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:32.078702 15324 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:32.059156 22729 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:32.068653 22783 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:32.097187 16032 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:32.098958 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:32.104215 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.154737 16026 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:32.155246 15250 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:32.165668 22667 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.166054 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:32.166347 22667 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.210057 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:32.069823 22570 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.106016 22707 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.211035 15248 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:32.081835 22729 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.212126 22729 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:32.212879 22707 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:32.109993 22586 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:32.213783 15398 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:32.196836 15214 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:32.215113 22570 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:32.217453 22724 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.217980 22724 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.111760 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:32.115104 15394 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:32.116163 22711 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:32.127125 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:32.241393 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 44687.3us
I20260709 13:05:32.225417 16030 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
W20260709 13:05:32.128705 22795 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:05:32.230768 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 191265us
I20260709 13:05:32.269613 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:32.168394 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:32.278832 22586 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:32.285810 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:32.195855 22448 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:05:32.296962 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 128632us
I20260709 13:05:32.272513 22575 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:32.242122 22783 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.325479 22538 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:32.333446 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:32.082281 22761 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:32.296027 22586 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:32.350059 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:32.351094 15390 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:32.359573 15999 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 2.875s (SENT) [suppressed 39 similar messages]
I20260709 13:05:32.330412 22783 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.337141 22724 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:32.404397 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 134885us
I20260709 13:05:32.406987 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:32.410643 15390 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 25: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:32.420722 22540 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:32.441563 22540 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.442144 22540 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:32.428877 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 951) took 1571 ms. Trace:
I20260709 13:05:32.429158 15247 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:32.429855 15249 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
W20260709 13:05:32.446926 22708 consensus_meta.cc:287] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:05:32.447265 15249 pending_rounds.cc:85] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 11
I20260709 13:05:32.447629 15249 pending_rounds.cc:107] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:05:32.447429 22708 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:32.447993 15249 raft_consensus.cc:2889] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:32.423450 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:32.433315 22711 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:32.449388 15393 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:32.450619 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:32.451372 15393 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:32.452263 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:32.434676 22741 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:32.436007 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:32.454586 16024 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:05:32.446511 15246 rpcz_store.cc:276] 0709 13:05:30.857771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.241072 (+383301us) service_pool.cc:224] Handling call
0709 13:05:31.799220 (+558148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.799817 (+   597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.428665 (+628848us) spinlock_profiling.cc:243] Waited 505 ms on lock 0x7b540025cbd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:32.428811 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1161640704}
I20260709 13:05:32.457505 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:32.439426 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.439932 22761 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:32.376111 22667 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:32.430637 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:32.454058 22715 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
I20260709 13:05:32.481659 15246 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:05:32.441619 22783 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:32.487547 22779 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.005s
I20260709 13:05:32.488168 22779 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:32.490815 22799 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:05:32.492357 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3648) took 1275 ms. Trace:
I20260709 13:05:32.492901 15316 rpcz_store.cc:276] 0709 13:05:31.216928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.223303 (+  6375us) service_pool.cc:224] Handling call
0709 13:05:31.223658 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:31.236116 (+ 12458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.236159 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:31.930406 (+694247us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b2c0012b498. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:05:31.930935 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:05:32.047189 (+116254us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:32.047247 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.047352 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:32.491928 (+444576us) raft_consensus.cc:1685] finished
0709 13:05:32.491963 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.492268 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38048,"raft.queue_time_us":21081,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":39837,"spinlock_wait_cycles":2582912,"thread_start_us":115790,"threads_started":1,"wal-append.queue_time_us":145706}
I20260709 13:05:32.496023 22779 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:32.498504 22538 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:32.474830 22741 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.514073 22739 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:32.515213 22739 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:32.515643 22739 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:32.516269 22565 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.517071 22565 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.517729 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:32.519173 15391 raft_consensus.cc:2410] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:05:32.524827 15248 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:32.525106 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3719) took 1609 ms. Trace:
I20260709 13:05:32.525853 15241 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:05:32.525744 15399 rpcz_store.cc:276] 0709 13:05:30.915990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.333205 (+417215us) service_pool.cc:224] Handling call
0709 13:05:31.333523 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.359130 (+ 25607us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.359167 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.359209 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:31.359241 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.524779 (+1165538us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b5400271354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:32.524851 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.525030 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58403712}
I20260709 13:05:32.527879 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:32.532899 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.535916 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 3082) took 1023 ms. Trace:
I20260709 13:05:32.536362 15397 rpcz_store.cc:276] 0709 13:05:31.512446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.841671 (+329225us) service_pool.cc:224] Handling call
0709 13:05:32.535731 (+694060us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b54002b5a54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:32.535850 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186173824}
I20260709 13:05:32.541332 15242 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:32.542807 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3716) took 1627 ms. Trace:
I20260709 13:05:32.546975 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:32.560642 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3710) took 1714 ms. Trace:
I20260709 13:05:32.561115 15394 rpcz_store.cc:276] 0709 13:05:30.846152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.846533 (+   381us) service_pool.cc:224] Handling call
0709 13:05:30.864407 (+ 17874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.225318 (+1360911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.560354 (+335036us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000271d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:32.560568 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2875406080}
I20260709 13:05:32.564939 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:32.564733 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:32.565639 15396 raft_consensus.cc:2376] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24. Re-sending same reply.
I20260709 13:05:32.566184 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 3084) took 1053 ms. Trace:
I20260709 13:05:32.566522 15396 rpcz_store.cc:276] 0709 13:05:31.513044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.564640 (+1051596us) service_pool.cc:224] Handling call
0709 13:05:32.566122 (+  1482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:32.543426 15395 rpcz_store.cc:276] 0709 13:05:30.914965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.309210 (+394245us) service_pool.cc:224] Handling call
0709 13:05:31.309594 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.922504 (+612910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.542426 (+619922us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54001dae54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:32.542718 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404800256}
I20260709 13:05:32.567319 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:32.567394 15316 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 25: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:32.572131 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:32.572713 15291 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:32.573590 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47393.7us
W20260709 13:05:32.578001 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.581514 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:32.581784 15321 raft_consensus.cc:1217] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Deduplicated request from leader. Original: 20.11->[21.12-21.12]   Dedup: 21.12->[]
I20260709 13:05:32.582361 15321 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:05:32.583199 15397 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:31.694279 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:32.587275 15319 raft_consensus.cc:2410] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:05:32.595709 15393 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:32.603073 15324 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: [19.14-21.15]
I20260709 13:05:32.593901 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3098) took 1041 ms. Trace:
I20260709 13:05:32.611240 15397 rpcz_store.cc:276] 0709 13:05:31.542663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.579361 (+1036698us) service_pool.cc:224] Handling call
0709 13:05:32.582806 (+  3445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.583711 (+   905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.583960 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:32.596613 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3088) took 1058 ms. Trace:
I20260709 13:05:32.613974 15393 rpcz_store.cc:276] 0709 13:05:31.538608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.569492 (+1030884us) service_pool.cc:224] Handling call
0709 13:05:32.595239 (+ 25747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.596258 (+  1019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.596530 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:32.615837 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:32.609760 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:32.618300 22740 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:05:32.621068 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:32.621694 15245 raft_consensus.cc:2376] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21. Re-sending same reply.
I20260709 13:05:32.623872 22370 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:32.624442 22370 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:32.625327 22370 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.626611 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:32.627210 15394 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:32.629184 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:32.629791 15322 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:05:32.630254 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:32.632280 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:32.632879 15246 raft_consensus.cc:2376] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21. Re-sending same reply.
W20260709 13:05:32.633961 22798 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.312s	user 0.000s	sys 0.000s
I20260709 13:05:32.637146 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:32.645323 15324 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:32.641363 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:32.646350 15318 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:32.534370 22597 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:32.516620 22739 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.644215 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:32.658990 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:32.654368 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:32.660579 15322 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:05:32.663302 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:32.665567 15322 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:32.613305 22717 consensus_meta.cc:287] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.007s
I20260709 13:05:32.667642 15317 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:32.671310 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:32.673513 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:32.679046 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:32.680264 15320 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:05:32.681228 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:32.681857 15245 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:32.683707 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:32.684437 15248 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:32.685708 15399 raft_consensus.cc:2410] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:05:32.686839 22801 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:05:32.687846 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:32.688804 15246 raft_consensus.cc:2410] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 24 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:05:32.690291 15395 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:05:32.690686 15395 pending_rounds.cc:85] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 10
I20260709 13:05:32.690903 15395 pending_rounds.cc:107] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:05:32.691131 15395 raft_consensus.cc:2889] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:32.691443 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:32.692200 15323 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:32.599785 22570 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:32.696822 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:32.650418 22597 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.694397 15394 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:32.574424 22581 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.100s
I20260709 13:05:32.721082 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:32.712724 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:32.583851 22784 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.130s
I20260709 13:05:32.710700 15246 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:32.728228 15318 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:05:32.730744 22570 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.733423 22570 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:32.707015 22717 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:32.735513 15320 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:32.738679 22769 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.072s	user 0.010s	sys 0.004s
I20260709 13:05:32.726862 22597 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:32.709971 22707 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:32.744696 22581 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:32.745261 22581 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:32.746345 22581 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:32.748225 22738 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:32.748847 22738 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.749264 22738 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:32.751787 22750 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.000s
I20260709 13:05:32.752308 22750 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:32.752866 22256 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:32.755800 22586 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:32.657075 22797 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.124s
I20260709 13:05:32.768193 22739 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:32.771423 22761 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.772176 22761 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.774696 22784 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:32.775290 22784 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:32.775833 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 946) took 1919 ms. Trace:
I20260709 13:05:32.776477 22784 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.781977 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:32.786427 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 51098.1us
I20260709 13:05:32.776417 15243 rpcz_store.cc:276] 0709 13:05:30.856468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.858189 (+  1721us) service_pool.cc:224] Handling call
0709 13:05:30.928880 (+ 70691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:31.150359 (+221479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.150393 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:31.226494 (+ 76101us) log.cc:844] Serialized 26 byte log entry
0709 13:05:31.526616 (+300122us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:31.526673 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.526780 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:32.685628 (+1158848us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:32.775404 (+ 89776us) raft_consensus.cc:1685] finished
0709 13:05:32.775435 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.775744 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79014,"raft.queue_time_us":80519,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4694,"spinlock_wait_cycles":2761088,"thread_start_us":383633,"threads_started":2,"wal-append.queue_time_us":289889}
I20260709 13:05:32.729346 15291 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:32.790187 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60951.9us
I20260709 13:05:32.726029 15324 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:32.800495 15325 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:05:32.809681 15322 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:05:32.796591 22315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.005s	sys 0.044s
I20260709 13:05:32.792948 22707 consensus_queue.cc:1059] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:05:32.791996 22581 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:32.821774 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 462210us
I20260709 13:05:32.785156 22565 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:32.823457 15243 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:32.798182 22448 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:32.797940 22767 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:32.875738 22767 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.876297 22767 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:32.804108 22724 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.878927 22724 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:32.881753 22724 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:32.796589 15141 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:32.820943 22750 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:32.824009 22784 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:32.883070 22570 raft_consensus.cc:3055] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:32.887615 22690 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:32.889721 22761 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:32.860539 22783 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:32.762090 22540 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:32.826726 22315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.006s	sys 0.045s
W20260709 13:05:32.858881 22575 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.015s	sys 0.024s
I20260709 13:05:32.874421 22448 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.949848 15246 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:32.908735 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:32.938164 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.907823 22570 raft_consensus.cc:740] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:32.942694 22575 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.015s	sys 0.024s
W20260709 13:05:32.950139 22679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.008s	sys 0.026s
I20260709 13:05:32.970623 22723 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:32.971124 22723 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:32.972056 22723 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:32.973104 22723 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:32.963332 22711 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.001s
I20260709 13:05:32.994100 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:32.914647 22783 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:32.968147 22575 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:33.001040 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.006s	sys 0.009s
W20260709 13:05:33.041335 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.006s	sys 0.009s
W20260709 13:05:33.041742 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 730023us
I20260709 13:05:33.043901 15250 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:33.044824 15246 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:05:33.039268 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.045789 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.042598 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 408040us
I20260709 13:05:33.047192 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:33.047756 15396 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:33.049225 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:33.042485 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:32.994453 22679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.009s	sys 0.026s
I20260709 13:05:33.059994 15319 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
W20260709 13:05:33.094736 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.112013 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:33.112067 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 456529us
W20260709 13:05:33.113288 15290 leader_election.cc:336] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.915s (SENT)
I20260709 13:05:33.112814 15399 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:33.113708 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:32.980786 22695 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:33.225766 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:33.226778 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:33.227413 15399 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:33.228401 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:33.018013 22729 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.805s	user 0.008s	sys 0.005s
W20260709 13:05:33.118819 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 445400us
I20260709 13:05:32.994944 22690 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.361812 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:33.363198 15399 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:33.104383 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:33.227430 15390 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:05:33.229938 15242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.030s	sys 0.088s
W20260709 13:05:33.367113 15242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.030s	sys 0.088s
I20260709 13:05:33.367832 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:33.368458 15390 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:33.369308 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:33.369876 15390 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:32.998684 22750 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:33.372051 22750 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:33.376492 22750 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:33.384560 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 134740us
I20260709 13:05:33.385059 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:33.385838 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:33.394857 22812 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.393s	user 0.000s	sys 0.000s
W20260709 13:05:33.402631 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 289346us
W20260709 13:05:33.403594 15290 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.947s (SENT)
I20260709 13:05:33.404081 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:33.411747 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:33.412601 15393 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:33.112979 22811 raft_consensus.cc:2764] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:05:33.248961 22779 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:33.430382 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3100) took 1887 ms. Trace:
I20260709 13:05:33.432359 15395 rpcz_store.cc:276] 0709 13:05:31.543268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.645952 (+1102684us) service_pool.cc:224] Handling call
0709 13:05:32.689867 (+ 43915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.707544 (+ 17677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.430080 (+722536us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b54001950d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:33.430307 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100297472}
I20260709 13:05:33.040513 22738 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:33.451370 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 347106us
I20260709 13:05:33.453728 15396 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
W20260709 13:05:33.455736 15997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.005s	sys 0.012s
W20260709 13:05:33.456245 15997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.005s	sys 0.012s
W20260709 13:05:33.460559 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.003s	sys 0.011s
W20260709 13:05:33.461126 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.003s	sys 0.011s
I20260709 13:05:33.361812 22695 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:33.452564 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:05:33.539034 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.537278 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:33.363991 22729 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:33.628218 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:33.631691 16030 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:33.628417 16026 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
W20260709 13:05:33.628479 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 242693us
W20260709 13:05:33.633087 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 180583us
I20260709 13:05:33.635445 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:33.020079 22570 consensus_queue.cc:260] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:33.668015 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:33.668360 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:33.406972 22690 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:33.686195 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:33.710340 15316 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:33.439716 22540 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:33.721379 15322 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:33.731212 15316 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:33.487450 22810 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.486646 22707 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:33.758380 15325 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:33.763958 15392 raft_consensus.cc:2368] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19.
I20260709 13:05:33.659427 22750 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.704355 22565 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:33.790664 15996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.014s	sys 0.023s
W20260709 13:05:33.868069 15996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.014s	sys 0.023s
W20260709 13:05:33.868423 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 806590us
I20260709 13:05:33.457937 22618 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:33.660261 22676 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.786126 15317 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:33.881240 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:33.544150 22818 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:05:33.871462 15398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.006s	sys 0.003s
I20260709 13:05:33.873340 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:33.875389 15316 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
W20260709 13:05:33.887507 15398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.006s	sys 0.003s
W20260709 13:05:33.790277 22747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.110s	sys 0.144s
I20260709 13:05:33.891583 16024 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 21: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:33.892781 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:33.897048 15325 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
W20260709 13:05:33.908066 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 504473us
W20260709 13:05:33.908886 15290 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 1.980s (SENT)
I20260709 13:05:33.909332 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:33.493352 15390 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:33.921787 15396 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:33.769861 22825 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:33.489542 22575 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:33.898729 22747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.111s	sys 0.144s
I20260709 13:05:33.884068 22565 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:33.899325 22618 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:33.987598 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:34.002049 15316 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:05:33.889724 22783 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:33.872701 22821 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:33.807057 22707 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:33.885756 22540 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.022014 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 113165us
W20260709 13:05:34.022998 15290 leader_election.cc:336] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Timed out: RequestConsensusVote RPC to 127.13.206.195:44417 timed out after 2.017s (SENT)
I20260709 13:05:34.023473 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:33.783931 22810 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:33.989164 22779 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:05:34.053436 22739 consensus_meta.cc:287] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.284s	user 0.010s	sys 0.002s
I20260709 13:05:34.054939 22717 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:34.055616 22717 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:34.058698 22829 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:05:34.059917 22810 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:34.060897 22817 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:05:34.016815 22825 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.062695 22825 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.065148 22825 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:33.910384 22822 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.124s
I20260709 13:05:33.910837 22676 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.068578 22676 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.060006 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3231) took 1341 ms. Trace:
I20260709 13:05:34.063032 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 964) took 1454 ms. Trace:
I20260709 13:05:34.050679 22783 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:34.069216 15247 rpcz_store.cc:276] 0709 13:05:32.718514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.719749 (+  1235us) service_pool.cc:224] Handling call
0709 13:05:32.720111 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:32.778886 (+ 58775us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:32.778934 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:32.779577 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:05:33.039585 (+260008us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:33.039636 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.039712 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.059792 (+1020080us) raft_consensus.cc:1685] finished
0709 13:05:34.059813 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.059947 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58941,"raft.queue_time_us":65421,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":3786,"thread_start_us":259555,"threads_started":1,"wal-append.queue_time_us":687193}
I20260709 13:05:33.992084 22818 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.883863 22750 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.057973 22717 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.038303 22540 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.070389 15249 rpcz_store.cc:276] 0709 13:05:32.608134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.609286 (+  1152us) service_pool.cc:224] Handling call
0709 13:05:32.609681 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:32.610091 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:32.610131 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:32.610803 (+   672us) log.cc:844] Serialized 26 byte log entry
0709 13:05:33.060586 (+449783us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:33.060629 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.060709 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.062729 (+1002020us) raft_consensus.cc:1685] finished
0709 13:05:34.062762 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.062949 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40764,"raft.queue_time_us":85205,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":33101,"thread_start_us":370867,"threads_started":1,"wal-append.queue_time_us":1307748}
I20260709 13:05:34.012998 22565 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:34.054080 22739 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.109009 22836 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:34.149559 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 126599us
I20260709 13:05:34.109457 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:34.113399 15393 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.000s
I20260709 13:05:34.119174 22695 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.128537 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2389) took 1701 ms. Trace:
I20260709 13:05:34.153849 15393 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:34.154431 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 3113) took 1101 ms. Trace:
I20260709 13:05:34.154067 15241 rpcz_store.cc:276] 0709 13:05:32.426972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.427164 (+   192us) service_pool.cc:224] Handling call
0709 13:05:32.525608 (+ 98444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:32.526384 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.128203 (+1601819us) spinlock_profiling.cc:243] Waited 98 ms on lock 0x7b54001a77d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:34.128430 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225457536}
I20260709 13:05:34.122970 22538 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:34.121619 22750 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.131831 22708 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:34.140513 15999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.180s	user 0.051s	sys 0.293s
W20260709 13:05:34.156540 15999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.196s	user 0.051s	sys 0.294s
I20260709 13:05:34.153487 15316 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:34.158993 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:34.160653 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:34.162853 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 1.2541e+06us
I20260709 13:05:34.144403 16030 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
W20260709 13:05:34.101351 22814 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.736s	user 0.001s	sys 0.001s
I20260709 13:05:34.154865 15393 rpcz_store.cc:276] 0709 13:05:33.052874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.264149 (+211275us) service_pool.cc:224] Handling call
0709 13:05:34.154363 (+890214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:34.168092 15288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.027s	sys 0.113s
W20260709 13:05:34.168499 15288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.028s	sys 0.113s
I20260709 13:05:34.169157 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:34.171232 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:34.171993 15393 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
W20260709 13:05:34.173053 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.173017 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:34.176141 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.177508 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:34.178448 15390 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:34.180153 15390 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:34.184762 15393 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 16.
I20260709 13:05:34.194077 15999 leader_election.cc:400] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 25. Current term is 26.
W20260709 13:05:34.207181 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.226115 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.227706 15213 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:34.167418 22695 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:34.163775 22783 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:34.175967 22836 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:34.167644 22750 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:34.176941 22729 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.228853 22717 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.238001 22831 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:34.243177 22830 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:05:34.191859 22692 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.152761 22739 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.236074 22695 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:34.277423 22695 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:34.244333 22738 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.260177 22669 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:05:34.209553 22707 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.264618 22717 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.287250 22540 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.262835 22840 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:05:34.288704 22840 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:34.289088 22840 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:34.241953 22839 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:34.291607 22839 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.293825 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:34.297113 22723 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.324s	user 0.009s	sys 0.004s
W20260709 13:05:34.297786 22808 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.323s	user 0.006s	sys 0.040s
I20260709 13:05:34.298902 15395 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:05:34.298979 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:34.299474 15395 pending_rounds.cc:85] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 9
I20260709 13:05:34.299736 15395 pending_rounds.cc:107] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:05:34.300130 15395 raft_consensus.cc:2889] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:34.255802 15249 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:34.241706 22815 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.301313 22815 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.225423 22818 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:34.302722 22818 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:34.304349 22581 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 1.435s	user 0.009s	sys 0.001s
I20260709 13:05:34.305075 22818 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.305037 22581 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:34.305801 22818 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.163439 22538 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.231606 22676 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:34.321466 22815 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.321768 22676 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.324283 22676 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.324806 22818 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.267002 22831 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.282510 22738 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.299700 15242 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:34.301687 22711 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:34.227589 22822 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:05:34.254865 22448 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:34.252120 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.260656 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.249404 22821 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:34.306041 22581 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:34.276177 22690 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.277032 22692 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.321075 22538 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.289894 22840 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.242035 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:34.353971 15318 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
W20260709 13:05:34.339634 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.003s	sys 0.016s
I20260709 13:05:34.294003 22839 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.260449 22783 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:34.343560 15324 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.006s	sys 0.007s
I20260709 13:05:34.343787 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:34.362088 15324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.007s	sys 0.008s
I20260709 13:05:34.362314 15243 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:34.265851 22836 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.344671 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:34.346081 22711 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:34.390720 15247 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:34.391053 15244 raft_consensus.cc:1240] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:34.345871 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.346614 15241 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:34.344694 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.392359 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.339368 22767 consensus_meta.cc:287] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.450s	user 0.013s	sys 0.000s
W20260709 13:05:34.245733 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 51807us
W20260709 13:05:34.341519 22784 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.426s	user 0.012s	sys 0.000s
I20260709 13:05:34.339687 22618 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.253229 22750 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.327931 22679 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.356351 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.003s	sys 0.016s
I20260709 13:05:34.313946 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.341590 22448 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.387349 15242 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:34.346119 22581 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:34.363282 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 385822us
W20260709 13:05:34.326982 22597 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.584s	user 0.007s	sys 0.005s
I20260709 13:05:34.394021 15246 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 21: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:34.397305 22717 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.398550 22818 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.350813 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3106) took 1357 ms. Trace:
I20260709 13:05:34.342814 22738 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.438179 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.432549 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:34.440716 15996 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:34.348795 22565 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.409505 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:34.405658 22840 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:34.412006 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.412107 22711 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 23.10, Last appended by leader: 10, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.412676 22831 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.414636 22695 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.414940 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:34.415841 22750 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.416136 22739 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.408527 22771 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:05:34.431738 22448 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:34.422802 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 787420us
W20260709 13:05:34.481402 15391 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 3094) took 2940 ms (client timeout 2201 ms). Trace:
W20260709 13:05:34.482034 15391 rpcz_store.cc:269] 0709 13:05:31.541244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.890118 (+348874us) service_pool.cc:224] Handling call
0709 13:05:34.479045 (+2588927us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b540034b7d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:34.481330 (+  2285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1362323200}
W20260709 13:05:34.402094 22833 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:05:34.431175 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:34.433411 15392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 1103) took 2388 ms (client timeout 1672 ms). Trace:
I20260709 13:05:34.481204 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2395) took 1836 ms. Trace:
W20260709 13:05:34.483899 15392 rpcz_store.cc:269] 0709 13:05:32.044838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.064384 (+ 19546us) service_pool.cc:224] Handling call
0709 13:05:34.433139 (+2368755us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b5400154fd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:34.433323 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3880415104}
I20260709 13:05:34.439042 15246 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:34.442049 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.446848 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.447573 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.406816 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:34.484131 15319 rpcz_store.cc:276] 0709 13:05:32.644752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.645483 (+   731us) service_pool.cc:224] Handling call
0709 13:05:32.645788 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.111798 (+466010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.480902 (+1369104us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400218ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:34.481134 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915606400}
I20260709 13:05:34.447853 16031 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:34.451731 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.486500 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:34.434953 15398 rpcz_store.cc:276] 0709 13:05:32.993223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.993361 (+   138us) service_pool.cc:224] Handling call
0709 13:05:33.018184 (+ 24823us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:33.021801 (+  3617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.021836 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:33.025208 (+  3372us) log.cc:844] Serialized 52 byte log entry
0709 13:05:33.888106 (+862898us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:34.342079 (+453973us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.346617 (+  4538us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.349969 (+  3352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.350446 (+   477us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.350512 (+    66us) raft_consensus.cc:1685] finished
0709 13:05:34.350530 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.350730 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60157,"raft.queue_time_us":8000,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":15028,"spinlock_wait_cycles":9687296,"thread_start_us":1279423,"threads_started":2,"wal-append.queue_time_us":1012965}
I20260709 13:05:34.348204 22821 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.431496 22707 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.418224 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.479712 15397 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:05:34.453644 22822 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:05:34.492028 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.405941 22767 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:34.481237 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 229590us
I20260709 13:05:34.501101 22767 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.502075 22581 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.503512 22581 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:34.503954 22256 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.750s	user 0.015s	sys 0.000s
I20260709 13:05:34.506640 22707 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.401544 22836 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.510653 22836 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.512777 22822 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:34.513898 22822 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.437667 22679 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.516718 22738 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.480707 22675 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:34.517602 22675 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.518589 22679 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.519865 22675 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.443132 22597 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.521425 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:34.522511 22597 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.522717 15363 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:34.524226 22717 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.524726 22717 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:34.456449 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 295865us
I20260709 13:05:34.485163 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.527135 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:34.455914 22820 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:05:34.527714 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 120995us
I20260709 13:05:34.525521 22033 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:34.538810 15243 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:34.531360 15245 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:34.534585 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:34.541682 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:34.481118 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 236093us
I20260709 13:05:34.546505 16024 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:34.537741 15247 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:34.457657 22832 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.528326 22831 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:34.601423 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.540436 22739 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:05:34.622751 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.539667 22256 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.126s
I20260709 13:05:34.660919 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:34.578024 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 43507.3us
I20260709 13:05:34.559141 22679 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:05:34.566272 22736 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:34.672672 15999 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:34.672972 22736 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.675252 22736 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.564845 22820 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:34.679173 22820 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.602344 22675 raft_consensus.cc:2764] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
W20260709 13:05:34.682698 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 149166us
I20260709 13:05:34.683890 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:34.688020 22570 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:34.693060 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.693751 15245 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
W20260709 13:05:34.694761 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 154399us
I20260709 13:05:34.555934 22540 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:05:34.534124 22838 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:34.697147 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:34.698504 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:34.606627 22597 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:34.543668 22818 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.152s
I20260709 13:05:34.720142 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.686058 22695 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.710378 22610 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:34.703058 22675 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:34.727778 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.712697 22854 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:34.730001 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.730995 16033 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
W20260709 13:05:34.735335 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 51591.8us
I20260709 13:05:34.738511 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:34.746367 22540 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:34.746881 22540 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.747037 15241 raft_consensus.cc:1240] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:34.747325 22540 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:34.750854 16032 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:34.751682 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.750914 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2388) took 2326 ms. Trace:
I20260709 13:05:34.754173 15250 rpcz_store.cc:276] 0709 13:05:32.424018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.424207 (+   189us) service_pool.cc:224] Handling call
0709 13:05:32.424548 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:33.044346 (+619798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.750626 (+1706280us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b540023aad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:34.750819 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423851776}
I20260709 13:05:34.757763 16031 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:34.761168 16024 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
W20260709 13:05:34.762480 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 217820us
W20260709 13:05:34.764461 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 67368.3us
I20260709 13:05:34.760345 22610 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:34.726461 22679 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:34.599817 22832 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:34.769093 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.773042 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:34.775669 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.761282 22784 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:34.776875 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:34.781477 15213 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:34.779449 22255 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.786530 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.787137 15392 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:34.787830 22255 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.782123 22843 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:34.790460 22255 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.790673 22843 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:34.791121 22843 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:34.794512 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56153.7us
I20260709 13:05:34.796054 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:34.796912 22255 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:34.779449 22256 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:05:34.800189 16028 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
W20260709 13:05:34.801430 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.803732 16028 pending_rounds.cc:85] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 13
I20260709 13:05:34.804005 16028 pending_rounds.cc:107] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:05:34.804245 16028 raft_consensus.cc:2889] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:34.807848 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:34.808499 15391 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:34.811277 22852 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:34.811622 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:34.812323 15398 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:34.813498 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:34.814636 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:34.797811 22821 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:34.820147 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 194528us
I20260709 13:05:34.826004 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:34.826936 22350 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:34.827399 16025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 1083) took 2687 ms. Trace:
I20260709 13:05:34.827999 15141 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.828074 16025 rpcz_store.cc:276] 0709 13:05:32.140500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.140717 (+   217us) service_pool.cc:224] Handling call
0709 13:05:32.167112 (+ 26395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.167321 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:05:32.353593 (+186272us) log.cc:844] Serialized 14 byte log entry
0709 13:05:33.043305 (+689712us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.127435 (+1084130us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b1800337d20. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:05:34.541543 (+414108us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.810505 (+268962us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:34.810577 (+    72us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:34.810654 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.810747 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.827304 (+ 16557us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87741,"prepare.queue_time_us":367533,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":138,"raft.queue_time_us":1458709,"raft.run_cpu_time_us":441,"raft.run_wall_time_us":43925,"spinlock_wait_cycles":25255808,"thread_start_us":1550951,"threads_started":6,"wal-append.queue_time_us":608526,"wal-append.run_cpu_time_us":2894,"wal-append.run_wall_time_us":1431886}
W20260709 13:05:34.846705 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65294.9us
I20260709 13:05:34.806783 22854 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:05:34.831147 15141 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 16 to 17, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 17 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:05:34.831966 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.810129 22818 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:34.832747 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.833719 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.860214 16032 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:34.834369 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.834545 22610 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.776266 22679 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.840860 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.842444 15394 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:34.843622 22832 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.841898 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:34.782670 22867 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
W20260709 13:05:34.846151 15999 connection.cc:256] RPC call timeout handler was delayed by -1.7494749160000538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 13:05:34.822021 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:34.849732 15391 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
W20260709 13:05:34.826228 15215 connection.cc:256] RPC call timeout handler was delayed by -1.794977918000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
I20260709 13:05:34.871145 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:34.856106 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:34.861944 22868 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:34.863224 15398 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:05:34.859001 22818 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.864774 16025 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:34.857622 22255 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:34.863662 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:34.843390 22843 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.878759 15391 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:34.875742 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:34.844714 22676 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:05:34.883153 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.857662 22350 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:05:34.886212 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.896889 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:34.898614 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:34.901629 22740 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:34.904129 22868 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:34.879856 22818 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:34.878549 22867 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.879963 22784 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:34.913254 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:34.905102 22717 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.916859 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:34.917238 22835 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:34.877552 22540 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.917557 22870 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.905993 22695 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:34.912585 22838 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:34.917297 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:34.923521 22835 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:34.918998 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:34.907153 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 59157.8us
I20260709 13:05:34.904208 22707 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.916790 22784 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:34.935706 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:34.918877 22867 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:34.905126 22868 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.922189 22854 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:35.088212 22565 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.994648 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:35.219400 22867 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:34.949430 15390 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:35.145143 22537 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.985721 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.143901 22836 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.222538 22537 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.953076 22255 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:35.222957 22836 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.926970 22870 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.224982 15250 raft_consensus.cc:2410] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:05:35.082067 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3730) took 1620 ms. Trace:
W20260709 13:05:34.966645 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47698.2us
I20260709 13:05:35.078846 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3115) took 2025 ms. Trace:
I20260709 13:05:34.978253 22740 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:34.967347 22835 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.040745 15141 catalog_manager.cc:5697] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.093564 22681 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:35.226526 15395 rpcz_store.cc:276] 0709 13:05:33.053323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.433306 (+379983us) service_pool.cc:224] Handling call
0709 13:05:33.433640 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.300596 (+866956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.078575 (+777979us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540009a6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:35.078770 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988433664}
I20260709 13:05:35.071799 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.228576 15392 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:35.228724 15395 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:05:35.007759 22692 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:35.081507 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2394) took 2644 ms. Trace:
I20260709 13:05:34.981817 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3108) took 1930 ms. Trace:
I20260709 13:05:34.995800 15243 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:05:35.083716 22586 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:05:34.986660 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 164714us
W20260709 13:05:35.055312 22869 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:05:35.231670 15399 rpcz_store.cc:276] 0709 13:05:33.051723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.385989 (+334266us) service_pool.cc:224] Handling call
0709 13:05:33.386605 (+   616us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.703449 (+316844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.703482 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.703969 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.399743 (+695774us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b180000c8e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:05:34.551055 (+151312us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:34.599944 (+ 48889us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.981027 (+381083us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b180000c8e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f3669bf2060 00007f3669c04716 00007f3669c15287 00007f3669c15208
0709 13:05:34.981335 (+   308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.981450 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.981510 (+    60us) raft_consensus.cc:1685] finished
0709 13:05:34.981531 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.981731 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":298292,"prepare.queue_time_us":54244,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":810775,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":239,"spinlock_wait_cycles":88455168,"thread_start_us":151010,"threads_started":1,"wal-append.queue_time_us":912868}
I20260709 13:05:35.231307 15244 rpcz_store.cc:276] 0709 13:05:32.437254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.437438 (+   184us) service_pool.cc:224] Handling call
0709 13:05:32.437834 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.393753 (+1955919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.081170 (+687417us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b540023b4d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:35.081429 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4491495296}
W20260709 13:05:34.985893 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.070137 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1107) took 3023 ms. Trace:
W20260709 13:05:35.235015 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.009891 22581 consensus_meta.cc:287] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.004s
I20260709 13:05:35.235358 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:35.236068 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.236498 22838 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:35.236719 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.938216 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.219000 22854 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:35.237533 15246 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:35.002934 22843 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.986984 22717 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:35.072208 22540 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.095331 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.048213 22370 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.240120 22870 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.240739 22370 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.241475 22818 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.224889 22537 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:35.244381 22818 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:35.244735 22370 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:35.043638 15394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3726) took 1994 ms (client timeout 2014 ms). Trace:
I20260709 13:05:35.143255 22350 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:35.245460 15394 rpcz_store.cc:269] 0709 13:05:33.048859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.048974 (+   115us) service_pool.cc:224] Handling call
0709 13:05:35.043431 (+1994457us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54002bb6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:35.043569 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4122439040}
I20260709 13:05:35.228328 15141 catalog_manager.cc:5697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 11 to 18, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 18 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.137689 22783 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.247256 22870 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.967051 22679 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.247946 22870 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.249028 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:35.042701 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 54496.4us
I20260709 13:05:35.226924 22740 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:35.217190 22784 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:35.037753 22744 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.179s
I20260709 13:05:35.146519 22780 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 13:05:35.277794 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.937031 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:34.986325 22841 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.020746 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.236333 22581 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:35.237067 22838 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:34.925150 22695 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:34.979823 22875 log.cc:927] Time spent T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:35.238716 22717 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.295962 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:34.971933 22448 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.042706 22741 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:35.239189 15391 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:35.238112 22854 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:34.936597 15213 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:35.145320 22704 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:35.145828 22715 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.984314 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.142843 22779 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:34.959838 22878 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.266s
I20260709 13:05:35.078635 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.289117 22679 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:35.145684 22738 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:35.144904 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.107129 22256 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.134s
I20260709 13:05:35.225719 15396 rpcz_store.cc:276] 0709 13:05:33.462196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.487978 (+ 25782us) service_pool.cc:224] Handling call
0709 13:05:33.921616 (+433638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:33.943623 (+ 22007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.081879 (+1138256us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b540009bfd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:35.082018 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996279680}
I20260709 13:05:35.227440 22681 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:35.204372 22597 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:05:34.985989 22723 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.975136 22840 consensus_meta.cc:287] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.005s
I20260709 13:05:35.350710 22448 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:34.970518 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.351854 15245 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:35.351440 22740 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.047300 22575 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:35.352705 22740 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:35.353041 22575 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:35.353907 22575 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.355077 22575 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:34.986380 22815 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.982642 22739 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:35.356359 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.356346 22815 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.356819 22739 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.358620 22815 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:34.971277 15242 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:35.275250 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:35.245913 22350 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.220510 15248 raft_consensus.cc:2368] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19.
I20260709 13:05:35.234958 15397 rpcz_store.cc:276] 0709 13:05:32.046344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.675896 (+629552us) service_pool.cc:224] Handling call
0709 13:05:34.479377 (+1803481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.491852 (+ 12475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.069877 (+578025us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b540034b7d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:35.070035 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4146847488}
W20260709 13:05:35.188760 15142 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49174 (request call id 242) took 54731 ms (client timeout 15000 ms). Trace:
I20260709 13:05:35.224771 15363 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:35.250074 22870 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:35.273864 22843 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.264506 15141 catalog_manager.cc:5697] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 3 to 15, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 15 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:05:35.371945 22784 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.276033 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.275336 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.252342 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:35.259675 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 67402.7us
I20260709 13:05:35.045938 22618 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:35.279629 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 342985us
I20260709 13:05:35.383714 15244 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:35.281677 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.283203 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:35.238265 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:35.386090 15250 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 25: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:35.386304 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 148117us
I20260709 13:05:35.287165 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:35.389717 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 102634us
I20260709 13:05:35.225585 22836 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:35.291786 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.396919 15243 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:35.296838 16032 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:35.290278 22838 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:35.402920 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 119829us
I20260709 13:05:35.290969 22695 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:35.303107 22780 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:35.303726 22717 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:35.289357 22581 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:35.308660 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 372107us
I20260709 13:05:35.173513 16027 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:05:35.313503 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.316783 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:35.318094 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.327872 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:35.326941 15319 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:35.420671 15391 raft_consensus.cc:2368] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19.
I20260709 13:05:35.324662 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.419435 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.421554 15392 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:35.312225 22255 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:35.424870 22255 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.425385 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.426108 15318 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:35.427129 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:35.427407 22255 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.330833 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.331036 22878 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:35.428256 22878 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:35.428308 15325 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:35.429382 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.429818 22784 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:35.330874 22681 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.430203 15325 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:35.430678 22681 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:35.431164 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:35.332552 15320 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:35.431941 15325 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:35.332805 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.333817 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.432862 15317 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:35.433329 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.433692 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:35.434026 15322 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:35.434689 15317 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:35.435111 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:35.435513 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.436172 15317 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:35.436367 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.437031 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.416033 22667 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:05:35.437800 15317 raft_consensus.cc:2410] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:05:35.310906 22711 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:05:35.309882 22818 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:35.440769 22818 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:35.317662 22741 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.335120 15323 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:35.312383 22537 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.470758 22741 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.319921 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.472056 15324 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:35.288292 22885 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:05:35.312206 22704 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.472734 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:35.474470 22704 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.475078 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.340710 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.475818 15317 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:35.347031 15241 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:35.312491 22715 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.476807 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:35.349261 22729 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.289979 22841 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.350051 22723 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.478324 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:35.360147 16030 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:05:35.352727 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.482072 15245 raft_consensus.cc:2376] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21. Re-sending same reply.
I20260709 13:05:35.363915 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.483292 15248 raft_consensus.cc:2376] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22. Re-sending same reply.
I20260709 13:05:35.364987 22586 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.365904 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 141194us
I20260709 13:05:35.366494 22707 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:35.368496 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2404) took 1052 ms. Trace:
I20260709 13:05:35.488675 15242 rpcz_store.cc:276] 0709 13:05:34.315692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.696535 (+380843us) service_pool.cc:224] Handling call
0709 13:05:34.696814 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.359937 (+663123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.368201 (+  8264us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400316354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:35.368431 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609558784}
I20260709 13:05:35.339113 22738 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.369804 22843 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.371796 15141 catalog_manager.cc:5697] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 11 to 17, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 17 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:35.258446 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 79576.3us
I20260709 13:05:35.500279 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.391971 22763 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:35.391753 22870 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:35.393136 22842 consensus_queue.cc:1059] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:35.391794 22815 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:35.517200 22815 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.517660 22815 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:35.405946 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.410214 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.519761 15243 raft_consensus.cc:2410] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:05:35.385349 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:35.522655 22841 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:35.415346 22747 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:05:35.523732 22763 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:35.524776 22763 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:35.522703 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 137415us
I20260709 13:05:35.527132 15215 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:35.528424 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:35.490324 22575 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:35.529760 22575 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.527861 22815 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.530308 22575 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:35.531775 22815 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:35.489656 22729 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.533763 22738 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.536054 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:35.535566 15141 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 12 to 14, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 14 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.537010 16031 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:35.493152 22586 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.539512 22723 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.420145 15396 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 17.
I20260709 13:05:35.418360 15321 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:35.442072 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.540655 15319 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:35.540913 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:35.541077 22586 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:35.541580 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.542100 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.542744 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.419713 15316 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:35.417842 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:35.543488 15319 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:05:35.543648 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 126075us
I20260709 13:05:35.460321 22581 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.544828 22581 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:35.544876 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:35.545333 22581 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.545225 22783 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:35.545828 22581 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:35.546437 22815 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:35.422224 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:35.546829 22815 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:35.547250 22815 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:35.547358 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 125216us
I20260709 13:05:35.548547 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:35.550375 22711 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:35.551047 22715 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:35.550952 22723 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:35.441272 22818 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:35.470799 22537 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.564554 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.565286 15324 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:35.565953 22537 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:35.314570 22779 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.566183 22741 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.566479 15324 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:35.556830 22840 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:35.477453 15317 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:35.551097 22711 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:35.557264 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:35.570996 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:35.572072 22898 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.162s	user 0.008s	sys 0.000s
I20260709 13:05:35.573658 22879 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:35.474397 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:35.574626 15325 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:35.574996 22695 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.537716 15141 catalog_manager.cc:5697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 13 to 16, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.577324 22695 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:35.577036 15141 catalog_manager.cc:5697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.578416 15323 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:35.578269 22581 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.479660 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.531800 22843 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:35.582710 15392 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:35.480257 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:35.583597 22717 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.485575 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:35.585189 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 99686.9us
I20260709 13:05:35.585471 22838 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.485744 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:35.498123 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:35.504779 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:35.506201 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.510632 15395 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:05:35.517573 22842 raft_consensus.cc:3055] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:35.522871 22667 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:35.501835 15399 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:05:35.481403 22885 consensus_queue.cc:1243] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:05:35.552233 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:35.441583 22448 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:35.645781 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.646054 15320 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:35.642928 15395 pending_rounds.cc:85] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 15
I20260709 13:05:35.647038 15395 pending_rounds.cc:107] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:05:35.429334 22878 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.466627 15998 leader_election.cc:400] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19.
I20260709 13:05:35.555408 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:35.469810 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.648134 15998 leader_election.cc:403] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:05:35.562700 16030 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
W20260709 13:05:35.648942 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 206888us
I20260709 13:05:35.563660 15316 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:35.552119 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:35.649617 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 163935us
W20260709 13:05:35.649822 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 97778.3us
I20260709 13:05:35.567988 22779 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.574168 22879 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.542968 15321 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:05:35.545517 15397 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:05:35.657497 15397 pending_rounds.cc:85] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 16
I20260709 13:05:35.657960 15397 pending_rounds.cc:107] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:05:35.657575 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:35.658497 15397 raft_consensus.cc:2889] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:35.580678 22581 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:35.594293 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:35.647377 15395 raft_consensus.cc:2889] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:35.651415 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.647601 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 95480.6us
I20260709 13:05:35.591106 15319 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:05:35.583629 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.745623 15392 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:35.668686 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.746543 15245 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:35.746658 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.650496 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:35.663022 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:35.747941 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 97513.2us
W20260709 13:05:35.748515 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.664165 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.655464 15391 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:35.655491 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 100194us
I20260709 13:05:35.655604 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:35.750633 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:35.655440 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.660705 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:35.752104 15390 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:35.577966 22695 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:35.753509 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:35.750744 15393 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:35.664314 22840 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:35.659904 22815 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.759407 22815 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.654947 22667 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.760262 22667 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:35.760921 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 158992us
I20260709 13:05:35.586150 22717 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:35.762387 22838 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.659898 22739 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:35.656441 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:35.644796 22256 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.119s
I20260709 13:05:35.764257 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:35.765503 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:35.766561 15398 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:35.766777 16029 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:35.659544 22841 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:05:35.773510 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 122491us
I20260709 13:05:35.776234 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.777036 15242 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:35.777253 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.661720 15317 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:35.661931 15325 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:35.586962 22669 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:35.770633 15393 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:35.771692 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.747268 15392 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:35.779469 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.780392 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.780558 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.780953 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.792058 15246 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:35.662866 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:35.781587 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.763029 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.782279 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.791501 15250 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:35.797132 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.798010 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.798794 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:35.363663 15142 rpcz_store.cc:269] 0709 13:04:40.457498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.457768 (+   270us) service_pool.cc:224] Handling call
0709 13:05:35.188475 (+54730707us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:24.115238 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:24.115978 (+   740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:24.116029 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:05:24.116051 (+    22us) tablet.cc:662] Decoding operations
0709 13:05:24.159017 (+ 42966us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:24.159145 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:24.159173 (+    28us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:05:24.160832 (+  1659us) tablet.cc:701] Row locks acquired
0709 13:05:24.160882 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:05:24.161063 (+   181us) write_op.cc:270] Start()
0709 13:05:24.161364 (+   301us) write_op.cc:276] Timestamp: P: 1783602324160996 usec, L: 0
0709 13:05:24.161411 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:05:24.162216 (+   805us) log.cc:844] Serialized 8360 byte log entry
0709 13:05:24.258092 (+ 95876us) op_driver.cc:464] REPLICATION: finished
0709 13:05:24.327647 (+ 69555us) write_op.cc:301] APPLY: starting
0709 13:05:24.327797 (+   150us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:25.192980 (+865183us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:25.193100 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:25.993223 (+800123us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:25.993672 (+   449us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:05:25.993734 (+    62us) write_op.cc:312] APPLY: finished
0709 13:05:25.994202 (+   468us) log.cc:844] Serialized 188 byte log entry
0709 13:05:26.178839 (+184637us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:26.204845 (+ 26006us) write_op.cc:454] Released schema lock
0709 13:05:26.232243 (+ 27398us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:26.274981 (+ 42738us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:26.276646 (+  1665us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39179,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":69190,"apply.run_cpu_time_us":53431,"apply.run_wall_time_us":1923805,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91865,"num_ops":21,"prepare.queue_time_us":86659,"prepare.run_cpu_time_us":19126,"prepare.run_wall_time_us":85856,"raft.queue_time_us":53073,"raft.run_cpu_time_us":13388,"raft.run_wall_time_us":41364,"replication_time_us":96494,"thread_start_us":270785,"threads_started":5,"wal-append.queue_time_us":186407,"wal-append.run_cpu_time_us":27946,"wal-append.run_wall_time_us":2141268}]]}
I20260709 13:05:35.659546 22711 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:35.802465 22711 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:35.802906 22711 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:35.802838 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:35.785138 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.659732 22747 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19.
I20260709 13:05:35.806380 22448 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:35.806870 15318 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:35.807199 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.787478 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:35.807979 15244 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:35.788048 22669 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:35.808710 22669 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:35.806926 22448 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:35.811878 22448 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:35.795599 15320 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:35.815025 22739 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:35.661357 22879 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:35.816125 22739 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.799715 15245 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:35.654165 22836 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.809966 22695 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:35.821197 22836 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:35.821686 15320 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 25. Current term is 26. Ops: []
W20260709 13:05:35.818513 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67947.8us
I20260709 13:05:35.819247 22586 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:35.820497 22707 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.642853 22842 raft_consensus.cc:740] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:35.588766 22784 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:35.794023 15391 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:35.845060 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.838909 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:35.933048 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.842485 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:35.766431 22868 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:35.798825 15250 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:35.859160 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59367.2us
I20260709 13:05:35.851457 15244 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 23 index: 10. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
W20260709 13:05:35.935374 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 96535.5us
I20260709 13:05:35.933940 15247 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:35.838986 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:35.970664 15390 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:35.766356 22256 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:35.937443 15325 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:35.871111 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.777351 22679 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:35.887003 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.979409 15399 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:35.980655 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:35.825363 22841 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:35.941468 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:35.823586 15317 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:05:35.974110 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:35.989542 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:35.990445 15391 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:35.873092 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:35.975822 15325 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:35.981253 15399 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:35.880318 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:35.788966 22843 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:35.793991 22715 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.987823 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.993444 15249 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:35.764318 22540 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.209s
I20260709 13:05:35.934037 22586 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.978072 22784 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:05:35.944927 22895 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:05:35.995909 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54555.9us
I20260709 13:05:35.996654 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:36.011668 15247 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:35.823410 22836 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:35.933357 22870 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.003317 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.943495 22868 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.007712 15317 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:05:35.971663 22838 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:36.011695 15250 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:35.980305 22256 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:35.822167 22818 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.011540 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:35.936604 15242 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:35.824044 22575 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.013559 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:36.014880 15246 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:35.839289 22815 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.162s
I20260709 13:05:36.033489 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:36.012426 15391 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:36.056476 15317 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:05:36.008446 22586 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:36.013247 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:35.994823 22679 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:35.969302 22707 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.057163 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:36.022483 22448 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:36.021328 22717 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:36.069195 15391 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 24: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:36.049484 15399 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
W20260709 13:05:36.055958 22900 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:05:36.023049 22840 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.074584 15248 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:36.075618 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:36.081571 15250 raft_consensus.cc:2368] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24.
I20260709 13:05:36.081790 15399 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:36.032846 22838 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.080361 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:36.034955 22868 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:36.082392 15390 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:36.087271 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:36.087921 15390 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:36.088799 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:36.089007 22707 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:36.089363 15390 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:36.091032 22784 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.091571 22669 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.093264 15243 raft_consensus.cc:2393] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:36.094341 22256 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.095917 22256 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:36.097858 15399 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:36.100363 22667 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.006987 22715 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.023617 22723 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:05:36.073794 22448 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:36.102536 15241 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:36.142596 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:36.143512 15391 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:36.144636 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:36.145624 15391 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:36.147326 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:36.085558 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:36.115922 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:36.128630 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:36.105727 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:36.032184 22870 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.165591 15393 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:05:36.175146 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.177380 15390 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:36.086934 22841 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.132421 22679 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.208313 15390 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:05:36.208858 15390 pending_rounds.cc:85] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 14
I20260709 13:05:36.209093 15390 pending_rounds.cc:107] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:05:36.209355 15390 raft_consensus.cc:2889] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:36.138685 22448 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:36.132671 22681 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.078s
I20260709 13:05:36.211100 15390 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:36.212514 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:35.824700 15141 catalog_manager.cc:5697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 9 to 15, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 15 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.218689 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:36.221285 15246 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:36.228001 15247 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:36.236037 22681 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:36.224625 22747 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:36.238865 22747 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.241353 22747 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:36.124842 22729 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:36.117012 22897 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.708s	user 0.002s	sys 0.000s
W20260709 13:05:36.101958 22902 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:05:36.256755 15249 pending_rounds.cc:85] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 12
I20260709 13:05:36.103122 22717 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:36.087523 22838 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:36.264029 15249 pending_rounds.cc:107] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:05:36.259783 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:36.119984 22878 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:36.137928 22879 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.266461 22747 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:05:36.267385 15246 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:05:36.299041 15246 pending_rounds.cc:85] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 11
I20260709 13:05:36.299391 15246 pending_rounds.cc:107] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:05:36.299732 15246 raft_consensus.cc:2889] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:36.267616 22870 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:36.272821 22448 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.279214 22681 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:36.281411 22818 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:36.103287 22707 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:36.103817 22667 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:36.288784 15249 raft_consensus.cc:2889] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:36.289695 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:36.312660 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:36.291523 16032 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.019s	sys 0.126s
I20260709 13:05:36.087116 22840 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.316109 22840 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:36.315092 15141 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 16 to 20, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 20 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.288024 22717 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.317880 22717 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:36.120673 22586 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.324103 22586 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:36.327323 15390 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
W20260709 13:05:36.327700 16032 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.019s	sys 0.126s
I20260709 13:05:36.329278 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:36.289831 22763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.009s	sys 0.029s
W20260709 13:05:36.332494 15324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.012s	sys 0.027s
I20260709 13:05:36.289592 22852 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:05:36.298141 22695 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:36.346261 15245 raft_consensus.cc:2393] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:36.346884 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.337735 22763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.009s	sys 0.030s
W20260709 13:05:36.333083 15324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.012s	sys 0.028s
I20260709 13:05:36.333242 22836 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:36.367980 22350 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:36.369522 22899 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.960s	user 0.000s	sys 0.005s
I20260709 13:05:36.339584 22707 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:36.371485 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3755) took 1016 ms. Trace:
I20260709 13:05:36.371937 15394 rpcz_store.cc:276] 0709 13:05:35.355226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.358065 (+  2839us) service_pool.cc:224] Handling call
0709 13:05:35.358439 (+   374us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:35.360587 (+  2148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.360622 (+    35us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:05:35.373055 (+ 12433us) log.cc:844] Serialized 78 byte log entry
0709 13:05:35.408990 (+ 35935us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:35.409044 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.409110 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.368857 (+959747us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:36.371104 (+  2247us) raft_consensus.cc:1685] finished
0709 13:05:36.371129 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.371414 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3826,"raft.queue_time_us":4617,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":1341,"spinlock_wait_cycles":13014784,"thread_start_us":35559,"threads_started":1,"wal-append.queue_time_us":35909}
I20260709 13:05:36.337648 22741 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:36.374727 22741 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:36.375705 22741 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:36.378486 15398 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3746) took 1546 ms (client timeout 2051 ms). Trace:
W20260709 13:05:36.379074 15398 rpcz_store.cc:269] 0709 13:05:34.832072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.935496 (+103424us) service_pool.cc:224] Handling call
0709 13:05:36.378185 (+1442689us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54002b4b54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:36.378410 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804619008}
I20260709 13:05:36.381767 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:36.358757 22852 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:36.342415 22695 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.361313 22669 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:36.338603 22779 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:36.357861 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:36.382136 15398 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:05:36.385113 15397 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: [22.11-22.11]
W20260709 13:05:36.394608 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.387354 15394 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:05:36.453938 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 96181.2us
I20260709 13:05:36.455870 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:36.463477 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 52192.9us
W20260709 13:05:36.396384 22854 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.002s	sys 0.040s
I20260709 13:05:36.463433 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:36.390836 22711 consensus_meta.cc:287] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.000s
W20260709 13:05:36.460457 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 449005us
I20260709 13:05:36.467926 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:36.460813 22885 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:36.469062 22914 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:36.457247 22610 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
W20260709 13:05:36.406208 22739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.022s	sys 0.022s
I20260709 13:05:36.391398 22695 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:36.391987 22879 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:36.471588 15290 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:36.405930 22779 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.390921 22852 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:36.483950 22779 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:36.484551 22852 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.485908 22852 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:36.475128 15290 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:36.462733 22780 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:36.453722 22868 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.372139 22707 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.466571 15141 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:36.470928 22854 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.002s	sys 0.040s
I20260709 13:05:36.471776 22711 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:36.472915 22739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.023s	sys 0.022s
I20260709 13:05:36.386718 22842 consensus_queue.cc:260] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.519718 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2425) took 1139 ms. Trace:
W20260709 13:05:36.519958 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 44940.9us
I20260709 13:05:36.521123 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 1113) took 1166 ms. Trace:
I20260709 13:05:36.392464 22575 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:36.487622 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:36.528002 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:36.489223 22836 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:36.489789 22879 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:36.490430 22747 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:36.491107 22448 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:36.491142 22610 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:05:36.494714 15323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.055s	sys 0.083s
W20260709 13:05:36.595139 15323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.057s	sys 0.083s
I20260709 13:05:36.495187 15398 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: [21.14-22.15]
I20260709 13:05:36.597246 15398 raft_consensus.cc:1240] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:36.521545 15396 rpcz_store.cc:276] 0709 13:05:35.354556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.356084 (+  1528us) service_pool.cc:224] Handling call
0709 13:05:36.520947 (+1164863us) spinlock_profiling.cc:243] Waited 63 ms on lock 0x7b54001d9f54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:36.521059 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144859392}
I20260709 13:05:36.520191 15322 rpcz_store.cc:276] 0709 13:05:35.380311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.437358 (+ 57047us) service_pool.cc:224] Handling call
0709 13:05:35.437668 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.534436 (+ 96768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.534468 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.534511 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:35.534543 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.519425 (+984882us) spinlock_profiling.cc:243] Waited 96.6 ms on lock 0x7b54002ee0d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:36.519483 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.519643 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222068096}
I20260709 13:05:36.473345 22350 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:36.520718 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:36.601924 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 81291.9us
I20260709 13:05:36.604311 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:36.530074 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:36.469657 22914 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:36.525311 22708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.012s	sys 0.024s
I20260709 13:05:36.578991 15244 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:05:36.586179 22586 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:36.497354 22744 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:36.606495 15318 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.009s	sys 0.020s
I20260709 13:05:36.589098 22739 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:36.608180 15318 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.009s	sys 0.021s
I20260709 13:05:36.608734 22914 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.594964 22610 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:36.615538 22610 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.616782 22610 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:36.619151 22370 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:36.619920 22370 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.620210 22717 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.621479 15391 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:36.622593 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 3120) took 1217 ms. Trace:
I20260709 13:05:36.622987 15391 rpcz_store.cc:276] 0709 13:05:35.405100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.147020 (+741920us) service_pool.cc:224] Handling call
0709 13:05:36.622357 (+475337us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54003d90d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:36.622533 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088131840}
I20260709 13:05:36.625288 15392 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:05:36.631484 22711 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:36.593917 22836 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:36.633510 22836 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.593667 22879 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.639016 22879 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:36.640427 22695 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.642385 22838 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.644614 22838 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:36.645357 15390 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:05:36.645517 22779 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.620370 22370 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:36.648788 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 118808us
I20260709 13:05:36.618808 15398 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:36.650132 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:36.609836 22708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.013s	sys 0.024s
I20260709 13:05:36.601239 22350 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:36.664294 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:36.628472 22717 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:36.663411 22912 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:36.665949 22695 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:36.665800 22838 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:36.677850 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:36.669659 22715 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:36.611900 22780 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:36.671861 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:36.680500 22708 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.673939 22350 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.671707 22885 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:36.676584 22763 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260709 13:05:36.687496 22708 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.681381 22815 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:36.683050 22780 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.708834 22779 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:36.686072 22717 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:05:36.702363 15365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.022s	sys 0.025s
I20260709 13:05:36.709816 22747 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:36.717835 22763 consensus_queue.cc:1059] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:36.702998 22815 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:36.710273 22780 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:05:36.719897 15365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.022s	sys 0.025s
W20260709 13:05:36.729314 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 715827us
W20260709 13:05:36.711393 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.024s	sys 0.023s
I20260709 13:05:36.718118 15141 catalog_manager.cc:5697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 8 to 17, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 17 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
W20260709 13:05:36.734663 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.025s	sys 0.023s
I20260709 13:05:36.720975 22717 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:36.735404 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.736382 15241 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:05:36.723435 22747 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:36.723881 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.011s	sys 0.037s
W20260709 13:05:36.735631 15242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.011s	sys 0.013s
I20260709 13:05:36.728767 22815 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:36.740154 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.012s	sys 0.038s
I20260709 13:05:36.731369 22868 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:36.749369 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3683) took 1282 ms. Trace:
I20260709 13:05:36.741290 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:36.750020 15323 rpcz_store.cc:276] 0709 13:05:35.466951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.580531 (+113580us) service_pool.cc:224] Handling call
0709 13:05:35.580912 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:35.581296 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.581320 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:35.581942 (+   622us) log.cc:844] Serialized 52 byte log entry
0709 13:05:36.595696 (+1013754us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:36.595786 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.595886 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.749076 (+153190us) raft_consensus.cc:1685] finished
0709 13:05:36.749108 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.749290 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8810,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"thread_start_us":1013318,"threads_started":1,"wal-append.queue_time_us":1164763}
W20260709 13:05:36.742201 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.727511 22704 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:36.745373 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 872331us
I20260709 13:05:36.762614 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:36.754041 22868 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:36.754164 22575 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.755247 15250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1389463201b74b128d916816a1d7c24c"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:36.756531 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:36.764430 15997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.010s	sys 0.031s
I20260709 13:05:36.757987 15247 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:36.764669 15250 raft_consensus.cc:606] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:05:36.765116 15250 raft_consensus.cc:614] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:36.738943 22717 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:36.758476 22669 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:36.759044 15245 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22. Ops: []
W20260709 13:05:36.759505 22907 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:05:36.742738 22747 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:36.764816 15997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.010s	sys 0.031s
I20260709 13:05:36.765632 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:36.770594 15247 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:36.733637 22784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.016s	sys 0.023s
W20260709 13:05:36.740373 15242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.012s	sys 0.013s
W20260709 13:05:36.769357 15996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.009s	sys 0.033s
I20260709 13:05:36.749452 22842 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:36.773687 15996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.009s	sys 0.033s
W20260709 13:05:36.776717 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 524083us
W20260709 13:05:36.767576 22679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.013s	sys 0.010s
I20260709 13:05:36.784823 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:36.786835 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.758433 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:36.792117 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:36.802922 15250 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:36.804688 15250 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:36.820873 15244 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:36.773144 22784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.016s	sys 0.024s
I20260709 13:05:36.834903 15247 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:36.802202 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:36.838567 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:36.841177 15291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.003s	sys 0.020s
W20260709 13:05:36.841574 15291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.003s	sys 0.020s
I20260709 13:05:36.848284 22838 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.849067 22838 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.850430 22586 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:36.851162 22586 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.853925 22586 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:36.862866 22586 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.864157 22586 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.862001 22838 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:36.872274 22838 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:36.873128 22838 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.881708 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:36.883064 15390 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:36.867339 22586 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:36.845410 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 506595us
I20260709 13:05:36.886180 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:36.821926 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:36.890525 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:36.890820 15245 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
W20260709 13:05:36.801615 22679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.014s	sys 0.011s
I20260709 13:05:36.891549 15390 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:05:36.781618 22843 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:36.843472 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:36.907756 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 64387.2us
I20260709 13:05:36.909214 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:36.882972 22838 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:36.783780 22370 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:36.840754 22878 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:36.769552 22868 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:36.766806 22704 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:36.769230 22575 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:36.930131 15399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.021s	sys 0.045s
W20260709 13:05:36.930655 15399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.021s	sys 0.045s
I20260709 13:05:36.932307 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:36.917259 22784 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:36.838667 22667 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:36.838593 22885 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.921820 16026 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:05:36.893481 22879 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:36.892160 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:36.916127 15999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.020s	sys 0.033s
W20260709 13:05:36.946642 15999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.020s	sys 0.033s
I20260709 13:05:36.920944 22679 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:36.939612 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:36.921902 22708 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:36.947268 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 734781us
I20260709 13:05:36.942355 22669 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:36.933779 22840 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:05:36.952695 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60615.3us
W20260709 13:05:36.953154 15249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.004s	sys 0.039s
W20260709 13:05:36.960831 15249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.004s	sys 0.039s
I20260709 13:05:36.960121 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:36.966907 15324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.009s	sys 0.035s
I20260709 13:05:36.920528 22695 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:05:36.925519 22878 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:36.954803 22715 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:05:36.924477 22779 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:05:36.955796 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:36.953861 22679 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:36.954025 22885 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:36.974637 22741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.006s	sys 0.011s
I20260709 13:05:36.957998 22711 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:36.887718 15141 catalog_manager.cc:5697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:37.018193 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3681) took 1551 ms. Trace:
W20260709 13:05:36.986359 22841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.014s	sys 0.033s
I20260709 13:05:37.021394 15324 rpcz_store.cc:276] 0709 13:05:35.466409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.567265 (+100856us) service_pool.cc:224] Handling call
0709 13:05:35.567613 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:35.660467 (+ 92854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.660498 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:35.661052 (+   554us) log.cc:844] Serialized 52 byte log entry
0709 13:05:36.352547 (+691495us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:36.758879 (+406332us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:36.986884 (+228005us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.987158 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.987232 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.987272 (+    40us) raft_consensus.cc:1685] finished
0709 13:05:37.017894 (+ 30622us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.018116 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92440,"prepare.queue_time_us":392926,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":94054,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":114479,"spinlock_wait_cycles":31799040,"thread_start_us":1049866,"threads_started":2,"wal-append.queue_time_us":858168}
W20260709 13:05:37.018491 22741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.006s	sys 0.012s
I20260709 13:05:36.979290 22915 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:37.008575 22679 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:37.025352 22841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.014s	sys 0.033s
I20260709 13:05:37.025476 22913 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.055866 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:37.056727 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 367307us
I20260709 13:05:37.050107 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:37.009227 22708 consensus_queue.cc:1059] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:05:37.056890 22854 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:37.037917 22838 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.046s
W20260709 13:05:37.110486 22903 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.447s	user 0.004s	sys 0.000s
I20260709 13:05:37.147993 16032 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 1164) took 1674 ms. Trace:
I20260709 13:05:37.114910 22885 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:37.075031 22914 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.152851 22914 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:37.123339 22917 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:37.157253 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3128) took 1743 ms. Trace:
I20260709 13:05:37.157550 22704 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:37.137068 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 333370us
I20260709 13:05:37.080706 22913 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.159684 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:37.157755 15393 rpcz_store.cc:276] 0709 13:05:35.413586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.166744 (+753158us) service_pool.cc:224] Handling call
0709 13:05:36.167145 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.167590 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.167629 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.242179 (+ 74550us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.772183 (+530004us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:37.070193 (+298010us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.075499 (+  5306us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.075593 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.156983 (+ 81390us) raft_consensus.cc:1685] finished
0709 13:05:37.157006 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.157181 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7910,"raft.queue_time_us":1683,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":28624,"spinlock_wait_cycles":449280,"thread_start_us":697400,"threads_started":2,"wal-append.queue_time_us":765055}
I20260709 13:05:37.160898 22913 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:37.162915 22448 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:37.163749 22448 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:37.164108 22448 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:37.164556 22448 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:37.166472 22840 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:37.167577 22840 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:37.169348 22840 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:37.078652 22729 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:37.148499 16032 rpcz_store.cc:276] 0709 13:05:35.474010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.475959 (+  1949us) service_pool.cc:224] Handling call
0709 13:05:35.476277 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:35.476659 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.476690 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:35.477169 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.328983 (+851814us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:36.329042 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.329136 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.075386 (+746250us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:37.147616 (+ 72230us) raft_consensus.cc:1685] finished
0709 13:05:37.147647 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.147918 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1163,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7200,"spinlock_wait_cycles":5781760,"thread_start_us":851382,"threads_started":1,"wal-append.queue_time_us":1115773}
I20260709 13:05:37.176811 15141 catalog_manager.cc:5697] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.179311 15141 catalog_manager.cc:5697] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 6 to 14. New cstate: current_term: 14 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.091241 22854 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:37.079051 22878 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.081698 22784 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:37.183266 22784 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:37.183748 22784 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:37.183555 22854 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.184880 22854 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:37.090384 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:37.186596 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 96341.3us
W20260709 13:05:37.186950 22744 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.004s
I20260709 13:05:37.187525 22744 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:37.187778 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:37.188308 22744 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:37.189206 22744 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:37.189657 22744 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.191810 22918 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:37.192413 22918 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.192795 22918 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:37.143746 22909 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.435s	user 0.004s	sys 0.009s
I20260709 13:05:37.083712 22739 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:37.194577 22739 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:37.195637 22739 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.196995 22739 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:37.197170 22840 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:37.197826 22840 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:37.198966 22575 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:37.199864 22575 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:05:37.144745 22852 consensus_meta.cc:287] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 13:05:37.200284 22575 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:37.200901 22852 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:37.203157 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:37.204118 22919 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:05:37.204492 22885 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:37.144423 22350 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:37.145481 22610 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.004s
I20260709 13:05:37.070060 22920 raft_consensus.cc:3055] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:37.145990 22868 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:37.213019 15396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.030s	sys 0.029s
W20260709 13:05:37.214742 15396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.031s	sys 0.029s
I20260709 13:05:37.215165 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:37.220094 16033 raft_consensus.cc:2410] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:05:37.199079 22840 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.190062 22744 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:37.201370 22575 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.249744 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.250419 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.251282 15320 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:37.254604 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.255934 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.217828 22920 raft_consensus.cc:740] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:37.260027 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:37.260437 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.267644 15323 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:37.238618 22610 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:05:37.261051 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.253028 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:37.262373 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:37.278137 15317 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:37.279129 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:37.280215 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:37.281235 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.281953 15317 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:37.264724 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.235082 22925 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:37.266091 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:37.237901 22916 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:05:37.217165 22885 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:05:37.268674 15319 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:05:37.291334 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 343516us
W20260709 13:05:37.269436 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 377420us
I20260709 13:05:37.239526 22912 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:37.270695 15325 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 24 index: 11. (index mismatch)
I20260709 13:05:37.223067 22741 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:05:37.285122 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:37.318655 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.319443 15325 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:37.320308 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.244736 22779 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:05:37.283259 22840 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:37.282883 22610 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:05:37.292510 15996 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.025s	sys 0.030s
I20260709 13:05:37.238935 22715 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:37.299772 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:37.300841 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 345101us
I20260709 13:05:37.303611 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.305132 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.309142 15291 leader_election.cc:400] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24.
I20260709 13:05:37.331418 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:37.331969 15291 leader_election.cc:403] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:37.331550 15319 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:37.321310 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.287796 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:37.332831 15999 leader_election.cc:400] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19.
I20260709 13:05:37.333123 15999 leader_election.cc:403] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:37.334026 15317 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:37.302577 22836 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:37.330008 15996 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.025s	sys 0.030s
I20260709 13:05:37.333943 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:37.301877 22879 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:37.307020 22912 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:37.317227 22667 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:37.336884 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 557382us
I20260709 13:05:37.324038 22695 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:37.343184 22947 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:05:37.354867 22667 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.356763 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1084) took 1585 ms. Trace:
I20260709 13:05:37.285238 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3126) took 1878 ms. Trace:
I20260709 13:05:37.362476 15320 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:37.372567 15399 rpcz_store.cc:276] 0709 13:05:35.407229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.154299 (+747070us) service_pool.cc:224] Handling call
0709 13:05:36.154737 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.155216 (+   479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.155258 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.223323 (+ 68065us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.931190 (+707867us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:37.278346 (+347156us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.282516 (+  4170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.284887 (+  2371us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.284956 (+    69us) raft_consensus.cc:1685] finished
0709 13:05:37.284975 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.285171 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":423786,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":880,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":56320,"thread_start_us":1008502,"threads_started":2,"wal-append.queue_time_us":812690}
I20260709 13:05:37.321374 22597 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:05:37.182058 15141 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 9 to 18, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 18 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.341518 22931 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:37.372507 15318 rpcz_store.cc:276] 0709 13:05:35.771797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.808596 (+ 36799us) service_pool.cc:224] Handling call
0709 13:05:35.808905 (+   309us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:35.858469 (+ 49564us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:36.613690 (+755221us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.071318 (+457628us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:05:37.072388 (+  1070us) log.cc:844] Serialized 78 byte log entry
0709 13:05:37.072580 (+   192us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:37.072893 (+   313us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.076786 (+  3893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.076887 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.140077 (+ 63190us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b18001aa3a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d557 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:37.154182 (+ 14105us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b18001aa3a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d522 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:37.356436 (+202254us) raft_consensus.cc:1685] finished
0709 13:05:37.356469 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.356684 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32557,"prepare.queue_time_us":875854,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":1918,"raft.queue_time_us":44793,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":24248,"spinlock_wait_cycles":244569344,"thread_start_us":1010746,"threads_started":2,"wal-append.queue_time_us":653783}
I20260709 13:05:37.384176 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3259) took 1406 ms. Trace:
W20260709 13:05:37.385188 15289 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.196:38543 timed out after 1.515s (SENT) [suppressed 13 similar messages]
I20260709 13:05:37.342546 22715 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:37.348876 22936 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:37.347689 22763 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19.
I20260709 13:05:37.387560 15242 rpcz_store.cc:276] 0709 13:05:35.977706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.043058 (+ 65352us) service_pool.cc:224] Handling call
0709 13:05:36.043401 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.043793 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.043843 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.057635 (+ 13792us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.773536 (+715901us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:36.773579 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.773653 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.383897 (+610244us) raft_consensus.cc:1685] finished
0709 13:05:37.383925 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.384104 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80533,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":682969,"threads_started":1,"wal-append.queue_time_us":912634}
I20260709 13:05:37.394311 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:37.399959 15320 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 17: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:37.383116 22779 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:05:37.405360 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:37.407514 15320 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:37.399420 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 237236us
I20260709 13:05:37.411296 15318 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:37.342592 22836 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.375813 22915 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:37.416860 22915 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.415731 22836 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:37.417307 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.386976 22931 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:37.426517 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:37.431974 15242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:37.378170 22695 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:37.395694 22949 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:05:37.466902 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 121591us
I20260709 13:05:37.468402 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:37.402156 22711 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:37.427572 22815 consensus_meta.cc:287] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.003s
I20260709 13:05:37.476030 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:37.478478 15393 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:37.478346 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51975.4us
W20260709 13:05:37.466596 22780 consensus_meta.cc:287] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.713s	user 0.008s	sys 0.004s
I20260709 13:05:37.482599 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:37.486426 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 68458.1us
I20260709 13:05:37.501093 15394 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:37.487874 15391 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:37.501456 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:37.398258 22610 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:37.444845 22763 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.047s
W20260709 13:05:37.491451 22937 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:05:37.491865 22940 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:37.491859 22715 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.492476 22711 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:37.401959 22912 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:37.489168 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 415956us
I20260709 13:05:37.346263 22920 consensus_queue.cc:260] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:37.496381 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 187474us
I20260709 13:05:37.496635 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:37.481273 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:37.497612 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:37.506716 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.499011 15398 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 17.
I20260709 13:05:37.545810 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:37.511137 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:37.481221 22931 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.547091 15391 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:37.552160 15391 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:05:37.553020 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:37.555029 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 58479.3us
I20260709 13:05:37.497097 22955 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:37.548429 15397 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:37.560866 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:37.549628 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 53133.4us
I20260709 13:05:37.425187 22879 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:37.512383 22842 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.728s	user 0.013s	sys 0.000s
I20260709 13:05:37.466043 22939 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.102s
I20260709 13:05:37.576220 15248 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:05:37.502974 22933 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.054s
I20260709 13:05:37.502790 22949 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
W20260709 13:05:37.573648 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.574525 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:37.593850 15247 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:37.504190 22780 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.556367 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:37.559944 22930 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:05:37.595093 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:37.616676 15248 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:37.580472 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:37.499491 22815 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:37.560453 22854 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:37.608928 15394 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
W20260709 13:05:37.614271 15365 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.010s	sys 0.018s
I20260709 13:05:37.615022 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:37.615430 15241 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: [19.10-19.10]
W20260709 13:05:37.632206 15365 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.011s	sys 0.018s
I20260709 13:05:37.527669 22942 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.073s
W20260709 13:05:37.632593 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 582538us
I20260709 13:05:37.633327 15365 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:37.621541 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.624038 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:37.632411 15244 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:37.633502 15241 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:05:37.560637 22741 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:37.617729 15250 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:37.565106 22954 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:37.582306 22931 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:37.639214 15398 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22. Ops: [21.18-21.18]
W20260709 13:05:37.629928 22965 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:05:37.650439 15316 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:37.563638 22885 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 13:05:37.656929 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.657155 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 100858us
I20260709 13:05:37.667455 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:37.676738 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:37.679392 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:37.680370 15241 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 24 because replica has last-logged OpId of term: 22 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:05:37.681474 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:37.682997 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:37.543063 22940 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:37.687132 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:37.638477 22597 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:37.667644 22448 consensus_meta.cc:287] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.003s
I20260709 13:05:37.688822 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1122) took 1474 ms. Trace:
I20260709 13:05:37.689000 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:37.688326 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:37.695204 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:37.698714 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:37.700369 15241 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
W20260709 13:05:37.706012 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.706393 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:37.699362 15396 rpcz_store.cc:276] 0709 13:05:36.214261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.597995 (+383734us) service_pool.cc:224] Handling call
0709 13:05:36.598379 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.598812 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.598852 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.599425 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:05:37.217005 (+617580us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:37.217055 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.217353 (+   298us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.688613 (+471260us) raft_consensus.cc:1685] finished
0709 13:05:37.688635 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.688767 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1878,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7315,"thread_start_us":617219,"threads_started":1,"wal-append.queue_time_us":776917}
W20260709 13:05:37.707113 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.708074 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.708520 15396 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:37.492268 15141 catalog_manager.cc:5697] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 13 to 15, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 15 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.689997 22915 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:37.716812 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:37.686077 22951 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:37.690637 22955 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:37.721758 15397 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
W20260709 13:05:37.731735 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53320.3us
I20260709 13:05:37.734059 22961 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:37.734618 22961 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:05:37.735901 22747 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.954s	user 0.003s	sys 0.008s
I20260709 13:05:37.735564 22961 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.736356 22747 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:37.737018 22961 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:37.737473 22780 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:37.738137 22780 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:37.739723 15395 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:37.742380 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:37.705828 22729 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:05:37.716809 22717 consensus_meta.cc:287] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.940s	user 0.013s	sys 0.000s
I20260709 13:05:37.705828 22952 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:37.747864 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:37.749588 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:37.750660 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:37.763316 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:37.764421 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:37.765100 15397 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:37.718961 22915 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.661298 22954 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:37.720309 22763 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:37.715047 22838 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:37.745577 22586 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:37.719120 22949 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:37.786710 15248 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:37.787137 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:37.702749 22597 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:37.787839 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:37.724429 22951 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:37.707031 22448 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:37.789386 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 76105.9us
I20260709 13:05:37.704908 22963 consensus_queue.cc:1059] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.085s
I20260709 13:05:37.802891 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:37.803488 15397 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:37.761612 22707 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.808177 15244 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
I20260709 13:05:37.805790 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:37.763535 22841 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:37.812791 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 71293.5us
I20260709 13:05:37.786448 22915 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:37.787449 22763 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:37.789012 22729 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:37.832607 15242 raft_consensus.cc:606] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:05:37.833284 15242 raft_consensus.cc:614] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:37.824317 22707 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:37.739778 22955 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.766719 22717 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:37.813526 22952 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:37.809540 22951 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:37.825227 22695 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:37.827396 22747 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:37.868470 22679 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.002s
W20260709 13:05:37.872123 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 486932us
W20260709 13:05:37.861824 22918 consensus_meta.cc:287] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.002s
I20260709 13:05:37.868832 22841 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:37.910334 15396 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:37.910207 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:37.872797 22948 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:05:37.872782 22978 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:37.918779 15323 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:37.921741 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 118941us
W20260709 13:05:37.920305 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 355052us
I20260709 13:05:37.930183 15396 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
I20260709 13:05:37.904829 22914 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.917413 22885 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:37.924134 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:37.943526 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:37.918314 22959 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:37.924324 22815 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:37.917584 22978 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:37.946105 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:37.947386 22717 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:37.947499 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:38.016618 15999 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.008s	sys 0.003s
W20260709 13:05:38.016992 15999 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.008s	sys 0.003s
I20260709 13:05:37.918550 22841 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.916951 22918 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:37.952474 22784 consensus_meta.cc:287] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.003s
I20260709 13:05:37.952877 22695 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:37.958451 22957 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:05:37.957903 22763 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:38.006748 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 82689.5us
I20260709 13:05:38.036214 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:38.004034 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 190314us
I20260709 13:05:37.924015 22972 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:05:38.012053 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:37.873493 22946 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.167s
W20260709 13:05:38.017880 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:38.017261 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 542198us
I20260709 13:05:37.873507 22979 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.220s
I20260709 13:05:38.026963 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:37.924497 22911 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.027171 22841 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:37.899363 22974 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.154s
I20260709 13:05:37.913719 22679 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.008630 22885 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.960770 22981 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:38.046492 15394 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:05:38.047289 15362 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:38.052767 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.008338 22959 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:38.064733 16031 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:38.103094 15244 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:37.945974 22707 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:38.072381 16030 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:05:38.077947 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:38.078147 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:38.078424 16032 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:38.131145 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:38.035337 22695 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.078706 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:38.008287 22914 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:38.100565 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53373.8us
I20260709 13:05:38.134866 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:38.078488 22985 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.101078 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:38.064028 22961 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:38.104315 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.012s	sys 0.012s
I20260709 13:05:38.131894 16031 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
W20260709 13:05:38.140671 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.016s	sys 0.016s
I20260709 13:05:38.092869 22885 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:38.036496 22784 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:38.102280 22744 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.856s	user 0.013s	sys 0.000s
I20260709 13:05:38.138330 15394 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:05:38.141299 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:38.075220 22940 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:38.072804 22780 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 13:05:38.141026 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 610022us
W20260709 13:05:38.142091 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 115756us
W20260709 13:05:38.103405 22739 consensus_meta.cc:287] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.903s	user 0.010s	sys 0.005s
I20260709 13:05:38.074608 22911 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.183476 15393 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:05:38.100569 22836 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.229563 15319 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:38.101684 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:38.207034 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:38.207969 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 66752.5us
I20260709 13:05:38.231339 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:38.222393 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.129295 22959 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:38.224880 22933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.000s	sys 0.013s
W20260709 13:05:38.232126 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 130723us
W20260709 13:05:38.249540 15320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.000s	sys 0.014s
I20260709 13:05:38.249542 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:38.249899 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:38.250113 15320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.000s	sys 0.014s
I20260709 13:05:38.254317 16031 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 27 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 13:05:38.255316 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:38.257408 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:38.258873 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:38.260480 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:38.261184 16028 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
W20260709 13:05:38.233143 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 429936us
W20260709 13:05:38.191202 22741 consensus_meta.cc:287] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.002s
I20260709 13:05:38.268841 22741 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:38.269194 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:38.263411 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.263302 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:38.267719 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:38.137151 22707 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:38.271016 16028 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
I20260709 13:05:38.271041 22707 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:05:38.273083 22933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.001s	sys 0.013s
I20260709 13:05:38.272898 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:38.273366 22707 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.274115 22707 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.247722 22667 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:38.276468 22667 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:38.276952 22667 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.277347 22667 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:38.278748 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:38.279722 15394 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:38.228075 22962 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 13:05:38.184422 22597 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:38.294898 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:38.194010 22961 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.226164 22952 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:05:38.318805 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 55194.4us
I20260709 13:05:38.321733 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:38.301443 15247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.009s	sys 0.014s
W20260709 13:05:38.326957 15247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.009s	sys 0.014s
W20260709 13:05:38.328603 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.053027 15141 catalog_manager.cc:5697] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:38.225898 22954 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:38.331687 15393 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:38.305239 22925 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.002s	user 0.014s	sys 0.000s
I20260709 13:05:38.338928 15289 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:38.299701 22739 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:38.339572 15291 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.041s
I20260709 13:05:38.340797 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.284801 22707 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:38.303665 22955 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:38.298542 22987 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:38.331079 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:38.353313 22970 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.449s	user 0.001s	sys 0.000s
I20260709 13:05:38.348501 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.190497 22985 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.306617 22939 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.353551 22982 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.353420 22925 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:38.335318 22597 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:05:38.354409 22679 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:38.354915 22695 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:38.355449 22954 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.130556 22981 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.219365 22744 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.350630 22739 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:38.383913 15322 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:38.365202 22918 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:38.206387 22978 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.375062 22986 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:38.300289 22836 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.347059 22952 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:38.334930 22974 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:38.426963 22975 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:05:38.397575 22739 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:38.398327 22695 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:05:38.399207 22966 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.334s	user 0.000s	sys 0.002s
I20260709 13:05:38.427680 22995 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:38.453984 22952 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.456488 22990 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:38.457056 22981 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:38.457336 22990 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:38.457767 22990 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.458148 22990 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:38.447806 22977 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:05:38.491384 22959 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.454809 22995 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:38.493916 22959 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:38.494132 22995 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.495450 22995 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:38.496053 22878 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:38.496512 22878 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:38.497324 22878 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:38.472155 22926 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.332s	user 0.008s	sys 0.005s
W20260709 13:05:38.472551 22998 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:05:38.473210 22988 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
W20260709 13:05:38.473524 22976 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.438s	user 0.000s	sys 0.001s
I20260709 13:05:38.474450 22985 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:38.474752 22784 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:38.476742 22854 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.835s	user 0.009s	sys 0.003s
I20260709 13:05:38.478477 22911 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:38.479182 22999 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:05:38.447446 22996 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.452473 22974 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.481057 22914 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:38.482581 22992 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
W20260709 13:05:38.486825 22931 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.831s	user 0.006s	sys 0.006s
I20260709 13:05:38.486896 22836 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:38.487262 22961 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:38.380635 22939 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.526862 22885 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.531973 22841 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.532771 22939 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:38.385135 22954 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.533453 22885 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:38.534180 22841 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:38.534653 22996 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.535037 22954 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:38.411530 22925 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:05:38.398881 22982 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.536267 22925 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:38.536657 22925 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:38.514513 22878 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:38.537299 22982 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:38.530454 22951 consensus_meta.cc:287] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.003s
I20260709 13:05:38.537755 22925 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.538085 22951 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.539377 22925 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:38.536680 22996 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:38.533121 22915 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.693s	user 0.013s	sys 0.000s
I20260709 13:05:38.541538 22915 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.542068 22951 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:38.543642 22974 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:38.543623 22915 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:38.545460 23009 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 13:05:38.547421 22971 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.752s	user 0.001s	sys 0.001s
W20260709 13:05:38.549896 23003 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:05:38.448077 22986 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.561321 22978 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:38.561407 22986 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:38.572793 22973 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:38.573293 22973 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:38.574187 22973 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:38.575460 22973 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:38.579001 22990 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:38.586061 23013 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 13:05:38.586752 22990 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:38.582674 23018 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
W20260709 13:05:38.619269 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.620342 15141 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:38.624617 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 405192us
W20260709 13:05:38.627017 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 395604us
I20260709 13:05:38.628417 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:38.629642 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2438) took 1876 ms. Trace:
I20260709 13:05:38.629227 15141 catalog_manager.cc:5697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:38.630159 15243 rpcz_store.cc:276] 0709 13:05:36.753362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.754248 (+   886us) service_pool.cc:224] Handling call
0709 13:05:36.754618 (+   370us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:36.944054 (+189436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.944100 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:36.951664 (+  7564us) log.cc:844] Serialized 52 byte log entry
0709 13:05:37.360321 (+408657us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:37.360363 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.628643 (+1268280us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400316354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:38.628765 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.628859 (+    94us) raft_consensus.cc:1685] finished
0709 13:05:38.628885 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.629412 (+   527us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13346,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":434634496,"thread_start_us":373223,"threads_started":1,"wal-append.queue_time_us":463569}
I20260709 13:05:38.633781 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:38.634392 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38848 (request call id 40) took 1202 ms. Trace:
I20260709 13:05:38.638625 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3266) took 2383 ms. Trace:
I20260709 13:05:38.655165 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3779) took 1155 ms. Trace:
W20260709 13:05:38.352108 15291 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.000s	sys 0.041s
W20260709 13:05:38.656984 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 851047us
I20260709 13:05:38.655604 15249 rpcz_store.cc:276] 0709 13:05:36.255034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.256138 (+  1104us) service_pool.cc:224] Handling call
0709 13:05:36.256490 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:36.333885 (+ 77395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.333932 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:36.335871 (+  1939us) log.cc:844] Serialized 52 byte log entry
0709 13:05:36.961398 (+625527us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:37.431212 (+469814us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.485785 (+ 54573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.485855 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.471804 (+985949us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b2400155678. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f36669939c4 00007f3666991acb 00007f3666b4cdc9 00007f3666b4ca55 00007f3666b4c09d 00007f366977e10e 00007f366979588c 00007f3669794bb6 00007f36697947d8 00007f366979e221
0709 13:05:38.637862 (+166058us) raft_consensus.cc:1685] finished
0709 13:05:38.638052 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.638377 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":450182,"prepare.run_cpu_time_us":4255,"prepare.run_wall_time_us":38145,"raft.queue_time_us":137081,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":13027,"spinlock_wait_cycles":4662144,"thread_start_us":1096034,"threads_started":3,"wal-append.queue_time_us":702848}
I20260709 13:05:38.660172 15291 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:38.655536 15242 rpcz_store.cc:276] 0709 13:05:37.431614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.431815 (+   201us) service_pool.cc:224] Handling call
0709 13:05:38.633795 (+1201980us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54000ada54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf4853 00007f366ebc260a 00007f36681487d4 00007f3668148762 00007f3668148691 00007f366814860c 00007f36681478c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:38.634040 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907087616}
W20260709 13:05:38.639225 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 308059us
I20260709 13:05:38.656987 15397 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:38.663035 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:38.641178 15318 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:38.641970 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1097) took 1082 ms. Trace:
W20260709 13:05:38.642535 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.671618 15325 rpcz_store.cc:276] 0709 13:05:37.559541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.561392 (+  1851us) service_pool.cc:224] Handling call
0709 13:05:37.561697 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.562028 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.562055 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.571075 (+  9020us) log.cc:844] Serialized 26 byte log entry
0709 13:05:38.016320 (+445245us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:38.016381 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.016496 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.641316 (+624820us) raft_consensus.cc:1685] finished
0709 13:05:38.641358 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.641719 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1060,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":7443,"thread_start_us":366317,"threads_started":1,"wal-append.queue_time_us":591223}
I20260709 13:05:38.647030 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2426) took 1406 ms. Trace:
I20260709 13:05:38.649735 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2432) took 1395 ms. Trace:
I20260709 13:05:38.675633 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1117) took 3023 ms. Trace:
W20260709 13:05:38.651954 15322 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2441) took 1375 ms (client timeout 1675 ms). Trace:
I20260709 13:05:38.676857 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1098) took 1114 ms. Trace:
W20260709 13:05:38.652768 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 313791us
I20260709 13:05:38.677412 15319 rpcz_store.cc:276] 0709 13:05:37.562663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.562784 (+   121us) service_pool.cc:224] Handling call
0709 13:05:37.563067 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.236490 (+673423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.676320 (+439830us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54004033d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:38.676699 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532331776}
I20260709 13:05:38.676571 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:38.679356 15325 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:38.679620 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:38.680644 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:38.653388 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1096) took 1081 ms. Trace:
I20260709 13:05:38.682163 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:38.682900 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.684226 15245 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:05:38.683056 15320 rpcz_store.cc:276] 0709 13:05:37.559254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.559363 (+   109us) service_pool.cc:224] Handling call
0709 13:05:37.559658 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.564477 (+  4819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.564507 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.564930 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:05:38.254157 (+689227us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:05:38.254198 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.254326 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.640415 (+386089us) raft_consensus.cc:1685] finished
0709 13:05:38.640470 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.640831 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4422,"raft.queue_time_us":23171,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":21347,"thread_start_us":661313,"threads_started":1,"wal-append.queue_time_us":963550}
I20260709 13:05:38.685458 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:38.677083 15322 rpcz_store.cc:269] 0709 13:05:37.276339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.284899 (+  8560us) service_pool.cc:224] Handling call
0709 13:05:38.651430 (+1366531us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400374e54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:38.651745 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453844352}
I20260709 13:05:38.686654 15248 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:38.687422 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:38.688752 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1095) took 1129 ms. Trace:
I20260709 13:05:38.689055 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:38.689329 15318 rpcz_store.cc:276] 0709 13:05:37.558939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.559110 (+   171us) service_pool.cc:224] Handling call
0709 13:05:37.559434 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.670769 (+1111335us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.688412 (+ 17643us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002ed1d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:38.688672 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2485554048}
I20260709 13:05:38.684095 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:38.690174 15322 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:38.706084 15396 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:38.690856 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.653512 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 976) took 1896 ms. Trace:
I20260709 13:05:38.655124 15394 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:05:38.663652 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1128) took 1116 ms. Trace:
I20260709 13:05:38.716058 15398 rpcz_store.cc:276] 0709 13:05:37.547505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.582584 (+ 35079us) service_pool.cc:224] Handling call
0709 13:05:37.634204 (+ 51620us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.647513 (+ 13309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.663108 (+1015595us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b54001545d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:38.663408 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24189824}
I20260709 13:05:38.715224 15246 rpcz_store.cc:276] 0709 13:05:36.756569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.757069 (+   500us) service_pool.cc:224] Handling call
0709 13:05:36.757351 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.938602 (+181251us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:37.359775 (+421173us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.490300 (+130525us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:37.493293 (+  2993us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:37.493908 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.653023 (+1159115us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54000ad554. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:38.653086 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.653339 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":443737,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5000,"raft.queue_time_us":149693,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":30151,"spinlock_wait_cycles":416303488,"thread_start_us":529511,"threads_started":2,"wal-append.queue_time_us":172035}
I20260709 13:05:38.656087 15392 rpcz_store.cc:276] 0709 13:05:37.500224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.500398 (+   174us) service_pool.cc:224] Handling call
0709 13:05:37.500814 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.554425 (+ 53611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.554457 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.557841 (+  3384us) log.cc:844] Serialized 26 byte log entry
0709 13:05:37.728327 (+170486us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:37.728383 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.728479 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.654441 (+925962us) raft_consensus.cc:1685] finished
0709 13:05:38.654491 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.654866 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91893,"raft.queue_time_us":69224,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":18915,"thread_start_us":112999,"threads_started":1,"wal-append.queue_time_us":137922}
I20260709 13:05:38.665313 15244 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:38.661928 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:38.668133 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:38.669636 15247 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:38.719906 15249 raft_consensus.cc:2368] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26.
I20260709 13:05:38.720072 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:38.639807 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2446) took 1359 ms. Trace:
I20260709 13:05:38.669584 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.676262 15395 rpcz_store.cc:276] 0709 13:05:35.652220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.212391 (+560171us) service_pool.cc:224] Handling call
0709 13:05:36.212748 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.740258 (+1527510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.675014 (+934756us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540026ff54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:38.675371 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3511246080}
I20260709 13:05:38.675935 15316 rpcz_store.cc:276] 0709 13:05:37.254072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.254271 (+   199us) service_pool.cc:224] Handling call
0709 13:05:38.649222 (+1394951us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b540021a7d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:38.649516 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":907699968}
I20260709 13:05:38.718746 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:38.720196 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 58627.8us
I20260709 13:05:38.715699 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:38.725672 15319 raft_consensus.cc:2368] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26.
I20260709 13:05:38.725971 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:38.704927 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:38.720826 15317 rpcz_store.cc:276] 0709 13:05:37.279996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.334898 (+ 54902us) service_pool.cc:224] Handling call
0709 13:05:37.335311 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:37.339193 (+  3882us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:37.371916 (+ 32723us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.493246 (+121330us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:37.506017 (+ 12771us) log.cc:844] Serialized 52 byte log entry
0709 13:05:37.506353 (+   336us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:37.506429 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.506563 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.639117 (+1132554us) raft_consensus.cc:1685] finished
0709 13:05:38.639159 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.639549 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16091,"prepare.queue_time_us":36606,"raft.queue_time_us":24557,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":21017,"spinlock_wait_cycles":8252800,"thread_start_us":80583,"threads_started":1,"wal-append.queue_time_us":314461}
I20260709 13:05:38.674916 15324 rpcz_store.cc:276] 0709 13:05:37.241874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.248753 (+  6879us) service_pool.cc:224] Handling call
0709 13:05:37.283185 (+ 34432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:37.300973 (+ 17788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.301005 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:37.301687 (+   682us) log.cc:844] Serialized 52 byte log entry
0709 13:05:37.489846 (+188159us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:37.496760 (+  6914us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.510687 (+ 13927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.510772 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.646438 (+1135666us) raft_consensus.cc:1685] finished
0709 13:05:38.646477 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.646852 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36914,"prepare.queue_time_us":648,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":46333,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":26592,"thread_start_us":148766,"threads_started":1,"wal-append.queue_time_us":337971}
I20260709 13:05:38.727993 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:38.728639 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:38.707165 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.729938 15241 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:38.730554 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:38.732687 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.721458 15242 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:38.734072 15324 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:38.635241 15141 catalog_manager.cc:5697] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 1 to 13. New cstate: current_term: 13 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.714192 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:38.685513 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:38.723592 15289 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:38.709861 15393 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:38.714622 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:38.483716 22586 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:38.726922 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:38.736931 15997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.023s	sys 0.031s
W20260709 13:05:38.739312 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.727237 15316 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 27 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
W20260709 13:05:38.476631 22779 consensus_meta.cc:287] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.052s	user 0.011s	sys 0.000s
I20260709 13:05:38.733682 15246 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
W20260709 13:05:38.777223 22972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.026s	sys 0.050s
I20260709 13:05:38.739295 16029 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1210) took 1307 ms. Trace:
I20260709 13:05:38.723604 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:38.738023 16025 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:38.810503 15325 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
W20260709 13:05:38.805361 15997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.024s	sys 0.032s
I20260709 13:05:38.850123 15316 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:38.851174 15322 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:38.850042 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.522553 22854 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:38.853767 16029 rpcz_store.cc:276] 0709 13:05:37.432112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.432674 (+   562us) service_pool.cc:224] Handling call
0709 13:05:37.433717 (+  1043us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:37.465868 (+ 32151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.467689 (+  1821us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:37.498085 (+ 30396us) log.cc:844] Serialized 52 byte log entry
0709 13:05:37.717078 (+218993us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:37.717122 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.717191 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.738528 (+1021337us) raft_consensus.cc:1685] finished
0709 13:05:38.738591 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.738959 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":231223,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":16433,"thread_start_us":157038,"threads_started":1,"wal-append.queue_time_us":287366}
I20260709 13:05:38.857657 22841 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.858031 22931 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:38.858654 22931 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.859197 22931 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:38.861045 15318 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:38.862392 22836 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.863322 22836 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.868693 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:38.869796 15396 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
W20260709 13:05:38.870395 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.811527 22885 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:05:38.879019 15394 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:05:38.883263 22586 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:05:38.883576 22711 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.009s	sys 0.006s
W20260709 13:05:38.884101 22711 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.010s	sys 0.007s
I20260709 13:05:38.885181 22784 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:38.885972 22784 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.887342 22946 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:38.887923 22946 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.892585 22946 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:38.898172 15319 raft_consensus.cc:2410] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:05:38.899884 22958 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:05:38.903324 22986 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:38.899906 15319 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 24. Current term is 25. Ops: [23.10-24.11]
I20260709 13:05:38.895121 15394 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:38.909420 22990 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:05:38.912653 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 207949us
W20260709 13:05:38.871182 22972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.027s	sys 0.051s
I20260709 13:05:38.920310 23026 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:05:38.921167 23026 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:38.914827 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:38.883358 22967 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.927500 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:38.933269 22885 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:38.938644 15321 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:38.941337 22610 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:38.942613 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 219196us
I20260709 13:05:38.944175 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:38.945634 23017 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:38.946164 23017 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:38.946699 23017 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:38.947271 15319 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:38.948587 22868 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:38.951032 23021 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:05:38.951720 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.952668 22597 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:38.953121 22597 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:05:38.954123 22715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.007s	sys 0.014s
I20260709 13:05:38.954610 22597 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.858656 22841 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.959821 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.960150 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.961218 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:38.961987 15242 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:38.964565 15392 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:38.961787 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.969319 22840 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.970010 22840 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:38.971202 22763 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:38.972543 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 94504.8us
W20260709 13:05:38.973408 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.982690 15324 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:05:38.984925 22961 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 13:05:38.974777 23022 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:39.000252 23022 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:38.991391 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:38.966536 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:38.954607 22715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.007s	sys 0.014s
W20260709 13:05:39.006711 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49993.2us
I20260709 13:05:38.959077 22597 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:39.017006 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:38.927820 22836 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:38.961787 22841 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:39.026782 15322 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:38.988029 22784 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:39.031378 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:39.035024 23030 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
W20260709 13:05:39.035799 23036 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:05:39.037693 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.043385 15244 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 26.
I20260709 13:05:39.055512 15320 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:39.057381 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:39.086319 15398 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:39.087533 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:39.058632 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:39.088835 22997 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:38.979358 22960 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.130s
I20260709 13:05:39.089675 22982 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:39.090196 22982 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:39.090682 22982 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:39.091123 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1212) took 1363 ms. Trace:
I20260709 13:05:39.028403 22779 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24.
I20260709 13:05:39.107713 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:39.084566 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:39.048056 22667 consensus_meta.cc:287] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.010s
W20260709 13:05:39.083402 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 59883us
I20260709 13:05:39.118739 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3703) took 1207 ms. Trace:
W20260709 13:05:39.121762 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.066452 22974 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:39.129904 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.127568 15392 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
W20260709 13:05:39.124751 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 48052.1us
I20260709 13:05:39.091583 16033 rpcz_store.cc:276] 0709 13:05:37.562803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.563159 (+   356us) service_pool.cc:224] Handling call
0709 13:05:37.563446 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.563667 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.563698 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.575261 (+ 11563us) log.cc:844] Serialized 26 byte log entry
0709 13:05:37.648728 (+ 73467us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:37.648767 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.648833 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.807517 (+1158684us) raft_consensus.cc:1685] finished
0709 13:05:38.814007 (+  6490us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.926071 (+112064us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":66583,"threads_started":1,"wal-append.queue_time_us":292050}
I20260709 13:05:39.037686 23026 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.139089 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:39.150731 15244 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:39.136749 15391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.005s	sys 0.015s
I20260709 13:05:39.136551 15320 rpcz_store.cc:276] 0709 13:05:37.911541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.685174 (+773633us) service_pool.cc:224] Handling call
0709 13:05:39.118349 (+433175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:39.146063 15362 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.002s	sys 0.014s
I20260709 13:05:39.117481 22997 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:39.163787 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 91631.3us
W20260709 13:05:39.168334 15391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.006s	sys 0.015s
W20260709 13:05:39.172044 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.183720 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:39.155404 22947 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:05:39.205274 15246 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:39.206605 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46252.4us
I20260709 13:05:39.217831 15394 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:39.219470 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:39.220438 15394 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 15.
W20260709 13:05:39.223378 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.134517 22667 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.177644 22841 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:39.002795 22967 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:39.239413 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 83470us
I20260709 13:05:39.209936 15999 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:39.240705 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 166795us
I20260709 13:05:39.200203 22840 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:39.224371 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 818665us
I20260709 13:05:39.268486 15243 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:05:39.268663 15398 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:39.264170 15317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.011s	sys 0.037s
W20260709 13:05:39.273325 15317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.011s	sys 0.037s
I20260709 13:05:39.140338 23022 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.282919 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3150) took 1539 ms. Trace:
I20260709 13:05:39.276505 22841 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.202857 22974 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:39.298674 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.277163 22779 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.309355 16025 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:39.323725 15396 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:39.286435 15391 rpcz_store.cc:276] 0709 13:05:37.743123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.029766 (+286643us) service_pool.cc:224] Handling call
0709 13:05:38.030142 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.032082 (+  1940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.032115 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:38.048945 (+ 16830us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.238104 (+1189159us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:39.249908 (+ 11804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.264307 (+ 14399us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.264356 (+    49us) raft_consensus.cc:1685] finished
0709 13:05:39.264367 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.282855 (+ 18488us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1499,"raft.queue_time_us":103285,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":52659,"thread_start_us":1089433,"threads_started":1,"wal-append.queue_time_us":746064}
I20260709 13:05:39.329562 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:39.337984 15242 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:39.343292 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:39.292654 22958 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:39.341210 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:39.345402 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:39.337477 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:39.352187 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 43786.4us
I20260709 13:05:39.340330 22704 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:39.356585 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 674381us
I20260709 13:05:39.357642 22997 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:39.358922 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:39.360379 23023 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
W20260709 13:05:39.361785 22739 consensus_meta.cc:287] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.892s	user 0.012s	sys 0.001s
I20260709 13:05:39.363247 15392 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:39.351217 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:39.371080 22784 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:39.371734 22974 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:39.373770 22967 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:39.374369 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:39.376199 22836 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:39.376649 22836 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.376994 22836 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:39.382064 22667 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:39.358156 22815 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:39.393410 15241 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:39.371778 22841 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:39.358110 23046 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:05:39.343953 22840 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:39.416728 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 209853us
I20260709 13:05:39.431088 15392 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:39.383327 22704 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.441630 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:39.451094 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47950.1us
I20260709 13:05:39.348239 22960 consensus_queue.cc:1059] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.083s
I20260709 13:05:39.351924 22586 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.427161 22711 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:39.446758 23032 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.299s	user 0.000s	sys 0.002s
I20260709 13:05:39.383615 22779 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.400331 22739 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.486701 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:39.478400 23037 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:05:39.507483 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 80992.7us
W20260709 13:05:39.521566 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 370286us
I20260709 13:05:39.446087 23017 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:39.450626 22958 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:39.548110 15395 raft_consensus.cc:1240] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: []
W20260709 13:05:39.556473 23042 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:05:39.558373 15249 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:39.556558 22780 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.561671 22973 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:39.562369 22780 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.490475 22840 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.566308 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:39.574188 15323 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
W20260709 13:05:39.574674 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 133178us
W20260709 13:05:39.567224 22763 consensus_meta.cc:287] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.593s	user 0.013s	sys 0.000s
W20260709 13:05:39.586725 23041 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:05:39.587674 23029 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.089s
I20260709 13:05:39.588773 23029 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:39.589216 23029 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:39.590562 22836 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:39.586963 22878 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.049s	user 0.013s	sys 0.006s
W20260709 13:05:39.600821 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:39.598167 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 48959.5us
W20260709 13:05:39.590565 22925 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.033s	user 0.002s	sys 0.017s
I20260709 13:05:39.614553 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2457) took 1299 ms. Trace:
W20260709 13:05:39.632094 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.632661 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:39.586771 22741 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:39.584151 22986 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:39.557471 22711 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:39.623960 15325 rpcz_store.cc:276] 0709 13:05:38.307730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.905133 (+597403us) service_pool.cc:224] Handling call
0709 13:05:38.967726 (+ 62593us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:39.081586 (+113860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.081630 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:39.156333 (+ 74703us) log.cc:844] Serialized 52 byte log entry
0709 13:05:39.303212 (+146879us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:39.593208 (+289996us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.605757 (+ 12549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.606195 (+   438us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.606434 (+   239us) raft_consensus.cc:1685] finished
0709 13:05:39.606448 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.606646 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91088,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":40426,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":25860,"thread_start_us":345353,"threads_started":2,"wal-append.queue_time_us":287651}
W20260709 13:05:39.694309 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 90580.3us
I20260709 13:05:39.655119 22741 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.685482 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:39.703258 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.637400 22958 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:39.705662 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 218769us
W20260709 13:05:39.708452 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:39.709321 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:39.709693 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.654894 22981 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:39.726408 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.733886 16026 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:05:39.734800 22597 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.714s	user 0.012s	sys 0.000s
I20260709 13:05:39.735059 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:39.704782 22741 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:39.736348 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:39.598290 23029 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:39.756657 15392 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:05:39.757390 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.686728 22978 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.230s
I20260709 13:05:39.725324 22925 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:39.773464 23039 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
W20260709 13:05:39.778460 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 145901us
I20260709 13:05:39.778666 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:39.779402 22981 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:39.782346 15391 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 24. Current term is 25. Ops: [22.12-24.13]
W20260709 13:05:39.782532 22610 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.840s	user 0.002s	sys 0.013s
W20260709 13:05:39.791081 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 337969us
W20260709 13:05:39.792438 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.804042 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:39.802655 15290 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:39.820439 15392 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:39.824718 16026 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
W20260709 13:05:39.833535 15398 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.561s	user 0.013s	sys 0.000s
I20260709 13:05:39.834453 15398 raft_consensus.cc:2410] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:05:39.836110 16033 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:05:39.836301 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.842990 15394 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:39.821893 22879 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:39.848220 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3787) took 1143 ms. Trace:
I20260709 13:05:39.848726 15397 rpcz_store.cc:276] 0709 13:05:38.704970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.705160 (+   190us) service_pool.cc:224] Handling call
0709 13:05:38.705818 (+   658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.706345 (+   527us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.706374 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:38.707255 (+   881us) log.cc:844] Serialized 26 byte log entry
0709 13:05:38.813958 (+106703us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:38.814003 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.814069 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.847915 (+1033846us) raft_consensus.cc:1685] finished
0709 13:05:39.847940 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.848140 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":99150,"threads_started":1,"wal-append.queue_time_us":677350}
W20260709 13:05:39.851704 23050 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:39.851966 22981 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:39.852329 23043 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.325s	user 0.000s	sys 0.002s
I20260709 13:05:39.762831 22986 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.852686 22981 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.853341 22981 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.855130 22350 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:39.832278 23029 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:39.859593 22744 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:39.863127 22711 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:39.864326 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1213) took 2104 ms. Trace:
I20260709 13:05:39.864491 22711 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:39.865111 22711 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:39.866724 23021 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:39.867399 23021 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:39.868448 22912 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:39.844166 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:39.858222 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:39.879182 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:39.826573 22704 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:39.874938 15320 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 18.
I20260709 13:05:39.840902 22925 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:05:39.886781 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 43885.2us
I20260709 13:05:39.839100 22836 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:39.890482 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:39.891867 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89371.2us
I20260709 13:05:39.876899 22715 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.894531 15391 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:39.855181 23063 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.864770 16027 rpcz_store.cc:276] 0709 13:05:37.759532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.759690 (+   158us) service_pool.cc:224] Handling call
0709 13:05:37.791075 (+ 31385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.737540 (+946465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.737613 (+    73us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:38.738738 (+  1125us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.136095 (+397357us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:39.136162 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.863752 (+727590us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b5400631354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:39.863807 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.863862 (+    55us) raft_consensus.cc:1685] finished
0709 13:05:39.863873 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.864140 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174792448,"thread_start_us":343127,"threads_started":1,"wal-append.queue_time_us":531969}
I20260709 13:05:39.878134 22779 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:39.900372 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.895560 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:39.890347 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:39.900949 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3710) took 1960 ms. Trace:
I20260709 13:05:39.902035 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3770) took 2303 ms. Trace:
I20260709 13:05:39.907004 15317 rpcz_store.cc:276] 0709 13:05:37.941078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.731172 (+790094us) service_pool.cc:224] Handling call
0709 13:05:38.731596 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:38.732241 (+   645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.732278 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:38.733287 (+  1009us) log.cc:844] Serialized 52 byte log entry
0709 13:05:39.274290 (+541003us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:39.573875 (+299585us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.743611 (+169736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.743734 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.900724 (+156990us) raft_consensus.cc:1685] finished
0709 13:05:39.900753 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.900895 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":119729,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":195501,"raft.run_cpu_time_us":428,"raft.run_wall_time_us":428,"thread_start_us":979424,"threads_started":3,"wal-append.queue_time_us":572159}
I20260709 13:05:39.890177 22925 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:39.925544 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:39.892477 22879 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:39.909618 15399 rpcz_store.cc:276] 0709 13:05:37.439065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.472672 (+ 33607us) service_pool.cc:224] Handling call
0709 13:05:37.473057 (+   385us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:37.495503 (+ 22446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.495534 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:37.504139 (+  8605us) log.cc:844] Serialized 52 byte log entry
0709 13:05:38.684506 (+1180367us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b1800428800. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:05:39.010936 (+326430us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:39.020947 (+ 10011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.032662 (+ 11715us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.710204 (+677542us) raft_consensus.cc:1685] finished
0709 13:05:39.710223 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.742631 (+ 32408us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102579,"raft.queue_time_us":54588,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":22564,"spinlock_wait_cycles":9189760,"thread_start_us":116286,"threads_started":1,"wal-append.queue_time_us":1691966}
I20260709 13:05:39.946655 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:39.948920 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:39.949810 15322 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:39.902473 22915 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:39.949245 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:39.896232 22958 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:39.960237 15316 raft_consensus.cc:2410] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:05:39.954152 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:39.932124 22925 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:39.942584 22978 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.932294 22780 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:39.969269 16031 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:39.970611 15392 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:39.942353 22704 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.953634 22997 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.960392 22915 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:39.981125 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:39.984608 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:39.979377 15214 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:39.994046 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 130893us
I20260709 13:05:39.909281 22715 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:39.969373 22667 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:39.900189 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:39.996703 15325 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:39.975931 22836 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.959055 23022 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:05:39.962342 22947 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:05:39.972702 23048 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.009931 15392 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:05:39.980623 23023 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:40.027292 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:39.998967 22946 consensus_meta.cc:287] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.099s	user 0.011s	sys 0.007s
I20260709 13:05:39.972368 23057 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:40.019570 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 60553.8us
I20260709 13:05:40.008986 15246 raft_consensus.cc:606] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
W20260709 13:05:40.016481 23047 log.cc:927] Time spent T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.323s	user 0.000s	sys 0.002s
W20260709 13:05:40.016158 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 120764us
I20260709 13:05:40.008307 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:39.992766 22915 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:40.030341 15246 raft_consensus.cc:614] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:40.016400 23051 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.182s	user 0.000s	sys 0.002s
I20260709 13:05:39.962821 23063 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.039230 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:40.039803 15392 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:39.986958 22978 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.043459 22978 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:40.049469 22982 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.958s	user 0.011s	sys 0.000s
I20260709 13:05:40.051640 22981 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.052109 23022 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:40.052556 23022 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.052917 23022 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:40.032016 22946 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.057940 22681 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.057711 23048 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.058516 22681 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.060492 23048 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.060609 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3789) took 1261 ms. Trace:
I20260709 13:05:39.994170 22997 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.061112 15393 rpcz_store.cc:276] 0709 13:05:38.802349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.805949 (+  3600us) service_pool.cc:224] Handling call
0709 13:05:38.894562 (+ 88613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.003449 (+108887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.003482 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:39.039364 (+ 35882us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.233056 (+193692us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:39.233108 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.233187 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.060343 (+827156us) raft_consensus.cc:1685] finished
0709 13:05:40.060366 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.060544 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35470,"raft.queue_time_us":51817,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":8023,"thread_start_us":190220,"threads_started":1,"wal-append.queue_time_us":427131}
W20260709 13:05:40.062651 23053 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:05:40.026598 22941 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.168s
I20260709 13:05:40.064273 15245 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24. Ops: [23.12-23.12]
W20260709 13:05:40.066303 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 98130.6us
I20260709 13:05:40.067674 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:40.004329 22958 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.023056 22953 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 24.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:05:40.074819 16027 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:40.075140 23023 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:40.075177 15316 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:40.076202 22946 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.028820 22704 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.080215 23060 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.080497 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.028790 23026 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:40.108026 23026 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.108556 22695 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:40.109040 22695 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:40.111013 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3282) took 2398 ms. Trace:
I20260709 13:05:40.111410 15243 rpcz_store.cc:276] 0709 13:05:37.712439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.635001 (+922562us) service_pool.cc:224] Handling call
0709 13:05:38.635627 (+   626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.270688 (+635061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.110726 (+840038us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54001a8bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:40.110941 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449230080}
I20260709 13:05:40.111852 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3288) took 1261 ms. Trace:
I20260709 13:05:40.112303 15245 rpcz_store.cc:276] 0709 13:05:38.850062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.854554 (+  4492us) service_pool.cc:224] Handling call
0709 13:05:38.913043 (+ 58489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.070872 (+1157829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.111559 (+ 40687us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540001e854. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:40.111791 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2627103488}
I20260709 13:05:40.081012 15365 leader_election.cc:400] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26.
I20260709 13:05:40.031904 22711 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.091821 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3715) took 1829 ms. Trace:
I20260709 13:05:40.087729 23023 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.094980 23057 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.124871 23057 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.050010 22982 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.104211 22704 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.105185 15316 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:40.204373 16027 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:05:40.105851 22840 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.106647 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.108067 23060 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.115568 15365 leader_election.cc:403] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:05:40.208467 15319 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:40.021483 22836 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.085433 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:40.030282 22879 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:40.119500 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.063205 22997 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.122699 23023 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.103627 23063 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.114970 22958 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.116400 15318 rpcz_store.cc:276] 0709 13:05:38.262908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.862104 (+599196us) service_pool.cc:224] Handling call
0709 13:05:38.862650 (+   546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.892756 (+ 30106us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:05:39.259573 (+366817us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.546552 (+286979us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.553206 (+  6654us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.553269 (+    63us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:39.553327 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.091545 (+538218us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b54002ed6d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:40.091610 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.091756 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76384,"prepare.queue_time_us":497597,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":4302,"raft.queue_time_us":93111,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":30204,"spinlock_wait_cycles":94551040,"thread_start_us":522934,"threads_started":2,"wal-append.queue_time_us":669025}
I20260709 13:05:40.101758 15393 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:40.149008 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:40.118564 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51102.5us
W20260709 13:05:40.119916 23053 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:05:40.126430 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:40.110052 22695 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.231501 22836 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.231720 22695 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:40.195218 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:40.200557 15322 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:40.208940 16028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4"
dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:51484
I20260709 13:05:40.213475 22838 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:40.215129 23060 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:40.215696 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 134928us
I20260709 13:05:40.215826 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:40.215975 22982 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:40.216670 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.213722 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:40.226153 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:40.230919 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 135398us
I20260709 13:05:40.237051 16028 raft_consensus.cc:606] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
W20260709 13:05:40.237285 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.237603 16028 raft_consensus.cc:614] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:40.239027 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:40.242460 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.247334 16027 raft_consensus.cc:2410] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:05:40.223587 23026 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.248510 15318 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:40.247323 15392 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:40.225389 22915 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.220202 22704 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:05:40.247018 23029 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:40.250597 22912 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.250746 23029 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.251209 23029 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:40.252398 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:40.253732 22915 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.254501 22958 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:05:40.255719 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:40.257030 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.256964 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:40.257647 15316 raft_consensus.cc:2376] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25. Re-sending same reply.
I20260709 13:05:40.217130 22741 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.251230 22912 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.260465 22741 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.260587 22912 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.263280 15365 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:40.265020 15365 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:40.245500 22931 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.386s	user 0.018s	sys 0.000s
I20260709 13:05:40.235137 22953 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26.
I20260709 13:05:40.267580 15390 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:40.268950 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.273559 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:40.313000 15325 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:40.313163 15320 raft_consensus.cc:2376] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21. Re-sending same reply.
W20260709 13:05:40.275921 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.282469 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.296271 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.289672 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.317166 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:40.317283 15324 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:40.317806 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.318578 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.266202 15365 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:40.280224 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.276083 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.311856 15393 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:40.302578 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:40.285687 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.291985 15322 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:40.292869 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:40.281771 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:40.319406 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53282.7us
I20260709 13:05:40.320988 15392 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:40.306070 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:40.309944 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 330638us
I20260709 13:05:40.324451 15324 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:40.304472 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3796) took 1435 ms. Trace:
I20260709 13:05:40.326167 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:40.282259 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:40.328703 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.322158 15397 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:40.324950 15396 rpcz_store.cc:276] 0709 13:05:38.869029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.876867 (+  7838us) service_pool.cc:224] Handling call
0709 13:05:38.877335 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.324288 (+446953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.304063 (+979775us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b5400194bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:40.304386 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013787520}
I20260709 13:05:40.331092 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.331256 15394 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:40.267172 22912 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:40.266573 23069 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:40.298632 22972 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:05:40.295320 23017 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.274412 23058 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:40.341050 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.340533 15316 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:40.343025 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.349982 15322 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 27: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:40.292524 22681 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.330042 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:40.271915 22763 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.071s
I20260709 13:05:40.326821 23071 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:40.298333 22978 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.290397 22575 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:40.279520 22878 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:40.378336 22878 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.379333 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:40.380066 15243 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:40.380686 22878 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.336354 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:40.381494 15390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3773) took 2901 ms (client timeout 1526 ms). Trace:
I20260709 13:05:40.382694 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:40.385033 22815 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:05:40.347075 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 92900.6us
I20260709 13:05:40.386364 22978 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.387003 15324 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:40.388175 22969 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:40.388502 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:40.389693 22969 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:40.289862 23057 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:05:40.358071 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:40.358136 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:40.339062 22958 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:05:40.343887 22912 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.364188 15325 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:40.254549 22669 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 13:05:40.358850 23071 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.366254 22708 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.366369 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:40.374192 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1099) took 2809 ms. Trace:
I20260709 13:05:40.374349 22993 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 13:05:40.377233 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:40.271310 22986 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.392305 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:40.394336 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:40.289569 22931 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.397934 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:05:40.381994 15390 rpcz_store.cc:269] 0709 13:05:37.480739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.480967 (+   228us) service_pool.cc:224] Handling call
0709 13:05:40.381224 (+2900257us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b5400154ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:40.381400 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5908978048}
I20260709 13:05:40.345607 23026 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:40.346197 23069 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:40.352084 22982 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:40.404498 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 143062us
I20260709 13:05:40.419857 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:40.413601 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.420255 22912 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:40.423673 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:40.448350 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.297634 23022 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.447781 15246 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:40.428467 15320 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
W20260709 13:05:40.429765 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 108526us
I20260709 13:05:40.433291 15318 raft_consensus.cc:2410] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:05:40.434144 22681 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:40.357839 22947 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.435281 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:40.403059 22763 consensus_queue.cc:1243] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:05:40.428553 15321 rpcz_store.cc:276] 0709 13:05:37.564279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.564402 (+   123us) service_pool.cc:224] Handling call
0709 13:05:37.564680 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.939214 (+1374534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.373839 (+1434625us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54004038d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:40.374101 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3156328192}
I20260709 13:05:40.419691 23023 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:40.453420 15241 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:05:40.427479 22841 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:40.495968 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:40.459252 15213 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:40.495208 15289 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:40.428957 23071 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:40.495424 15242 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:40.501454 15392 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
W20260709 13:05:40.502737 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 495027us
I20260709 13:05:40.503778 23074 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:05:40.403721 23058 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.442921 23069 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:40.505936 22931 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.434132 22448 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:40.511053 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51896.2us
I20260709 13:05:40.511286 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:40.481570 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46372us
I20260709 13:05:40.454782 22667 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:40.442396 23077 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:40.514189 16033 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:40.523753 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:40.453920 22681 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:40.453228 22815 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.496788 22879 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:40.527135 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:40.463378 22993 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:40.530333 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:40.549014 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53135us
I20260709 13:05:40.549965 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:40.436364 22708 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:40.524780 23081 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:05:40.444039 22925 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.521456 22667 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.520390 22878 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:40.556900 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:40.496138 22947 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.458182 23026 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.457929 22982 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.562750 15245 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:40.546931 22695 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:40.555004 23077 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:40.554989 22815 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.570535 22978 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.551393 22763 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:40.570822 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:40.562475 22667 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:40.571884 23022 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.573889 23058 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.545774 22841 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:40.575992 23079 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.069s	user 0.001s	sys 0.001s
I20260709 13:05:40.578181 22947 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:40.579864 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 84731.4us
I20260709 13:05:40.580499 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:40.552093 22993 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:40.587539 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 189743us
I20260709 13:05:40.588150 16029 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:40.612485 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:05:40.584340 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 77173.5us
I20260709 13:05:40.600919 15241 raft_consensus.cc:2410] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:40.615145 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:40.618867 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:40.607617 22978 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:40.615986 15250 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:40.624696 22843 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.627983 22912 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.630404 22695 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:40.630872 22841 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.631089 22695 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.631709 22695 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:40.631803 23082 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.632737 23082 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.636878 15390 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:40.637209 22925 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.637614 15399 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24. Ops: [22.11-23.12]
I20260709 13:05:40.638171 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.638437 15390 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:05:40.638687 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.639420 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.644207 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.578087 23029 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.613863 22993 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:40.651633 23026 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.651839 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:40.642800 22978 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.653469 22978 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:40.625447 22843 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.655018 22925 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:40.655848 22925 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:40.657164 22925 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.659360 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:40.698761 15397 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 25: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:40.671412 22912 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:40.682771 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 156326us
I20260709 13:05:40.620461 22953 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:40.688300 22695 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.691378 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:40.705942 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:40.663471 23014 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:40.664462 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:40.672983 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 123145us
I20260709 13:05:40.705060 15242 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:40.714897 16030 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 27: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:40.715262 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:40.712786 22838 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:40.720603 22838 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:40.721091 22838 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:40.720999 23064 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:05:40.722291 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.707208 23058 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:40.725404 15362 leader_election.cc:400] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26.
I20260709 13:05:40.722987 15317 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
W20260709 13:05:40.727041 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.709774 23014 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:40.615000 22681 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.731285 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.727825 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.729723 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.732821 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:40.730753 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:40.733493 16027 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:05:40.714725 23012 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.733168 15397 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:40.732018 15399 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:40.736673 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:40.743815 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:40.746701 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.745198 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.747810 15397 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:40.737823 15321 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:40.748625 15399 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:40.749505 15390 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:40.753670 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:40.753309 23014 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.754604 23014 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:40.754936 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:40.755558 15390 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:40.749662 23012 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.759877 23071 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.760543 23012 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.732633 22695 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.764024 15390 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:40.765144 15399 raft_consensus.cc:1240] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:05:40.765651 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.717796 23077 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.769486 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.768620 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:40.769428 15397 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:40.778432 23096 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:40.779210 23069 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:40.780589 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.781486 15398 raft_consensus.cc:1240] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:40.782544 22815 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.793738 23082 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.794631 22940 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.795235 22852 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:40.795770 22852 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:40.795229 22940 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.796869 22852 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:40.797385 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 66730.1us
I20260709 13:05:40.798209 22940 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.798390 23096 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:40.799202 23096 consensus_queue.cc:1243] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:05:40.799547 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.799625 22763 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:40.765193 23021 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.810727 22739 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:40.810837 16025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 1168) took 2552 ms (client timeout 1632 ms). Trace:
I20260709 13:05:40.800149 22763 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:40.812707 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:40.812702 16025 rpcz_store.cc:269] 0709 13:05:38.256958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.257085 (+   127us) service_pool.cc:224] Handling call
0709 13:05:40.803252 (+2546167us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b540066eed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:40.808812 (+  5560us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102972672}
I20260709 13:05:40.813520 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:40.818740 22843 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.821602 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:40.805888 22695 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:40.825917 23093 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:40.802562 22982 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.813297 22978 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.841936 22978 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.828105 22979 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:40.829674 23086 log.cc:927] Time spent T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:05:40.843302 22979 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.832201 22763 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.845187 22763 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:40.845367 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:40.845857 22979 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.833644 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:40.838495 16031 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46354 (request call id 1169) took 2580 ms (client timeout 2059 ms). Trace:
I20260709 13:05:40.827792 16028 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:40.846312 16029 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:40.837184 22838 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.853818 15397 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:40.849180 16031 rpcz_store.cc:269] 0709 13:05:38.258445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.258580 (+   135us) service_pool.cc:224] Handling call
0709 13:05:40.830907 (+2572327us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540065e354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:40.838415 (+  7508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3092148992}
I20260709 13:05:40.848124 23082 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:05:40.868582 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.860208 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49655.6us
I20260709 13:05:40.878420 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.880326 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:40.880051 15396 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:40.886610 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.887336 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:40.879475 22350 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:40.888921 22350 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:40.889639 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:40.883028 22979 raft_consensus.cc:2764] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:05:40.854432 22993 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.853861 22739 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:40.891393 22739 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.891888 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:40.893154 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:40.893664 22739 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.894025 16028 raft_consensus.cc:2410] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 21 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:05:40.889904 22838 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.894404 15397 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:40.894479 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:40.889838 22350 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.854259 22695 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:40.901219 23085 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.330s	user 0.000s	sys 0.003s
W20260709 13:05:40.902508 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.879985 23084 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:05:40.905336 23071 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.918430 15362 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:40.880286 22667 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.902089 22973 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:40.927446 22695 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.924162 22973 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:40.918612 23029 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.930821 22973 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.932054 22838 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:40.932919 22838 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:40.933202 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3790) took 2128 ms. Trace:
I20260709 13:05:40.933720 15395 rpcz_store.cc:276] 0709 13:05:38.805065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.811872 (+  6807us) service_pool.cc:224] Handling call
0709 13:05:38.873009 (+ 61137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.557477 (+684468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.932970 (+1375493us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54001540d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:40.933140 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512463104}
I20260709 13:05:40.934717 22711 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:40.935148 22711 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:40.936280 22370 raft_consensus.cc:3055] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:40.936035 22711 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.11, Last appended by leader: 11, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.936728 22370 raft_consensus.cc:740] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:40.937419 22711 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:40.937772 22370 consensus_queue.cc:260] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.938679 22911 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:40.939026 22370 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.939072 15998 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:40.940006 22993 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.940613 22610 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:40.940678 22993 consensus_queue.cc:1059] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:05:40.941131 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.941738 23027 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:40.941844 23029 raft_consensus.cc:3055] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:40.942257 23027 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:40.942345 23029 raft_consensus.cc:740] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:40.943058 22667 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:40.943545 23029 consensus_queue.cc:260] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.945053 23029 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:40.946346 15249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 3292) took 1986 ms (client timeout 2468 ms). Trace:
W20260709 13:05:40.933211 15323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3702) took 3022 ms (client timeout 1632 ms). Trace:
W20260709 13:05:40.946774 15249 rpcz_store.cc:269] 0709 13:05:38.959414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.959544 (+   130us) service_pool.cc:224] Handling call
0709 13:05:40.946107 (+1986563us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54001a81d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:40.946222 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1374799232}
W20260709 13:05:40.946921 15323 rpcz_store.cc:269] 0709 13:05:37.911224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.009130 (+ 97906us) service_pool.cc:224] Handling call
0709 13:05:40.933000 (+2923870us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400078354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:40.933129 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2509562752}
I20260709 13:05:40.943470 23027 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.948858 23027 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:40.948994 22953 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:40.940889 22715 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.934216 22838 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:40.941188 22610 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.939095 22911 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:40.955718 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 410262us
I20260709 13:05:40.956292 16028 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:05:40.956555 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:40.957778 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:40.958338 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 75568.7us
I20260709 13:05:40.958635 22969 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:40.960096 22969 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:40.960486 22969 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:40.960361 22990 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:40.961227 22744 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:40.961633 22744 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:40.961393 22969 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.962478 22575 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:40.962530 22744 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.968948 22667 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:05:40.963804 15393 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:40.969928 22744 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:40.971326 23023 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:40.971725 22969 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:05:40.965210 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 346385us
I20260709 13:05:40.975507 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:40.977049 16031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:40.977581 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:40.977717 16031 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
W20260709 13:05:40.962654 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 435559us
I20260709 13:05:40.965397 22984 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:40.965749 23069 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:40.965804 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:40.932070 22973 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:40.956212 22911 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:40.967412 22715 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:40.968410 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:40.968636 22586 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:40.955236 22610 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:05:40.972570 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 87651.8us
I20260709 13:05:40.964751 22448 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:40.981029 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:40.980358 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:40.992628 15248 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:40.993363 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:40.997704 15290 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:40.999810 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:40.999958 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:41.003123 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.004050 15249 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:40.978063 22925 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:41.005519 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:41.003276 22695 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:41.006876 22695 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.007316 22985 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:41.008111 22843 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:41.008766 22843 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:41.009415 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:41.007336 22695 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:41.010433 22979 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:41.010936 22979 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.011281 22979 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:05:41.019544 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.992440 23064 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:41.026548 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:41.028826 15398 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:40.996635 22984 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:41.038287 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:41.020836 22990 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:41.046566 22990 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.047055 22990 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:41.021844 22982 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:41.052515 22982 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:41.052920 22695 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.053124 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:41.009749 22843 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 24.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.054782 22911 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:41.056902 22985 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:41.037719 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:41.043159 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:41.059528 15394 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:41.044775 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:41.053617 22982 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.031263 23074 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:41.059451 15395 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:41.070969 15393 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:05:41.057683 22969 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:41.072664 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.077397 22695 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:41.078765 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:41.058404 22985 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:41.079798 15321 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:05:41.080004 22985 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:41.084254 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.081300 22985 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.085000 15318 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:41.085704 22985 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:41.089915 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.087584 22969 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:41.092301 22708 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:41.092458 22969 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:41.093184 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 124851us
W20260709 13:05:41.093513 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48866.5us
I20260709 13:05:41.041981 23064 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:41.096014 23064 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.086504 23074 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:41.099898 23017 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:41.099465 23074 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.100415 23017 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:41.105002 22990 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.106704 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:41.106704 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:41.109778 22984 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.111002 22681 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:41.114634 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.114778 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:41.115736 15398 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:41.101464 23017 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.122960 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:41.140228 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46238.3us
I20260709 13:05:41.068205 23069 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:41.145649 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51329.5us
I20260709 13:05:41.156414 15362 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:41.147993 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.149046 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:41.157613 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.141680 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:41.157651 15242 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:05:41.152179 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:41.146443 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:41.161510 15289 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:41.159878 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:41.175040 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:41.175264 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.175732 15316 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:41.110040 22920 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:41.172773 15215 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:41.179585 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:41.180075 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:41.182039 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.189469 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.193519 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:41.200593 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:41.170390 22744 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:41.170658 23023 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:41.164821 22973 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:41.210760 15317 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:41.169685 22925 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:41.182116 22868 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:41.227716 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 71410.1us
I20260709 13:05:41.195751 22879 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:41.213317 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 61267.2us
I20260709 13:05:41.183264 23017 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:41.215306 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.187146 23080 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:41.187606 22947 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:41.170008 23071 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:05:41.228626 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:41.228929 15322 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260709 13:05:41.229960 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 68553.3us
W20260709 13:05:41.234571 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.230521 23069 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:41.210378 22744 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.177588 23021 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:05:41.232970 15289 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:05:41.279295 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 46390.5us
W20260709 13:05:41.274991 16027 consensus_meta.cc:287] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.002s
I20260709 13:05:41.217132 23023 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.212918 22961 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:41.283210 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.218890 22925 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.253646 22947 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.232299 22879 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:41.289898 15243 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:41.211005 22878 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
W20260709 13:05:41.298408 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.289109 22815 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:41.283181 22350 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:41.296021 22947 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:41.296167 22879 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:41.228470 22973 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.304152 22973 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:41.304988 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.280561 22744 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.253434 23080 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:41.231976 22708 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:41.299321 22350 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.281090 23022 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:41.325450 23022 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:41.326442 22708 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:41.326527 23022 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.327605 22708 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.307397 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:41.281213 16027 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:41.310994 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.288460 23023 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:41.291160 22925 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:41.316606 15316 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:41.281903 15398 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:41.319559 22990 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:41.276705 22610 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:41.346318 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.350122 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.339224 22575 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:41.315297 23080 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:41.360045 15245 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:41.330143 22350 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:41.337087 15242 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
W20260709 13:05:41.365088 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.366686 16025 raft_consensus.cc:2468] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:05:41.372291 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.372769 15396 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:41.383533 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 190054us
I20260709 13:05:41.315478 22979 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:41.389371 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 160783us
I20260709 13:05:41.390890 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:41.404275 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.415716 22610 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:41.417712 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.419730 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:41.421816 22961 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:41.422297 22586 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:41.423446 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.423281 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:41.424518 15399 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:41.431088 22575 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:41.475128 16030 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 1114) took 1186 ms. Trace:
I20260709 13:05:41.436122 22979 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:41.475533 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 52333.3us
I20260709 13:05:41.436944 15320 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 24: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:41.439248 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.439611 23007 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.440716 22852 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:41.459435 23095 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.444099 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.453375 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.489926 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:41.456395 23098 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.657s	user 0.003s	sys 0.000s
I20260709 13:05:41.422165 22838 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:41.465631 15243 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:05:41.496668 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.466854 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:41.497412 15241 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:05:41.498407 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 273566us
I20260709 13:05:41.498546 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.496678 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:41.478960 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:41.500413 15391 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:41.428383 22744 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.442317 22941 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.475672 16030 rpcz_store.cc:276] 0709 13:05:40.281420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.281608 (+   188us) service_pool.cc:224] Handling call
0709 13:05:41.467198 (+1185590us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400632c54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:41.467343 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873042816}
I20260709 13:05:41.504928 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.505703 15317 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:41.503010 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:41.503677 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89822.3us
I20260709 13:05:41.509472 15999 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:41.502864 16026 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:41.499493 15246 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:41.513271 15317 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:05:41.486624 22575 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:41.486169 22953 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:41.513880 15317 pending_rounds.cc:85] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 9
I20260709 13:05:41.494143 22711 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:41.524142 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 316579us
I20260709 13:05:41.523326 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.555842 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.562186 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.563702 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.566063 15322 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:41.570623 15244 raft_consensus.cc:2393] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:41.563766 15317 pending_rounds.cc:107] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:05:41.575026 15317 raft_consensus.cc:2889] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:41.574908 23074 consensus_queue.cc:1059] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:41.576116 22984 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:41.576525 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.576997 15243 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:05:41.576704 22984 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.577214 15317 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:41.578138 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.523212 22941 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.578905 22667 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:41.579502 16024 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:41.578227 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.514701 22969 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:41.578895 15243 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:41.557350 22681 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:41.601923 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:41.602804 15317 raft_consensus.cc:2368] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23.
I20260709 13:05:41.564509 22711 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.584852 22969 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:41.579511 22667 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.612816 22987 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:41.502295 23095 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.515830 23007 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.592866 23064 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:41.621342 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.629503 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.598680 22681 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.568109 22953 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.657971 15244 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
W20260709 13:05:41.646513 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.661051 15317 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 10.
I20260709 13:05:41.514752 22879 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.624250 22969 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:41.649260 22985 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
I20260709 13:05:41.668785 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:41.672766 23007 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:41.675273 16028 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:41.676891 22979 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.623272 22711 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:41.677948 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.681552 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:41.681972 16024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46364 (request call id 1106) took 3601 ms (client timeout 1742 ms). Trace:
I20260709 13:05:41.680001 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.682613 22667 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:41.654489 22947 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.691350 23095 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:41.692595 22744 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:41.680338 22984 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:41.627724 22987 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:41.678274 23077 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.024s	sys 0.015s
I20260709 13:05:41.697544 15317 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:41.698643 15248 raft_consensus.cc:2410] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:05:41.694885 15363 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:41.694084 23071 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:41.702275 15318 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:05:41.698101 16024 rpcz_store.cc:269] 0709 13:05:38.080815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.097820 (+ 17005us) service_pool.cc:224] Handling call
0709 13:05:41.681743 (+3583923us) spinlock_profiling.cc:243] Waited 3.44 s on lock 0x7b54006f0754. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:41.681902 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7908876032}
I20260709 13:05:41.701273 15291 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:41.662451 22681 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:05:41.706964 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 210465us
I20260709 13:05:41.702621 23027 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.711408 16025 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:05:41.712445 15996 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:41.714937 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:41.717947 15250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2444) took 4041 ms (client timeout 1569 ms). Trace:
I20260709 13:05:41.719684 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.723052 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.723290 23071 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.730835 15248 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:41.724843 22941 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:41.729466 15250 rpcz_store.cc:269] 0709 13:05:37.676357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.676465 (+   108us) service_pool.cc:224] Handling call
0709 13:05:41.717673 (+4041208us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b540023aad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:41.717807 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6673532160}
I20260709 13:05:41.727078 15365 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:41.720669 23077 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.024s	sys 0.016s
I20260709 13:05:41.734081 15321 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:41.735548 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.732821 23027 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.740365 15365 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:41.699671 22979 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.729005 23127 raft_consensus.cc:2804] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:41.704838 23080 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.727993 22744 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:41.739665 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:41.735879 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.748811 23021 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.749779 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:41.761111 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:41.761268 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.761745 15321 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:41.755950 23127 raft_consensus.cc:697] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:41.762609 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 50269.9us
I20260709 13:05:41.763191 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.763284 23127 consensus_queue.cc:237] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.764492 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.765683 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.766187 15250 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:41.766531 22912 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:05:41.767179 22912 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:41.768085 22979 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:41.768164 22912 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.759825 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:41.751441 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.770754 15394 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:41.751791 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:41.771410 15323 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:41.772837 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:41.752265 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:41.754942 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:41.756959 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 55778.7us
I20260709 13:05:41.720196 22987 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:41.757869 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:41.758704 16030 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:41.775446 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:41.786530 15244 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:41.775466 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:41.799079 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.814045 15323 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
W20260709 13:05:41.799723 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.774766 15322 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:41.745278 23126 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:05:41.826575 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 51189.1us
I20260709 13:05:41.831983 15242 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 21: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:41.835449 23027 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:41.835970 23012 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:41.799644 22979 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:41.756047 22941 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:41.842247 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:41.849555 15244 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:41.846472 15391 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:05:41.854653 15250 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:41.857120 15322 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:05:41.830090 22982 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.839073 22879 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:41.757289 22925 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.878114 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:41.790508 22838 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:05:41.789467 23021 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.789310 22350 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:41.864895 23012 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:41.884286 15322 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:41.887091 15316 raft_consensus.cc:2368] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22.
I20260709 13:05:41.839035 22575 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.877121 23082 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:41.891777 15241 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 27.
I20260709 13:05:41.856535 22969 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:41.895278 23138 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:05:41.895370 23142 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:05:41.896136 23133 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:05:41.877818 22981 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:41.874926 23126 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:41.906641 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.917814 15241 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:05:41.878468 22940 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:05:41.917202 22981 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:41.933609 22981 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.905028 22708 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:41.935248 22981 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:41.935364 22708 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:41.937652 22708 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:41.938015 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.944518 23021 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:41.884919 22982 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:41.926978 23023 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 13:05:41.954294 15244 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:41.954975 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:41.960177 23074 raft_consensus.cc:3055] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:41.960882 23074 raft_consensus.cc:740] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:41.963028 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 367918us
I20260709 13:05:41.927794 23080 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:41.927904 22969 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:41.903072 23082 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:41.932298 22947 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.002689 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:42.013173 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:41.965402 22953 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:42.021490 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.024883 15322 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 25: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:42.015695 22815 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:42.026213 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.028188 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:41.988284 23023 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.034188 15998 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:42.037945 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.039011 15391 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:42.037901 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:42.041723 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:41.991524 23121 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:05:42.051597 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.015812 22708 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:05:42.026901 22815 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.054189 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.055136 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.057422 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.028508 22915 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:42.060140 15248 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:42.051765 22667 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:42.046380 15394 raft_consensus.cc:2393] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:42.059871 22815 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:42.035557 23127 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.023451 22681 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:42.072990 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 81953.9us
I20260709 13:05:42.075140 15394 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:42.062469 22667 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.081907 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.061923 23077 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:42.086467 15398 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:41.962044 23074 consensus_queue.cc:260] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.061738 22915 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:42.088048 22915 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:42.065642 23139 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.101460 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:42.030052 23012 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.112088 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.112106 15247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:42.113672 15247 raft_consensus.cc:606] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:42.114176 15247 raft_consensus.cc:614] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:42.115015 15249 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 27: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:42.052748 23126 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.093576 22925 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.054193 23082 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.111136 23149 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:42.100831 23077 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:42.124737 16030 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:42.120838 15391 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:42.109752 22852 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:05:42.125592 23143 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:05:42.110384 22575 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.141189 16030 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:05:42.150358 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.150336 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.154531 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2487) took 1177 ms. Trace:
I20260709 13:05:42.155162 15245 rpcz_store.cc:276] 0709 13:05:40.976692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.983174 (+  6482us) service_pool.cc:224] Handling call
0709 13:05:42.154284 (+1171110us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54004498d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:42.154443 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826119552}
I20260709 13:05:42.159732 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.099851 23139 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.146345 22912 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.164525 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.139374 22852 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:42.162446 23148 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
W20260709 13:05:42.170894 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 133124us
I20260709 13:05:42.171706 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.172580 15241 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:42.175153 15362 leader_election.cc:400] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23.
W20260709 13:05:42.176092 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.178181 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.184085 23077 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.191375 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:42.192689 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.194864 15244 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 13:05:42.195286 15244 pending_rounds.cc:85] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 12
I20260709 13:05:42.195518 15244 pending_rounds.cc:107] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 13:05:42.195750 15244 raft_consensus.cc:2889] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:42.196913 23023 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.171280 22852 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:42.201040 23122 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.201617 23122 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.169339 22912 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.203718 23122 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.204557 22912 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:42.204898 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.206154 22979 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:42.209406 15249 raft_consensus.cc:1240] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:42.210275 22940 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:42.210736 22940 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:42.210834 15249 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: []
W20260709 13:05:42.211313 16026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 1230) took 1564 ms (client timeout 1606 ms). Trace:
W20260709 13:05:42.211767 16026 rpcz_store.cc:269] 0709 13:05:40.647333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.658987 (+ 11654us) service_pool.cc:224] Handling call
0709 13:05:42.211151 (+1552164us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54000d98d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:42.211259 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848676096}
I20260709 13:05:42.205716 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.211670 22940 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.214040 22940 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:42.214887 22925 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.215435 22925 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.218078 15245 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:42.204640 23122 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:42.226423 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.247066 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:42.210577 23151 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:05:42.240244 23152 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 13:05:42.259749 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 381710us
I20260709 13:05:42.257336 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.260586 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:42.261431 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 70233.4us
I20260709 13:05:42.246416 23163 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.217783 22925 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.289520 23095 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.290120 23095 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.291481 22952 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:42.291931 22952 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.292253 22952 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:42.265552 15215 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.267874 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3742) took 1148 ms. Trace:
W20260709 13:05:42.242481 23147 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:05:42.249190 23007 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:42.273662 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.270183 22575 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:05:42.297386 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.292451 23095 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.281124 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.261989 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.284564 22852 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.278162 22838 consensus_queue.cc:1059] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:05:42.298511 22981 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.305326 22979 consensus_queue.cc:1059] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:42.295105 23021 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:42.303130 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.292969 15324 rpcz_store.cc:276] 0709 13:05:41.119106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.119228 (+   122us) service_pool.cc:224] Handling call
0709 13:05:41.164330 (+ 45102us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:41.200483 (+ 36153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:41.200537 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:41.215559 (+ 15022us) log.cc:844] Serialized 26 byte log entry
0709 13:05:41.731532 (+515973us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b18001b5980. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:05:41.876428 (+144896us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:41.876470 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.876545 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:42.259005 (+382460us) raft_consensus.cc:1685] finished
0709 13:05:42.259027 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:42.267771 (+  8744us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37475,"raft.queue_time_us":34332,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3027,"spinlock_wait_cycles":3775872,"thread_start_us":144662,"threads_started":1,"wal-append.queue_time_us":744268}
I20260709 13:05:42.309204 15291 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:42.310117 22711 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.599s	user 0.003s	sys 0.008s
I20260709 13:05:42.310766 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.316308 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:42.319073 15391 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 24: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:42.289083 15362 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:42.324630 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.326867 15245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:42.327740 15245 raft_consensus.cc:606] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:42.327872 22838 raft_consensus.cc:3055] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:42.328251 15245 raft_consensus.cc:614] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:42.328593 22838 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:42.330181 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:42.331923 16026 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
W20260709 13:05:42.333496 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44526.5us
I20260709 13:05:42.334714 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:42.307263 23167 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:42.335747 16025 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:05:42.329556 22838 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.313230 23074 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:42.334884 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.317328 23022 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:42.334811 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:42.338181 22941 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:42.354631 23166 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.355111 22852 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.355822 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.356310 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:42.357350 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 56708.9us
I20260709 13:05:42.336807 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:42.323431 22681 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:42.319612 22925 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:42.364382 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:42.366875 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.335429 22586 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:42.358819 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.371088 15395 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:42.374997 22815 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.370620 22838 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:42.338362 23095 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.292724 23155 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:05:42.337515 22739 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.383003 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.397415 15393 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:42.367321 15291 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.398296 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:42.370563 22979 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:05:42.400610 22912 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:42.398902 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.399075 23084 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:42.401597 23084 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:42.401829 23126 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:42.402029 23084 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:42.402204 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:42.403056 23166 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:42.403554 15291 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.404404 23167 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:42.405125 23167 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.408152 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:42.409050 22979 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:42.409579 22979 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:42.410189 23084 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.410491 22979 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.411481 23166 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:42.402446 23126 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.412544 23084 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:42.399466 22940 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:42.399595 23160 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:05:42.387207 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 50487.6us
I20260709 13:05:42.400856 23155 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:42.413800 23155 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:42.414814 15291 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:42.414681 23155 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.416977 23155 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:42.417250 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.418349 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.400942 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:42.423872 23160 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:42.424327 23160 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.424702 23160 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:42.427989 15325 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:42.428018 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.428833 15316 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:42.430521 15324 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:05:42.431696 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.431668 22912 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:42.432649 15320 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 25: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:42.439527 23167 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:05:42.440196 23167 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:42.445910 15245 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:05:42.441502 23167 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.452098 15247 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:42.323635 22711 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.369985 23161 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.460323 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.468747 15396 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:42.474107 16058 heartbeater.cc:646] Failed to heartbeat to 127.13.206.254:45539 (6 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.206.254:45539 timed out after 15.000s (SENT)
I20260709 13:05:42.498301 22969 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.498982 22969 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.508244 22815 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:42.459671 23095 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.512269 23095 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.523133 23071 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:42.528755 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.542068 22982 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.543821 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.544559 15320 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:42.546828 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.548365 15390 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:05:42.548496 16028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 1236) took 1603 ms (client timeout 1716 ms). Trace:
W20260709 13:05:42.548974 16028 rpcz_store.cc:269] 0709 13:05:40.944647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.957506 (+ 12859us) service_pool.cc:224] Handling call
0709 13:05:42.548313 (+1590807us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54006c02d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:42.548432 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1631584640}
I20260709 13:05:42.549566 22711 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:42.471609 23163 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.550479 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.550673 23163 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.551740 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.552666 15390 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:42.552945 23163 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:42.553671 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.554847 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.555413 15390 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:42.558872 23165 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:05:42.561941 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.566043 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.567462 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.567860 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.568463 15398 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:42.568542 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.569335 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.571033 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.571683 22669 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:42.572103 22669 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:42.572942 22915 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.574723 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.574990 15394 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:42.575402 15324 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:05:42.566210 15390 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
W20260709 13:05:42.578250 23168 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:05:42.579737 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2492) took 1422 ms. Trace:
I20260709 13:05:42.580158 15242 rpcz_store.cc:276] 0709 13:05:41.157052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.372014 (+214962us) service_pool.cc:224] Handling call
0709 13:05:42.579532 (+1207518us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b54001397d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:42.579677 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1046524672}
I20260709 13:05:42.581220 15243 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:42.570114 15398 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 26 because replica has last-logged OpId of term: 24 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 9.
I20260709 13:05:42.572909 22669 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:42.598335 23064 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.936s	user 0.004s	sys 0.008s
I20260709 13:05:42.598812 23064 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:42.598896 22669 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:42.599539 23064 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.599685 15399 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:42.600067 23064 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.455606 23126 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:42.453743 23160 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.583925 23139 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:42.595840 22448 consensus_queue.cc:1059] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:05:42.596156 15393 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:42.596446 22990 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:42.596622 22715 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:42.597229 22969 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:42.597602 22987 consensus_meta.cc:287] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.004s
I20260709 13:05:42.591943 15362 leader_election.cc:400] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22.
I20260709 13:05:42.617604 15362 leader_election.cc:403] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:05:42.610415 23095 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.608042 15320 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:42.609306 15242 raft_consensus.cc:3060] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:42.610754 15390 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 24 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:05:42.610323 23064 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:42.618595 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 203847us
I20260709 13:05:42.607781 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.624328 15398 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:42.594141 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.599565 22350 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:42.627208 15316 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:05:42.627390 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.628084 15393 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:42.628156 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:42.629009 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.624506 15291 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:42.629848 15393 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:05:42.634889 15398 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
W20260709 13:05:42.636466 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44714.3us
I20260709 13:05:42.636694 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.613922 22990 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:42.641927 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.637838 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:42.622532 22448 consensus_queue.cc:1243] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 21.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:05:42.647228 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:42.631695 23126 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22.
I20260709 13:05:42.631726 22982 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.659022 15398 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:42.651198 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:42.637830 23139 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:42.661208 15363 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.196:38543 timed out after 1.716s (SENT) [suppressed 17 similar messages]
I20260709 13:05:42.666042 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.619791 22715 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.648701 23026 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.621980 22987 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.665467 15362 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:42.631769 23021 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:05:42.630832 23095 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.656343 22711 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:05:42.673736 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49231us
I20260709 13:05:42.689545 15399 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:42.690438 23178 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:05:42.702468 15998 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.732522 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.703730 22987 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:42.698314 22711 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.688359 23026 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.707907 23095 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:42.715451 22815 raft_consensus.cc:2804] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:42.649845 23064 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:05:42.719722 22715 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:42.720115 23153 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.552s	user 0.004s	sys 0.000s
I20260709 13:05:42.721127 22952 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.723908 23082 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:42.728994 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 81829.4us
I20260709 13:05:42.656141 23155 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:05:42.672284 23071 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:42.725991 22925 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:42.729554 15242 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:42.757807 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.768244 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.768477 15395 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 18: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:42.768980 15316 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:42.746747 22711 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:42.682642 23139 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.748433 22979 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:42.764813 15248 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:42.747655 22982 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.763433 23166 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:05:42.779481 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.780349 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.781575 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.756067 23178 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:42.757287 23071 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:42.781270 15318 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:42.784379 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.779076 22982 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.789450 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.763721 22868 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.792243 15322 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:05:42.802412 15320 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:42.790055 22925 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:42.804705 15247 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:42.768558 22575 raft_consensus.cc:3055] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:42.772360 22350 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:42.805606 22925 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:42.776288 22979 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:42.817179 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 103152us
I20260709 13:05:42.811753 15391 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:05:42.804296 23071 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:42.748729 22990 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.835686 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.807582 22575 raft_consensus.cc:740] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:42.837003 15320 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:42.838327 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.823608 22979 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:42.841060 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.842079 15316 raft_consensus.cc:2393] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:42.842556 22952 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:42.843394 22990 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:42.844290 22575 consensus_queue.cc:260] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.845366 22575 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:42.847342 22925 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.847985 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.848662 22925 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:42.849360 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.849929 15319 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:42.841056 23160 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:42.850561 23095 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.851068 23095 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.853497 23095 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.841171 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.831368 23077 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.856052 15320 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:42.856230 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.842643 23139 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.848656 15316 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:42.857120 15319 raft_consensus.cc:2468] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:05:42.841287 15325 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:42.860517 15243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3305) took 1392 ms. Trace:
I20260709 13:05:42.860944 15243 rpcz_store.cc:276] 0709 13:05:41.468561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.599570 (+131009us) service_pool.cc:224] Handling call
0709 13:05:42.581036 (+981466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.581627 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.860294 (+278667us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54001397d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:42.860450 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256357120}
W20260709 13:05:42.866302 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.866912 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.867774 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2489) took 1115 ms. Trace:
I20260709 13:05:42.875476 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:42.885643 16025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:42.888464 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:42.889140 16024 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:42.817420 22868 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.832991 22350 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.890193 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:42.876573 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:42.893256 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.868188 15317 rpcz_store.cc:276] 0709 13:05:41.752473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.777742 (+ 25269us) service_pool.cc:224] Handling call
0709 13:05:41.778559 (+   817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.843431 (+ 64872us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:05:41.843763 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:05:42.206004 (+362241us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b180034cae0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:42.214058 (+  8054us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:42.214117 (+    59us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:42.214161 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.719676 (+505515us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b2400176858. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f36669939c4 00007f3666991acb 00007f3666b4cdc9 00007f3666b4ca55 00007f3666b4c09d 00007f366977e10e 00007f366979588c 00007f3669794bb6 00007f36697947d8 00007f366979e221
0709 13:05:42.867530 (+147854us) spinlock_profiling.cc:243] Waited 64.6 ms on lock 0x7b54002a7bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:42.867581 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:42.867715 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":193026,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":193282,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":80,"spinlock_wait_cycles":207322240,"thread_start_us":167100,"threads_started":1,"wal-append.queue_time_us":299448}
I20260709 13:05:42.895776 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:42.911550 16027 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:42.919009 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.892560 22852 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:42.922503 23064 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:42.923168 23064 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:42.924026 23064 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.925269 23064 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:42.926591 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:42.926759 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 161304us
I20260709 13:05:42.928037 22739 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:42.929513 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:42.930984 23163 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:42.931445 23163 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.931854 23163 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:42.922613 23121 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:42.939091 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.940065 15321 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:42.939301 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.942204 15323 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:42.947515 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.948328 15250 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:42.949232 15246 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:42.949779 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.948118 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.890210 23027 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.946878 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.958570 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.962901 15246 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:05:42.955330 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.964085 15241 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:42.964969 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.965962 15316 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:42.951299 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.966784 15243 raft_consensus.cc:2376] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22. Re-sending same reply.
I20260709 13:05:42.910415 16025 raft_consensus.cc:1275] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:42.964938 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.971179 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:42.971295 15393 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:05:42.974918 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.975203 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:42.975543 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.976017 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:42.976109 15319 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:42.976832 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:42.977481 15244 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:42.978658 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:42.914688 22815 raft_consensus.cc:697] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:42.919800 23166 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.920125 23095 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:42.970966 23179 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.981527 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:42.988389 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:42.922528 22852 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.990535 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 3199) took 1223 ms. Trace:
I20260709 13:05:42.990995 15399 rpcz_store.cc:276] 0709 13:05:41.759468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.759604 (+   136us) service_pool.cc:224] Handling call
0709 13:05:42.982670 (+1223066us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54000271d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:42.982787 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906213248}
I20260709 13:05:42.992233 22852 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:42.994513 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:43.002833 22350 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:42.972308 22739 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:43.008697 22739 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.009105 22815 consensus_queue.cc:237] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.012813 23179 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:42.893965 23077 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:42.982096 22744 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.020020 22744 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.021458 15248 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:42.989612 23166 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.026657 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:43.027631 16028 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:43.028788 23166 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:43.029836 15325 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 24 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:05:43.031637 22868 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:43.047642 15321 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:43.051113 15324 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:42.986649 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:42.987654 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:43.053239 16027 raft_consensus.cc:3060] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:43.053462 15323 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:43.055680 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:43.057459 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 140775us
W20260709 13:05:43.060253 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.063607 22946 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:43.064220 22946 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:42.914433 23178 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.071698 23179 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:43.022110 22744 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:43.076198 22667 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:43.078218 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:43.078964 16025 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:05:43.080099 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:43.083956 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:43.084851 22982 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:43.090412 15319 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:43.113153 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:43.113896 15319 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:42.974366 23027 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.094851 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:43.098538 16024 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:43.086709 15289 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.124724 15215 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:43.125074 16027 raft_consensus.cc:2468] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:43.125679 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:43.126713 16026 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:43.102545 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:43.108361 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:43.128485 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.108616 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.128849 15321 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:43.113334 16033 raft_consensus.cc:2393] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 17: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:43.065284 22946 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.091713 15244 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:43.114491 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:43.112550 16028 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:43.120893 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:43.130093 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:43.133147 15321 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 23 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:05:43.134362 15317 raft_consensus.cc:2410] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:05:43.086334 22915 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:43.017997 23071 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:43.147645 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:43.142354 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 55388.8us
I20260709 13:05:43.100085 23139 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:05:43.149855 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:43.150560 16032 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:43.155604 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:43.157258 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:43.159618 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:43.160212 15321 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:05:43.140295 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:43.160957 15319 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:43.136965 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.161168 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:43.158919 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:43.161888 15322 raft_consensus.cc:2410] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:05:43.161278 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:43.161908 15318 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 25.
I20260709 13:05:43.161193 23160 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:43.172902 22952 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:43.176226 23149 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:43.130576 22982 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:43.106266 22868 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:05:43.175321 15321 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:43.140690 23121 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:43.147248 22575 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:43.158515 22448 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:05:43.195866 23160 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:43.196398 23149 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:43.196610 23160 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:43.173611 23127 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:43.135365 22715 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:05:43.200628 15363 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:43.144404 22667 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:05:43.114840 22912 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.059s
W20260709 13:05:43.208819 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.136098 23132 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:43.137079 22744 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:43.144042 22969 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:05:43.181484 15362 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:43.232550 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51160.4us
I20260709 13:05:43.158069 23163 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.229823 15291 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.197839 22946 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:43.231251 23132 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:43.242138 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 50539.6us
I20260709 13:05:43.238948 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.256345 15321 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:43.203048 22739 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:43.301621 16032 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:43.293678 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.190971 22711 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.302624 15319 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:43.202800 22586 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:43.302971 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.317946 15396 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:43.304121 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:43.207082 22952 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:43.338747 22952 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:43.339272 22952 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:43.314411 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:43.341959 15396 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:05:43.208791 23127 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:43.317211 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78391.5us
I20260709 13:05:43.231007 22744 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.342391 15396 pending_rounds.cc:85] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 12
I20260709 13:05:43.344240 15396 pending_rounds.cc:107] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:05:43.344547 15396 raft_consensus.cc:2889] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:43.345600 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:43.346024 15321 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:43.347002 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.348294 15396 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:43.347199 15393 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 25: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:43.349399 23127 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.350250 22969 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:43.350518 22586 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:43.350901 22744 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:43.351516 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:43.340167 22711 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:43.272464 23084 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:43.271461 22990 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:43.354987 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.237869 23021 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.126s
I20260709 13:05:43.229775 22982 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.112s
I20260709 13:05:43.284874 23132 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:43.378156 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:43.381654 15392 raft_consensus.cc:2410] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:05:43.383200 15394 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:43.372057 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.391631 15396 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
W20260709 13:05:43.393682 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 445512us
I20260709 13:05:43.393877 15321 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:43.353709 23179 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:43.363565 23166 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:43.312841 22915 consensus_queue.cc:1048] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:05:43.399377 15996 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.407042 15321 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 12. (term mismatch)
I20260709 13:05:43.407809 15321 pending_rounds.cc:85] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 11
I20260709 13:05:43.408388 15321 pending_rounds.cc:107] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 23.12
I20260709 13:05:43.408751 15321 raft_consensus.cc:2889] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:43.412038 15321 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:43.379644 22852 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.431161 23190 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:43.431766 22961 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:43.432260 22961 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:43.390156 22350 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:43.434048 22350 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:43.435065 22350 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.437364 22990 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:43.437772 22852 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:43.437834 22990 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.438515 22990 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:43.438588 22852 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:43.440335 15325 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:05:43.441641 15325 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:43.441512 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:43.442673 15391 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:43.441453 23026 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:43.445417 15247 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:43.447429 23163 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:43.452016 22852 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:05:43.470484 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 390430us
I20260709 13:05:43.367856 22925 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:05:43.453075 22990 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.486357 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:43.401129 23084 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:43.395438 22586 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:43.493096 16030 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:43.487133 15391 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:05:43.340590 23160 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.498848 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:43.500353 16032 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: []
W20260709 13:05:43.501966 22979 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.001s
I20260709 13:05:43.502660 22979 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.504284 22990 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:43.505155 23071 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:43.505505 22979 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:43.507473 23188 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:43.508677 23188 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:43.508447 22961 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.509363 23188 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:43.510457 15317 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:43.512428 15398 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:43.515239 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3840) took 1257 ms. Trace:
I20260709 13:05:43.515645 15390 rpcz_store.cc:276] 0709 13:05:42.258086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.577188 (+319102us) service_pool.cc:224] Handling call
0709 13:05:42.608486 (+ 31298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.621321 (+ 12835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.515044 (+893723us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b54002bc0d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:43.515179 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71181184}
I20260709 13:05:43.407835 23166 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.518204 23166 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:43.523758 23095 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:43.475167 22852 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.530045 15323 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:05:43.530678 15323 pending_rounds.cc:85] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 16
I20260709 13:05:43.530984 15323 pending_rounds.cc:107] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:05:43.505913 23027 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:43.531316 15323 raft_consensus.cc:2889] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:43.524689 23095 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:43.543085 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39732 (request call id 3202) took 1128 ms. Trace:
I20260709 13:05:43.543648 15395 rpcz_store.cc:276] 0709 13:05:42.414450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.568319 (+153869us) service_pool.cc:224] Handling call
0709 13:05:43.542809 (+974490us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400271354. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:43.543004 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450469120}
I20260709 13:05:43.547024 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:43.547279 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:43.548094 15248 raft_consensus.cc:2393] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 18: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:43.548170 15243 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:43.407997 23012 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 13:05:43.549510 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:43.541585 22961 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:43.551352 16032 raft_consensus.cc:1217] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 19.16->[20.17-22.18]   Dedup: 20.17->[22.18-22.18]
W20260709 13:05:43.541975 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 398335us
I20260709 13:05:43.533874 22852 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:43.557618 16032 raft_consensus.cc:1240] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: [20.17-22.18]
W20260709 13:05:43.566546 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.461735 23191 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.135s
I20260709 13:05:43.575254 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:43.580310 15244 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:43.582860 15395 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:05:43.586773 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:43.587474 16033 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:43.588346 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:43.589013 16027 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
W20260709 13:05:43.590780 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.593391 22667 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.593988 22667 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:43.595319 23184 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.787s	user 0.007s	sys 0.004s
I20260709 13:05:43.596253 22667 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:43.582931 22981 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:43.597224 22981 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.586454 23196 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:43.599327 22981 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:43.598966 23196 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:43.607564 23082 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.857s	user 0.006s	sys 0.006s
I20260709 13:05:43.608706 22586 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.611663 23077 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:43.612516 23071 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.612433 23084 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.613332 23071 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.614809 23194 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.615593 23194 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.612394 15244 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:43.620241 22868 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:43.624094 22575 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:43.625048 22575 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:43.625422 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:43.626367 16030 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:43.626688 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.627396 15397 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:43.538574 23095 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:43.632596 15289 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:43.637018 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.638177 15289 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:43.637899 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:43.644383 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:43.646170 15244 raft_consensus.cc:2410] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 25 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:05:43.579849 23189 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:43.644657 23191 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:43.650131 23189 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.650789 23191 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:43.651796 23191 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.652650 23189 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:43.632082 23188 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.654305 23196 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:43.633384 23194 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:43.656333 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.642469 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:43.657610 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.649602 23166 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:43.625386 22575 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:43.661772 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.664712 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:43.668586 16030 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:43.682899 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:43.683671 16033 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:05:43.683949 15249 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 21: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:43.681322 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:43.694309 22969 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:43.694805 22969 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:43.665654 23166 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.696591 22711 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:43.696698 23166 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:43.697234 22711 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.701014 22711 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:43.666919 22925 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:43.707027 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:43.641114 23132 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.679520 23095 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.695706 22969 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.722681 15998 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:43.647044 22952 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.770394 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:43.713617 22925 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:43.771744 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.036s	sys 0.087s
W20260709 13:05:43.772879 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.036s	sys 0.087s
W20260709 13:05:43.773711 15997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.006s	sys 0.022s
W20260709 13:05:43.773573 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 636624us
W20260709 13:05:43.775375 15997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.006s	sys 0.022s
I20260709 13:05:43.775957 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:43.780088 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.784336 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:43.785665 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 386392us
I20260709 13:05:43.797201 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.682418 22744 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:43.726011 23121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.002s	sys 0.020s
I20260709 13:05:43.783603 23194 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:43.800537 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 422444us
I20260709 13:05:43.772430 23095 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:43.807379 15399 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:43.783393 22925 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:43.784363 22868 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:43.814772 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.754873 22990 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
W20260709 13:05:43.804713 23121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.002s	sys 0.020s
I20260709 13:05:43.826732 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:05:43.806398 22946 consensus_meta.cc:287] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.505s	user 0.009s	sys 0.003s
I20260709 13:05:43.823851 15398 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:43.806624 22969 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:43.826062 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:43.828055 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:43.823864 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:43.812386 23077 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.539438 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:43.811349 23194 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.849021 15244 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:43.844527 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:43.813540 23195 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:43.835204 15394 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:43.815076 22852 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:43.834705 15398 raft_consensus.cc:1240] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:05:43.826876 23121 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:43.858359 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:43.855983 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:43.791199 22575 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:43.860673 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:43.861603 15244 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:43.850617 23194 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:43.847359 23199 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:43.850304 23203 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:43.873867 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:05:43.869877 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 491218us
I20260709 13:05:43.887020 15291 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.860759 22946 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:43.894507 15365 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:43.895877 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.798259 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:43.902647 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:43.890331 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:43.905754 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.867322 23202 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:43.907681 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:43.907451 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.909008 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:43.910158 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:43.904848 15243 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:43.913596 15324 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:05:43.919145 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 121014us
I20260709 13:05:43.921008 15996 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:43.920125 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:43.926365 15244 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:43.930766 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:43.850785 23077 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:43.939800 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45433.8us
I20260709 13:05:43.880290 22448 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:43.929906 23195 raft_consensus.cc:2764] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:05:43.860532 22868 consensus_queue.cc:1059] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:05:43.941931 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:43.959172 15318 raft_consensus.cc:2393] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 16: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:43.906332 22946 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.905485 22575 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:43.953019 15323 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:05:43.955307 15291 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:43.904767 22981 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:05:43.906900 23167 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:43.952318 23082 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:43.925110 23202 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.917029 23203 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:43.933005 23205 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:43.886307 23196 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:05:43.950021 23021 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:43.952801 22990 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:43.916514 23026 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:44.003818 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:43.960191 23126 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:43.906643 23159 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:05:43.959703 23189 raft_consensus.cc:2804] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:43.968686 22946 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:43.963438 23199 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.023624 16026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1246) took 1159 ms. Trace:
I20260709 13:05:43.913832 23204 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.111s
W20260709 13:05:44.041108 15391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.025s
I20260709 13:05:43.957621 23166 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.013480 22448 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:44.022856 23132 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.025470 23202 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:44.024178 22667 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
I20260709 13:05:44.036672 22961 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:44.049790 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.105165 15322 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:05:44.038286 23205 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.051299 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.053614 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.109256 15318 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:44.035877 22990 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.036966 23021 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.140383 22990 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:44.140534 23021 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:44.057857 23189 raft_consensus.cc:697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:44.059883 23199 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.147330 23189 consensus_queue.cc:237] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.066324 15316 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:44.149559 23199 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.049996 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.053279 16026 rpcz_store.cc:276] 0709 13:05:42.863759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.892649 (+ 28890us) service_pool.cc:224] Handling call
0709 13:05:43.126449 (+233800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:43.127252 (+   803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.023354 (+896102us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54003e26d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:44.023538 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536922496}
W20260709 13:05:44.078789 15391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.007s	sys 0.025s
I20260709 13:05:44.047067 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:05:44.155632 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 108645us
I20260709 13:05:44.157449 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:44.079921 15320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.011s	sys 0.019s
W20260709 13:05:44.158422 15320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.011s	sys 0.019s
I20260709 13:05:44.159487 23201 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:43.998420 22350 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.012606 23121 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.161592 22350 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.163130 15324 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:44.163952 22350 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.164601 23179 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:05:44.055680 23160 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.022s	sys 0.011s
I20260709 13:05:44.019488 23167 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:44.165277 23160 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.022s	sys 0.011s
W20260709 13:05:44.055536 23193 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:05:44.045946 23126 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:44.045642 23127 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.012s	sys 0.034s
I20260709 13:05:44.059417 23159 consensus_queue.cc:1243] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer 45ddec37d9e741a598bf32f6c9d7e0ee log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:44.051865 23188 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:44.117427 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.118700 22852 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:44.058060 22744 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.107409 22952 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:44.123951 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:44.191170 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.107697 23139 raft_consensus.cc:3055] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:44.099305 22868 raft_consensus.cc:3055] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:44.125442 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:44.181294 23127 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.012s	sys 0.035s
W20260709 13:05:44.197417 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 72070us
I20260709 13:05:44.197639 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.198467 15317 raft_consensus.cc:2376] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24. Re-sending same reply.
I20260709 13:05:44.167266 23205 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:44.139528 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.181479 23126 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:44.185045 22961 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:44.215847 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:44.217224 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 293804us
I20260709 13:05:44.196349 23139 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:44.125804 23196 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:44.224546 15250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3334) took 1270 ms. Trace:
I20260709 13:05:44.227864 15250 rpcz_store.cc:276] 0709 13:05:42.953945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.958821 (+  4876us) service_pool.cc:224] Handling call
0709 13:05:42.959216 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:42.959505 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.959543 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:42.985710 (+ 26167us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.472685 (+486975us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:05:43.942557 (+469872us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.224206 (+281649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.224291 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.224337 (+    46us) raft_consensus.cc:1685] finished
0709 13:05:44.224350 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.224487 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":730336,"raft.queue_time_us":107214,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7245,"thread_start_us":1089361,"threads_started":3,"wal-append.queue_time_us":669906}
I20260709 13:05:44.186582 15316 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:44.219769 15322 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:05:44.195092 22868 raft_consensus.cc:740] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:44.194983 23159 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:44.133455 23166 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.234732 15325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3775) took 1170 ms. Trace:
I20260709 13:05:44.241426 15325 rpcz_store.cc:276] 0709 13:05:43.063991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.445180 (+381189us) service_pool.cc:224] Handling call
0709 13:05:43.447401 (+  2221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:43.447637 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:43.863328 (+415691us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.234335 (+371007us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.234395 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:44.234465 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.234537 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.234671 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":609019,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":162,"thread_start_us":785792,"threads_started":2}
I20260709 13:05:44.239600 15321 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3769) took 1177 ms. Trace:
I20260709 13:05:44.224710 23209 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:05:44.249567 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.185473 23203 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.263949 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:44.265653 15399 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:44.272215 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.273170 15398 raft_consensus.cc:2410] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:05:44.266549 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.246049 23229 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.275032 15394 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:44.289216 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.292618 15399 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:44.246354 23167 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.224035 23198 consensus_queue.cc:1059] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.051s
W20260709 13:05:44.294332 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 335142us
W20260709 13:05:44.299245 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 141857us
I20260709 13:05:44.258178 23077 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.266491 23160 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.270368 23161 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.305656 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.306324 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:44.306447 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.313858 15325 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:44.243355 23159 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.318070 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:44.325243 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.304658 23201 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:05:44.322803 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56935.8us
I20260709 13:05:44.302673 23204 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.302286 23230 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:44.305253 23167 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:44.312302 22961 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:44.344179 23226 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:05:44.345813 23225 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:05:44.346668 23216 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:05:44.348127 23222 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:05:44.349684 23214 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:05:44.350107 23212 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:05:44.342307 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:44.351069 23239 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:44.351636 23221 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:05:44.351903 22448 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:44.263198 23139 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.356753 23139 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:44.358762 23219 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:05:44.330540 22925 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.360661 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1258) took 1123 ms. Trace:
I20260709 13:05:44.360711 22815 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:44.361559 22925 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.362048 23233 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:44.362579 23233 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:44.362991 23233 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:44.362797 23021 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.365068 23021 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.368640 23230 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.368816 23202 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.369335 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2509) took 1431 ms. Trace:
I20260709 13:05:44.371094 23230 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.373437 22946 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.341233 23194 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.375517 15317 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 25: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:05:44.375968 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.369726 15320 rpcz_store.cc:276] 0709 13:05:42.937661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.937785 (+   124us) service_pool.cc:224] Handling call
0709 13:05:43.525006 (+587221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:43.534331 (+  9325us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:05:43.534392 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:43.535023 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.158853 (+623830us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:05:44.158905 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.159015 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.367643 (+208628us) raft_consensus.cc:1685] finished
0709 13:05:44.367662 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.369069 (+  1407us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b5400281c50. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:44.369275 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6584,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":8512,"spinlock_wait_cycles":1349525248,"thread_start_us":598346,"threads_started":1,"wal-append.queue_time_us":716983}
I20260709 13:05:44.379731 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.380894 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.381443 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.382057 15243 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:44.361162 16028 rpcz_store.cc:276] 0709 13:05:43.236868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.237059 (+   191us) service_pool.cc:224] Handling call
0709 13:05:43.313350 (+ 76291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:43.551035 (+237685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.551064 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:43.582065 (+ 31001us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.986859 (+404794us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:43.986896 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.986972 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.360427 (+373455us) raft_consensus.cc:1685] finished
0709 13:05:44.360449 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.360598 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":193435,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"thread_start_us":600486,"threads_started":2,"wal-append.queue_time_us":568572}
I20260709 13:05:44.384356 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.385169 15243 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:44.385282 23231 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.385804 23231 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.388095 23231 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.387799 22990 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.389163 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.389820 15394 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:44.390664 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.391314 15322 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 19: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:44.390690 15397 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:05:44.392263 15320 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 13:05:44.396628 15250 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:44.399495 23132 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.400451 23209 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:44.400163 23132 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.400933 23209 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:44.403648 23132 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.321873 23161 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.319046 23160 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.406657 23161 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:44.407473 23160 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:44.342828 23204 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:44.409602 23095 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.594s	user 0.012s	sys 0.000s
I20260709 13:05:44.409763 23204 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.412313 23194 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.303788 23229 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.378451 23167 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.416046 23229 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.416582 23167 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.416694 15325 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:44.417596 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:44.418035 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.419262 15249 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:05:44.420118 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.420871 15245 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 25: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:44.422501 16032 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:44.423271 23159 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.380129 23196 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:44.407514 22969 consensus_meta.cc:287] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 13:05:44.424710 23196 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:44.425668 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 467856us
I20260709 13:05:44.426525 22946 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.426702 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:44.427598 23232 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:44.428069 23232 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.428388 23232 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:44.430399 23160 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.430565 22952 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:44.430974 23160 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.431164 22952 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.432183 22990 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.418267 15393 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:44.430454 23127 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:44.434808 15215 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:44.434640 23127 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.435842 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.436617 15397 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:44.437245 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:44.440362 15243 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:05:44.442881 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:44.445147 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:44.440613 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 170626us
I20260709 13:05:44.446914 15250 raft_consensus.cc:2410] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:05:44.448927 15213 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:44.449028 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:44.450402 15244 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:44.454910 15291 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:44.433916 22952 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.465226 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.467934 15320 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:44.457242 15213 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:44.472321 23243 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:44.472874 23243 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.384100 22815 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:44.454900 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:44.479101 15245 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:05:44.480425 15393 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:44.484529 15291 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:44.504891 23229 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:44.505805 22925 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:44.507798 23159 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.487303 15215 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:44.426872 23196 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.448338 23160 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:44.455327 23161 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.509235 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:44.519318 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.504051 22575 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:44.473752 23204 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:44.474514 22946 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:44.463732 23074 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:44.522307 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:44.522953 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 57814us
W20260709 13:05:44.524698 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 182493us
I20260709 13:05:44.526501 15320 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:44.504202 22350 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:44.486338 22969 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:05:44.458762 23166 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:44.481709 23199 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:44.453529 22990 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:05:44.530907 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.519531 23021 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:05:44.520576 22815 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:44.481302 23243 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:44.524991 23132 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:44.577975 23132 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.579730 23232 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.580682 23196 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.580874 23132 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.581278 23196 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.565783 23202 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.584164 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.584373 23071 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.584761 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.547816 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.485935 22952 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:05:44.585356 22982 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.585755 15320 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:44.586735 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.559518 23235 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:05:44.587358 15320 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:44.588217 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.588744 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.589315 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.589447 15322 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:44.523670 23159 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.527837 23161 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.598646 15244 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:05:44.566208 23166 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.567173 22815 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.564677 23167 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:05:44.571062 23127 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:44.571717 23126 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.527526 23233 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.576642 23205 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.619199 23239 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:05:44.620275 23241 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:05:44.620644 23205 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:44.584870 15393 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 26.
I20260709 13:05:44.584430 23196 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.590816 15398 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:44.530131 23246 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.069s
I20260709 13:05:44.592226 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:44.530999 22961 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:44.520846 22667 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:44.595366 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.632961 15249 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:44.595582 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.595734 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.627873 23205 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:44.596096 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.634899 23205 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.635936 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.636562 15320 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:44.636806 23233 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:44.637044 23205 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.637614 23254 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.633204 23209 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.644867 23209 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.641178 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:44.549247 23074 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:44.530867 22575 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:44.640686 15250 raft_consensus.cc:2410] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:44.606644 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3760) took 1623 ms. Trace:
I20260709 13:05:44.607293 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.651350 15241 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:05:44.650679 15319 rpcz_store.cc:276] 0709 13:05:42.983639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.178032 (+194393us) service_pool.cc:224] Handling call
0709 13:05:43.302454 (+124422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:43.313771 (+ 11317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.606427 (+1292656us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54002ed6d0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:44.606580 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285231360}
I20260709 13:05:44.607942 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.610546 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.632725 22667 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.652391 22667 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:44.652697 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.652796 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.653615 15322 raft_consensus.cc:2368] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20.
I20260709 13:05:44.654009 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.654898 15319 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:05:44.640072 23254 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.655751 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.616075 23159 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.616428 23126 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:44.616824 15394 raft_consensus.cc:2410] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:05:44.618067 23178 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:44.658936 23178 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:44.659161 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.659665 22575 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:44.659922 23178 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.585930 22982 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.662642 22982 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.631944 23196 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:44.609032 23166 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.685621 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:44.687318 23166 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.546773 23204 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:44.688575 23204 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.673316 16026 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:44.666903 15320 raft_consensus.cc:2468] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:44.649165 23074 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.694744 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:44.695154 15248 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:05:44.698503 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 140031us
I20260709 13:05:44.699276 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.700207 15248 raft_consensus.cc:2393] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:44.700242 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.700695 15320 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:05:44.701098 15319 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:44.702767 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:44.703568 15249 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 25: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:44.704655 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:44.699205 23254 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.705667 16028 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:44.650130 22969 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:44.718281 15362 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:44.710445 16027 raft_consensus.cc:1275] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:05:44.770884 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:44.771612 15245 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:44.773026 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 69411.1us
I20260709 13:05:44.746261 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:44.714356 15319 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:05:44.775321 15319 pending_rounds.cc:85] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 15
I20260709 13:05:44.775691 15319 pending_rounds.cc:107] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:05:44.776010 15319 raft_consensus.cc:2889] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:44.706266 15244 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:05:44.708220 15997 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.706889 16024 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:05:44.778972 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.779922 15244 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:44.765614 15996 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:44.784485 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.706642 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.757941 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3855) took 1121 ms. Trace:
I20260709 13:05:44.736219 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:44.706624 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:44.786684 15248 raft_consensus.cc:2368] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21.
I20260709 13:05:44.786883 16030 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 23: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:44.708171 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:44.787504 16029 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:44.774745 15362 leader_election.cc:400] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20.
I20260709 13:05:44.788265 15362 leader_election.cc:403] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:05:44.786198 15241 raft_consensus.cc:2410] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:05:44.802201 15996 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:44.770601 23196 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.762324 23205 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:44.806730 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:44.774456 23074 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:44.775399 22969 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:44.827044 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.802145 15291 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:44.802450 15395 rpcz_store.cc:276] 0709 13:05:43.636534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.645474 (+  8940us) service_pool.cc:224] Handling call
0709 13:05:43.645781 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:43.646123 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.646151 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:43.646663 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.659160 (+1012497us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800134bc0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:05:44.701069 (+ 41909us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:44.701125 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.701217 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.704091 (+  2874us) raft_consensus.cc:1685] finished
0709 13:05:44.704111 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.757847 (+ 53736us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":23847296,"thread_start_us":41711,"threads_started":1,"wal-append.queue_time_us":1052209}
I20260709 13:05:44.784909 23163 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:44.708954 23201 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:44.828684 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.829870 15291 leader_election.cc:400] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21.
I20260709 13:05:44.830210 15291 leader_election.cc:403] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:44.831899 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.712280 22667 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.839586 22667 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.840487 15242 raft_consensus.cc:2368] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24.
W20260709 13:05:44.841189 23257 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:05:44.826292 22969 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:44.844089 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:44.845293 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:44.811527 23196 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.711830 23082 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 16, Time since last communication: 0.112s
I20260709 13:05:44.807042 23232 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:44.823086 23095 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:44.809564 23262 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:44.811983 23189 raft_consensus.cc:2804] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:44.812043 23077 raft_consensus.cc:2804] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:44.805653 23166 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:05:44.831418 23206 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:44.808753 23012 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:05:44.834834 22982 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:05:44.830360 23163 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.861382 23206 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.878969 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:44.862990 23139 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.887190 15396 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:05:44.881542 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:44.889390 15397 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:44.880836 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.890379 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.891142 15396 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:44.871055 23206 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:44.871186 23163 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:44.892735 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:44.893669 15392 raft_consensus.cc:2393] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:44.870734 23077 raft_consensus.cc:697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:44.895260 15393 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:05:44.895694 15393 pending_rounds.cc:85] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 14
I20260709 13:05:44.895949 15393 pending_rounds.cc:107] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:05:44.896181 15393 raft_consensus.cc:2889] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:44.873652 23189 raft_consensus.cc:697] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:44.900745 23189 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.869616 23243 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.894857 23077 consensus_queue.cc:237] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:44.910871 15243 raft_consensus.cc:1240] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:05:44.913743 15246 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:44.915314 15318 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:05:44.918903 23167 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:44.878589 23161 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:44.893178 22815 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:44.940913 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.958415 15318 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 13:05:44.910808 23139 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:44.964550 15318 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 24. Current term is 25. Ops: [24.12-24.12]
I20260709 13:05:44.965967 15245 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:44.967177 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:44.979678 15318 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:05:44.985268 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:44.986153 15393 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 16.
I20260709 13:05:44.972344 23012 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.000133 23012 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.002802 23012 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.008766 15318 raft_consensus.cc:1275] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:05:45.013377 15317 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:44.972626 23211 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:44.951749 22815 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:45.029956 23270 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:45.006122 23163 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.046577 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:45.047873 15242 raft_consensus.cc:2393] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:45.049332 23139 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.025835 23211 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:45.061182 22815 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:45.070838 23266 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:44.244241 15321 rpcz_store.cc:276] 0709 13:05:43.062336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.413124 (+350788us) service_pool.cc:224] Handling call
0709 13:05:43.413486 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:43.413733 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:43.796051 (+382318us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.239122 (+443071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:44.239198 (+    76us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:44.239265 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.239357 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.239524 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":531,"prepare.queue_time_us":627510,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":86,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4506,"thread_start_us":737370,"threads_started":2}
I20260709 13:05:45.073351 22969 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.078619 15244 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:45.079973 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46848 (request call id 1128) took 1046 ms. Trace:
I20260709 13:05:45.080530 23139 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:45.081568 23132 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:45.081561 23206 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.082767 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:45.086360 23203 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:45.035528 22982 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21.
I20260709 13:05:45.089794 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:45.017278 22575 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:45.100802 22575 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:45.105926 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:45.106810 15247 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:45.093093 15397 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:45.039021 23196 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.095937 15395 raft_consensus.cc:2368] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24.
I20260709 13:05:45.096776 15324 rpcz_store.cc:276] 0709 13:05:44.033606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.033730 (+   124us) service_pool.cc:224] Handling call
0709 13:05:45.079743 (+1046013us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b5400083c54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:45.079907 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19045248}
I20260709 13:05:45.087879 23242 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:45.094453 23268 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:05:45.127091 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:45.128026 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3851) took 1564 ms. Trace:
I20260709 13:05:45.109493 23132 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:45.118243 15324 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:05:45.098013 23266 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:45.128414 15390 rpcz_store.cc:276] 0709 13:05:43.563964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.564166 (+   202us) service_pool.cc:224] Handling call
0709 13:05:43.564614 (+   448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:43.565115 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.565160 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:43.582658 (+ 17498us) log.cc:844] Serialized 52 byte log entry
0709 13:05:44.761570 (+1178912us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b1800366ca0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:05:44.856224 (+ 94654us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:44.874393 (+ 18169us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.874688 (+   295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.874791 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.127695 (+252904us) raft_consensus.cc:1685] finished
0709 13:05:45.127793 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.127962 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18567,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":7300,"raft.queue_time_us":13468,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":17972,"spinlock_wait_cycles":5737728,"thread_start_us":94438,"threads_started":1,"wal-append.queue_time_us":1352739}
I20260709 13:05:45.130716 23266 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.123461 22969 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.096576 23243 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.124588 23211 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.109664 23139 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:45.121599 23217 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:05:45.104899 23203 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:45.132447 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:45.137908 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:45.139361 15323 raft_consensus.cc:2368] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17.
I20260709 13:05:45.141268 15242 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 16.
I20260709 13:05:45.130059 23132 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:45.136397 23082 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:45.138168 23012 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.159403 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:45.145570 23266 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:45.166713 23206 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.166985 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:45.168323 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:45.168893 15365 leader_election.cc:400] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24.
I20260709 13:05:45.169176 15241 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:45.169366 15365 leader_election.cc:403] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:45.141094 22987 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:05:45.170570 23155 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:45.170689 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:45.171044 23155 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:45.171532 23155 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:45.172041 23126 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:45.174449 23064 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:45.174599 23095 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:45.176213 23064 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.176673 23064 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:45.179479 22952 consensus_queue.cc:1059] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:45.180622 23139 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:45.180656 23161 raft_consensus.cc:3055] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:45.181267 23161 raft_consensus.cc:740] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:45.182060 23161 consensus_queue.cc:260] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:45.185437 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 404411us
I20260709 13:05:45.163466 23084 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:45.189607 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:45.189920 23203 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.191090 23203 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:45.163190 23012 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.196076 23262 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20.
I20260709 13:05:45.197757 23012 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.198312 23163 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:45.154963 23132 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.199594 23132 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.154294 23189 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.048s
I20260709 13:05:45.137272 23242 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:45.239727 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 53515us
W20260709 13:05:45.246459 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.247043 15391 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:45.174099 23126 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 24
W20260709 13:05:45.263015 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.274772 23132 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.279767 23242 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.261272 23163 consensus_queue.cc:1048] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:05:45.283049 23155 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.285519 23155 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:45.269562 23084 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:05:45.291311 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:45.292201 15244 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:45.229718 15241 raft_consensus.cc:2468] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:45.296093 22982 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:45.296850 22982 consensus_queue.cc:1243] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:45.294083 15291 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:45.303174 15291 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:45.303537 22744 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:45.303972 22744 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.304318 22744 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:45.304780 22982 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:45.305403 22982 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:45.306320 22982 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.325953 15241 pending_rounds.cc:85] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 9
I20260709 13:05:45.326637 15241 pending_rounds.cc:107] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:05:45.327042 15241 raft_consensus.cc:2889] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:45.331882 23132 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.319164 23012 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.330778 22990 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:45.345063 23132 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.346730 23012 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.395804 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:45.396747 15214 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:45.397094 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:45.397529 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:45.398339 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:45.398612 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:45.398705 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:45.399493 15250 raft_consensus.cc:3060] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:45.399912 15242 raft_consensus.cc:3055] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:45.400298 15242 raft_consensus.cc:740] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:45.401041 15242 consensus_queue.cc:260] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:45.401953 15242 raft_consensus.cc:3060] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:45.402639 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:45.403131 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.354828 22990 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:45.381901 23277 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.192s	user 0.003s	sys 0.000s
I20260709 13:05:45.398340 15248 raft_consensus.cc:2410] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:05:45.406989 15243 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:45.413727 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.411180 22868 consensus_queue.cc:260] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:45.415827 22868 raft_consensus.cc:3060] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:05:45.419215 23284 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:05:45.419749 23064 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:45.404821 22969 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:45.422655 23132 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.423568 23012 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.435837 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.436290 23064 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:45.436502 16028 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:45.424207 16030 raft_consensus.cc:1240] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 21. Current term is 22. Ops: [21.17-21.17]
W20260709 13:05:45.439873 16032 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46372 (request call id 1262) took 1655 ms (client timeout 1556 ms). Trace:
I20260709 13:05:45.441555 15247 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
W20260709 13:05:45.424965 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 252741us
I20260709 13:05:45.427542 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.428393 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3780) took 1136 ms. Trace:
W20260709 13:05:45.440337 16032 rpcz_store.cc:269] 0709 13:05:43.783969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.784100 (+   131us) service_pool.cc:224] Handling call
0709 13:05:45.439695 (+1655595us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400550ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:45.439805 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437672704}
I20260709 13:05:45.444437 16029 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:45.432179 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.445523 16027 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:45.445739 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:45.434816 16024 raft_consensus.cc:1240] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 13:05:45.435595 22990 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.444252 15322 rpcz_store.cc:276] 0709 13:05:44.292373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.190631 (+898258us) service_pool.cc:224] Handling call
0709 13:05:45.191008 (+   377us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:45.191408 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.191438 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:05:45.192123 (+   685us) log.cc:844] Serialized 78 byte log entry
0709 13:05:45.333758 (+141635us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:45.333799 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.333898 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.428144 (+ 94246us) raft_consensus.cc:1685] finished
0709 13:05:45.428165 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.428335 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12935,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9168,"thread_start_us":141203,"threads_started":1,"wal-append.queue_time_us":164342}
I20260709 13:05:45.449534 23064 raft_consensus.cc:2804] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:45.454710 23064 raft_consensus.cc:697] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:45.455780 23064 consensus_queue.cc:237] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.459967 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:45.462652 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.462946 15248 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 20: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:45.463392 16024 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:45.467018 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:45.451756 15250 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:45.467684 16027 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:45.471387 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:45.471415 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:45.472681 15242 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:05:45.473193 15242 pending_rounds.cc:85] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 16
I20260709 13:05:45.473510 15242 pending_rounds.cc:107] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:05:45.473337 15397 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:45.473995 15242 raft_consensus.cc:2889] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:45.482491 15246 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
W20260709 13:05:45.478019 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 133221us
I20260709 13:05:45.503734 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:45.504449 16032 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:45.505246 22744 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.507613 22744 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.512066 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:45.512895 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:45.513581 15246 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:45.516631 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:45.517314 15393 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:45.522840 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.523958 16029 raft_consensus.cc:2410] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 28 because replica has last-logged OpId of term: 27 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 13:05:45.520754 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:45.527030 16030 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 22: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:45.526165 15323 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:05:45.528971 16032 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:45.529345 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:45.530578 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.534266 16027 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:45.477128 23084 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:45.540774 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.543666 16028 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:45.553218 16024 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:45.538633 22711 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:45.583287 22711 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.585727 22711 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:45.586319 23127 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:45.592232 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:45.592481 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:45.592964 16028 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:45.593298 16024 raft_consensus.cc:2393] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:45.594149 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.594590 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.595170 16030 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:45.595387 23127 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:45.595839 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:45.596231 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.596580 16027 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 25: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:45.602764 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:45.611613 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:45.616119 15242 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:45.611227 16033 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:05:45.618835 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 292935us
I20260709 13:05:45.620352 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:45.621598 16028 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20.
I20260709 13:05:45.623093 16029 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:45.609105 15214 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:05:45.626258 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 208332us
I20260709 13:05:45.595853 23127 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:45.610100 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:45.613962 23195 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:45.609786 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:45.597586 23084 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.640480 15243 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:45.644506 23242 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:45.639019 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:45.648629 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:45.649576 23207 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:45.602356 23194 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.034s
I20260709 13:05:45.634078 22990 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:05:45.699373 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:45.731104 15323 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:05:45.775928 15247 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:45.666062 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.710095 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:45.777199 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.690783 15249 raft_consensus.cc:2410] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 25 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
W20260709 13:05:45.655740 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 46718.1us
W20260709 13:05:45.680570 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 58627.3us
I20260709 13:05:45.704062 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:45.650131 15246 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:45.779443 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:45.650355 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:45.689702 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:45.780998 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 130696us
I20260709 13:05:45.781591 16024 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:45.666465 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:45.783560 16029 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:45.786813 15243 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:45.802291 15214 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:45.789168 15999 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:45.807235 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:45.808234 15290 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:45.809159 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.814160 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:45.818037 16024 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:45.679430 23196 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.665998 23126 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24.
I20260709 13:05:45.651077 23190 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:05:45.798449 22868 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:45.820333 23242 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:45.667843 23084 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:45.708964 22815 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.839239 22815 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.841697 22815 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:45.652588 22667 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:45.842957 22667 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:45.824980 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 176416us
I20260709 13:05:45.843441 22667 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:45.844378 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:45.825469 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 89464.8us
I20260709 13:05:45.637877 23294 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:45.799401 23204 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.847378 23204 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.850507 15243 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:45.851397 23204 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.688987 23132 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.853384 23132 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.856464 23132 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.810367 23262 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:45.858282 23262 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.861765 23262 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:45.836362 15247 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:45.809077 22981 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.642927 23195 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.857532 23294 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:45.863430 23195 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:45.853570 22667 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:45.863407 22981 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.866645 22981 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.867259 22981 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:45.867643 22981 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:45.868038 22981 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:45.874414 23294 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.875029 23294 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:45.876055 22667 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:45.864305 23132 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:45.878875 23132 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:45.880127 23132 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:45.883953 23281 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.695s	user 0.002s	sys 0.000s
I20260709 13:05:45.824646 23266 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:45.837189 15290 leader_election.cc:400] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24.
I20260709 13:05:45.686129 22744 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.141s
I20260709 13:05:45.885154 22981 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.662945 23127 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 13, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.808796 23077 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.098s
I20260709 13:05:45.908345 23266 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:45.822193 23297 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:45.885478 23207 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:45.819947 23196 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:45.921221 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3867) took 1511 ms. Trace:
I20260709 13:05:45.923422 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2541) took 1118 ms. Trace:
I20260709 13:05:45.943387 15317 rpcz_store.cc:276] 0709 13:05:44.804736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.015716 (+210980us) service_pool.cc:224] Handling call
0709 13:05:45.023871 (+  8155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.024080 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:05:45.043124 (+ 19044us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.873421 (+830297us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b18003e9440. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d522 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:45.922554 (+ 49133us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b18003e9440. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f366d5f23c7 00007f3669c049a7 00007f3669c140bf 00007f3669c14038
0709 13:05:45.922842 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.923054 (+   212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.923104 (+    50us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:05:45.923151 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.923236 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.923356 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5676,"prepare.queue_time_us":21948,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":1375,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":16476,"spinlock_wait_cycles":70806144}
W20260709 13:05:45.932668 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.909371 15290 leader_election.cc:403] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:45.950904 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 113884us
I20260709 13:05:45.956391 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:45.942056 15394 rpcz_store.cc:276] 0709 13:05:44.410005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.417750 (+  7745us) service_pool.cc:224] Handling call
0709 13:05:45.921019 (+1503269us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54000276d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:45.921160 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454797184}
W20260709 13:05:45.935999 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 147423us
I20260709 13:05:45.965304 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:45.920464 22981 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.924525 23179 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:45.975579 23179 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:45.976521 23196 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:45.980491 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:45.981171 15395 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:05:45.919623 22586 raft_consensus.cc:3055] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:45.922724 23266 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:45.939424 23297 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:45.967653 23012 raft_consensus.cc:3060] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:05:45.932680 22925 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:05:46.015892 15394 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:45.913944 22868 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:46.021932 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 211710us
I20260709 13:05:45.991706 23077 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:46.017518 23306 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:05:46.016747 23283 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.832s	user 0.004s	sys 0.000s
W20260709 13:05:45.994998 23302 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:05:46.021549 23026 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:45.973449 23195 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:45.985180 22586 raft_consensus.cc:740] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:46.017338 23167 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.021764 23064 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:46.025558 23163 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:46.041505 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:46.042479 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:46.054296 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:46.038810 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 192241us
I20260709 13:05:46.097342 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3237) took 1129 ms. Trace:
I20260709 13:05:46.099210 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:46.099681 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:46.119419 15396 rpcz_store.cc:276] 0709 13:05:44.968237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.968396 (+   159us) service_pool.cc:224] Handling call
0709 13:05:44.968729 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:44.973781 (+  5052us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:44.999829 (+ 26048us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.179112 (+179283us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b1800273280. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:45.654804 (+475692us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b1800273280. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:05:45.970304 (+315500us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:45.978253 (+  7949us) log.cc:844] Serialized 52 byte log entry
0709 13:05:45.978454 (+   201us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:45.978492 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.978564 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:46.097069 (+118505us) raft_consensus.cc:1685] finished
0709 13:05:46.097094 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.097274 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32791,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":7210,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":31281,"spinlock_wait_cycles":23955584,"thread_start_us":285877,"threads_started":1,"wal-append.queue_time_us":1030910}
W20260709 13:05:46.065775 23211 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.002s	sys 0.019s
W20260709 13:05:46.123692 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 334611us
W20260709 13:05:46.082752 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 280552us
I20260709 13:05:46.117518 22711 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.070422 23167 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.127895 22711 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.129010 15316 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:46.130425 23163 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:46.091661 23302 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:46.130793 23167 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:46.131289 15325 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:46.131763 22711 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:46.124034 15395 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:46.032686 23077 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.135052 23163 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:46.135730 23237 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.136312 23237 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.138806 23237 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:46.138659 23077 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:46.142252 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:46.142406 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 438451us
I20260709 13:05:46.071841 15363 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:46.070645 23298 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:46.156584 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.160682 15317 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:46.161005 15395 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:46.161832 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:46.162707 15317 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:46.164233 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:46.165838 15317 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:46.035064 23026 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:46.126555 23211 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.003s	sys 0.020s
I20260709 13:05:46.165900 15325 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 26.
W20260709 13:05:46.166628 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 94897us
I20260709 13:05:46.172271 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:46.172720 15363 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:46.167695 15398 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:46.157501 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.169198 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:46.174073 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2537) took 1411 ms. Trace:
I20260709 13:05:46.181722 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:46.182523 16029 raft_consensus.cc:2376] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19. Re-sending same reply.
I20260709 13:05:46.176643 15318 rpcz_store.cc:276] 0709 13:05:44.763016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.009532 (+246516us) service_pool.cc:224] Handling call
0709 13:05:45.019199 (+  9667us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:45.019612 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.019641 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:45.023039 (+  3398us) log.cc:844] Serialized 52 byte log entry
0709 13:05:45.101819 (+ 78780us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:45.883295 (+781476us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:46.160059 (+276764us) log.cc:844] Serialized 14 byte log entry
0709 13:05:46.160488 (+   429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.160617 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:46.160685 (+    68us) raft_consensus.cc:1685] finished
0709 13:05:46.173852 (+ 13167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.174018 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":821966,"prepare.queue_time_us":876793,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":11979,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3918,"spinlock_wait_cycles":35759488,"thread_start_us":251927,"threads_started":2,"wal-append.queue_time_us":98268}
I20260709 13:05:46.172911 23315 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:46.176076 23246 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:46.171018 23189 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:05:46.171770 22711 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:46.184633 23316 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:46.194415 22711 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.184489 23318 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:46.196071 23318 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:46.197016 23318 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.195122 23316 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:46.199335 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:46.184870 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:46.204478 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:46.204943 15322 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:46.201136 16029 raft_consensus.cc:1240] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:46.090515 23064 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.203680 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:46.158478 23163 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:46.206100 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.208496 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:46.204627 15317 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:46.209741 15363 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:46.215607 15390 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 18.
I20260709 13:05:46.215708 15325 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:46.210996 15250 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:05:46.213248 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:46.178012 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:46.095865 23294 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.216787 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:46.212030 15395 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
W20260709 13:05:46.227526 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 49519.1us
I20260709 13:05:46.228371 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:46.191872 23310 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:46.231743 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:46.191202 23305 log.cc:927] Time spent T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:05:46.233026 15394 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:46.233127 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.232717 23139 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:46.244721 23139 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:46.245169 23139 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:46.237010 15317 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:46.198256 22711 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:46.190552 23246 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.238758 15323 raft_consensus.cc:1275] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:05:46.239405 23315 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:46.240701 23179 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.262593 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.263859 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.264499 15392 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:46.265336 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.242998 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:46.266690 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.268036 15365 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:46.269871 22815 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:46.270298 22815 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:46.270694 22815 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:46.251957 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:46.268057 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.276813 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.282526 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.093324 23297 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.246502 22952 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:46.252663 15396 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:46.253348 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:46.284694 23126 raft_consensus.cc:2804] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:46.284904 23308 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:46.285290 23126 raft_consensus.cc:697] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:46.190726 23026 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:46.256409 23317 consensus_queue.cc:1048] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:05:46.282650 22868 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:46.283581 22952 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:46.286288 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.299180 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.299919 15392 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:46.301030 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.302983 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.303725 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.305902 15392 raft_consensus.cc:2393] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:46.231794 23163 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.307338 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.289626 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.292634 23132 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.309443 15392 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:46.154966 22586 consensus_queue.cc:260] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.294185 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:46.288789 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.254817 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:46.295099 23315 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:46.312901 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:46.287250 23246 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:46.324324 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 69702.5us
I20260709 13:05:46.293053 23195 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:46.321257 23126 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.318926 15396 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:05:46.325757 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.341656 15390 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:46.285524 23308 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.326553 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:46.339730 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:46.329064 15393 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:05:46.351048 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:46.354266 15215 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:46.356931 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:46.338569 23077 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:46.308075 23266 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.339318 23313 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:46.320073 23288 consensus_queue.cc:1059] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 16, Time since last communication: 0.040s
W20260709 13:05:46.357849 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 88437.4us
I20260709 13:05:46.361984 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:46.353186 23195 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:46.383059 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:46.384137 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:46.391062 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 44519.9us
I20260709 13:05:46.392086 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:46.320783 23132 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.348148 23194 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:05:46.358332 22667 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:46.394682 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:46.361806 23074 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:46.317090 23316 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.369268 23313 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:46.357224 23203 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:05:46.401803 15250 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:46.360847 23202 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:05:46.405222 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:46.415412 16028 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:46.397384 23178 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:46.400781 23074 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:46.394073 23242 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:05:46.395527 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 76062.7us
I20260709 13:05:46.419982 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:46.410755 23313 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:05:46.426983 23323 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:05:46.427585 23322 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:05:46.436160 16029 raft_consensus.cc:1240] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:46.358353 22952 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.400478 22667 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:46.450894 16028 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:46.452292 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:05:46.449287 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92401.6us
I20260709 13:05:46.438503 23317 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.455616 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:46.438205 23064 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:46.446841 23294 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:46.453370 22667 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:46.474283 23311 log.cc:927] Time spent T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 13:05:46.477505 23300 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.799s	user 0.004s	sys 0.000s
I20260709 13:05:46.479543 23132 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:46.480700 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:46.481242 22586 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:46.482079 23139 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.484321 23139 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:46.485085 23179 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:46.486243 23012 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24.
I20260709 13:05:46.491364 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:46.491617 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:46.496392 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:46.468827 23195 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:05:46.490947 23332 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:05:46.453438 22711 consensus_queue.cc:1059] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.035s
I20260709 13:05:46.499696 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:46.469678 23342 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:46.403264 23315 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:46.516448 23312 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.302s	user 0.000s	sys 0.002s
W20260709 13:05:46.519017 23330 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:05:46.504693 23195 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.530910 23343 raft_consensus.cc:3055] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:46.531551 23343 raft_consensus.cc:740] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:46.532507 23343 consensus_queue.cc:260] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.531014 23195 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:46.500442 23139 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:46.468029 23317 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.526461 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:46.540987 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:46.536965 22981 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:46.543287 23132 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:46.543740 23132 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.544124 23132 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:46.547991 15318 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:46.550593 23266 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:46.508090 23308 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:46.552490 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:46.553004 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.527451 23342 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:46.494287 23074 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.537413 22815 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.574476 22815 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:46.579023 23246 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.581460 23246 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:46.569546 22981 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:46.582917 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:46.583562 23317 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:46.587743 15249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 3358) took 1814 ms. Trace:
I20260709 13:05:46.588176 15249 rpcz_store.cc:276] 0709 13:05:44.773090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.784221 (+ 11131us) service_pool.cc:224] Handling call
0709 13:05:46.587509 (+1803288us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54001a7cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:46.587675 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2081648384}
I20260709 13:05:46.568598 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:46.590843 22667 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.591476 15244 raft_consensus.cc:1275] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 13:05:46.591877 15244 pending_rounds.cc:85] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 17
I20260709 13:05:46.592123 15244 pending_rounds.cc:107] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 13:05:46.592356 15244 raft_consensus.cc:2889] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:46.594136 15244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1011) took 1198 ms. Trace:
I20260709 13:05:46.594543 15244 rpcz_store.cc:276] 0709 13:05:45.396036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.402381 (+  6345us) service_pool.cc:224] Handling call
0709 13:05:46.591118 (+1188737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:46.592777 (+  1659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.593922 (+  1145us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001a7cd0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:46.594075 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2732981760}
I20260709 13:05:46.583577 16030 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:46.602880 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.604399 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.604992 15393 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:46.613577 15244 raft_consensus.cc:1240] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:46.615110 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 92043.1us
I20260709 13:05:46.589838 23195 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.601872 23139 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:46.643863 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:46.644969 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:46.601723 23343 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:46.594107 22667 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:46.646435 23139 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.646865 22815 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:46.662292 15393 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 19.
I20260709 13:05:46.656644 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:46.663190 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:46.663754 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:46.665484 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3239) took 1196 ms. Trace:
I20260709 13:05:46.666059 15391 rpcz_store.cc:276] 0709 13:05:45.469322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.501603 (+ 32281us) service_pool.cc:224] Handling call
0709 13:05:45.502065 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.668377 (+166312us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:45.690285 (+ 21908us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.983248 (+292963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.983326 (+    78us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:45.983400 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.515826 (+532426us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:46.665251 (+149425us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54001dae54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:46.665304 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.665420 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29676,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":1095,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13697,"spinlock_wait_cycles":413302912,"thread_start_us":292500,"threads_started":1,"wal-append.queue_time_us":481115}
I20260709 13:05:46.672188 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.673036 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:46.674870 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:46.677002 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.682487 15248 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:46.685451 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:46.686480 22586 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:05:46.686825 23338 consensus_queue.cc:1059] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:46.687752 23319 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:46.687886 23314 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:46.688407 23314 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:46.688606 23319 raft_consensus.cc:3055] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:46.689003 23319 raft_consensus.cc:740] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:46.689283 23314 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.690730 23314 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:46.689841 23319 consensus_queue.cc:260] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.656839 23139 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:46.707348 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:46.647049 23340 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:05:46.667903 22667 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:46.712292 16024 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:05:46.684271 23318 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:46.684101 22952 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:46.685223 23266 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:05:46.782764 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.654929 23342 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.693653 23194 consensus_queue.cc:1048] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.150s
I20260709 13:05:46.668149 22815 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.851787 15392 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:05:46.860801 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.789729 22667 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:46.871722 15394 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 26.
I20260709 13:05:46.875509 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.856559 23319 raft_consensus.cc:3060] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:46.882494 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:46.883170 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49055.9us
I20260709 13:05:46.859807 23026 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:46.862561 23021 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:46.846778 23242 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:05:46.843562 23315 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.046s
I20260709 13:05:46.906996 16030 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:46.904986 23315 consensus_queue.cc:1243] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 21.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:05:46.910852 23163 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:46.914636 23299 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.236s	user 0.004s	sys 0.000s
W20260709 13:05:46.916875 23351 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:46.922987 23195 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:46.899561 23190 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:46.926534 23190 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:46.897909 22744 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:46.893215 22969 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:05:46.939595 23190 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:46.950220 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.896520 23021 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.891970 23026 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.930459 22667 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:46.961704 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:46.963723 15390 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:46.967144 22711 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:46.967921 23288 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:46.990959 15244 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:05:46.992337 15249 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:05:46.947031 22744 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.004855 23361 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:05:47.006712 15363 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:47.011255 15390 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:47.013358 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:47.015704 23318 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:47.017143 23318 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:47.018653 23363 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:47.018389 23318 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:47.023355 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 140928us
W20260709 13:05:47.035290 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 67764.3us
I20260709 13:05:47.021176 23266 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:47.027143 23288 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:47.059640 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:47.019222 23363 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:47.063280 23235 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.016s	sys 0.033s
W20260709 13:05:47.071903 23235 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.016s	sys 0.034s
I20260709 13:05:47.070547 23266 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.076751 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:47.055080 23313 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.006s
I20260709 13:05:47.047747 22815 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:47.063010 23132 consensus_meta.cc:287] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.518s	user 0.009s	sys 0.004s
I20260709 13:05:47.090195 15362 leader_election.cc:400] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 16 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 16. Current term is 17.
I20260709 13:05:47.060055 23202 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.060715 22586 consensus_queue.cc:1048] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:05:47.094480 23202 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.096946 23202 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:47.099123 23301 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.422s	user 0.010s	sys 0.000s
I20260709 13:05:47.103994 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:47.103770 23132 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.104796 15392 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:47.105980 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3245) took 1602 ms. Trace:
I20260709 13:05:47.089672 23313 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.106453 15397 rpcz_store.cc:276] 0709 13:05:45.504044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.508727 (+  4683us) service_pool.cc:224] Handling call
0709 13:05:45.509087 (+   360us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:45.509522 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.509558 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:45.510143 (+   585us) log.cc:844] Serialized 52 byte log entry
0709 13:05:45.698123 (+187980us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:45.700686 (+  2563us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.701183 (+   497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.701290 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:46.594526 (+893236us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b180000f7c0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:47.098511 (+503985us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:47.105740 (+  7229us) raft_consensus.cc:1685] finished
0709 13:05:47.105764 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.105919 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2243,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":1443,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":4663,"spinlock_wait_cycles":112944896,"thread_start_us":187470,"threads_started":1,"wal-append.queue_time_us":166937}
I20260709 13:05:47.120504 23363 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.092571 23368 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:47.117643 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:47.131050 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.090576 23288 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:47.135253 22744 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.135460 23288 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.136233 23026 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.136963 23021 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.137820 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:47.138444 15393 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:05:47.142670 23303 log.cc:927] Time spent T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.456s	user 0.001s	sys 0.002s
I20260709 13:05:47.145920 22979 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:47.146636 22979 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.149011 22979 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:47.149299 23132 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:47.137080 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.150204 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.151176 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:47.151829 15397 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:47.132664 23202 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:47.156081 15393 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 26.
I20260709 13:05:47.157233 15246 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:47.162178 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.163641 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.176852 15316 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 25: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:47.165480 15322 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:05:47.167688 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.177459 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:47.178483 16027 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 19: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:47.178763 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:47.178412 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:47.173405 16033 raft_consensus.cc:1217] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Deduplicated request from leader. Original: 19.16->[20.17-24.19]   Dedup: 20.17->[22.18-24.19]
I20260709 13:05:47.179559 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:47.180071 16033 pending_rounds.cc:85] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 17
I20260709 13:05:47.179708 16029 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:47.180562 16033 pending_rounds.cc:107] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 21.18
I20260709 13:05:47.180310 16028 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 19.
I20260709 13:05:47.180904 16033 raft_consensus.cc:2889] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:47.181839 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.177518 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:47.179665 15246 raft_consensus.cc:2410] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 26 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 13:05:47.172307 16030 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:05:47.114979 23313 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.186565 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.191520 15316 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:47.092800 23139 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.186637 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.192768 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.186975 16024 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:47.149655 22979 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:47.188083 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.132814 23246 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:47.188835 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.175170 23021 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.175665 23294 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.192070 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:47.187048 15323 raft_consensus.cc:2393] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 21: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:47.194576 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.221108 15325 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:47.189755 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:47.222254 15250 raft_consensus.cc:2368] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:47.194006 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.181715 23266 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.198628 15322 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:47.201325 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.153713 23368 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:47.181185 23202 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:47.190955 23343 consensus_meta.cc:287] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.007s
I20260709 13:05:47.189368 15397 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:47.174188 23243 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:47.172051 23026 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:47.188253 15242 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:05:47.223245 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:47.228744 15316 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 25: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:47.229198 15318 raft_consensus.cc:2368] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21.
I20260709 13:05:47.229997 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:47.232982 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.241798 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:47.244040 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 88076.1us
I20260709 13:05:47.248288 15317 raft_consensus.cc:2468] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:47.248524 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:47.269646 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.196650 23315 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.046s
W20260709 13:05:47.272192 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.275100 15362 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:47.238976 23202 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:47.279731 23261 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:05:47.281615 23288 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:47.278188 15391 raft_consensus.cc:2468] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:47.286628 15289 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:47.218622 22979 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.222000 23246 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.279498 23371 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:05:47.226377 23021 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.226593 23294 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.277325 23027 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:47.275959 23365 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:47.279342 23343 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:05:47.269570 23243 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.266754 23026 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.289090 23288 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:47.282261 23178 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.096s
I20260709 13:05:47.338529 23179 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:47.392210 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.403877 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 117318us
W20260709 13:05:47.405166 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.389240 23027 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:47.407007 15321 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:47.410048 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.410575 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.410904 15317 raft_consensus.cc:2393] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:47.411263 15316 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 20.
I20260709 13:05:47.389513 23288 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:47.412213 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.412956 16024 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:05:47.413334 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.392290 23161 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:47.417817 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 1169) took 1156 ms. Trace:
I20260709 13:05:47.418218 15394 rpcz_store.cc:276] 0709 13:05:46.261281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.276534 (+ 15253us) service_pool.cc:224] Handling call
0709 13:05:47.417676 (+1141142us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54001955d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:47.417769 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892045696}
I20260709 13:05:47.419888 15317 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:05:47.394665 23179 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:47.427502 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 152459us
I20260709 13:05:47.429402 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:47.431684 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:47.434790 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:47.436538 23084 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:47.437093 23084 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:47.437615 23084 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:47.439427 23314 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.440050 23314 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.447768 16024 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:05:47.453246 23314 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:47.453877 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:47.453879 22952 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:05:47.423791 23179 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:47.428836 23178 consensus_queue.cc:1243] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:05:47.387055 23365 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.466786 23371 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:47.432592 23269 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:47.489600 22979 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:47.490166 23374 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
W20260709 13:05:47.491303 23380 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:47.429579 23261 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:05:47.493332 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:47.471930 23139 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.497085 15320 raft_consensus.cc:1217] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Deduplicated request from leader. Original: 16.9->[19.10-19.10]   Dedup: 19.10->[]
I20260709 13:05:47.501430 15320 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:05:47.403462 23368 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.510700 23365 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.512555 23261 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:47.513082 23261 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:05:47.522408 23373 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:05:47.522056 23288 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.525178 23288 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:47.494501 23370 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 13:05:47.528717 23293 log.cc:927] Time spent T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.839s	user 0.014s	sys 0.010s
I20260709 13:05:47.532377 23026 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.533560 23021 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:47.539181 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:47.541523 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:47.542421 16029 raft_consensus.cc:2376] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 20. Re-sending same reply.
I20260709 13:05:47.487839 23371 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:47.479862 23027 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.582751 23243 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.577840 23371 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:47.508016 22667 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.609714 15241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3375) took 2293 ms. Trace:
W20260709 13:05:47.597802 23372 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:05:47.610186 15241 rpcz_store.cc:276] 0709 13:05:45.316025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.321808 (+  5783us) service_pool.cc:224] Handling call
0709 13:05:45.324900 (+  3092us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:45.327921 (+  3021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.327965 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:45.335878 (+  7913us) log.cc:844] Serialized 52 byte log entry
0709 13:05:45.475405 (+139527us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:45.521360 (+ 45955us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.552108 (+ 30748us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.602210 (+ 50102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.602319 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.874623 (+272304us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b18004880e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:46.548064 (+673441us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b18004880e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:47.527910 (+979846us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:47.609464 (+ 81554us) raft_consensus.cc:1685] finished
0709 13:05:47.609485 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.609648 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25334,"prepare.queue_time_us":134940,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":50203,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":5652,"spinlock_wait_cycles":60514816,"thread_start_us":139166,"threads_started":1,"wal-append.queue_time_us":290915}
I20260709 13:05:47.626143 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:47.627097 23202 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.628959 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:47.629390 23202 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.630170 15244 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:47.631398 23246 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:47.634745 23371 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.637240 23371 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:47.641549 23261 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.665308 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:47.666050 15393 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:47.666373 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 1176) took 1048 ms. Trace:
I20260709 13:05:47.666777 15391 rpcz_store.cc:276] 0709 13:05:46.617863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.676650 (+ 58787us) service_pool.cc:224] Handling call
0709 13:05:47.649655 (+973005us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b540026ff54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:47.666313 (+ 16658us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300037888}
I20260709 13:05:47.667423 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:47.668517 15399 raft_consensus.cc:2410] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:05:47.669019 23338 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.669516 23338 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:47.671053 23376 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.282s	user 0.002s	sys 0.000s
I20260709 13:05:47.673460 23338 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:47.681639 23266 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:47.690313 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:47.694860 15998 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:05:47.700821 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.688905 23202 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:47.677019 22982 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:47.675413 23235 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:47.692874 23194 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.711752 23202 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.728765 23242 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.724862 23235 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.608958 22667 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.700459 23294 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.713439 22982 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:47.703456 23266 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:47.702785 23362 raft_consensus.cc:2804] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:47.713712 23261 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:47.677800 23084 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.786408 15321 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:47.787575 15316 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:05:47.787566 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.812631 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.779223 23266 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:47.747539 23194 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.818058 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.819307 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.747121 23179 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.816258 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.830621 15316 raft_consensus.cc:2410] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 22 because replica has last-logged OpId of term: 21 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:05:47.824379 15325 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:47.753325 23242 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.831758 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.828811 15321 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:05:47.832438 15317 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
W20260709 13:05:47.830624 23196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.706s	user 0.017s	sys 0.021s
W20260709 13:05:47.833473 23196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.714s	user 0.017s	sys 0.021s
I20260709 13:05:47.836159 23179 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:47.837620 23393 log.cc:927] Time spent T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:05:47.841706 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:47.843720 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.844758 23166 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:47.845443 23166 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.845916 22667 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.811192 22744 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.847406 22744 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.849855 22744 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:47.844812 23377 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.434s	user 0.000s	sys 0.000s
I20260709 13:05:47.846166 23132 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:47.852393 23132 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.854771 23132 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.855239 23202 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:47.856206 15390 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:47.857580 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.858191 15321 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:47.858752 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.860121 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.787577 23362 raft_consensus.cc:697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:47.862677 15319 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:05:47.863489 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:47.868731 16024 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 23: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:47.864091 15322 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:47.864807 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:47.866397 15325 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:47.873940 15321 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:47.876024 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:47.876914 23331 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 1.521s	user 0.003s	sys 0.000s
W20260709 13:05:47.846276 23379 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.441s	user 0.000s	sys 0.002s
I20260709 13:05:47.880795 23242 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.882609 23194 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:47.823330 23266 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:47.915912 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.916805 15318 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:47.884027 23132 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:47.887320 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.921188 15325 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:05:47.886217 15319 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:47.887722 16028 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:05:47.888249 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:47.889935 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:47.924608 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:47.890290 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.892374 23163 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:47.893982 23392 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:47.887710 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.890982 23318 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:47.893339 15362 leader_election.cc:400] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21.
I20260709 13:05:47.931388 15362 leader_election.cc:403] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:47.901324 23235 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.902693 23362 consensus_queue.cc:237] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.903860 23084 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:47.943286 15245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1016) took 1731 ms. Trace:
I20260709 13:05:47.943761 15245 rpcz_store.cc:276] 0709 13:05:46.211831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.211955 (+   124us) service_pool.cc:224] Handling call
0709 13:05:46.212262 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:46.212638 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:46.212667 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:46.213109 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:05:46.290542 (+ 77433us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:05:46.290593 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.290666 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:47.876317 (+1585651us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:47.938517 (+ 62200us) raft_consensus.cc:1685] finished
0709 13:05:47.938541 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.943211 (+  4670us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":577,"raft.queue_time_us":1295,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6634,"spinlock_wait_cycles":15980800,"thread_start_us":77124,"threads_started":1,"wal-append.queue_time_us":103000}
I20260709 13:05:47.909879 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:47.945961 15391 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:47.926146 15213 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:47.947842 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
W20260709 13:05:47.951399 23348 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.258s	user 0.006s	sys 0.000s
I20260709 13:05:47.955991 22981 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:05:47.956835 22981 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:47.957214 22981 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.957620 22981 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:47.932168 23392 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.899107 23127 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:47.959765 23392 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:47.962404 22667 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:47.963521 22667 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:47.965633 15244 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:47.966892 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:47.967082 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:47.930877 23202 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:05:47.967943 15243 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:47.968391 23202 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 26 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:47.969352 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:47.970352 15248 raft_consensus.cc:2393] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:47.936780 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:47.930787 23243 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:47.931015 23132 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.942406 23242 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.972151 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:47.971114 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:47.973170 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:47.974270 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.974747 15318 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:47.980353 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:47.971092 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:47.981734 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 45075.8us
I20260709 13:05:47.934454 23262 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21.
I20260709 13:05:47.985730 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:47.864415 22982 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.015177 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:48.029877 15317 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:48.031037 15325 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:05:48.032382 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:48.033754 15318 raft_consensus.cc:2410] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 26 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
W20260709 13:05:48.045783 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 73709.5us
I20260709 13:05:48.048786 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:48.050082 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 79071.3us
I20260709 13:05:48.051505 23317 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:48.052047 23317 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.013190 22981 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.052443 23317 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:47.965660 22667 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:48.056532 22667 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:48.058316 23234 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.058859 23234 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.058101 23139 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:48.060408 15395 raft_consensus.cc:2410] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 26 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 14.
I20260709 13:05:48.060743 15245 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
I20260709 13:05:47.980937 23392 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.931022 23163 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:47.980687 23243 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:48.014699 23077 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:48.023243 22586 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:48.070703 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:48.009311 23235 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:48.048695 23204 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:48.078615 15291 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:48.065255 22981 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:47.969308 23202 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.074348 22586 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:48.070461 22982 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:48.058045 23266 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:48.092108 16033 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.019s
I20260709 13:05:48.072916 23243 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:48.044538 23242 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.091691 15291 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:48.067902 23189 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.026s
I20260709 13:05:48.080879 22990 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:05:48.095588 16033 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.000s	sys 0.020s
I20260709 13:05:48.097960 23179 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:48.100450 23266 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:48.101397 23163 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:48.102916 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:48.104969 23132 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:48.070043 23392 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.088935 22744 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:48.093432 22586 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:48.146641 23389 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:05:48.154588 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:48.161528 15249 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:48.115754 15291 leader_election.cc:400] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:48.163951 15243 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:48.077108 23077 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.190969 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:48.191056 22586 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.191519 23317 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.137092 23392 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:48.143334 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3907) took 1154 ms. Trace:
I20260709 13:05:48.193492 22586 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:48.192696 15396 rpcz_store.cc:276] 0709 13:05:46.988845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.989038 (+   193us) service_pool.cc:224] Handling call
0709 13:05:46.989409 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:46.989694 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:47.003449 (+ 13755us) log.cc:844] Serialized 14 byte log entry
0709 13:05:47.003909 (+   460us) log.cc:844] Serialized 14 byte log entry
0709 13:05:48.133765 (+1129856us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b18004cfea0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:48.142691 (+  8926us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b18004cfea0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f36697b0d70 00007f36697a4293 00007f3669799cea 00007f366979a23a 00007f3669c04a2a 00007f3669c140bf 00007f3669c14038
0709 13:05:48.142951 (+   260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:48.143005 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:48.143048 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.143115 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.143269 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19006,"prepare.queue_time_us":87155,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":22159,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"spinlock_wait_cycles":15526144}
I20260709 13:05:48.193773 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:48.194581 15248 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 26: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:48.194773 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:48.195405 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:48.195818 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:48.196700 15396 raft_consensus.cc:2393] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 23: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:48.170567 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:48.197219 15398 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:48.197511 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:48.164093 15291 leader_election.cc:403] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:48.198918 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 84937.3us
I20260709 13:05:48.200083 23297 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:48.200474 15291 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:48.194593 15393 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:48.202967 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:48.183519 23242 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:48.185631 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:48.191902 15244 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:48.083005 23235 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.196511 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:48.210409 15392 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:48.203068 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:48.216190 15243 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 23: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:48.216312 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:48.216991 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:48.218555 15390 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:48.219076 16026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:48.217569 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:48.219792 15390 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:48.220104 15397 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:48.221611 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:48.172983 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:48.219080 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:48.222573 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 49740.1us
I20260709 13:05:48.223119 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:48.225890 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:48.227521 15392 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:48.228807 15392 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:48.223280 15215 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:48.230844 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:48.239172 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:48.211786 15396 raft_consensus.cc:2410] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:05:48.212877 15391 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:05:48.179710 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:48.214422 16024 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:05:48.215343 15248 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
W20260709 13:05:48.096565 23190 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.003s	sys 0.010s
I20260709 13:05:48.208828 15398 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 26.
I20260709 13:05:48.224673 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:48.319510 15244 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 23: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:48.309291 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 83465us
I20260709 13:05:48.215438 22979 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:05:48.311195 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 89168.5us
W20260709 13:05:48.313892 15395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3884) took 2056 ms (client timeout 1696 ms). Trace:
I20260709 13:05:48.191269 23077 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:48.217569 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:48.365687 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 44420.4us
I20260709 13:05:48.242856 16030 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:05:48.240280 15291 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:48.223826 22744 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:05:48.370937 23392 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:48.323815 15397 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:48.319684 23340 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:05:48.321399 23190 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.008s	sys 0.011s
I20260709 13:05:48.285141 22981 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:05:48.368575 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 128377us
W20260709 13:05:48.323240 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.331143 23343 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:48.239004 23298 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.128s
I20260709 13:05:48.358978 23316 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:48.309170 22915 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.371407 23392 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:48.396590 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 349263us
W20260709 13:05:48.377527 15395 rpcz_store.cc:269] 0709 13:05:46.257608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.289248 (+ 31640us) service_pool.cc:224] Handling call
0709 13:05:48.313577 (+2024329us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54000280d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:48.313787 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4015731072}
W20260709 13:05:48.352649 15996 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.751s (SENT) [suppressed 9 similar messages]
I20260709 13:05:48.400990 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:48.202369 23243 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.244065 23315 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:48.417304 23315 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:48.418522 23315 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.238819 23132 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:05:48.379088 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 136952us
W20260709 13:05:48.383284 15323 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.007s	sys 0.008s
W20260709 13:05:48.424157 15323 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.007s	sys 0.009s
I20260709 13:05:48.403919 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:48.325531 23297 consensus_queue.cc:1059] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:05:48.416507 23243 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:48.423480 23343 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:48.365777 23262 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:05:48.427021 23343 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:48.433069 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 316869us
W20260709 13:05:48.440356 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46120.8us
I20260709 13:05:48.390954 23196 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:48.455957 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:48.455847 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 54912.7us
I20260709 13:05:48.459059 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:48.400765 23392 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:48.465438 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:48.391672 23266 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.466279 15244 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:48.386288 23021 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:05:48.468688 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:48.383713 23319 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:05:48.479080 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:48.413561 23340 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:48.465090 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:48.434562 23362 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.392077 23344 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.072s
I20260709 13:05:48.398039 22915 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.479808 23246 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:48.439790 23161 consensus_queue.cc:1059] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:05:48.391660 23126 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:05:48.397737 23316 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.470638 23261 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:48.482661 23342 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:48.488653 23389 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:48.502739 23246 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.468148 23338 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
W20260709 13:05:48.510044 23308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.024s	sys 0.035s
I20260709 13:05:48.468048 23196 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.478072 23266 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.535477 23317 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:48.517488 23163 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:05:48.539335 23405 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:05:48.511276 23261 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:48.544173 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3812) took 1135 ms. Trace:
I20260709 13:05:48.525727 23161 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:48.532155 23246 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:48.549539 23161 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.551994 23161 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:48.554586 23161 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:48.555332 23161 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.559744 23161 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:48.562491 23340 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.564255 23266 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:48.567615 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:48.541105 23389 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:48.571377 23389 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.488188 23362 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.576529 23362 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:48.510156 23337 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:05:48.524121 23342 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:48.546934 15324 rpcz_store.cc:276] 0709 13:05:47.409193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.409352 (+   159us) service_pool.cc:224] Handling call
0709 13:05:47.674422 (+265070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.674683 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:47.675061 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 13:05:47.985484 (+310423us) log.cc:844] Serialized 14 byte log entry
0709 13:05:48.010326 (+ 24842us) log.cc:844] Serialized 14 byte log entry
0709 13:05:48.010500 (+   174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:48.010547 (+    47us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:48.010591 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.010660 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.532791 (+522131us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54001e5ad0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf98ad 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:48.544083 (+ 11292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28926,"prepare.queue_time_us":1000,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":108,"raft.queue_time_us":55585,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":212,"spinlock_wait_cycles":576277760,"thread_start_us":305011,"threads_started":1,"wal-append.queue_time_us":437130}
W20260709 13:05:48.536579 23308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.025s	sys 0.035s
I20260709 13:05:48.505751 23368 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:05:48.546510 23261 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:48.583096 23235 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:48.591919 23342 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:48.660602 23196 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:48.671433 23235 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.660879 23202 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:48.689621 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 336997us
W20260709 13:05:48.718099 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 294512us
I20260709 13:05:48.719470 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:48.718338 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 237724us
I20260709 13:05:48.728158 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:48.730605 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:48.731600 15323 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:48.734553 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:48.721480 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:48.740718 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:48.742499 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 338641us
I20260709 13:05:48.743383 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:48.760882 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:48.741324 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:48.766197 15324 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:05:48.764688 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:48.720127 23297 consensus_queue.cc:1243] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:05:48.772464 15246 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 26. Current term is 27. Ops: []
I20260709 13:05:48.724088 23074 raft_consensus.cc:3060] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:48.777666 15245 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:05:48.723395 23132 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 26 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:48.765344 23318 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:05:48.773648 23391 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:05:48.782508 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 317805us
I20260709 13:05:48.783001 23338 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:48.765749 23362 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:48.773901 23316 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:48.715571 23202 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.792964 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:48.774809 23084 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.712587 23235 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.781080 23297 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:48.765575 23409 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:05:48.789436 23318 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:48.805539 23077 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:48.814435 23297 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:48.847891 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 55071.6us
I20260709 13:05:48.802775 23196 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:05:48.839111 23318 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:48.870569 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:48.805708 23338 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:48.844003 23077 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:48.899139 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 186741us
I20260709 13:05:48.845587 23204 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:48.902472 16033 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 1223) took 1750 ms. Trace:
W20260709 13:05:48.902761 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 102683us
I20260709 13:05:48.832309 23084 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:48.910513 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:48.873759 23344 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.874583 23297 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:48.909631 16033 rpcz_store.cc:276] 0709 13:05:47.152165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.153107 (+   942us) service_pool.cc:224] Handling call
0709 13:05:47.173127 (+ 20020us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:47.195737 (+ 22610us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:05:47.218990 (+ 23253us) log.cc:844] Serialized 14 byte log entry
0709 13:05:47.533705 (+314715us) spinlock_profiling.cc:243] Waited 9.01 ms on lock 0x7b1800363880. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:05:47.895077 (+361372us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b1800363880. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d522 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:48.601350 (+706273us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:48.603463 (+  2113us) log.cc:844] Serialized 52 byte log entry
0709 13:05:48.603869 (+   406us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:05:48.899279 (+295410us) log.cc:844] Serialized 14 byte log entry
0709 13:05:48.901625 (+  2346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.901863 (+   238us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:48.902130 (+   267us) raft_consensus.cc:1685] finished
0709 13:05:48.902147 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.902382 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8351,"prepare.queue_time_us":22894,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3618,"raft.queue_time_us":22072,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":51070,"spinlock_wait_cycles":26629248,"thread_start_us":1342569,"threads_started":3,"wal-append.queue_time_us":963740}
I20260709 13:05:48.921346 15395 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:05:48.926009 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:48.969206 16032 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:48.908761 23127 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:48.907423 23266 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:48.915356 23163 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:05:48.974860 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 45775.5us
I20260709 13:05:48.985400 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:48.907320 23077 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:48.977865 15319 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:05:48.992583 15319 pending_rounds.cc:85] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 14
I20260709 13:05:48.992933 15319 pending_rounds.cc:107] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:05:48.993237 15319 raft_consensus.cc:2889] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:48.978724 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:48.848605 23409 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:05:48.987465 15395 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:49.006790 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.008019 15397 raft_consensus.cc:1275] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:05:49.008440 15397 pending_rounds.cc:85] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 8
I20260709 13:05:49.010421 15397 pending_rounds.cc:107] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:05:49.009522 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.010735 15397 raft_consensus.cc:2889] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:48.985201 23403 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
I20260709 13:05:48.901732 23419 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.096s
I20260709 13:05:49.012720 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.014945 15397 raft_consensus.cc:2368] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:48.874738 23132 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:48.990998 23400 log.cc:927] Time spent T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:05:48.922286 23315 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.088s
I20260709 13:05:48.990733 23204 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:49.031467 23204 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:49.007979 23424 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:48.967831 23344 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.052237 23344 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:49.021745 23196 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 13:05:49.026351 23415 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:05:49.053807 23338 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:49.027731 23234 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:49.028695 23416 log.cc:927] Time spent T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 13:05:49.019062 23139 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:49.035475 23235 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:49.054600 23425 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:49.038532 23202 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:49.055141 23139 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:49.016814 23428 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:49.055812 23428 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:49.055392 23425 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.056257 23139 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.056839 23428 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.057928 23428 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:49.010152 23266 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.058605 23425 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:49.060729 23266 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:49.041836 23179 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Stepping down as leader of term 25
W20260709 13:05:49.027233 23431 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:49.054023 22990 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:48.998086 23163 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:49.037753 23410 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
W20260709 13:05:49.033077 23413 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260709 13:05:49.040832 23392 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.001s
I20260709 13:05:49.050127 23424 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.053298 23084 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:49.064765 23074 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:49.063303 23179 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:49.032416 23204 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.074985 23163 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:49.080720 23399 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:05:49.085862 23246 consensus_meta.cc:287] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.536s	user 0.003s	sys 0.009s
I20260709 13:05:49.082871 23392 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.099035 23399 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:49.116966 23399 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.118398 23399 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:49.120710 23412 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.311s	user 0.000s	sys 0.003s
I20260709 13:05:49.118184 23392 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:49.125485 23434 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.103s	user 0.000s	sys 0.002s
W20260709 13:05:49.167899 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 386881us
I20260709 13:05:49.164480 15140 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 15 to 18, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 18 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:49.183056 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.183199 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:49.184093 15140 catalog_manager.cc:5697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 8 to 19. New cstate: current_term: 19 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.189185 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:49.189493 15399 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 3882) took 2958 ms (client timeout 2021 ms). Trace:
I20260709 13:05:49.195462 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.196462 15397 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:05:49.195875 15399 rpcz_store.cc:269] 0709 13:05:46.231238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.231482 (+   244us) service_pool.cc:224] Handling call
0709 13:05:49.188802 (+2957320us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003296d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:49.189153 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3254350080}
I20260709 13:05:49.196938 15396 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:49.190050 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:49.190793 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 423244us
I20260709 13:05:49.191820 15320 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3783) took 4740 ms. Trace:
I20260709 13:05:49.194610 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.199069 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.199425 15320 rpcz_store.cc:276] 0709 13:05:44.451200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.714872 (+263672us) service_pool.cc:224] Handling call
0709 13:05:44.715260 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:47.501913 (+2786653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.781146 (+1279233us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b54003b77a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfda02 00007f3669bf9dd6 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:05:49.191033 (+409887us) spinlock_profiling.cc:243] Waited 2.78 s on lock 0x7b54002a6cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:49.191516 (+   483us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6474783232}
I20260709 13:05:49.201978 15325 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:49.203236 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.197754 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.204599 15215 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:49.212893 15397 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:49.194911 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:49.184850 15242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60000 (request call id 3402) took 1220 ms (client timeout 1535 ms). Trace:
I20260709 13:05:49.191870 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3914) took 1038 ms. Trace:
I20260709 13:05:49.230947 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:49.072068 22990 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:49.232110 15320 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:49.103088 23246 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.027882 22667 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:05:49.231045 23266 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:49.235870 23266 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:49.220189 15242 rpcz_store.cc:269] 0709 13:05:47.964745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.972435 (+  7690us) service_pool.cc:224] Handling call
0709 13:05:49.182823 (+1210388us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b5c0002ae0c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366d564161 00007f366d705a79 00007f366ebbf9b6 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:49.184704 (+  1881us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6032256}
W20260709 13:05:49.221150 15247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2570) took 2828 ms (client timeout 2870 ms). Trace:
I20260709 13:05:49.259558 15391 raft_consensus.cc:2368] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22.
I20260709 13:05:49.053025 22586 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:49.223704 15393 rpcz_store.cc:276] 0709 13:05:48.153668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.155765 (+  2097us) service_pool.cc:224] Handling call
0709 13:05:48.156117 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.202012 (+ 45895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.190987 (+988975us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b54002bc0d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:49.191532 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87976192}
W20260709 13:05:49.245585 15247 rpcz_store.cc:269] 0709 13:05:46.382537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.382726 (+   189us) service_pool.cc:224] Handling call
0709 13:05:49.173906 (+2791180us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b5400315954. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:49.210824 (+ 36918us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5275572096}
I20260709 13:05:49.233472 22990 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:49.274067 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 351258us
I20260709 13:05:49.245378 23166 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:49.106313 23204 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:49.286154 22990 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:49.288672 23421 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:49.290343 22586 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:49.291452 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:49.291587 23077 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.292202 22586 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.293859 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.295059 15395 raft_consensus.cc:2393] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:49.294305 23179 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.296326 23179 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:49.297550 23246 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:49.298542 23432 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:05:49.303982 23266 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:49.305194 15392 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 26. Current term is 27. Ops: []
I20260709 13:05:49.293040 16032 raft_consensus.cc:2410] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 25 because replica has last-logged OpId of term: 24 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 18.
I20260709 13:05:49.319725 22915 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:49.320850 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.321249 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66369.7us
I20260709 13:05:49.334681 23432 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 26 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:49.339466 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.341135 23432 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.347780 23420 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.348832 23420 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.352639 23424 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:49.354831 23420 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:49.357621 23409 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:49.358053 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:49.358428 23409 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.360143 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.361023 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.361253 23409 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:49.361519 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.362174 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.362563 15397 raft_consensus.cc:2410] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
W20260709 13:05:49.363924 23418 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:05:49.364694 15392 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:49.353493 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:49.366700 15323 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:49.337977 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:49.368132 16033 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:05:49.370805 15397 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:49.364007 15395 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:05:49.375710 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:49.376713 16032 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:49.378376 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:49.381542 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:49.401602 15320 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:05:49.428113 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:49.427922 23424 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:49.430800 23166 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.430668 23424 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:49.431598 23424 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:49.431773 23166 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.433032 23424 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.436342 23424 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:49.409366 22915 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:49.438966 22915 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.410866 23266 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:49.443106 23266 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.478536 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.444027 15390 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:49.480829 23441 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.480998 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.481523 23441 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.482091 15291 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:49.482724 23266 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:49.444205 23261 consensus_meta.cc:287] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.834s	user 0.008s	sys 0.008s
I20260709 13:05:49.454396 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:49.483896 23261 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.483196 23429 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:49.484117 23441 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:49.455304 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 1227) took 1718 ms. Trace:
I20260709 13:05:49.485908 15323 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:49.486986 23428 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.487735 23428 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:49.456413 23342 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.834s	user 0.013s	sys 0.004s
I20260709 13:05:49.442178 22915 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:49.461352 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:49.492728 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 147093us
I20260709 13:05:49.452857 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:49.462400 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:05:49.495302 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 91306.3us
I20260709 13:05:49.497709 23243 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:49.498180 23243 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.498639 23243 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:49.490924 23342 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.460870 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:49.501045 23455 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.501813 23455 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.503489 23342 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:49.504540 23455 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:49.507481 15319 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 26. Current term is 27. Ops: []
I20260709 13:05:49.510174 23261 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:49.512786 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:49.513026 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.515020 15390 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 15. (term mismatch)
I20260709 13:05:49.515349 23315 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:49.464685 23161 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:49.469928 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.516489 23161 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:49.517166 15243 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:05:49.518365 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.462811 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:49.519735 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.472411 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.473021 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.474844 23424 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:49.470798 15140 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 18 to 23, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 23 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:49.522712 23424 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.523626 15140 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:49.525501 23424 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:49.486990 16028 rpcz_store.cc:276] 0709 13:05:47.736531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.736742 (+   211us) service_pool.cc:224] Handling call
0709 13:05:47.737140 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.922892 (+185752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.454590 (+1531698us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540066eed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:49.455058 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339560704}
W20260709 13:05:49.458305 23456 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:05:49.497260 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:49.512786 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 131538us
I20260709 13:05:49.515508 15390 pending_rounds.cc:85] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 14
I20260709 13:05:49.471799 15242 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:05:49.481020 15246 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:05:49.465333 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.470005 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.551905 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.459690 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.549329 15243 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:49.556777 15390 pending_rounds.cc:107] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 25.15
I20260709 13:05:49.583674 15390 raft_consensus.cc:2889] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:49.550103 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:49.587491 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.486533 23441 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:49.533946 22586 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:49.515911 23315 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:49.464675 23166 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:49.602604 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:49.603407 15396 raft_consensus.cc:2393] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:49.450783 23077 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:49.517776 23161 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.612238 15395 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:49.613538 23297 consensus_meta.cc:287] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.641s	user 0.006s	sys 0.010s
I20260709 13:05:49.613633 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:49.549520 23012 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:49.615214 23315 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.619794 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:49.621057 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 137328us
I20260709 13:05:49.520958 23317 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:49.622651 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:49.623126 15250 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:05:49.623368 23261 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:05:49.632155 15248 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 22: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:49.549465 23262 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:49.641799 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1154) took 1687 ms. Trace:
I20260709 13:05:49.590322 23428 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:49.609045 23441 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.624653 23161 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:49.625277 23455 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.675832 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:49.630761 23012 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:05:49.712493 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 65700.4us
I20260709 13:05:49.683432 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:49.670848 23441 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:05:49.740401 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.740978 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.742503 23261 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.743517 23261 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.743981 23386 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.744346 15318 pending_rounds.cc:85] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 11
I20260709 13:05:49.744845 15318 pending_rounds.cc:107] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:05:49.745172 15318 raft_consensus.cc:2889] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:49.744961 23386 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.746507 23166 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.746644 23421 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:49.747411 23166 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.749791 15391 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:05:49.750567 22667 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.751375 22667 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.752107 23315 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:49.753777 23419 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:49.750782 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:49.624321 23297 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.749977 23166 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:49.754422 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:49.809876 15323 raft_consensus.cc:2468] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:05:49.732749 15390 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:49.754372 23419 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:49.742027 23308 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:49.841866 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:49.726044 23455 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:49.870253 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.820765 23421 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:49.879536 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:49.876966 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.870290 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 50635.8us
I20260709 13:05:49.883164 15245 raft_consensus.cc:1217] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Deduplicated request from leader. Original: 16.11->[18.12-18.12]   Dedup: 18.12->[]
W20260709 13:05:49.883077 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 240652us
I20260709 13:05:50.003037 15323 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 27: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:49.872985 15241 raft_consensus.cc:1240] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:05:49.651844 15317 rpcz_store.cc:276] 0709 13:05:47.954271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.058911 (+104640us) service_pool.cc:224] Handling call
0709 13:05:48.059287 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.224229 (+164942us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:05:48.310128 (+ 85899us) log.cc:844] Serialized 14 byte log entry
0709 13:05:48.678202 (+368074us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:48.678310 (+   108us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:05:48.678371 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.588608 (+910237us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54001c57d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:49.597359 (+  8751us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.641595 (+ 44236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7335,"prepare.queue_time_us":90292,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":7475,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":1319,"spinlock_wait_cycles":378812160,"thread_start_us":360197,"threads_started":1,"wal-append.queue_time_us":490486}
W20260709 13:05:49.996019 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 349444us
I20260709 13:05:50.004997 15245 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:49.885001 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:50.006295 15996 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:49.883034 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.846896 23317 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:49.891119 15319 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:49.906217 23340 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:49.906839 23132 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:49.907114 23429 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.916548 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 44827.9us
I20260709 13:05:49.898478 15324 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:49.916163 23447 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.932670 23421 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:49.921692 23308 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:49.916627 23457 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:05:49.934168 23012 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.937697 15247 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:50.039623 15391 raft_consensus.cc:1275] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:05:49.910759 23261 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:49.984227 15316 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:49.985083 23419 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:49.988818 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:49.990451 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.869571 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.996919 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:50.009582 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:50.021152 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.019011 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1184) took 2094 ms. Trace:
I20260709 13:05:50.034610 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:50.047214 15390 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:50.037356 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:50.037998 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:49.937904 22667 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:50.051259 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 69204.4us
I20260709 13:05:50.060175 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:50.061120 15320 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:50.061455 23242 raft_consensus.cc:2804] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:50.062047 23242 raft_consensus.cc:697] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:50.063022 23132 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.063119 23242 consensus_queue.cc:237] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.065714 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.045538 15394 rpcz_store.cc:276] 0709 13:05:47.908598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.911671 (+  3073us) service_pool.cc:224] Handling call
0709 13:05:47.929484 (+ 17813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:47.929962 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:47.930004 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:47.934011 (+  4007us) log.cc:844] Serialized 26 byte log entry
0709 13:05:49.188049 (+1254038us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b18004dfb00. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:05:49.406541 (+218492us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:49.410175 (+  3634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.527608 (+117433us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.911842 (+384234us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b5400432720. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b6fdbe 00007f3669b7a930 00007f3669b7a8d8 00007f3669b7a858 00007f3669b7a813 00007f3669b79a9c 00007f366fa65626 00007f366fa5fdd8 00007f3669bb67cb 00007f3669bb92c0
0709 13:05:49.994838 (+ 82996us) raft_consensus.cc:1685] finished
0709 13:05:49.994870 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.002681 (+  7811us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":627,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":4613,"spinlock_wait_cycles":117449344,"thread_start_us":83999,"threads_started":1,"wal-append.queue_time_us":1431937}
I20260709 13:05:50.068130 15397 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:50.068739 23419 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:50.074792 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:50.072657 15320 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:50.073553 15241 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
W20260709 13:05:50.057241 23163 consensus_meta.cc:287] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.005s
I20260709 13:05:50.007493 23317 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:50.064352 23399 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.014s
W20260709 13:05:50.085948 23318 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 1.131s	user 0.010s	sys 0.010s
I20260709 13:05:50.086541 15248 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:50.087880 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:50.086562 23318 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.092859 23318 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.090392 23163 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.096081 23163 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:50.096226 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2578) took 1111 ms. Trace:
I20260709 13:05:50.096451 15398 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:50.096666 15322 rpcz_store.cc:276] 0709 13:05:48.984797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.986694 (+  1897us) service_pool.cc:224] Handling call
0709 13:05:49.187083 (+200389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:49.215622 (+ 28539us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:05:49.305513 (+ 89891us) log.cc:844] Serialized 14 byte log entry
0709 13:05:49.619246 (+313733us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:49.619827 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:05:49.619967 (+   140us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:49.620002 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.620075 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:50.095887 (+475812us) raft_consensus.cc:1685] finished
0709 13:05:50.095908 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.096053 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99086,"prepare.queue_time_us":30463,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":108926,"raft.run_cpu_time_us":542,"raft.run_wall_time_us":39847,"thread_start_us":193329,"threads_started":1,"wal-append.queue_time_us":638047}
I20260709 13:05:50.098930 15140 catalog_manager.cc:5697] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:50.100926 15140 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 17 to 20, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 20 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.103303 15242 raft_consensus.cc:1240] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24. Ops: []
W20260709 13:05:50.070544 23243 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.571s	user 0.015s	sys 0.000s
I20260709 13:05:50.107452 23386 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.109433 15317 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:05:50.109699 23455 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:50.041467 23447 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.110428 23243 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.112558 23447 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:50.113360 15249 raft_consensus.cc:2393] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:50.057754 23429 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.116925 23429 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.121459 15362 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:50.123279 15321 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 25. Current term is 26. Ops: []
W20260709 13:05:50.123977 23179 consensus_meta.cc:287] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.827s	user 0.012s	sys 0.005s
I20260709 13:05:50.124675 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:50.127861 23317 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:50.130460 15246 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:50.133139 15248 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 27.
I20260709 13:05:50.135151 23262 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:50.121904 23297 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.137133 23421 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:50.137180 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53877.4us
I20260709 13:05:50.121606 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:50.140825 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 57826.5us
I20260709 13:05:50.150378 15390 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:05:50.153489 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.154662 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.156955 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.158115 15318 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:05:50.158349 23262 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:05:50.159026 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:50.159231 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.159739 15324 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:05:50.160158 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:50.160480 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.161192 23204 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:50.161517 23342 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:50.161955 23342 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.162328 23342 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:50.160363 23447 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:50.162618 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.152722 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.157353 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.151952 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:50.168809 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 87745.1us
I20260709 13:05:50.168020 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.169014 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.112560 23243 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:50.139832 22990 consensus_meta.cc:287] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.853s	user 0.017s	sys 0.000s
I20260709 13:05:50.175547 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.164263 23132 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:50.213343 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.215782 23363 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:50.216298 15320 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:05:50.216589 15323 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:50.216298 15321 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:05:50.219197 23266 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:05:50.220243 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:50.232990 15318 raft_consensus.cc:2410] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:50.222532 23317 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:05:50.235687 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:50.238628 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:50.226779 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 105448us
I20260709 13:05:50.243496 22990 consensus_queue.cc:1048] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:50.251986 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1322) took 1048 ms. Trace:
I20260709 13:05:50.293380 16024 rpcz_store.cc:276] 0709 13:05:49.203116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.238336 (+ 35220us) service_pool.cc:224] Handling call
0709 13:05:49.460395 (+222059us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b5800183698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5eee 0000000000375939 00007f366eb491e0 00007f366ec120c4 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:05:49.460586 (+   191us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:49.570680 (+110094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:49.570717 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:49.642472 (+ 71755us) log.cc:844] Serialized 52 byte log entry
0709 13:05:49.970382 (+327910us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:49.970446 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.970547 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:50.234488 (+263941us) raft_consensus.cc:1685] finished
0709 13:05:50.234511 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.251775 (+ 17264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100477,"raft.queue_time_us":100437,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":48034,"spinlock_wait_cycles":12202752,"thread_start_us":152623,"threads_started":1,"wal-append.queue_time_us":487828}
W20260709 13:05:50.257297 23315 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.000s
W20260709 13:05:50.258528 23161 consensus_meta.cc:287] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.563s	user 0.004s	sys 0.008s
I20260709 13:05:50.213333 15322 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:05:50.263506 23429 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:50.265067 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:50.276471 23441 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.314796 15246 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:50.316636 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.319015 15243 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
W20260709 13:05:50.330013 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 65017.2us
I20260709 13:05:50.335073 15324 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:50.326170 23132 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:50.336103 22990 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:50.336611 22990 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:50.336612 23132 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.337316 22990 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:50.337625 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:50.339134 23132 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:50.339022 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:50.329562 23266 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:50.348358 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:50.349061 15397 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:50.351763 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:50.353196 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.355675 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:50.355978 15394 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:05:50.357532 15392 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:05:50.358430 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.359414 23441 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:50.359596 23288 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:50.360064 23288 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:50.360540 23288 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:50.365347 15395 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:05:50.370126 23363 consensus_queue.cc:1048] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:05:50.371703 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:50.373452 23471 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.389s	user 0.000s	sys 0.004s
W20260709 13:05:50.374807 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.377138 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:50.387291 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:50.388557 23262 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:50.396303 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:50.397607 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:50.348721 23161 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:05:50.402631 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:50.405725 16030 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:50.404698 15291 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:50.375362 23243 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:50.409221 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 189084us
W20260709 13:05:50.414916 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 50709.1us
I20260709 13:05:50.417397 15395 raft_consensus.cc:2468] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:50.398655 23429 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.420667 15291 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:50.422645 23429 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.425063 23429 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.425529 15397 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:05:50.414850 23297 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:05:50.426698 23297 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:50.427829 23297 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.430334 23455 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:05:50.416873 23243 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.434604 22990 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.425874 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:50.437800 16028 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 21: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:50.437971 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:50.436179 15215 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:50.438813 15397 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 27.
I20260709 13:05:50.433982 23243 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.446697 15396 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:50.447353 15246 raft_consensus.cc:2468] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:50.451296 15365 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:50.407644 23386 consensus_queue.cc:1059] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:05:50.442386 23447 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:50.458640 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:50.336793 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:50.465781 15246 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:50.422093 23342 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.447067 23455 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:50.452679 23179 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:50.475538 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:50.478266 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.479137 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:50.484201 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.484961 15318 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:50.462870 23447 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.444628 23419 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:05:50.444279 23421 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:05:50.485909 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.488795 15320 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:05:50.486896 15324 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:50.490851 15248 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:05:50.487047 15322 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:05:50.476368 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.487432 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:50.494469 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.471611 23420 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:05:50.487032 23447 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:50.497129 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.497241 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.486686 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:50.492795 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:50.506830 15244 raft_consensus.cc:3060] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:50.514392 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 99692.5us
I20260709 13:05:50.515692 15291 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
W20260709 13:05:50.517762 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 81467.5us
I20260709 13:05:50.486747 23363 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:50.492935 23315 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:50.518622 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:50.486188 23266 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:50.499990 23420 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.509620 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:50.530297 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.507599 23317 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:50.475628 23318 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:05:50.529613 22990 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.542408 23315 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.542951 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:50.543635 15247 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:50.503906 23455 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.545140 23139 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:05:50.521906 23262 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:50.546314 23077 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:50.546494 22979 raft_consensus.cc:2804] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:50.547168 22979 raft_consensus.cc:697] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:50.548143 22979 consensus_queue.cc:237] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.535965 23420 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:50.551160 23288 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.553478 23288 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:50.534175 23386 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:50.555634 23424 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:05:50.556072 23424 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:50.557209 23424 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.559851 15393 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:50.561309 23288 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.562083 23288 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.572853 23288 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:50.573706 23447 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.575018 15398 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3266) took 1372 ms. Trace:
I20260709 13:05:50.575611 15398 rpcz_store.cc:276] 0709 13:05:49.202304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.203813 (+  1509us) service_pool.cc:224] Handling call
0709 13:05:49.204337 (+   524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.096992 (+892655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.574696 (+477704us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54000271d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:50.574936 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051127040}
W20260709 13:05:50.576474 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 111824us
I20260709 13:05:50.576053 23447 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:50.578048 15247 raft_consensus.cc:2468] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
I20260709 13:05:50.570751 23424 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:50.579762 23363 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.569365 23317 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:50.520350 23399 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:50.577720 23420 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.588660 23420 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.589754 23342 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:50.591913 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 57845.2us
W20260709 13:05:50.611867 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.598470 23477 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.613004 23477 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.599526 23451 raft_consensus.cc:3055] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:50.599784 23163 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:05:50.607849 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89298.1us
I20260709 13:05:50.625610 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:50.582090 23363 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.629195 16024 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:50.630571 23308 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.630949 23477 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.633103 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:50.633931 16033 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:50.634693 23399 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:50.635321 23399 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:50.635607 23452 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:05:50.636322 23399 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.637133 23452 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:05:50.622474 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 150119us
I20260709 13:05:50.641734 15140 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 16 to 17, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 17 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:05:50.642832 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:50.643972 23243 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:05:50.643699 15140 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:05:50.621733 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 209103us
I20260709 13:05:50.645215 15140 catalog_manager.cc:5697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.646317 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:50.647863 23315 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.647938 23317 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:50.665455 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:50.665625 23317 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.666812 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:50.669008 23368 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:50.670665 23317 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:50.628633 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 47514.1us
I20260709 13:05:50.636559 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:50.654498 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:50.570268 15244 raft_consensus.cc:2468] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:50.664582 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:50.670814 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 161359us
I20260709 13:05:50.621114 23451 raft_consensus.cc:740] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:50.671710 23288 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.696708 23288 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.699821 23288 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:50.689810 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:50.649869 23308 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:50.674310 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:50.703897 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:50.637712 23452 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.686537 15391 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:50.687387 16028 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:50.692901 23429 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.693004 23262 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:05:50.694854 23458 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.886s	user 0.000s	sys 0.004s
I20260709 13:05:50.695469 22915 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:50.701963 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:50.715240 23429 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.716382 15362 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:50.718535 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:50.719704 15214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.744272 16030 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 27.
I20260709 13:05:50.685524 23163 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:50.750988 23368 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:50.765584 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49312.2us
I20260709 13:05:50.778148 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:50.784916 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 96866.8us
I20260709 13:05:50.785544 23288 raft_consensus.cc:2804] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:50.785823 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:50.786194 23316 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.786708 23316 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.787266 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:50.788347 23451 consensus_queue.cc:260] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.789434 23288 raft_consensus.cc:697] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:50.789952 23451 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:50.790578 23288 consensus_queue.cc:237] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:50.791699 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 117626us
I20260709 13:05:50.788905 23316 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:50.794725 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 150008us
I20260709 13:05:50.771327 23261 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:50.795773 23074 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:50.795631 23261 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:50.796242 23074 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:50.796849 23074 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:50.765304 23163 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:50.798704 23163 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:50.756742 23315 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 13:05:50.775872 23139 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.794572 23368 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:50.795620 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:50.808041 16030 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:50.756477 23308 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:50.798022 23261 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.809477 23477 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:05:50.812431 23315 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:05:50.880860 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 93662.3us
I20260709 13:05:50.882378 15213 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:50.888084 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.847246 23452 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:50.880578 23166 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:50.879842 23315 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:50.811589 23139 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:50.911273 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:50.905952 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 112012us
I20260709 13:05:50.916500 15244 raft_consensus.cc:2393] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:50.917155 15363 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:50.921977 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:50.923427 15291 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:50.925088 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.926112 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:50.927603 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 132079us
I20260709 13:05:50.929011 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:50.929267 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:50.890703 23132 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:05:50.915755 23315 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:50.932945 15241 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 26. Current term is 28. Ops: []
I20260709 13:05:50.941354 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.924523 23318 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:50.948181 15291 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:50.951072 23064 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:50.951139 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:50.952065 16029 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:50.952849 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:50.953792 23243 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:05:50.960078 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.955080 23297 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:50.963356 15140 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 16 to 19, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 19 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:50.963408 23297 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:50.970701 23485 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:05:50.970808 23297 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:50.976851 23012 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:50.981324 23139 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:50.951382 15319 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:50.965804 15140 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:50.993834 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 52246.4us
I20260709 13:05:50.996681 23288 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.001089 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 61785.4us
W20260709 13:05:51.002297 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 49545.9us
I20260709 13:05:50.941367 23455 raft_consensus.cc:2804] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:05:51.013458 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:50.942342 23429 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:50.971431 23161 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:05:51.023726 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:51.020143 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:51.029333 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:51.029803 15317 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:05:50.995859 23179 raft_consensus.cc:2804] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:05:51.040055 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:50.999620 23318 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:51.057852 15242 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 13:05:51.003666 22915 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.050814 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:51.028344 23161 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:51.069274 16024 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:50.997377 23288 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.070706 15140 catalog_manager.cc:5697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 14 to 22. New cstate: current_term: 22 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.071825 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:51.077481 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45254.8us
W20260709 13:05:51.073314 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 53265.4us
I20260709 13:05:51.055949 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:51.078907 15213 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:51.047322 23429 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.074059 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 47262.8us
I20260709 13:05:51.054595 23179 raft_consensus.cc:697] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:51.098649 22586 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:51.126669 15140 catalog_manager.cc:5697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.147312 22586 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.075598 23455 raft_consensus.cc:697] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:51.097276 23266 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:51.151612 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:51.156014 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 77237.5us
I20260709 13:05:51.064311 23399 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:05:51.102578 23447 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:05:51.158900 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 163926us
I20260709 13:05:51.135123 23342 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:51.188269 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:51.080749 22915 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.103942 23132 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260709 13:05:51.195735 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:51.194617 15319 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:05:51.197639 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:51.200924 15319 pending_rounds.cc:85] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 14
I20260709 13:05:51.195735 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:51.201346 15319 pending_rounds.cc:107] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:05:51.201741 15319 raft_consensus.cc:2889] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:51.198549 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:51.157444 23266 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:51.205001 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:51.210637 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:51.203583 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:51.132001 23429 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.221150 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:51.221810 15394 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:51.222409 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 70726.8us
I20260709 13:05:51.197503 23340 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:51.211153 23266 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:51.208000 23452 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:51.232434 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:51.230192 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:51.219587 23497 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:51.239481 15391 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 25: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:05:51.239645 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78314.9us
I20260709 13:05:51.189502 23503 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:05:51.203192 23243 consensus_queue.cc:1059] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:05:51.208772 23342 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:51.251183 15290 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:51.212607 23317 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.026s
I20260709 13:05:51.235297 23424 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.276291 16024 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:51.270646 15394 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:51.245272 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:51.250874 15141 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49174 (request call id 243) took 52779 ms (client timeout 15000 ms). Trace:
W20260709 13:05:51.253922 23508 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:51.327457 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:51.258864 23490 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:05:51.331554 15391 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:51.213541 23161 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:51.254930 23501 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:05:51.326773 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:51.334352 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 135895us
I20260709 13:05:51.311296 22667 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:05:51.385951 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 140812us
I20260709 13:05:51.254170 23478 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:51.243705 23497 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:51.310338 23243 consensus_queue.cc:1243] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:05:51.391731 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:51.393092 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 157255us
W20260709 13:05:51.394137 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 153611us
I20260709 13:05:51.396021 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:51.239042 23318 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.383249 23261 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:51.254279 23319 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:51.419553 23243 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:51.420138 23506 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 13:05:51.414786 23316 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:51.421736 23492 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.302s	user 0.001s	sys 0.001s
I20260709 13:05:51.421594 23505 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:51.422327 23511 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:51.422924 23511 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:51.423353 23511 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:51.403885 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:51.244483 23496 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:51.396946 23497 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:51.385154 22667 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.424898 22667 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:05:51.426607 23510 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:05:51.420274 23499 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:05:51.272874 23421 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:51.324790 23424 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:51.397774 23288 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:51.388588 23503 consensus_queue.cc:1059] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:05:51.441020 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:05:51.458606 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 253720us
I20260709 13:05:51.467419 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:51.495710 23297 consensus_meta.cc:287] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.004s
W20260709 13:05:51.496097 23515 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:51.496225 23297 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.459178 23421 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.498409 23496 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:51.499792 23421 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:51.501222 23266 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:51.501328 23497 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:51.503607 23266 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:51.402469 23315 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:51.499890 23521 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:05:51.310988 23455 consensus_queue.cc:237] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:51.328687 23179 consensus_queue.cc:237] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.415758 23319 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:51.505295 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 101532us
I20260709 13:05:51.589572 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:51.536692 15391 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 28.
I20260709 13:05:51.711534 15391 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
W20260709 13:05:51.711458 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51497.1us
I20260709 13:05:51.509546 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:51.507292 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 66432.2us
I20260709 13:05:51.586642 15248 raft_consensus.cc:3055] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:51.731065 15248 raft_consensus.cc:740] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:51.579936 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.729837 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:51.586462 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:51.581323 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:51.735311 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 75104.7us
I20260709 13:05:51.519472 22667 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.727926 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:51.519716 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:51.511374 15395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3954) took 1088 ms. Trace:
W20260709 13:05:51.740470 15362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.021s	sys 0.030s
W20260709 13:05:51.749524 15362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.021s	sys 0.033s
W20260709 13:05:51.585613 23074 consensus_meta.cc:287] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.004s
W20260709 13:05:51.513923 23012 consensus_meta.cc:287] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
W20260709 13:05:51.509024 23516 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:05:51.509150 23500 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 13:05:51.544747 23494 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.142s	user 0.000s	sys 0.002s
I20260709 13:05:51.507818 23297 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:51.567585 23489 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:51.755712 15250 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 13:05:51.789431 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 199959us
I20260709 13:05:51.788792 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:51.506111 23315 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:51.559952 23132 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:51.517292 23503 raft_consensus.cc:3055] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:51.754268 23288 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:51.794656 23521 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:51.794628 15324 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:05:51.581408 23161 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:05:51.792532 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 272882us
I20260709 13:05:51.509948 23429 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:51.847167 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3854) took 1361 ms. Trace:
I20260709 13:05:51.825284 23519 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.516149 23342 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:51.847630 15324 rpcz_store.cc:276] 0709 13:05:50.485480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.509831 (+ 24351us) service_pool.cc:224] Handling call
0709 13:05:50.510272 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.837634 (+1327362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.846881 (+  9247us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001e69d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:51.847104 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2952967424}
I20260709 13:05:51.847942 23519 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:51.849466 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:51.850286 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3953) took 1433 ms. Trace:
I20260709 13:05:51.850697 15392 rpcz_store.cc:276] 0709 13:05:50.416662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.421328 (+  4666us) service_pool.cc:224] Handling call
0709 13:05:50.430755 (+  9427us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:50.452372 (+ 21617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.452402 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:50.504091 (+ 51689us) log.cc:844] Serialized 52 byte log entry
0709 13:05:50.716917 (+212826us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b48002001d8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366eb23aa1 00007f366eb1ab37 00007f366eb1a9ca 00007f366ec1226f 00007f366ec11f37 00007f366ec2655c 00007f366ec26508 00007f366ec26488 00007f366ec26443 00007f366ec256ec 00007f366db4fa96
0709 13:05:50.887866 (+170949us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:50.887926 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.888000 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:51.543855 (+655855us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:51.850039 (+306184us) raft_consensus.cc:1685] finished
0709 13:05:51.850062 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.850202 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50252,"raft.queue_time_us":30666,"raft.run_cpu_time_us":2517,"raft.run_wall_time_us":254333,"spinlock_wait_cycles":18946304,"thread_start_us":350946,"threads_started":1,"wal-append.queue_time_us":867057}
I20260709 13:05:51.796365 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:51.503687 23497 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:51.573890 23424 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:51.566992 23340 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:51.550722 23064 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:51.507455 23243 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:51.799239 22667 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:51.829981 15248 consensus_queue.cc:260] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:51.802769 15215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.020s	sys 0.034s
I20260709 13:05:51.799882 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:05:51.876679 15215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.020s	sys 0.034s
I20260709 13:05:51.507766 23262 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:51.807657 15323 raft_consensus.cc:2393] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:51.790729 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:51.818902 23368 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:51.882169 16028 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 23: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:05:51.724534 23163 consensus_meta.cc:287] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.005s
I20260709 13:05:51.753417 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:51.835196 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:51.825047 23503 raft_consensus.cc:740] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:51.794486 23074 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.838214 23166 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.879004 23451 consensus_meta.cc:287] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 1.088s	user 0.013s	sys 0.000s
I20260709 13:05:51.854154 23340 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:51.860827 15398 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:05:51.805434 23489 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:51.800156 23012 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:51.922348 15247 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:51.870457 15397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1200) took 1198 ms. Trace:
I20260709 13:05:51.859411 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:51.822348 23132 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:51.924219 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 64932us
I20260709 13:05:51.925027 23132 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.925812 15291 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:51.842532 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:51.583056 23319 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.843474 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:51.844128 15245 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260709 13:05:51.859583 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 350201us
I20260709 13:05:51.755044 23399 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:05:51.560220 22915 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:51.749217 15395 rpcz_store.cc:276] 0709 13:05:50.422717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.442820 (+ 20103us) service_pool.cc:224] Handling call
0709 13:05:50.451896 (+  9076us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:50.487511 (+ 35615us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:50.487549 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:50.595850 (+108301us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b2c0012d858. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f36684f3a11 00007f3668503372 00007f3669c35a01 00007f3669bfa43a 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2
0709 13:05:50.596461 (+   611us) log.cc:844] Serialized 26 byte log entry
0709 13:05:50.827622 (+231161us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:50.827679 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.827774 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:51.511017 (+683243us) raft_consensus.cc:1685] finished
0709 13:05:51.511037 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.511311 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20507,"raft.queue_time_us":58443,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6654,"spinlock_wait_cycles":7806336,"thread_start_us":230604,"threads_started":1,"wal-append.queue_time_us":321414}
I20260709 13:05:51.956591 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:51.957860 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:51.884152 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:51.959441 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 75383.6us
I20260709 13:05:51.960407 23363 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:51.962002 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:51.504738 23493 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.318s
I20260709 13:05:51.962742 23363 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:51.964258 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:51.855201 22586 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:51.894850 15244 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 26. Current term is 27. Ops: []
W20260709 13:05:51.330569 15141 rpcz_store.cc:269] 0709 13:04:58.303788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.319734 (+ 15946us) service_pool.cc:224] Handling call
0709 13:04:58.980558 (+660824us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b64090 00007f3669c02f3a 00007f366f9b91cc 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc 00007f366df77392 00007f3667f3548c 00007f3667f348c6
0709 13:05:51.075183 (+52094625us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:40.304922 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:40.305866 (+   944us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:40.305937 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:05:40.305974 (+    37us) tablet.cc:662] Decoding operations
0709 13:05:40.366706 (+ 60732us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:40.366804 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:40.366860 (+    56us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:05:40.369001 (+  2141us) tablet.cc:701] Row locks acquired
0709 13:05:40.369055 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:05:40.369301 (+   246us) write_op.cc:270] Start()
0709 13:05:40.369505 (+   204us) write_op.cc:276] Timestamp: P: 1783602340369215 usec, L: 0
0709 13:05:40.369548 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:05:40.370569 (+  1021us) log.cc:844] Serialized 9127 byte log entry
0709 13:05:41.187381 (+816812us) op_driver.cc:464] REPLICATION: finished
0709 13:05:41.579812 (+392431us) write_op.cc:301] APPLY: starting
0709 13:05:41.579931 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:41.950567 (+370636us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:42.015081 (+ 64514us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:42.727960 (+712879us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:42.845625 (+117665us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:05:42.845711 (+    86us) write_op.cc:312] APPLY: finished
0709 13:05:42.846281 (+   570us) log.cc:844] Serialized 204 byte log entry
0709 13:05:43.102151 (+255870us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:43.136293 (+ 34142us) write_op.cc:454] Released schema lock
0709 13:05:43.145571 (+  9278us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:43.150911 (+  5340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:43.150957 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3861084,"reported_tablets":50,"spinlock_wait_cycles":21049216,"child_traces":[["op",{"apply.queue_time_us":312540,"apply.run_cpu_time_us":45521,"apply.run_wall_time_us":1582753,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100221,"num_ops":23,"prepare.queue_time_us":453444,"prepare.run_cpu_time_us":72497,"prepare.run_wall_time_us":255303,"raft.queue_time_us":218323,"raft.run_cpu_time_us":4250,"raft.run_wall_time_us":316914,"replication_time_us":744549,"thread_start_us":659771,"threads_started":5,"wal-append.queue_time_us":595202,"wal-append.run_cpu_time_us":43060,"wal-append.run_wall_time_us":2399812}]]}
I20260709 13:05:51.908407 15391 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:51.914382 23519 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:51.903339 23166 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.916970 23503 consensus_queue.cc:260] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:51.918403 23447 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:51.920145 23489 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:51.842567 15213 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:51.926429 23524 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:05:51.923700 15397 rpcz_store.cc:276] 0709 13:05:50.672197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.672657 (+   460us) service_pool.cc:224] Handling call
0709 13:05:50.673037 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:50.673474 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.673504 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:50.673999 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:05:50.919868 (+245869us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:05:50.919927 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.920023 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:51.870246 (+950223us) raft_consensus.cc:1685] finished
0709 13:05:51.870264 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.870395 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3188,"raft.queue_time_us":12445,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":15255,"thread_start_us":245167,"threads_started":1,"wal-append.queue_time_us":534023}
I20260709 13:05:51.943286 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:51.944401 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:51.944770 15246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:51.927465 23012 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:05:51.947964 23518 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:52.021831 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.022547 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:51.951572 23266 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:51.953224 23528 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:51.756635 23139 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:51.888499 15248 raft_consensus.cc:3060] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:51.976991 15250 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 28: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:51.890609 23064 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:52.005685 15244 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:05:51.926550 23132 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:51.997727 16027 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.017s	sys 0.070s
W20260709 13:05:52.043790 16027 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.017s	sys 0.070s
I20260709 13:05:52.023648 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:52.024763 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:51.896863 23163 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:52.031978 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 189477us
I20260709 13:05:52.046790 22667 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:05:52.014818 15290 connection.cc:256] RPC call timeout handler was delayed by -1.2228033949999144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 13:05:52.033015 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89786.4us
I20260709 13:05:52.033123 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.049325 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:52.050611 22667 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:51.890394 23368 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.042085 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.028143 23503 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:52.054214 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.052343 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:52.053058 15290 connection.cc:256] RPC call timeout handler was delayed by -1.2111033949998955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 13:05:52.062690 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:52.106114 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53857.4us
I20260709 13:05:52.065793 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.089346 15392 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 25: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:52.100322 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.109220 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:52.111230 15290 connection.cc:256] RPC call timeout handler was delayed by -1.1481033949999073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 13:05:52.088814 23518 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:52.041643 23489 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:52.054593 23493 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:52.054425 23495 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:52.187547 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:52.087958 23511 consensus_meta.cc:287] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.664s	user 0.006s	sys 0.007s
W20260709 13:05:52.160837 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.161073 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.054297 23451 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:52.034533 23261 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:52.166261 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.060913 23139 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:52.029193 23447 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.167600 15245 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 24. Current term is 25. Ops: [23.16-24.17]
W20260709 13:05:52.101845 23179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.049s	sys 0.082s
I20260709 13:05:52.109373 23319 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:52.173403 15290 connection.cc:256] RPC call timeout handler was delayed by -1.0977033949999395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 13:05:52.214632 15290 connection.cc:256] RPC call timeout handler was delayed by -1.0916098149999698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 13:05:52.180203 15248 raft_consensus.cc:1275] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260709 13:05:52.036865 23266 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:52.215415 15248 pending_rounds.cc:85] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 14
I20260709 13:05:52.216144 15248 pending_rounds.cc:107] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:05:52.216691 15248 raft_consensus.cc:2889] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:52.212484 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.217176 15248 pending_rounds.cc:107] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 23.16
W20260709 13:05:52.213853 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.217674 15248 raft_consensus.cc:2889] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:52.219314 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.221019 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.221916 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.189062 15394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.010s	sys 0.022s
I20260709 13:05:52.192245 15250 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:52.169800 23521 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:05:52.168020 23297 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.225172 15394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.012s	sys 0.023s
I20260709 13:05:52.213851 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.235358 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43794 (request call id 1043) took 1040 ms. Trace:
I20260709 13:05:52.233213 23266 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:52.154177 23315 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:05:52.060325 23528 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.239724 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3960) took 1032 ms. Trace:
I20260709 13:05:52.230217 15391 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 27.
W20260709 13:05:52.211347 23179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.050s	sys 0.082s
I20260709 13:05:52.170305 22979 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.217670 15249 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:05:52.235792 15248 rpcz_store.cc:276] 0709 13:05:51.194910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.195041 (+   131us) service_pool.cc:224] Handling call
0709 13:05:51.212834 (+ 17793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.586503 (+373669us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540022bb20. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfc1c0 00007f3669bfd231 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c
0709 13:05:52.235079 (+648576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.235303 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371975040}
I20260709 13:05:52.240402 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:52.241578 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:52.189178 23318 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.014s	sys 0.018s
I20260709 13:05:52.240324 15393 rpcz_store.cc:276] 0709 13:05:51.207435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.207575 (+   140us) service_pool.cc:224] Handling call
0709 13:05:51.857938 (+650363us) spinlock_profiling.cc:243] Waited 873 us on lock 0x7b5800003698. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad5a22 00007f366f9eec09 00007f366eb48ee0 00007f366ec120ab 00007f366ec12131 00007f366ebd3fc0 00007f366ebbe929 00007f366ebbe3d2 00007f3668135bd4
0709 13:05:51.861109 (+  3171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.156860 (+295751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.156892 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.156931 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:52.156959 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.239387 (+ 82428us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54001950d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:52.239458 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.239642 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":597784832}
I20260709 13:05:52.219837 23012 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.236124 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 365066us
I20260709 13:05:52.283742 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.281113 15323 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:52.284574 15324 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:05:52.303069 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:52.303689 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.321836 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:52.279074 23318 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.016s	sys 0.020s
I20260709 13:05:52.109758 23340 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:52.329116 15250 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:05:52.337337 15249 raft_consensus.cc:1240] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:05:52.242269 23521 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:52.214089 23511 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:52.283569 23519 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.227234 23493 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 13:05:52.235080 23261 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.276050 23297 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:52.339836 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:52.341639 23266 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:52.342172 23363 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.290243 23012 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.407519 15249 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:52.344822 23447 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:52.330399 23074 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:52.346660 23520 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:05:52.347035 23368 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:52.348001 23166 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:52.280213 22979 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.354435 23139 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:52.356201 23523 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:05:52.242741 23477 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 13:05:52.358687 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.359704 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:52.360605 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.421191 23340 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:52.447649 16027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46354 (request call id 1246) took 1300 ms. Trace:
I20260709 13:05:52.334823 23179 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.376281 23531 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:05:52.396275 15323 raft_consensus.cc:3060] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:52.239980 23451 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.406538 15241 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
W20260709 13:05:52.406795 15996 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.486423 15246 raft_consensus.cc:606] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:05:52.409265 15317 raft_consensus.cc:1240] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:52.427245 15320 raft_consensus.cc:1240] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:52.432153 15249 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:52.361667 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.442643 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:52.432155 23163 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:52.488809 15316 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:52.363440 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.453362 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.419781 23363 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:52.489876 15391 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
W20260709 13:05:52.484515 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 189716us
I20260709 13:05:52.396502 23519 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.493160 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:52.495450 15365 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:52.496632 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.503285 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.503682 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.505105 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.505367 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:52.505800 15397 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
I20260709 13:05:52.506628 15395 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:05:52.507930 15395 raft_consensus.cc:3055] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:52.508370 15395 raft_consensus.cc:740] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:52.504285 15396 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
I20260709 13:05:52.521574 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:52.529363 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 346152us
I20260709 13:05:52.537019 15391 raft_consensus.cc:2393] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 22: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:52.537295 15397 raft_consensus.cc:3055] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:52.537742 15397 raft_consensus.cc:740] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:52.546170 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.448115 16027 rpcz_store.cc:276] 0709 13:05:51.147389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.148160 (+   771us) service_pool.cc:224] Handling call
0709 13:05:51.159535 (+ 11375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:51.173337 (+ 13802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.173384 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:51.230816 (+ 57432us) log.cc:844] Serialized 52 byte log entry
0709 13:05:51.395200 (+164384us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:05:52.056984 (+661784us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.447279 (+390295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.447365 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.447410 (+    45us) raft_consensus.cc:1685] finished
0709 13:05:52.447421 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.447582 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7129,"prepare.queue_time_us":847110,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":15485,"raft.queue_time_us":300367,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":39970,"thread_start_us":1118811,"threads_started":3,"wal-append.queue_time_us":320042}
I20260709 13:05:52.550343 15323 raft_consensus.cc:2468] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 27.
I20260709 13:05:52.552332 15321 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 27 because replica has last-logged OpId of term: 25 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:05:52.552919 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.504200 23166 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:52.521014 23308 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.424026 23518 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.515108 23386 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:52.561057 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:52.519515 23455 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:52.559614 15395 consensus_queue.cc:260] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.559983 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.489809 23179 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.536556 23317 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:52.506336 23288 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:52.589219 15395 raft_consensus.cc:3060] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:52.520684 23163 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:05:52.555119 23523 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:05:52.594013 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.559792 23166 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:52.591864 16032 raft_consensus.cc:1240] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:52.563661 15397 consensus_queue.cc:260] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.604135 15397 raft_consensus.cc:3060] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:52.567399 15250 raft_consensus.cc:1240] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:52.584848 23543 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:52.584518 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:52.596962 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:52.611363 16024 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:52.570353 23540 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:05:52.623705 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 442791us
I20260709 13:05:52.579453 23308 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.647509 23179 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:52.594409 23538 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:05:52.616120 23368 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:52.626147 23543 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:52.653613 15398 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:52.488409 23521 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.658871 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.659902 15316 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:52.664366 15250 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 13:05:52.666416 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.638453 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:52.667106 15316 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
W20260709 13:05:52.668861 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.672438 15395 raft_consensus.cc:1275] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260709 13:05:52.673686 15395 pending_rounds.cc:85] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 16
W20260709 13:05:52.673424 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 300317us
I20260709 13:05:52.673981 15395 pending_rounds.cc:107] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260709 13:05:52.623656 23317 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:52.684080 16033 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260709 13:05:52.685753 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.602875 23386 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:52.686769 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.623739 23288 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.700723 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:52.685778 23533 log.cc:927] Time spent T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:05:52.664225 22990 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:52.622581 23544 consensus_queue.cc:1048] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 13:05:52.676949 23319 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:52.714743 15399 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3962) took 1494 ms. Trace:
I20260709 13:05:52.688258 22979 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:52.686197 23511 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:52.642284 23540 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:52.708745 23535 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:05:52.689193 23528 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:52.715292 15399 rpcz_store.cc:276] 0709 13:05:51.220223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.220354 (+   131us) service_pool.cc:224] Handling call
0709 13:05:51.236026 (+ 15672us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:51.258355 (+ 22329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.258402 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:51.259113 (+   711us) log.cc:844] Serialized 52 byte log entry
0709 13:05:51.719233 (+460120us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:51.802129 (+ 82896us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.819853 (+ 17724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.819928 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:51.923079 (+103151us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b18004df5c0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666b0d3f3 00007f3666b0f7c1 00007f3666b0f779 00007f3666b0f709 00007f3666b0f6d1 00007f3666b0e9cd 000000000038f354 000000000038f199 00007f3666af083a
0709 13:05:52.705317 (+782238us) raft_consensus.cc:1685] finished
0709 13:05:52.714416 (+  9099us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.714659 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16478,"prepare.queue_time_us":78274,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":43708,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"spinlock_wait_cycles":79595776,"thread_start_us":395501,"threads_started":1,"wal-append.queue_time_us":774656}
I20260709 13:05:52.733476 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3961) took 1525 ms. Trace:
I20260709 13:05:52.708045 23012 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:52.718814 23261 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:52.714372 23319 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:52.743076 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 73318.7us
W20260709 13:05:52.746431 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.757946 15248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c377e25836b14680beed769c143a593c"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:52.759609 15248 raft_consensus.cc:606] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:52.761070 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.752844 23319 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:52.761761 15321 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:52.737639 23519 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:52.763556 23166 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:52.750022 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.732442 23539 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:05:52.760881 23368 consensus_queue.cc:1059] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:52.737648 15390 rpcz_store.cc:276] 0709 13:05:51.207759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.207918 (+   159us) service_pool.cc:224] Handling call
0709 13:05:51.218341 (+ 10423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.241930 (+ 23589us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:51.322923 (+ 80993us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.170509 (+847586us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.170721 (+   212us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.210732 (+ 40011us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.210883 (+   151us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:52.210922 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.210989 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.733203 (+522214us) raft_consensus.cc:1685] finished
0709 13:05:52.733232 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.733400 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73631,"prepare.queue_time_us":149431,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":74,"raft.queue_time_us":104069,"raft.run_cpu_time_us":500,"raft.run_wall_time_us":26243,"thread_start_us":716892,"threads_started":2,"wal-append.queue_time_us":705670}
I20260709 13:05:52.771236 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:52.747824 15395 raft_consensus.cc:2889] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:52.739365 23558 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:52.729036 22990 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:52.789562 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:52.749118 23451 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:52.798476 15395 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:52.799094 22586 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:52.790982 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.800685 15319 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:52.756639 23452 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:52.748337 23528 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:05:52.807339 23386 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:52.814666 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3966) took 1593 ms. Trace:
I20260709 13:05:52.815116 15394 rpcz_store.cc:276] 0709 13:05:51.221361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.583448 (+362087us) service_pool.cc:224] Handling call
0709 13:05:51.583781 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.584126 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.584155 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.584653 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.242524 (+657871us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:52.242568 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.242642 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.814426 (+571784us) raft_consensus.cc:1685] finished
0709 13:05:52.814446 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.814599 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1155,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":650767,"threads_started":1,"wal-append.queue_time_us":813349}
W20260709 13:05:52.816160 23503 consensus_meta.cc:287] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.000s
I20260709 13:05:52.817752 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.819728 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.820338 15322 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
W20260709 13:05:52.821341 23132 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.761s	user 0.006s	sys 0.006s
I20260709 13:05:52.823081 15322 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:05:52.824959 23540 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:52.826810 15319 raft_consensus.cc:1275] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:05:52.827780 15321 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:52.833557 15242 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
W20260709 13:05:52.809161 23489 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.626s	user 0.010s	sys 0.000s
I20260709 13:05:52.845983 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.847110 15319 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:52.837185 15290 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:52.856467 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.859397 23451 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:52.861410 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:52.826495 23455 raft_consensus.cc:3055] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:52.873265 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.913246 15318 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
W20260709 13:05:52.856880 23064 consensus_meta.cc:287] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.789s	user 0.007s	sys 0.004s
I20260709 13:05:52.873337 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:52.879496 15319 raft_consensus.cc:1275] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:05:52.777076 23519 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:05:52.797875 23558 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:52.909776 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.900089 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 199256us
W20260709 13:05:52.917874 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.900426 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 198099us
I20260709 13:05:52.897738 23572 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.865233 23386 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:05:52.789187 23317 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:52.898085 23580 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.916309 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.936061 22586 consensus_queue.cc:1243] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 24.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
W20260709 13:05:52.922930 23560 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:05:52.913012 23455 raft_consensus.cc:740] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:52.930656 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.914248 23166 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:52.935829 15243 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:52.949553 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.950677 15243 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:05:52.951653 15243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:52.952293 15243 raft_consensus.cc:606] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:05:52.919448 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.920271 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.916532 23288 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:52.954861 15246 raft_consensus.cc:2393] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:52.964737 15999 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:52.965230 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:52.965673 23544 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:52.966091 23544 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.966485 23544 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:52.973376 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 112094us
I20260709 13:05:52.974397 23580 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:52.927801 23489 consensus_queue.cc:1059] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:05:52.976154 23489 raft_consensus.cc:3055] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:52.976550 23489 raft_consensus.cc:740] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:52.977017 23580 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:52.977411 23489 consensus_queue.cc:260] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.974362 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:52.979581 23489 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:52.979660 23166 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:52.981773 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:52.982483 15248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:52.982645 23558 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:52.933331 23572 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:52.993494 23572 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:52.994854 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.995713 15321 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 26: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:52.996435 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:52.997354 15319 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:05:52.925302 23064 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:52.986640 23547 log.cc:927] Time spent T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: Append to log took a long time: real 0.160s	user 0.002s	sys 0.000s
I20260709 13:05:52.999729 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.001111 15250 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 21: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:53.010530 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.013867 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:53.023062 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.027590 15250 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:53.031683 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:53.031904 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 50216.8us
I20260709 13:05:53.032411 15245 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:53.035487 15397 raft_consensus.cc:1240] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 26. Current term is 27. Ops: []
I20260709 13:05:53.038420 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.029774 23477 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:53.041304 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.045583 23544 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:53.065563 23534 log.cc:927] Time spent T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.689s	user 0.000s	sys 0.005s
I20260709 13:05:53.068209 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:53.069329 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:53.075675 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.083170 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.084508 23363 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.077134 23558 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:53.084523 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.087505 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:53.088002 23582 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:05:53.088617 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.089455 15245 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
I20260709 13:05:53.092130 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:53.067389 23477 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:53.096138 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:53.099107 15245 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:53.091547 23261 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:05:53.098677 23166 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:53.093940 23363 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:53.107172 23544 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:53.117384 23571 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.225s	user 0.001s	sys 0.001s
W20260709 13:05:53.119324 23581 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.230s	user 0.002s	sys 0.000s
W20260709 13:05:53.120927 23574 log.cc:927] Time spent T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 13:05:53.126761 23559 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:05:53.099808 23477 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:53.134572 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59013.9us
I20260709 13:05:53.137259 15245 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 25.
I20260709 13:05:53.142261 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.148321 15290 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.151933 23553 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:53.140761 23524 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:05:53.153590 23524 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:53.153956 23524 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:53.154799 23524 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:53.156143 23524 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:53.139081 23558 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:53.147421 23261 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:05:53.173095 23586 log.cc:927] Time spent T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
W20260709 13:05:53.175561 23568 log.cc:927] Time spent T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
I20260709 13:05:53.167860 23319 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:53.185011 23575 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260709 13:05:53.160048 23455 consensus_queue.cc:260] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:53.164793 23340 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.004s
W20260709 13:05:53.190181 23569 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:05:53.223240 23477 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:53.190963 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 44756.7us
I20260709 13:05:53.225492 23477 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.191161 23064 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:53.226486 23308 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.228753 15317 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 13. (term mismatch)
I20260709 13:05:53.229229 15317 pending_rounds.cc:85] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 12
I20260709 13:05:53.229465 15317 pending_rounds.cc:107] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 25.13
I20260709 13:05:53.229707 15317 raft_consensus.cc:2889] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:53.230356 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.231302 15324 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:53.232631 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:53.233287 15320 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:53.235965 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:53.236657 15322 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:53.238433 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:53.215984 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:53.218847 16024 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 25. Current term is 26. Ops: []
W20260709 13:05:53.246362 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.254755 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:53.225417 15290 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.220080 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:53.263796 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:53.267103 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:53.274969 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:53.271770 22667 consensus_queue.cc:1059] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:05:53.265048 23477 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.278769 23477 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:53.280606 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.290203 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:53.200158 23577 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
W20260709 13:05:53.298414 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.304351 22667 raft_consensus.cc:3055] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:53.305022 22667 raft_consensus.cc:740] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:53.306332 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:53.308701 23477 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.265473 23163 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:53.309578 23163 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.309996 23163 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:53.316298 15322 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:53.318367 23538 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
W20260709 13:05:53.318849 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 93524.9us
I20260709 13:05:53.319036 23538 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.319693 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.320667 23308 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:53.321242 23538 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:53.322330 15363 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:53.323678 22586 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:53.324185 22586 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.324572 22586 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:53.192618 23455 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:53.201026 23297 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:53.196270 23553 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.209241 22990 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:53.328344 23261 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:05:53.328225 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.336427 23587 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:53.357553 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:53.358322 16024 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:53.359750 15363 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:53.360697 23503 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:53.361074 23503 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:53.361465 23503 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:53.364120 23587 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:53.364681 23587 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.366122 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.367842 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.368741 23179 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:53.369273 23297 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:53.370733 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.376379 23297 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:53.385870 23566 log.cc:927] Time spent T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.477s	user 0.000s	sys 0.001s
I20260709 13:05:53.356560 23553 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.387300 23543 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.390516 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:53.401346 15391 raft_consensus.cc:3060] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:53.391177 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:53.391885 22667 consensus_queue.cc:260] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.402906 22586 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.396111 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:53.393333 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:53.403430 22667 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:53.407574 16028 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:53.410856 15243 raft_consensus.cc:1240] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:53.400169 15242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60014 (request call id 2622) took 1387 ms. Trace:
I20260709 13:05:53.414554 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.414644 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.420557 15246 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:53.353432 15320 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 28.
I20260709 13:05:53.431066 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.446676 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:53.447832 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 77192.5us
I20260709 13:05:53.449595 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.394603 23503 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.460623 15317 raft_consensus.cc:1217] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Deduplicated request from leader. Original: 20.14->[21.15-23.16]   Dedup: 21.15->[23.16-23.16]
I20260709 13:05:53.461177 15317 raft_consensus.cc:1240] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: [21.15-23.16]
I20260709 13:05:53.451902 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:53.462200 15247 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:53.413618 15242 rpcz_store.cc:276] 0709 13:05:52.013793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.024434 (+ 10641us) service_pool.cc:224] Handling call
0709 13:05:53.399997 (+1375563us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b540011b2d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:53.400108 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786715008}
I20260709 13:05:53.453358 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:53.457516 22586 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:53.458642 23074 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:53.459162 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:53.470033 16028 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:05:53.477589 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.486379 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:53.517503 16028 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:05:53.518205 22586 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.518756 22586 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.527429 15363 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:53.528242 15391 raft_consensus.cc:2468] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 25.
I20260709 13:05:53.451118 23543 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:53.531827 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:53.533558 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:53.531921 15998 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:53.538717 15324 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:53.534296 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:53.459833 23554 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.547142 15324 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:05:53.543658 23399 raft_consensus.cc:2804] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:53.549530 22990 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:53.549963 22990 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.538937 23179 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:53.550338 22990 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:53.550612 23179 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.551003 23179 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:53.543699 23554 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:53.439081 23288 consensus_queue.cc:1059] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.091s
I20260709 13:05:53.526566 23497 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:53.525950 23558 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:53.513521 23386 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:53.560415 15318 raft_consensus.cc:1240] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 25. Current term is 26. Ops: []
W20260709 13:05:53.538789 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 89302.2us
I20260709 13:05:53.529778 23544 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:53.568331 15290 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.575736 15247 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 27.
I20260709 13:05:53.578152 22586 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:53.561901 23554 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.541508 23074 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:53.569743 23288 consensus_queue.cc:1243] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer 89940175e5444593aab6b3a025624b5b log is divergent from this leader: its last log entry 24.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:05:53.587731 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:53.591446 15318 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 26.
I20260709 13:05:53.574806 23064 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:05:53.592267 23297 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:53.597602 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:53.599120 15324 raft_consensus.cc:2393] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:53.577693 23544 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.571341 23558 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.591545 23503 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:53.618364 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:53.600849 23584 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.705s	user 0.003s	sys 0.000s
I20260709 13:05:53.599258 23064 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:53.583379 23386 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.637095 15390 raft_consensus.cc:3055] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:53.637672 15390 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:53.644950 15289 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:53.646108 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:53.610812 23261 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:53.650069 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:53.648800 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:53.620193 23557 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:53.657712 22990 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.663062 23074 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.663259 23544 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.665426 23558 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.665974 23553 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:53.667142 23553 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:53.667436 22990 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:53.667846 23553 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:53.665197 23179 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:53.668409 23553 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:53.669391 23553 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.670384 23179 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.671373 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.672586 15213 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.673336 23477 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:53.673653 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:53.659008 23064 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.653510 23554 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:05:53.673743 23477 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:53.677079 23477 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:53.681285 23573 log.cc:927] Time spent T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.793s	user 0.001s	sys 0.002s
W20260709 13:05:53.658859 23600 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:53.683768 23587 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:53.695489 15215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.683820 15390 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:53.657712 23163 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:53.709568 23074 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:53.709589 15213 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:53.710325 23074 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:53.711388 23074 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:53.712116 15213 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.713363 22667 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:53.714118 22667 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:05:53.714872 23554 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:53.715653 23554 consensus_queue.cc:1059] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 26.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:05:53.650950 23521 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.008s	sys 0.044s
I20260709 13:05:53.724548 22667 raft_consensus.cc:993] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:05:53.717414 23139 raft_consensus.cc:3055] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:05:53.729643 15390 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:53.717792 23561 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:05:53.736756 23521 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.009s	sys 0.044s
W20260709 13:05:53.737283 23317 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.021s	sys 0.036s
I20260709 13:05:53.707482 23493 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.081s
W20260709 13:05:53.816357 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.819558 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:53.756536 23139 raft_consensus.cc:740] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:53.791155 23317 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.022s	sys 0.037s
I20260709 13:05:53.814785 23319 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:53.822458 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:53.835474 15392 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 27.
I20260709 13:05:53.833483 15248 raft_consensus.cc:606] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Received request to transfer leadership to TS 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:53.807020 23495 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:53.837460 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:53.840524 15392 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:53.717823 23477 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:53.842415 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 315096us
I20260709 13:05:53.852386 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:53.854637 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:53.857201 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:53.859547 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:53.860581 15242 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:53.862169 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.835839 23561 raft_consensus.cc:1081] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:05:53.843369 23399 raft_consensus.cc:697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:53.873085 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 3979) took 1280 ms. Trace:
I20260709 13:05:53.874984 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:53.877379 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:05:53.880187 23368 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
W20260709 13:05:53.885146 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 316915us
W20260709 13:05:53.886001 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.888895 16024 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:53.890564 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:53.891904 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:53.893191 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.872822 16028 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:53.894608 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:53.887517 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:53.884408 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 324876us
I20260709 13:05:53.920686 15363 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:05:53.893996 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 245259us
I20260709 13:05:53.896953 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:53.891881 15392 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 21.
I20260709 13:05:53.887490 15390 rpcz_store.cc:276] 0709 13:05:52.592884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.827210 (+234326us) service_pool.cc:224] Handling call
0709 13:05:52.863095 (+ 35885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:53.636966 (+773871us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b54001287a0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669b71dc0 00007f3669bfc1c0 00007f3669bfd231 00007f3669bf9d8f 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c
0709 13:05:53.872499 (+235533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.872542 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.872606 (+    64us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:53.872653 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.872829 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.873000 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92016,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7925,"spinlock_wait_cycles":84444032}
W20260709 13:05:53.909876 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46600.7us
I20260709 13:05:53.965248 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:53.895247 23424 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:05:53.975622 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 78741.9us
W20260709 13:05:53.965999 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 45447.9us
I20260709 13:05:53.976632 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:53.896127 23518 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:53.978322 16032 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:05:53.975459 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 237987us
I20260709 13:05:53.979893 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:53.932814 23163 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:53.982254 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:53.969374 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:53.981640 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:53.977320 15363 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:53.980813 16030 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:53.986985 15363 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:53.982465 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 262776us
I20260709 13:05:53.988677 15213 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:53.981355 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:53.968616 23489 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:53.998800 22667 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:53.906329 23308 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 13:05:53.979959 23424 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:53.995801 15290 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:54.008917 22667 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.017s
I20260709 13:05:53.993057 23615 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:54.027756 23615 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.895536 23139 consensus_queue.cc:260] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:53.993533 23503 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:54.028236 23556 raft_consensus.cc:993] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: : Instructing follower 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
W20260709 13:05:54.029111 23619 log.cc:927] Time spent T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:05:54.029445 23556 raft_consensus.cc:1081] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Signalling peer 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
W20260709 13:05:54.030174 23620 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:05:53.997093 23477 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:53.928787 23399 consensus_queue.cc:237] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.028934 23424 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:05:54.031951 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.032538 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:53.980306 23621 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:53.991233 23528 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:05:54.034116 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:54.032928 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:54.038832 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:54.046583 15242 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:54.039613 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 43943.4us
I20260709 13:05:54.040377 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:53.996557 23606 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:05:54.028306 23615 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:54.039193 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:54.005653 23555 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:54.005326 23288 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:54.057956 15246 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:54.054144 15242 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:54.060109 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:54.024607 23519 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:54.088802 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:54.089184 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:54.089936 15390 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 25: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:54.005388 23166 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:54.036278 23503 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:54.087633 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 46577.3us
W20260709 13:05:54.095489 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 62611us
I20260709 13:05:54.098130 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:54.045836 23556 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:54.046474 23616 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:54.055063 15392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:05:54.111692 15392 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:54.112231 15392 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.117187 15250 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:54.119661 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:54.057940 23621 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:54.091447 23528 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:54.099171 23503 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:54.097551 23166 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:54.094883 23633 consensus_queue.cc:1048] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:05:54.127771 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:54.132969 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.133739 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:54.134160 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.139703 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.140833 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.141038 15393 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:54.106833 23288 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:54.104576 23556 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:54.141479 15395 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
W20260709 13:05:54.128767 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 109106us
I20260709 13:05:54.143554 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.142474 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.144618 15393 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 17.
I20260709 13:05:54.147814 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.155315 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.155606 15246 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:54.128281 23489 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:54.095849 23555 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.129612 23074 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:54.159060 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.168486 15397 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:54.129451 23166 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:54.106766 23519 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.135217 23064 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:54.170125 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72207.7us
I20260709 13:05:54.146723 23556 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:54.160501 23261 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:54.167900 23074 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:54.196594 23623 log.cc:927] Time spent T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:05:54.203461 23612 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:54.175369 23621 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.209436 23074 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:54.191349 23064 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:54.254066 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 112592us
W20260709 13:05:54.225629 23617 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.257s	user 0.000s	sys 0.002s
I20260709 13:05:54.283100 16033 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:05:54.285511 15392 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:54.264382 23602 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:05:54.289043 15291 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:54.289868 23261 raft_consensus.cc:2804] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:54.290412 23261 raft_consensus.cc:697] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:54.291309 23261 consensus_queue.cc:237] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.283418 23424 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.217621 23288 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:54.297569 23636 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:05:54.271457 23519 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:54.269104 23626 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:05:54.277257 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:54.306639 15390 raft_consensus.cc:3060] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:05:54.279466 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:54.294832 23624 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:05:54.287683 15392 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:54.274682 23618 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:05:54.340822 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:54.347054 15250 raft_consensus.cc:2368] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 26. Current term is 27.
I20260709 13:05:54.351954 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:54.353247 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:54.354148 15243 raft_consensus.cc:3055] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:54.358007 23074 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.360423 23074 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:54.363727 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 321683us
I20260709 13:05:54.364065 23424 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:54.337060 23630 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:05:54.354606 15243 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:54.303370 23626 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.374919 15243 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.379386 15243 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.346510 23477 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:54.397527 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:54.400941 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.402035 15390 raft_consensus.cc:2468] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:54.398548 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:54.223495 23528 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.336345 23572 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:05:54.411556 15323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c377e25836b14680beed769c143a593c"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:39714
I20260709 13:05:54.412230 15323 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:05:54.404166 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 260074us
I20260709 13:05:54.406188 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:54.412686 15323 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:54.413075 15324 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:05:54.213109 23632 consensus_queue.cc:1059] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.142s
I20260709 13:05:54.386682 23626 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:54.262426 23612 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.414144 23489 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:54.440173 15364 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:54.415040 15363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:54.449084 15365 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.452859 15321 raft_consensus.cc:1240] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:54.415686 23572 consensus_queue.cc:1243] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer edcf4a6bae7e4781bce325a586109ca5 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:05:54.474522 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 376479us
I20260709 13:05:54.474977 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:54.475574 15321 raft_consensus.cc:2376] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 27. Re-sending same reply.
I20260709 13:05:54.476189 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:54.467074 15323 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.488377 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:54.490568 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:54.492726 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:54.494168 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:54.498338 15396 raft_consensus.cc:1240] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:54.499559 15323 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:54.499987 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:54.409235 23477 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.506317 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:54.506999 15321 raft_consensus.cc:2376] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23. Re-sending same reply.
I20260709 13:05:54.496968 15324 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:54.507853 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:54.508987 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:54.513793 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:54.469048 23555 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:54.521293 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:54.507302 23616 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:54.529831 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:54.520328 23643 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:54.556244 23477 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:54.557170 23386 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:54.535012 23632 raft_consensus.cc:2764] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:05:54.586931 15319 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:54.577521 23615 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.608460 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:54.609351 15318 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:54.581310 23503 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.530836 23651 raft_consensus.cc:2764] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
W20260709 13:05:54.610482 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 96046.2us
I20260709 13:05:54.571798 15243 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:54.603804 23612 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:54.621377 15325 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 27: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:05:54.624856 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.620779 15215 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:54.631105 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.534734 23489 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.607707 23625 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.632586 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:54.635210 23561 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:54.635854 23561 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.638106 23556 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:54.640393 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66114.6us
I20260709 13:05:54.642638 23518 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:54.644882 23615 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:54.644732 23625 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.650849 15290 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:54.631754 15362 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.206.194:34635 timed out after 1.570s (SENT) [suppressed 16 similar messages]
I20260709 13:05:54.652233 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:54.658540 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:54.638121 23561 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:54.662624 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:54.663023 23503 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:54.663774 23670 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:54.664302 23670 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:54.664736 23670 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:54.661294 23518 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:54.666445 23561 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:54.667124 23561 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:54.668128 23561 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.660861 23556 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:54.670863 23166 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.671432 15999 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:54.672806 23649 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:54.673635 23649 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:54.675402 15362 connection.cc:256] RPC call timeout handler was delayed by -1.136369567000088s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19240000000000002s for a response
I20260709 13:05:54.675899 15322 raft_consensus.cc:1240] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 21. Current term is 22. Ops: []
W20260709 13:05:54.676404 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.659960 23651 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:05:54.660192 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:54.680658 15362 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:54.683516 22586 raft_consensus.cc:2764] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:05:54.685497 15362 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:54.681981 23288 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:54.686728 23288 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.660118 23368 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:54.687855 23368 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.689039 23288 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:54.692310 23625 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:54.699987 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:54.701004 22586 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:54.701578 22586 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:54.702145 22586 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:54.673147 23166 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:54.702450 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:54.681804 23503 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.690054 23368 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:54.710305 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39714 (request call id 3871) took 1234 ms. Trace:
I20260709 13:05:54.701222 23587 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:54.746431 23587 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:54.747045 23587 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:54.714555 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:54.711714 23503 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.716850 23610 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:54.734365 23543 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:54.701889 23633 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:05:54.739532 23261 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:54.741068 23626 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.798894 23261 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:54.800092 23261 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.801156 23626 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:54.801262 23261 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:54.743964 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.713222 23615 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:54.749641 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:54.751546 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:54.804865 23670 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.752283 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:54.806509 15392 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:54.757438 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:54.758213 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:54.758599 22586 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.759474 15213 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:54.809998 16030 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
W20260709 13:05:54.810300 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 50942.7us
I20260709 13:05:54.811510 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:54.712074 15317 rpcz_store.cc:276] 0709 13:05:53.475559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.475709 (+   150us) service_pool.cc:224] Handling call
0709 13:05:53.533580 (+ 57871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:53.533813 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:05:53.557025 (+ 23212us) log.cc:844] Serialized 14 byte log entry
0709 13:05:53.664377 (+107352us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b18003401e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a23a 00007f3669c04a2a
0709 13:05:54.300061 (+635684us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b18003401e0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666a87c0a 00007f36701c7219 00007f3666b0fa40 00007f3666b0a4e4 00007f3666b0a455 00007f366d5f23c7 00007f3669c049a7 00007f3669c140bf 00007f3669c14038
0709 13:05:54.709661 (+409600us) log.cc:844] Serialized 14 byte log entry
0709 13:05:54.709911 (+   250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:54.709968 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:54.710015 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.710084 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.710212 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19995,"prepare.queue_time_us":482092,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":114,"raft.queue_time_us":3697,"spinlock_wait_cycles":71303168,"thread_start_us":660089,"threads_started":2,"wal-append.queue_time_us":428607}
I20260709 13:05:54.760314 15320 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:54.763378 15390 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:05:54.813894 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:54.814512 15390 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:54.764362 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:54.764799 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:54.771389 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:54.776326 15391 raft_consensus.cc:1240] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:54.776404 16033 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:54.763968 23528 consensus_queue.cc:1048] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:05:54.780264 23166 consensus_queue.cc:1059] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:05:54.784583 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:54.787222 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:54.795374 15248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:38848 (request call id 47) took 1823 ms. Trace:
I20260709 13:05:54.828265 15248 rpcz_store.cc:276] 0709 13:05:52.971841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.982314 (+ 10473us) service_pool.cc:224] Handling call
0709 13:05:54.794924 (+1812610us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b5400119ed4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf4853 00007f366ebc260a 00007f36681487d4 00007f3668148762 00007f3668148691 00007f366814860c 00007f36681478c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:05:54.795222 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946311424}
I20260709 13:05:54.816687 15396 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
W20260709 13:05:54.823737 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 59083us
I20260709 13:05:54.831281 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:54.824221 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:54.824928 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53692.6us
I20260709 13:05:54.841495 15323 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:54.839857 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:54.846657 22586 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:54.847153 15391 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:54.848315 15399 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:54.852164 15362 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:54.848456 15289 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:54.854084 15289 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:54.826246 23521 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:54.823400 23610 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.837247 23288 raft_consensus.cc:2764] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:05:54.826699 23545 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:54.876840 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:54.888583 15317 raft_consensus.cc:3060] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.889508 15391 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:54.878041 15392 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:54.808140 23543 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.867663 23489 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:54.869179 23648 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.841197 23243 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:54.910598 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:54.881771 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:54.894898 22586 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:54.914767 22586 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.776440 23556 consensus_queue.cc:1059] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.079s
I20260709 13:05:54.909581 15323 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 27.
I20260709 13:05:54.886555 23616 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:54.880908 23643 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.922564 15391 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:54.859711 23646 consensus_queue.cc:1048] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.051s
I20260709 13:05:54.920182 15290 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:54.888226 23521 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:54.892814 23424 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:54.870169 23665 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.083s
I20260709 13:05:54.891294 23650 raft_consensus.cc:2764] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:05:54.888233 23610 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.905149 23553 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.037s
I20260709 13:05:54.879837 15390 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 27 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 13:05:54.937954 23643 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.931970 23616 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.946429 23543 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:54.948340 23503 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:54.950954 15243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f"
dest_uuid: "89940175e5444593aab6b3a025624b5b"
mode: GRACEFUL
new_leader_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:38848
I20260709 13:05:54.971776 15243 raft_consensus.cc:606] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Received request to transfer leadership to TS ee9654803379434388de45d4693e6b16
I20260709 13:05:54.972304 15243 raft_consensus.cc:614] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:54.951960 23587 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:54.953656 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.955019 15391 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:05:54.974028 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 121964us
I20260709 13:05:54.938110 23243 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:54.955096 22586 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:54.932442 23166 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:54.937805 23318 raft_consensus.cc:3055] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:54.954298 23179 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:54.977986 15394 raft_consensus.cc:1240] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 26. Current term is 27. Ops: []
I20260709 13:05:54.923431 23648 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:54.971134 23616 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:54.986783 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:54.994601 15248 raft_consensus.cc:1275] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:05:54.996430 23670 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:54.996170 23243 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:54.997181 23648 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:54.994174 23528 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:54.976434 23318 raft_consensus.cc:740] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:55.002046 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:54.987267 23166 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.021471 23166 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.016650 22586 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:05:55.031052 23424 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:55.031749 23424 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.007206 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:55.035152 15243 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 27. Current term is 28. Ops: []
I20260709 13:05:55.037161 23424 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.018626 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:55.044417 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.045213 15391 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 27: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:55.019702 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.047004 15390 raft_consensus.cc:2410] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 26 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:05:55.020191 23318 consensus_queue.cc:260] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.049084 23318 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:55.015661 23572 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:55.052613 23555 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:55.053390 23572 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.055227 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.055845 23572 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:55.037381 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:55.061435 15317 raft_consensus.cc:2468] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
W20260709 13:05:55.041479 23653 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.538s	user 0.001s	sys 0.002s
I20260709 13:05:55.041889 23166 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:55.042788 23654 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.529s	user 0.001s	sys 0.000s
I20260709 13:05:54.989449 23179 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:55.063290 23521 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.066188 23643 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:55.076211 23610 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:55.075559 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:55.077584 23561 consensus_queue.cc:1059] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:05:55.080353 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.016928 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:55.040246 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:55.081759 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.081913 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.094650 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:55.093225 15291 leader_election.cc:400] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 26. Current term is 27.
I20260709 13:05:55.098431 15319 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:05:55.100018 15291 leader_election.cc:403] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260709 13:05:55.086383 23651 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:55.112701 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.109683 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:55.100409 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:55.088177 23297 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:55.114639 15362 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:55.087944 23633 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 13:05:55.128566 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:55.130532 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:55.133198 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:55.134368 22586 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:55.111864 23610 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:05:55.132015 23503 raft_consensus.cc:2804] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:55.139242 23503 raft_consensus.cc:697] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:55.122605 23489 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:55.116731 23685 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:55.123317 23553 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.145555 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:55.122176 23628 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.126506 23658 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.132828 23661 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.149973 15317 raft_consensus.cc:2410] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:05:55.134786 23538 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:05:55.137370 22990 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.137722 23633 consensus_queue.cc:1243] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer ee9654803379434388de45d4693e6b16 log is divergent from this leader: its last log entry 26.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260709 13:05:55.125525 23297 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.154598 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:55.160635 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:55.133088 23166 consensus_queue.cc:1059] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:05:55.170464 22990 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:55.220523 23652 log.cc:927] Time spent T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.712s	user 0.001s	sys 0.000s
I20260709 13:05:55.221123 22990 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.222018 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:55.174641 23503 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.223490 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:55.224730 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:55.225308 15317 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:55.147190 23179 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.227882 23386 raft_consensus.cc:3055] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:55.228425 23386 raft_consensus.cc:740] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:55.120303 23651 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.229321 23386 consensus_queue.cc:260] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.156694 23553 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.159649 23661 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.183378 16033 pending_rounds.cc:85] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Aborting all ops after (but not including) 14
I20260709 13:05:55.157929 23658 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.186088 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:55.188139 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:55.188803 16030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:55.190938 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:55.191783 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:55.148461 23628 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.196355 23616 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.204356 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.212548 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:55.214774 15242 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:55.215816 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:55.232316 23651 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.179515 23297 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.234936 23064 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:55.237234 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:55.240844 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.243045 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.244906 23139 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:55.245893 16033 pending_rounds.cc:107] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:05:55.280972 16033 raft_consensus.cc:2889] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:55.255235 15242 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:55.246047 23386 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:55.286816 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:55.291283 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:55.293452 15242 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.312049 15242 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:55.285400 22990 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.287683 23179 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.294668 23651 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.332304 15398 raft_consensus.cc:1240] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:55.342167 15394 raft_consensus.cc:1240] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:05:55.350888 15242 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 18.
I20260709 13:05:55.359985 23538 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.360687 23538 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.364619 23538 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:55.369381 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:55.370817 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:55.372689 23538 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:55.319682 22990 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.384470 15319 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:05:55.385445 22990 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.385972 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:55.386740 15318 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:55.388828 23628 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:55.390460 23658 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:55.390988 15996 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:55.392050 23616 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:55.392831 15996 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:55.393543 23661 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.393766 23340 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:55.394290 23340 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.369756 23689 consensus_queue.cc:1059] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
W20260709 13:05:55.369976 23074 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:05:55.394726 23340 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:55.395496 23266 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:55.324690 23179 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.395920 23266 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:55.396390 23266 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:55.330646 23651 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.400933 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.401201 23651 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:55.401649 15248 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
I20260709 13:05:55.402981 15244 raft_consensus.cc:1240] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:05:55.378618 23691 consensus_queue.cc:1059] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 26.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:05:55.397993 23179 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.405545 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.405819 23685 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 26. Current term is 27.
I20260709 13:05:55.406726 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.418180 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.419164 15248 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:55.418273 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:55.417516 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46675.6us
I20260709 13:05:55.419989 15322 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1198) took 1136 ms. Trace:
I20260709 13:05:55.420393 15322 rpcz_store.cc:276] 0709 13:05:54.283812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.285678 (+  1866us) service_pool.cc:224] Handling call
0709 13:05:54.286006 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.676373 (+390367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.419738 (+743365us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54004033d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:55.419918 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896078208}
I20260709 13:05:55.420881 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:55.432821 15321 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:55.407631 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.447099 15393 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:55.408174 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.409418 23553 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.410162 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.460574 15245 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:55.412168 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.450460 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:55.454856 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.433368 15321 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:55.459348 15320 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 26. Current term is 27. Ops: [26.13-26.13]
I20260709 13:05:55.448859 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:55.460722 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.461583 15398 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
I20260709 13:05:55.467643 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.469300 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:55.473912 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.475375 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:55.476081 15245 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:55.464088 15321 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:55.482652 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 64480.2us
I20260709 13:05:55.483882 15321 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:55.463790 23503 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:55.464953 23540 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.501917 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.473390 22990 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:55.505084 15243 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:55.512795 16028 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:05:55.512926 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:55.516635 16028 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:05:55.495875 23503 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:55.473963 23399 consensus_queue.cc:1059] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:05:55.524400 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.501648 23538 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:55.515595 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:55.500996 23558 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:55.528002 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:55.522745 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 45021.7us
I20260709 13:05:55.506568 23495 raft_consensus.cc:3055] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:05:55.523950 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.530880 23495 raft_consensus.cc:740] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:55.525637 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.526505 15245 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 27.
I20260709 13:05:55.506870 22990 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.524462 23503 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:55.567265 15241 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 27.
I20260709 13:05:55.570978 15397 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:05:55.561851 23179 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:55.534029 15214 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:55.573518 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:55.523394 23642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.009s	sys 0.006s
I20260709 13:05:55.575448 15325 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 27.
I20260709 13:05:55.572736 22586 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:05:55.509778 23540 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.582890 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:55.583815 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 49896.6us
I20260709 13:05:55.590310 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:55.588078 15291 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:55.589362 15322 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:55.559842 23689 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:55.559527 22990 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:55.518364 23340 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.529090 23648 consensus_queue.cc:1059] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.054s
W20260709 13:05:55.579140 23642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.011s	sys 0.014s
I20260709 13:05:55.598266 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:55.559182 23561 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.596755 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:55.572500 23318 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.601462 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.591639 23139 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:55.598204 23386 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:05:55.598465 23690 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:55.528425 23538 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:55.603917 16024 raft_consensus.cc:1240] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
W20260709 13:05:55.604233 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.604874 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.606047 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.607535 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:55.600956 23308 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:55.641403 23308 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.641844 23308 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:55.642632 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:55.612839 15243 raft_consensus.cc:1240] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 26. Current term is 27. Ops: []
I20260709 13:05:55.635632 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:55.635115 23697 log.cc:927] Time spent T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:05:55.600628 23495 consensus_queue.cc:260] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.649101 23495 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:55.612920 15247 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:05:55.618520 23518 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:55.660729 15321 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 13:05:55.661227 15321 pending_rounds.cc:85] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 17
I20260709 13:05:55.661481 15321 pending_rounds.cc:107] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260709 13:05:55.661742 15321 raft_consensus.cc:2889] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:55.558055 23558 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.665812 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:55.611613 15291 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:55.673691 15246 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:05:55.680194 23477 raft_consensus.cc:3055] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:55.680693 23477 raft_consensus.cc:740] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:55.681502 23266 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:55.685460 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 74004.2us
I20260709 13:05:55.687107 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.687603 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:55.689222 15291 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:55.690286 15291 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:55.694393 15291 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:55.695395 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:55.696403 15246 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:55.684378 23518 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:55.628455 23540 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.698915 15249 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:05:55.699404 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:55.706128 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:55.706627 16032 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:55.677968 23538 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:55.712711 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.688851 23179 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:55.702373 23363 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.683257 23318 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.702320 23166 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:05:55.698172 23386 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:55.612232 23561 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.705685 23555 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.686939 23297 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:05:55.703570 23518 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.721848 23363 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.734140 23266 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:55.736568 23701 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.160s	user 0.002s	sys 0.000s
W20260709 13:05:55.742676 23637 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 1.352s	user 0.003s	sys 0.001s
I20260709 13:05:55.681556 23477 consensus_queue.cc:260] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.713763 23540 consensus_queue.cc:1048] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:05:55.729285 23643 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:55.727648 23386 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:55.741489 23518 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:55.740871 23166 raft_consensus.cc:697] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:55.781312 15249 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:55.738845 23555 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.784400 23558 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.785902 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:55.758759 23643 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:55.788483 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 255947us
I20260709 13:05:55.800411 16032 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 27.
I20260709 13:05:55.803002 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:55.781270 23386 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:55.874454 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 174211us
I20260709 13:05:55.796370 23139 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.804004 23643 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:05:55.876371 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 73502.4us
W20260709 13:05:55.866106 23637 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:05:55.862474 23064 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.015s
I20260709 13:05:55.877313 23646 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:55.877437 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:55.807070 23610 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:55.870637 23243 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.878005 23621 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:55.817795 23708 consensus_queue.cc:1059] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 26.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
W20260709 13:05:55.899616 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 205315us
I20260709 13:05:55.882794 23553 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:55.917979 15242 raft_consensus.cc:1240] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 27. Current term is 28. Ops: [27.15-27.15]
I20260709 13:05:55.893778 23709 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:55.879649 23139 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.934543 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:55.941510 23610 raft_consensus.cc:3055] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:05:55.942016 23610 raft_consensus.cc:740] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:55.942921 23610 consensus_queue.cc:260] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.944262 23610 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:05:55.930977 23706 log.cc:927] Time spent T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:05:55.952169 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:55.933841 23363 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.960664 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:55.894409 23243 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.968468 22667 raft_consensus.cc:993] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: : Instructing follower 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
I20260709 13:05:55.969396 22667 raft_consensus.cc:1081] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Signalling peer 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
W20260709 13:05:55.970804 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 54536.1us
I20260709 13:05:55.972829 15289 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:55.973634 16033 raft_consensus.cc:2393] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 27: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:55.979687 15250 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:55.952328 23297 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:55.982892 23297 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.985163 23297 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:55.912060 23166 consensus_queue.cc:237] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.987262 23297 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:55.990420 23243 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:55.959108 23540 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:55.992412 23540 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.985992 22990 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:55.999169 22990 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.000633 23544 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.001178 23544 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:55.970630 23642 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:56.003518 15216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.003647 23544 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.012771 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:56.013103 23386 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.014146 16033 raft_consensus.cc:2410] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 25 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
W20260709 13:05:56.018994 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 141597us
I20260709 13:05:56.021225 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:56.022146 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.022773 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:56.025924 15365 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:56.027058 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.030936 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.032136 23503 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.032558 15249 raft_consensus.cc:1275] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:05:56.036388 23538 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.029019 23621 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:56.029402 23709 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:56.038929 23709 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.039088 23139 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.039343 23709 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:56.039088 23538 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:56.025823 23555 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.036394 23518 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.023610 23064 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:56.050657 23518 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.050504 23308 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.052297 23709 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.052922 23308 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.054570 23709 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:56.056286 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.057070 15242 raft_consensus.cc:2393] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:56.058570 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.058804 15321 raft_consensus.cc:1240] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:56.060192 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:56.062758 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:56.064257 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:56.064644 16033 raft_consensus.cc:1240] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:56.065117 15324 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 24: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:56.066938 23704 consensus_queue.cc:1059] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:56.068270 23665 raft_consensus.cc:3055] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:56.069013 23665 raft_consensus.cc:740] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:56.068338 23627 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:56.073756 15323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:39714
I20260709 13:05:56.074451 15323 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.074818 15323 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:05:56.072358 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:56.076566 15319 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 26. Current term is 27. Ops: [26.13-26.13]
I20260709 13:05:56.073052 15213 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:56.081167 15213 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:56.084841 15323 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.085837 15324 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 28. Current term is 29. Ops: []
I20260709 13:05:56.087138 22586 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:56.090095 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:56.091387 15316 raft_consensus.cc:2410] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 28 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
I20260709 13:05:56.091820 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.092972 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.093567 15250 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:56.069978 23665 consensus_queue.cc:260] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.094709 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:56.087929 23621 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.011s
I20260709 13:05:56.096540 23665 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:56.094868 15213 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:56.102876 23139 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:05:56.108788 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: true dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.109434 15248 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:05:56.109799 15248 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:56.110667 15248 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.111531 15248 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:05:56.086669 23538 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:56.088464 23627 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:56.115188 15323 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.094798 23503 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:56.118777 23642 consensus_queue.cc:1059] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:05:56.115461 23704 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:05:56.123132 23139 raft_consensus.cc:3055] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:56.123611 23704 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 27 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:56.123667 23139 raft_consensus.cc:740] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
W20260709 13:05:56.124223 23702 log.cc:927] Time spent T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.592s	user 0.000s	sys 0.003s
I20260709 13:05:56.124779 23139 consensus_queue.cc:260] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.126276 23139 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:56.124737 23704 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.115633 23538 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.128574 15213 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:56.104208 23643 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.129595 23642 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:05:56.136089 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:56.131779 23340 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.133666 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:56.134414 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:56.138396 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:56.135514 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:56.139061 15322 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 26.
I20260709 13:05:56.139184 15323 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 19.
I20260709 13:05:56.127889 23720 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.143024 23720 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.144909 23720 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.145604 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.140839 15996 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:56.133666 23538 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:56.150084 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:56.152136 15996 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:56.153721 23558 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:56.154168 23558 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:56.154582 23558 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.157382 15248 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 29.
I20260709 13:05:56.158107 15250 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 27.
I20260709 13:05:56.159555 23555 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:05:56.160704 23555 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:56.161098 23555 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:56.161496 23540 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.147780 23642 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:56.149536 23720 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.167678 23587 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:56.231979 22586 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:05:56.232719 15394 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:05:56.186097 23709 consensus_queue.cc:1059] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:56.168993 23643 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.166193 23558 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.210707 15317 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2644) took 1067 ms. Trace:
W20260709 13:05:56.216809 23524 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 26 current term: 26 is higher.
I20260709 13:05:56.229259 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:56.231675 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.235245 15395 raft_consensus.cc:1240] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:56.238471 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.242888 23318 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.250811 15392 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:56.251164 15325 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:56.244462 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:56.244879 15317 rpcz_store.cc:276] 0709 13:05:55.143454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.312761 (+169307us) service_pool.cc:224] Handling call
0709 13:05:55.313222 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:55.313691 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:55.326972 (+ 13281us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.368773 (+ 41801us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:55.369893 (+  1120us) log.cc:844] Serialized 26 byte log entry
0709 13:05:55.370086 (+   193us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:55.371046 (+   960us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.371400 (+   354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.371514 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.123879 (+752365us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b2400176738. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f36669939c4 00007f3666991acb 00007f3666b4cdc9 00007f3666b4ca55 00007f3666b4c09d 00007f366977e10e 00007f366979588c 00007f3669794bb6 00007f36697947d8 00007f366979e221
0709 13:05:56.210365 (+ 86486us) raft_consensus.cc:1685] finished
0709 13:05:56.210412 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.210623 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13309,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":333,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":4290,"spinlock_wait_cycles":17693952,"thread_start_us":25050,"threads_started":1,"wal-append.queue_time_us":162389}
I20260709 13:05:56.245939 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:56.252374 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.253880 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.254690 15249 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:05:56.246635 23621 raft_consensus.cc:3055] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:56.256196 23621 raft_consensus.cc:740] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:56.257115 23621 consensus_queue.cc:260] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.257668 23558 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.232523 23633 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.258363 23621 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:56.258496 23633 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.260793 23633 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.266713 23625 raft_consensus.cc:3055] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:05:56.267313 23625 raft_consensus.cc:740] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:56.268208 23625 consensus_queue.cc:260] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.269512 23561 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:56.270196 23625 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:56.266798 23661 raft_consensus.cc:3055] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:56.275336 23661 raft_consensus.cc:740] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:56.276564 23661 consensus_queue.cc:260] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.278053 23661 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:56.274088 15999 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:56.171819 23555 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.285478 15248 raft_consensus.cc:2468] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:05:56.292297 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:56.298791 15999 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:56.304539 15397 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:05:56.305629 16033 raft_consensus.cc:1240] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 26. Current term is 27. Ops: []
I20260709 13:05:56.307827 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:56.308534 15395 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 27.
I20260709 13:05:56.308044 15396 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:05:56.239430 23720 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.290489 23558 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:56.323835 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:56.326501 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:56.306286 23711 raft_consensus.cc:2804] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:56.322422 23558 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:56.329589 23318 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:56.336853 23555 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.337844 23558 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:56.329394 23628 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:05:56.342825 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.345728 15213 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:56.348289 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:56.348994 15319 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 27.
I20260709 13:05:56.350293 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:56.351923 15323 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:56.332814 23711 raft_consensus.cc:697] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:56.352664 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:56.352864 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:56.353474 15323 raft_consensus.cc:3060] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:56.353713 23711 consensus_queue.cc:237] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.354388 15319 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260709 13:05:56.354811 15319 pending_rounds.cc:85] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting all ops after (but not including) 12
I20260709 13:05:56.355062 15319 pending_rounds.cc:107] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:05:56.355257 15317 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:05:56.355309 15319 raft_consensus.cc:2889] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:56.356585 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:56.352763 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:56.327941 23704 consensus_queue.cc:1059] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
W20260709 13:05:56.349618 23723 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:05:56.371994 15322 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:05:56.373039 15316 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:05:56.375644 15396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100"
dest_uuid: "ee9654803379434388de45d4693e6b16"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59684
I20260709 13:05:56.353724 23665 consensus_queue.cc:1059] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:05:56.363308 23627 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:05:56.349411 23644 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:56.375541 23628 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:56.389328 15396 raft_consensus.cc:606] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Received request to transfer leadership
I20260709 13:05:56.397897 15396 raft_consensus.cc:614] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:56.370204 23424 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:56.380688 23538 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.395648 15323 raft_consensus.cc:2468] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 27.
I20260709 13:05:56.391616 23642 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:56.393343 23627 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.405117 15323 raft_consensus.cc:1240] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:56.394097 23561 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:05:56.407948 23627 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:56.417834 16028 raft_consensus.cc:1240] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:56.401599 23424 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.418749 16027 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:05:56.430629 15245 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:05:56.432226 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.433015 22586 consensus_queue.cc:1059] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:05:56.433130 15365 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:56.436695 15247 raft_consensus.cc:1240] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:05:56.435814 23633 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.011s
I20260709 13:05:56.450383 23717 raft_consensus.cc:3055] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:56.451027 23717 raft_consensus.cc:740] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:56.452077 23717 consensus_queue.cc:260] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.453315 23558 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.453395 23717 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.467852 15249 raft_consensus.cc:2468] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 27.
I20260709 13:05:56.440966 23708 raft_consensus.cc:2804] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:05:56.460206 23720 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:56.476923 23726 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:05:56.495525 23729 log.cc:927] Time spent T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:56.481964 23708 raft_consensus.cc:697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:56.496529 16027 raft_consensus.cc:1240] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:56.497095 23708 consensus_queue.cc:237] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.499076 23538 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:56.505491 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:56.509059 15319 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:05:56.520936 23613 raft_consensus.cc:3055] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:56.521644 23613 raft_consensus.cc:740] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:56.522876 23613 consensus_queue.cc:260] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.524681 23613 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:56.514636 23650 consensus_queue.cc:1059] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 17, Time since last communication: 0.012s
I20260709 13:05:56.527154 23650 raft_consensus.cc:3055] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:56.527210 23495 raft_consensus.cc:3055] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:05:56.527626 23650 raft_consensus.cc:740] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:56.527757 23495 raft_consensus.cc:740] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:56.528615 23650 consensus_queue.cc:260] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.528980 23495 consensus_queue.cc:260] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.527783 23558 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.535075 23495 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:56.539939 23166 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.540604 23166 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.511157 23424 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:56.545506 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:56.547802 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 109411us
I20260709 13:05:56.554427 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:56.529994 23650 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:56.568785 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:56.566807 15319 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:56.573837 23621 consensus_queue.cc:1059] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:56.574813 23621 raft_consensus.cc:3055] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:56.575178 23621 raft_consensus.cc:740] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:56.576066 23621 consensus_queue.cc:260] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.576753 23477 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:56.577232 23621 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:56.584082 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:56.584812 23538 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:56.569643 15365 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:56.593601 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.595736 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:56.596097 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:56.596446 15241 raft_consensus.cc:3060] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:56.596714 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.601138 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.602417 15244 raft_consensus.cc:2410] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
W20260709 13:05:56.607410 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.597880 23538 raft_consensus.cc:2804] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:05:56.613790 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.599355 23166 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:56.617182 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.605221 23288 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.630733 23651 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:56.639665 15291 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:56.642704 15241 raft_consensus.cc:2468] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:56.610405 23682 consensus_queue.cc:1059] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.013s
I20260709 13:05:56.645789 15365 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:56.619683 23538 raft_consensus.cc:697] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:56.639478 23728 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.232s	user 0.004s	sys 0.000s
I20260709 13:05:56.654599 23386 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.655413 15243 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:05:56.657847 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:56.641677 23643 consensus_queue.cc:1048] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:05:56.622394 23288 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.650977 23424 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:05:56.669595 23386 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:56.673061 23682 raft_consensus.cc:2804] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:56.677008 23424 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:56.713030 23682 raft_consensus.cc:697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:56.743209 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:56.743420 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.749550 15319 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
W20260709 13:05:56.759472 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 113805us
I20260709 13:05:56.785897 23644 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:56.756232 23642 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.796162 23738 log.cc:927] Time spent T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:05:56.805119 23682 consensus_queue.cc:237] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:56.829305 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.722870 23538 consensus_queue.cc:237] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.838716 23627 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.839627 23704 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:56.852052 23627 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.857189 15242 raft_consensus.cc:2368] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 27. Current term is 28.
I20260709 13:05:56.859304 23646 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:56.859882 23646 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.863466 22586 raft_consensus.cc:3055] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:05:56.864084 22586 raft_consensus.cc:740] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:56.865087 22586 consensus_queue.cc:260] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.866618 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:56.866993 15395 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:56.845719 23665 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:05:56.871845 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:56.872502 15394 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:05:56.874344 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.845587 23650 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.875362 23650 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.877823 23288 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:56.756690 23424 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.856926 23572 raft_consensus.cc:3055] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:56.883383 22586 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:56.885648 15242 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:05:56.877743 15317 raft_consensus.cc:3060] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:56.895316 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:56.882603 23572 raft_consensus.cc:740] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:56.901026 15394 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:05:56.902534 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:56.843071 23744 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:05:56.917687 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:56.924039 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: true dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:56.924898 15390 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:05:56.877830 23650 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:56.924062 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:56.930001 23650 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:56.931447 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:56.932610 15394 raft_consensus.cc:2393] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 27: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:56.934111 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.934456 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.935361 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:56.935132 15242 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:56.943153 15241 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 28: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:56.944211 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:56.948228 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:56.830499 23642 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:56.897327 23558 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:56.912616 23524 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.954196 15290 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:56.958057 15317 raft_consensus.cc:1275] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:05:56.968701 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:56.970873 23751 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:56.971105 23386 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:56.971555 23751 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.973364 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:56.973992 23751 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:56.975016 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:56.976070 15394 raft_consensus.cc:2410] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260709 13:05:56.976147 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:56.976975 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:56.977795 15394 raft_consensus.cc:2410] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for term 25 because replica has last-logged OpId of term: 24 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 18.
I20260709 13:05:56.977798 23752 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:56.978606 23752 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.978979 23752 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:56.979373 23750 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:56.980003 23642 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:56.979977 23750 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:56.982144 23717 consensus_meta.cc:287] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.511s	user 0.004s	sys 0.006s
W20260709 13:05:56.982822 23747 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:05:56.983747 15249 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:05:56.913437 23613 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:05:56.985612 23717 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:56.958557 23553 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:56.955331 23625 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:05:56.975008 23503 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:57.001302 15391 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:05:56.994825 23166 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:56.987700 23524 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.000129 23503 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.007146 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:56.951508 23317 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:57.014760 15394 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:57.029201 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:57.029778 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:57.030802 15394 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
W20260709 13:05:57.019872 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 51244.5us
I20260709 13:05:57.033771 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:57.037264 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:57.038472 15320 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
W20260709 13:05:57.042192 23707 log.cc:927] Time spent T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 1.168s	user 0.007s	sys 0.000s
W20260709 13:05:57.043987 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.968995 23558 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.044127 23553 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:57.031998 23166 raft_consensus.cc:697] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:57.035027 23317 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:56.995491 23340 consensus_queue.cc:1048] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:05:57.049952 15318 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2646) took 1904 ms. Trace:
W20260709 13:05:57.060811 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 144970us
I20260709 13:05:57.065196 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:56.996294 15390 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 29.
I20260709 13:05:57.067627 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:57.068787 15246 raft_consensus.cc:1240] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:57.069742 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:57.070850 15245 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:05:57.071321 15362 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:56.968892 23572 consensus_queue.cc:260] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.057624 23524 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:57.078775 15291 leader_election.cc:400] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 27. Current term is 28.
I20260709 13:05:57.079604 15291 leader_election.cc:403] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Cancelling election due to peer responding with higher term
I20260709 13:05:57.083099 23633 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:57.083292 15291 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:57.083841 23625 consensus_queue.cc:1059] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:57.084345 23424 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:57.084766 23424 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.084985 23625 raft_consensus.cc:3055] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:57.085155 23424 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:57.085402 23625 raft_consensus.cc:740] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:57.072695 23621 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:05:57.086263 23625 consensus_queue.cc:260] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.069743 23665 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.088594 23665 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.091146 23665 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:57.092372 23717 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:57.092687 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:57.093648 16024 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:57.095614 15214 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:57.096153 23166 consensus_queue.cc:237] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.096876 23139 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:57.097458 23139 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.097820 23139 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:57.100440 23646 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:57.104377 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:57.106626 23561 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:57.107059 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:57.107510 23561 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.121695 23572 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:57.056151 23752 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.127564 23752 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:57.142210 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:57.143441 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:57.062090 15318 rpcz_store.cc:276] 0709 13:05:55.145984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.387388 (+241404us) service_pool.cc:224] Handling call
0709 13:05:55.387752 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:55.470306 (+ 82554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:55.470353 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:55.474726 (+  4373us) log.cc:844] Serialized 26 byte log entry
0709 13:05:55.682543 (+207817us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:05:55.716814 (+ 34271us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.882037 (+165223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.882171 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.034831 (+1152660us) spinlock_profiling.cc:243] Waited 6.63 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:05:57.044744 (+  9913us) raft_consensus.cc:1685] finished
0709 13:05:57.049685 (+  4941us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.049865 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127079,"prepare.queue_time_us":31111,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":99679,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":13153,"spinlock_wait_cycles":15256448,"thread_start_us":332158,"threads_started":2,"wal-append.queue_time_us":278666}
I20260709 13:05:57.144088 15399 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:57.146661 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:57.148658 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:57.156893 23717 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:05:57.183207 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:57.183779 15290 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:57.187387 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:57.193874 15244 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:05:57.193804 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:57.195188 15318 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
W20260709 13:05:57.189989 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.201713 15398 raft_consensus.cc:2468] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:05:57.202870 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:57.203850 15398 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 24: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:57.188930 15393 raft_consensus.cc:2468] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 25.
I20260709 13:05:57.211885 15394 raft_consensus.cc:2468] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:05:57.216599 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:57.217599 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:57.220717 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:57.233464 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:57.260661 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:57.258675 23524 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:57.264153 15393 raft_consensus.cc:1240] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 26. Current term is 27. Ops: []
I20260709 13:05:57.264407 23524 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:57.265489 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.189185 23625 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:57.266947 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:57.270579 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:57.269721 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 73327.8us
I20260709 13:05:57.271714 15390 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 24: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:57.215461 23455 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:57.282898 15244 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:57.265080 23524 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:57.293043 15398 raft_consensus.cc:2468] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 27.
I20260709 13:05:57.294814 15398 raft_consensus.cc:1240] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:57.302618 15365 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:05:57.306216 15999 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.266378 23685 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:57.272414 23179 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:57.309612 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:57.311049 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 239756us
I20260709 13:05:57.279716 23755 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:05:57.318130 15399 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 28.
I20260709 13:05:57.339628 15390 raft_consensus.cc:1240] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:57.342072 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:57.310768 23685 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:57.325426 23317 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:57.348526 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:57.350696 15390 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:05:57.323706 23543 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:05:57.415385 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66936.1us
I20260709 13:05:57.308136 23455 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:57.414390 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.422078 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 80118.3us
I20260709 13:05:57.340116 23558 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:57.348671 23610 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:57.380019 23685 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:57.446555 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:57.454092 15318 raft_consensus.cc:1275] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:05:57.417783 23543 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:57.421134 23553 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:57.424839 23166 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.448176 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:57.425065 23477 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:57.472558 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:57.368649 23746 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.086s
I20260709 13:05:57.477289 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:57.477962 15317 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 28.
I20260709 13:05:57.367910 23737 consensus_queue.cc:1059] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.123s
I20260709 13:05:57.455384 23503 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:57.537298 23424 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.492123 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:57.462011 23561 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:57.496114 23455 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:57.503335 15243 raft_consensus.cc:1275] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
W20260709 13:05:57.505007 23763 log.cc:927] Time spent T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:05:57.505879 23760 log.cc:927] Time spent T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:05:57.477039 23166 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.481398 23477 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.514933 23317 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:57.465999 23543 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:57.567695 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 75658.6us
I20260709 13:05:57.594962 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:57.488679 23610 raft_consensus.cc:697] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:57.599532 15316 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:57.562860 23633 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader election lost for term 27. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 27. Current term is 28.
I20260709 13:05:57.596330 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:57.576433 23682 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:57.608480 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:57.589866 23489 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:57.589445 23179 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.616914 23770 consensus_queue.cc:1048] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.003s
I20260709 13:05:57.617695 23166 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:57.618402 23477 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:57.627106 23179 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.612465 23455 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:05:57.631392 23455 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:57.631971 23455 raft_consensus.cc:3060] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:57.635924 23610 consensus_queue.cc:237] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.636940 23685 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.597218 23317 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.641270 23317 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:57.653539 15248 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:05:57.654071 15248 pending_rounds.cc:85] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Aborting all ops after (but not including) 12
I20260709 13:05:57.654484 15248 pending_rounds.cc:107] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Aborting uncommitted NO_OP operation due to leader change: 23.13
W20260709 13:05:57.643035 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.643322 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:57.655756 15245 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:05:57.613586 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:57.657900 16032 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:57.650868 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:57.654829 15248 raft_consensus.cc:2889] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:57.604229 23737 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:57.669925 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:57.670828 15317 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:57.672672 15363 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:57.662842 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:57.682732 15998 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:57.684602 15998 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:57.678488 16033 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 27.
I20260709 13:05:57.693593 15998 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:57.700127 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:57.701321 15321 raft_consensus.cc:2393] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 24: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:57.701413 15998 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:05:57.666271 23477 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.754513 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:57.732263 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:57.734964 15998 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:57.610975 23538 consensus_queue.cc:1048] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:05:57.765865 15998 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:57.746443 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.752516 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:57.755540 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 46491.2us
I20260709 13:05:57.691843 23317 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:57.703565 23613 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:57.784304 15247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60000 (request call id 3528) took 1026 ms. Trace:
I20260709 13:05:57.707800 23166 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.707535 23451 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:57.790063 15247 rpcz_store.cc:276] 0709 13:05:56.758301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.758438 (+   137us) service_pool.cc:224] Handling call
0709 13:05:56.758766 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.989358 (+230592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.989405 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.002106 (+ 12701us) log.cc:844] Serialized 26 byte log entry
0709 13:05:57.207264 (+205158us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:57.334843 (+127579us) log.cc:844] Serialized 14 byte log entry
0709 13:05:57.335110 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.636794 (+301684us) spinlock_profiling.cc:243] Waited 38.4 ms on lock 0x7b1800480dc0. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666adb2a6 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419
0709 13:05:57.637288 (+   494us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400398ad4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:57.637334 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.783979 (+146645us) raft_consensus.cc:1685] finished
0709 13:05:57.784011 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.784214 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":125826,"raft.queue_time_us":5887,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":14119,"spinlock_wait_cycles":634821760,"thread_start_us":234370,"threads_started":2,"wal-append.queue_time_us":323572}
I20260709 13:05:57.710644 23545 raft_consensus.cc:2804] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:57.711544 23179 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:57.773010 23646 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:57.771028 23767 raft_consensus.cc:2804] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:57.774434 23399 raft_consensus.cc:2804] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:05:57.774264 23558 raft_consensus.cc:2804] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:57.772090 23709 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:57.817293 23752 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.832065 23751 raft_consensus.cc:3055] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:05:57.833277 23777 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:05:57.735231 23708 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
W20260709 13:05:57.821039 23139 consensus_meta.cc:287] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.718s	user 0.015s	sys 0.000s
W20260709 13:05:57.847537 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 72347.4us
I20260709 13:05:57.849557 23751 raft_consensus.cc:740] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:57.858098 23784 log.cc:927] Time spent T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:05:57.858494 23751 consensus_queue.cc:260] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.864391 23399 raft_consensus.cc:697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 27 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:57.865557 23399 consensus_queue.cc:237] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.867728 23767 raft_consensus.cc:697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:57.867808 23558 raft_consensus.cc:697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:57.868849 23767 consensus_queue.cc:237] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.869117 23558 consensus_queue.cc:237] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:57.871698 23524 consensus_meta.cc:287] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.002s
I20260709 13:05:57.872308 23524 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:57.873471 23756 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.258s	user 0.000s	sys 0.003s
I20260709 13:05:57.875185 23497 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:57.875650 23625 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.000s
I20260709 13:05:57.875829 23497 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.876300 23625 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:57.876801 23625 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.774459 23477 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.818324 23646 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:57.803800 23768 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:05:57.851842 23572 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.729s	user 0.011s	sys 0.002s
I20260709 13:05:57.812083 23166 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.849157 23545 raft_consensus.cc:697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:57.815747 23451 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.884923 23646 raft_consensus.cc:3060] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:57.878773 23139 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.894534 23708 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.850400 23709 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.851640 23752 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.899559 23424 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:57.915769 23685 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:57.900151 23455 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:57.911468 23791 consensus_queue.cc:1059] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.071s
I20260709 13:05:57.978634 23572 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.035915 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 233756us
I20260709 13:05:57.981482 23625 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:57.921990 23708 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:57.944475 23545 consensus_queue.cc:237] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:58.078564 23788 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:05:58.029438 23554 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.090520 23752 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:58.091140 23787 log.cc:927] Time spent T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:05:58.093333 15393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 4060) took 1184 ms. Trace:
I20260709 13:05:58.093853 15393 rpcz_store.cc:276] 0709 13:05:56.908754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.268787 (+360033us) service_pool.cc:224] Handling call
0709 13:05:57.269000 (+   213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.280109 (+ 11109us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:05:57.592166 (+312057us) log.cc:844] Serialized 14 byte log entry
0709 13:05:57.810312 (+218146us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.811071 (+   759us) log.cc:844] Serialized 26 byte log entry
0709 13:05:57.811219 (+   148us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:57.811430 (+   211us) log.cc:844] Serialized 14 byte log entry
0709 13:05:57.823668 (+ 12238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.823759 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.092981 (+269222us) raft_consensus.cc:1685] finished
0709 13:05:58.093026 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.093238 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142675,"prepare.queue_time_us":72832,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":84,"raft.queue_time_us":87405,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":13376,"spinlock_wait_cycles":37866368,"thread_start_us":390573,"threads_started":2,"wal-append.queue_time_us":258570}
I20260709 13:05:58.102696 23554 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.115813 23455 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:58.122265 23477 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.125408 23708 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.128836 23166 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.041401 23572 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.133611 23572 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.135190 23451 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.078107 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:58.146448 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:58.146677 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:58.147475 15242 raft_consensus.cc:2393] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 24: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:58.151115 23424 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.151476 23685 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:58.151708 23424 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.152048 23685 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.154451 23768 raft_consensus.cc:493] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:58.155025 23768 raft_consensus.cc:515] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.157228 23768 leader_election.cc:290] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.157647 23690 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:58.158344 23690 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.160392 23690 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.160938 23646 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.167289 23139 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.167594 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.170591 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:58.172614 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.173288 15321 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:58.154017 23685 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:05:58.179263 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.180366 23477 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.180955 23477 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.157750 23768 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:58.202050 15325 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 28.
I20260709 13:05:58.153975 23424 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:58.141649 23543 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.006s
I20260709 13:05:58.220746 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.224174 22586 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.225108 22586 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.247411 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.243983 15213 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:58.253019 23497 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.254882 23625 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:58.256455 23625 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.259451 23477 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.262053 22586 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:05:58.253198 23798 log.cc:927] Time spent T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:05:58.255779 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.251507 23708 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.209748 23768 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.266857 15325 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 27.
I20260709 13:05:58.251775 23424 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:58.268147 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:58.269749 15320 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:58.261186 23690 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:05:58.236503 23543 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.288848 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.292203 23543 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.277853 23625 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.298645 16024 raft_consensus.cc:1240] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Rejecting Update request from peer ee9654803379434388de45d4693e6b16 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:58.300043 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:58.301007 23139 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:05:58.301450 23139 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.276382 23690 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:58.301834 23139 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:58.302034 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.302788 15325 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:58.302412 23690 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.303963 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:58.304852 23704 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:58.305299 23704 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.305699 23704 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:58.270433 23708 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:58.322265 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.322806 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:58.324271 23764 log.cc:927] Time spent T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.992s	user 0.004s	sys 0.003s
I20260709 13:05:58.325584 16028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46364 (request call id 1197) took 1785 ms. Trace:
I20260709 13:05:58.325970 16028 rpcz_store.cc:276] 0709 13:05:56.539838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.541705 (+  1867us) service_pool.cc:224] Handling call
0709 13:05:56.542098 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.557842 (+ 15744us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:05:56.557880 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.559908 (+  2028us) log.cc:844] Serialized 26 byte log entry
0709 13:05:57.137663 (+577755us) spinlock_profiling.cc:243] Waited 8.35 ms on lock 0x7b18002a7f60. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:05:57.257759 (+120096us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:05:57.257813 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.257902 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.322049 (+1064147us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b24002d96c8. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f36669939c4 00007f3666991acb 00007f3666b4cdc9 00007f3666b4ca55 00007f3666b4c09d 00007f366977e10e 00007f366979588c 00007f3669794bb6 00007f36697947d8 00007f366979e221
0709 13:05:58.325348 (+  3299us) raft_consensus.cc:1685] finished
0709 13:05:58.325371 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.325519 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8641,"raft.queue_time_us":16636,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4786,"spinlock_wait_cycles":26196608,"thread_start_us":119833,"threads_started":1,"wal-append.queue_time_us":715665}
I20260709 13:05:58.340559 23768 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.273061 23424 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.342980 23424 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.343906 23783 raft_consensus.cc:3055] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:58.344429 23708 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:58.344616 23783 raft_consensus.cc:740] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:05:58.346628 23783 consensus_queue.cc:260] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.347829 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.348079 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:58.348344 23783 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:58.348660 15394 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 23: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:58.349285 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.350090 15399 raft_consensus.cc:2393] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 27: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:58.351614 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.352280 23751 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:58.350965 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:58.361649 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.362607 15390 raft_consensus.cc:2393] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 20: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:58.352466 15397 raft_consensus.cc:2410] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 28 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 12.
I20260709 13:05:58.372706 15321 raft_consensus.cc:1240] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:58.375190 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.377822 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:58.378719 23770 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:58.378860 23554 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.379449 23554 consensus_queue.cc:1059] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:58.380887 15320 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:58.387531 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.387658 15213 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:58.388615 15396 raft_consensus.cc:2410] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for term 28 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 12.
I20260709 13:05:58.389329 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.390172 15390 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 25: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:58.394273 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.395164 15397 raft_consensus.cc:2393] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 24: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:58.395988 23646 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.396450 15396 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:05:58.397255 23709 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:58.397655 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.401216 23524 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.409271 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:58.409963 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.410640 15393 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:58.411281 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:58.411559 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.412143 15399 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 27.
I20260709 13:05:58.412669 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6183201d0cfc47c68ab021f085302aab" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:58.414335 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.414779 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:58.415308 15396 raft_consensus.cc:2410] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:05:58.418006 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:58.418430 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:58.420243 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:58.417092 15213 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:58.419852 15289 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:58.422591 16032 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:05:58.418802 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.423717 15390 raft_consensus.cc:2468] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:05:58.418391 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:58.427747 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:58.429276 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:58.430059 16032 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:05:58.433609 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:58.433727 22586 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:58.434315 16027 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:58.434481 22586 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.435398 15999 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:58.436646 15290 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:58.441143 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.443024 15397 raft_consensus.cc:2393] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 25: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:05:58.449100 15289 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:58.416782 23690 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:58.450172 15290 leader_election.cc:304] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:58.419445 23386 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:58.432664 23572 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.432991 23642 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.467056 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.468389 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:58.421530 23503 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:58.455710 23626 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:58.437528 23768 raft_consensus.cc:3060] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:05:58.456066 15196 auto_rebalancer.cc:893] Removing replace marker failed: Replica ee9654803379434388de45d4693e6b16 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:05:58.499238 15196 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:05:58.425007 23554 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.472267 23770 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:58.444231 23755 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:05:58.477960 22586 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:58.504412 15397 raft_consensus.cc:1275] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:05:58.444473 23545 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:58.480363 23651 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.007s
I20260709 13:05:58.472548 23179 raft_consensus.cc:3060] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:58.513332 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.513260 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:05:58.499583 15196 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:05:58.517489 15322 raft_consensus.cc:2468] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 28.
I20260709 13:05:58.460495 16032 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:58.497427 23626 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:58.469517 23792 raft_consensus.cc:3060] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:58.491842 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.469790 23799 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.503984 15396 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:05:58.478557 23572 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.498585 23690 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:58.493738 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.482162 23642 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.529189 15321 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:58.511620 23545 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:05:58.531494 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 114498us
I20260709 13:05:58.534759 15320 raft_consensus.cc:1240] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:58.536631 23477 raft_consensus.cc:3055] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:58.537081 23477 raft_consensus.cc:740] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:58.530568 23711 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.012s
I20260709 13:05:58.544523 23750 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:58.495800 23503 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.546657 23644 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:58.547431 23644 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.547935 23503 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:58.550737 23642 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.533540 23690 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.554534 23704 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.556509 23690 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.511201 23554 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.531455 23545 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:58.558518 23554 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.559072 23554 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:58.559588 23554 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.530936 23799 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.549896 23644 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.592584 15394 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:05:58.611549 16033 raft_consensus.cc:2468] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:58.585215 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:58.635370 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39722 (request call id 2673) took 1189 ms. Trace:
I20260709 13:05:58.537917 23477 consensus_queue.cc:260] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.639600 23139 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.640573 23477 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:58.640735 23077 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:05:58.641886 23139 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.634153 15996 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:05:58.593979 23812 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:05:58.596750 23811 log.cc:927] Time spent T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.003s
I20260709 13:05:58.636058 15319 rpcz_store.cc:276] 0709 13:05:57.445840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.447368 (+  1528us) service_pool.cc:224] Handling call
0709 13:05:57.460514 (+ 13146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.475319 (+ 14805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.475356 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.475867 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.400022 (+924155us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b1800450940. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f366f9d5de1 00007f366f9e25b1 00007f3666aefe07 00007f366f94aab9 00007f3666b0c69b 00007f3666b0a93f 00007f3666b0cc02 00007f366979420b 00007f3669799d23 00007f366979a0d1 00007f3669bb5a0f
0709 13:05:58.506805 (+106783us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:58.522314 (+ 15509us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.524750 (+  2436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.524852 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.600146 (+ 75294us) raft_consensus.cc:1685] finished
0709 13:05:58.635070 (+ 34924us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.635295 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22316,"prepare.queue_time_us":15182,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":22490,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":52123,"spinlock_wait_cycles":15846272,"thread_start_us":106442,"threads_started":1,"wal-append.queue_time_us":1057792}
I20260709 13:05:58.629971 15363 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:58.565784 23179 raft_consensus.cc:2749] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:05:58.582705 23651 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:58.556509 23704 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.652890 15249 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:05:58.652050 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:58.652850 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:58.699704 15248 raft_consensus.cc:2393] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 28: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
W20260709 13:05:58.690282 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 60442.4us
I20260709 13:05:58.583526 23642 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:58.562199 23554 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.695865 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:58.598992 23572 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.702508 15320 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:05:58.698451 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 48938.4us
I20260709 13:05:58.708151 15244 raft_consensus.cc:2410] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 13:05:58.564414 23799 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:58.715354 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:58.643146 23644 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.694886 23139 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:58.698642 23489 raft_consensus.cc:2804] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:58.732983 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:58.733731 15244 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:05:58.703896 23783 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:05:58.597612 23626 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.743873 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:58.746912 15247 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:05:58.748610 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:58.749691 15244 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 28: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:58.751613 15214 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:58.758435 23489 raft_consensus.cc:697] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:58.759057 23810 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.309s	user 0.000s	sys 0.005s
I20260709 13:05:58.759891 23489 consensus_queue.cc:237] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.766846 15362 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:58.768198 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:58.769353 23717 raft_consensus.cc:2804] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:05:58.769928 23717 raft_consensus.cc:697] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 28 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:58.770819 23717 consensus_queue.cc:237] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.766760 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:58.775097 15247 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:05:58.775879 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:58.777261 15393 raft_consensus.cc:1275] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:05:58.778918 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.779754 15317 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 27.
I20260709 13:05:58.781088 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.783035 15390 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:05:58.777380 15321 raft_consensus.cc:3060] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:05:58.776921 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:05:58.790963 15323 raft_consensus.cc:1275] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:05:58.792344 15324 raft_consensus.cc:2393] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 22: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:58.731671 23816 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:58.716867 23642 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.796841 15319 raft_consensus.cc:1275] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:05:58.801702 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.802604 15319 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:05:58.805826 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:58.708132 23651 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:58.810055 15362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.810307 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.816322 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:58.816715 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:58.726806 23644 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:58.813680 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 280303us
I20260709 13:05:58.825634 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.826390 15325 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:58.791771 23455 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:58.827797 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.834931 15318 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:58.797727 23554 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:05:58.836200 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.836997 15318 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:58.828572 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:58.838586 15324 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:58.741039 23139 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.832751 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.833691 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:58.831126 15213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.795666 23503 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:58.822935 23708 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:58.837762 23455 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.818328 23815 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:58.835878 23646 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:58.840996 23754 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:05:58.857275 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:58.799901 23077 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:05:58.865262 23455 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:58.859875 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:58.827385 23783 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:05:58.884513 15316 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:58.817480 23545 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.880434 23820 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:58.847240 23751 consensus_queue.cc:1048] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:05:58.882016 23651 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.840407 23554 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:58.886670 23820 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.842981 23720 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.880316 23799 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:05:58.887136 23554 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:58.887878 23720 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.847909 23792 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:58.892297 23817 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:05:58.890827 15323 raft_consensus.cc:1275] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:05:58.892915 23817 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.895265 23545 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.812264 23816 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:58.897851 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:58.898798 15399 raft_consensus.cc:2393] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 24: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:58.899313 23816 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.900803 23720 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.895284 23817 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.859211 23503 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.903182 23139 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.903725 23644 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.904086 23503 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:58.865445 23815 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.901731 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:58.910717 23818 consensus_queue.cc:1059] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:58.911700 23818 raft_consensus.cc:3055] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:58.912071 23818 raft_consensus.cc:740] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:58.912855 23818 consensus_queue.cc:260] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.913340 23554 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:58.914683 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57508.1us
I20260709 13:05:58.917454 15213 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:58.873831 15321 raft_consensus.cc:1275] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:05:58.915817 23554 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.869467 23572 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.905709 23754 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.892575 23820 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.914125 23818 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:59.028589 15316 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 28.
I20260709 13:05:58.939865 23768 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:05:58.917567 23815 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:58.923841 23704 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:58.870350 23708 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.946964 23642 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:58.905500 23646 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.951263 23545 consensus_queue.cc:1048] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:58.954865 23477 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:59.063915 23646 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:59.064332 23477 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.064774 23477 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:58.953624 23796 consensus_queue.cc:1048] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:58.958467 16024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46372 (request call id 1388) took 1349 ms. Trace:
I20260709 13:05:59.069698 16024 rpcz_store.cc:276] 0709 13:05:57.609211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.609348 (+   137us) service_pool.cc:224] Handling call
0709 13:05:57.609644 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.299201 (+689557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.958173 (+658972us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54006c02d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfae01 00007f3669bf983e 00007f366ebbe419 00007f3668135bd4 00007f3668135b62 00007f3668135a91 00007f3668135a0c 00007f3668134cc2 00007f3667f3548c 00007f3667f348c6
0709 13:05:58.958409 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583890816}
I20260709 13:05:58.961004 23455 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:58.990787 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 148186us
I20260709 13:05:59.071497 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:59.072481 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:59.072669 23455 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:59.073272 23455 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:58.982146 15324 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:05:59.023277 23754 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:59.074844 23746 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:58.990685 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:05:59.076509 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 86026.7us
I20260709 13:05:58.996593 23650 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:59.078544 23650 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:05:59.030170 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 71075.6us
I20260709 13:05:59.079941 23751 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:59.044839 15317 raft_consensus.cc:1275] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:05:59.080797 23650 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:58.996554 23621 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:59.081075 23538 consensus_queue.cc:1059] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:05:59.081739 23621 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.082234 23538 raft_consensus.cc:3055] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:59.082670 23538 raft_consensus.cc:740] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:05:59.047595 15216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.027s	sys 0.046s
I20260709 13:05:59.083422 23538 consensus_queue.cc:260] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:59.083951 23621 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:59.084671 23538 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:59.023017 23572 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.085203 23796 consensus_queue.cc:1048] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:05:59.086951 23572 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:59.073640 23455 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:59.088487 23455 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:59.078014 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:59.092188 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:05:59.093894 23829 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:59.048327 22586 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.095570 22586 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:58.999892 23633 consensus_queue.cc:1048] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:05:59.097365 22586 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:58.999936 23503 consensus_queue.cc:1048] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260709 13:05:59.087980 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:59.094395 23746 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:59.099844 23746 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:59.100628 23708 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:59.100910 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
W20260709 13:05:59.084116 15216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.028s	sys 0.047s
I20260709 13:05:59.073980 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:59.104085 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:59.105691 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.106729 15244 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 28: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:59.106783 15242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.108194 15244 raft_consensus.cc:1240] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 27. Current term is 28. Ops: []
I20260709 13:05:59.111342 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.115370 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.116194 15244 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:05:59.118098 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:59.118942 15325 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 26: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:59.123560 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:59.124588 15318 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:59.126173 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:59.127041 15320 raft_consensus.cc:3060] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:05:59.128788 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:59.130381 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:59.133023 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:59.145881 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.148368 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.111853 23708 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:59.173629 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.174619 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.175630 15248 raft_consensus.cc:2393] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 27: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:59.111548 23642 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:59.137202 23817 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:59.112028 23646 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:05:59.171113 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 253728us
I20260709 13:05:59.168978 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.169909 15243 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
W20260709 13:05:59.180107 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 257195us
I20260709 13:05:59.188373 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.198846 15320 raft_consensus.cc:2468] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:05:59.186033 15291 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:05:59.170523 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 249326us
I20260709 13:05:59.196625 15247 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 29 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:05:59.159082 23796 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:59.202857 15214 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:05:59.203666 15362 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:59.196254 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:59.204175 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:05:59.168311 23793 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.207576 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:59.211815 22586 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.146298 23503 consensus_queue.cc:1048] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:05:59.212479 22586 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.179908 23708 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:59.213856 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.217661 15213 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:59.201932 23646 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.214963 23796 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:59.235925 23646 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:59.218276 23793 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.239424 15399 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:05:59.225757 15291 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:59.240622 23793 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:59.240952 15291 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:59.241566 23720 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:59.242339 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:59.218747 23751 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:59.243068 23751 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:59.245280 23751 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:59.226482 23770 consensus_queue.cc:1059] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: INVALID_TERM, Last received: 27.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:59.246534 23770 raft_consensus.cc:3055] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:05:59.246604 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:59.247102 23770 raft_consensus.cc:740] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:05:59.247443 16024 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:05:59.248291 23796 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:59.248733 15363 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:59.249773 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.249976 23709 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:59.250608 23709 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:59.251088 23709 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:59.223507 23179 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:05:59.228127 22586 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:59.215905 23816 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:59.219007 23489 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:59.194938 23642 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.234136 23477 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.209226 23820 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:05:59.213181 23690 raft_consensus.cc:2804] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:59.202502 23817 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.242440 23720 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:59.219007 23644 raft_consensus.cc:3060] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:59.245328 23650 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:59.229836 23455 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.260215 23816 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.261144 15243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.259461 15213 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:05:59.223851 23708 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:59.272449 15243 raft_consensus.cc:2393] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 28: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:59.274642 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:59.275157 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 71570.3us
I20260709 13:05:59.276327 15242 raft_consensus.cc:2368] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24.
I20260709 13:05:59.275377 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:59.279825 15325 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:05:59.281164 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:05:59.282696 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:59.253552 23754 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.264954 23626 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:59.263332 23554 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:05:59.277606 15291 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:59.285441 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:59.265000 23690 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:05:59.296377 23455 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:59.266618 23720 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:59.270493 23768 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:59.300531 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:59.304798 15320 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:05:59.272028 23816 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:59.263643 23489 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.310097 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.310823 15396 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 22.
I20260709 13:05:59.311367 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.311822 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:59.312703 15396 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 28: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:05:59.312551 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.313733 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.314033 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.315124 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:05:59.330006 23793 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:59.330917 23793 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:59.337970 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:59.343405 15248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:05:59.287967 23643 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:59.289790 23751 raft_consensus.cc:2804] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:59.346922 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.333912 23793 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:59.299285 23690 raft_consensus.cc:3060] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:59.353843 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:05:59.359222 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.367345 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.304806 23720 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:59.272485 23650 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.248335 23770 consensus_queue.cc:260] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:59.308436 23626 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:05:59.312585 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 272654us
I20260709 13:05:59.392205 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:59.293602 23815 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:05:59.395102 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:59.402832 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:59.357983 23818 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.406272 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:05:59.364145 23751 raft_consensus.cc:697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:05:59.428323 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:05:59.420384 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 65589.9us
I20260709 13:05:59.420840 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:05:59.435487 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:05:59.388870 23651 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:59.429607 15395 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:05:59.393520 23477 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:59.453871 15248 raft_consensus.cc:2368] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 24. Current term is 25.
I20260709 13:05:59.467849 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:59.475540 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:05:59.485476 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:05:59.490082 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:05:59.494616 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 200262us
I20260709 13:05:59.455327 23651 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.501304 16033 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:05:59.472219 23770 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:05:59.428300 23626 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:59.497007 15291 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:05:59.509039 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:05:59.429896 23818 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:05:59.510952 15291 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: ee9654803379434388de45d4693e6b16
I20260709 13:05:59.483992 23817 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:59.503355 23651 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:59.503645 23477 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:59.508863 23809 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:05:59.627279 23538 consensus_meta.cc:287] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.515s	user 0.012s	sys 0.002s
I20260709 13:05:59.584095 23554 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:05:59.650709 23489 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:59.660789 23642 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:59.551767 23587 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.149s
I20260709 13:05:59.695176 23754 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:59.649865 23751 consensus_queue.cc:237] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:05:59.731807 23828 log.cc:927] Time spent T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
W20260709 13:05:59.731046 23825 log.cc:927] Time spent T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.340s	user 0.001s	sys 0.000s
W20260709 13:05:59.758080 23834 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 13:05:59.759428 23840 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:59.795655 23818 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:05:59.783871 23833 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
W20260709 13:05:59.788177 23832 log.cc:927] Time spent T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:05:59.735252 23853 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:05:59.776793 23844 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:05:59.855947 15214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.000s
W20260709 13:05:59.856909 15214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.000s	sys 0.000s
W20260709 13:05:59.862597 15213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.003s	sys 0.007s
W20260709 13:05:59.863148 15213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.003s	sys 0.007s
W20260709 13:05:59.863607 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 563698us
W20260709 13:05:59.868654 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 433089us
I20260709 13:05:59.877774 15245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.879422 15246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60014 (request call id 2716) took 1229 ms. Trace:
I20260709 13:05:59.877823 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.880829 15241 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:05:59.881693 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:05:59.883463 15318 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.007s	sys 0.006s
W20260709 13:05:59.884016 15318 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.007s	sys 0.007s
I20260709 13:05:59.885066 15317 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:05:59.777166 23815 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:05:59.895838 23815 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.878361 15249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.883463 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.880752 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.497920 23837 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.470s
I20260709 13:05:59.982901 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
W20260709 13:05:59.984717 23709 consensus_meta.cc:287] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.005s
W20260709 13:05:59.990124 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 458052us
I20260709 13:05:59.985441 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:05:59.994640 23650 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:05:59.995723 23855 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:05:59.996446 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
W20260709 13:05:59.999982 23644 consensus_meta.cc:287] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.730s	user 0.013s	sys 0.012s
I20260709 13:06:00.000671 23644 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:00.002100 15243 raft_consensus.cc:1275] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:06:00.002301 23815 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.003787 23864 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:06:00.003090 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:06:00.006536 15247 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:06:00.008108 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:06:00.009059 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:06:00.010270 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:06:00.010695 15291 leader_election.cc:400] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24.
I20260709 13:06:00.012568 15291 leader_election.cc:403] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:59.996614 23855 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.012182 15250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:06:00.010138 15244 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 29.
I20260709 13:06:00.027392 23792 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:06:00.033063 23871 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 23. Current term is 24.
I20260709 13:06:00.033464 14139 tablet_server.cc:179] TabletServer@127.13.206.193:0 shutting down...
I20260709 13:06:00.036042 15244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:06:00.036943 23818 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:00.006101 23815 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:05:59.712584 23626 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.045353 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:00.014137 23704 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:00.046697 23704 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.050330 23704 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.050650 23554 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 26.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.037961 23818 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.051441 23340 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:05:59.880071 15246 rpcz_store.cc:276] 0709 13:05:58.650099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.650576 (+   477us) service_pool.cc:224] Handling call
0709 13:05:58.714702 (+ 64126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:58.739556 (+ 24854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.739602 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.745298 (+  5696us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.112908 (+367610us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:59.112964 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.113836 (+   872us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.878711 (+764875us) raft_consensus.cc:1685] finished
0709 13:05:59.878800 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.879161 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24407,"raft.queue_time_us":28962,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":11314,"thread_start_us":289797,"threads_started":1,"wal-append.queue_time_us":550224}
I20260709 13:06:00.063062 15246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b"
I20260709 13:06:00.064360 15246 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:05:59.985572 23709 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.068531 15392 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 20: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:06:00.039299 23644 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:00.060456 15247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:06:00.075774 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:06:00.082616 15250 raft_consensus.cc:2393] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 23: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
W20260709 13:06:00.077719 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 67394us
W20260709 13:06:00.083640 23845 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
I20260709 13:06:00.098627 23750 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:06:00.099663 23646 consensus_meta.cc:287] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.863s	user 0.005s	sys 0.015s
W20260709 13:06:00.081611 23843 log.cc:927] Time spent T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.358s	user 0.001s	sys 0.001s
W20260709 13:06:00.105688 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 60618.7us
I20260709 13:06:00.106889 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:00.107157 15394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39732 (request call id 3399) took 1003 ms. Trace:
I20260709 13:06:00.107580 15394 rpcz_store.cc:276] 0709 13:05:59.104071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.104177 (+   106us) service_pool.cc:224] Handling call
0709 13:05:59.104455 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.108527 (+  4072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.108558 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.113701 (+  5143us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.394107 (+280406us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:05:59.394145 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.394207 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.080429 (+686222us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:06:00.106622 (+ 26193us) raft_consensus.cc:1685] finished
0709 13:06:00.106644 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.106941 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3699,"raft.queue_time_us":4282,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":28386,"spinlock_wait_cycles":13697792,"thread_start_us":280061,"threads_started":1,"wal-append.queue_time_us":559397}
I20260709 13:06:00.110096 23855 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.110850 23855 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:00.074601 23340 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.122357 23853 raft_consensus.cc:697] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:00.082783 23644 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.126520 23644 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.130934 15241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "89940175e5444593aab6b3a025624b5b" is_pre_election: true
I20260709 13:06:00.102798 23750 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:00.104338 23815 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:00.132344 22586 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:00.077303 23831 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.623s	user 0.001s	sys 0.000s
I20260709 13:06:00.135237 15247 raft_consensus.cc:1275] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
W20260709 13:06:00.079511 23839 log.cc:927] Time spent T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.453s	user 0.002s	sys 0.000s
I20260709 13:06:00.148077 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.148918 22586 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.149406 15393 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:06:00.151664 22586 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.156003 23709 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.157086 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:00.158191 16033 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:06:00.137326 23646 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.153129 15324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46848 (request call id 1258) took 1077 ms. Trace:
I20260709 13:06:00.124060 23853 consensus_queue.cc:237] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.134485 23750 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:00.183708 23770 consensus_meta.cc:287] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.012s
I20260709 13:06:00.185688 23799 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:00.187270 15396 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 25: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:06:00.190847 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:06:00.191398 23818 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:00.194941 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 54140.8us
I20260709 13:06:00.194203 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:00.198810 23799 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.201494 23799 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.167217 15324 rpcz_store.cc:276] 0709 13:05:59.075208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.075705 (+   497us) service_pool.cc:224] Handling call
0709 13:05:59.076052 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.076392 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.076419 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.076882 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.365345 (+288463us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:59.365389 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.365471 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.078170 (+712699us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:06:00.152589 (+ 74419us) raft_consensus.cc:1685] finished
0709 13:06:00.152617 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.152938 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1102,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":108269312,"thread_start_us":286949,"threads_started":1,"wal-append.queue_time_us":418662}
W20260709 13:06:00.206153 15320 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.712s	user 0.007s	sys 0.015s
I20260709 13:06:00.213835 15390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51818 (request call id 1265) took 1329 ms. Trace:
I20260709 13:06:00.214973 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:00.215389 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:06:00.215950 23720 consensus_meta.cc:287] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.822s	user 0.013s	sys 0.007s
I20260709 13:06:00.202514 23709 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:00.230993 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.224702 23709 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.230129 15320 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:06:00.237069 15323 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 28.
W20260709 13:06:00.240422 23816 consensus_meta.cc:287] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.892s	user 0.020s	sys 0.002s
I20260709 13:06:00.214452 15390 rpcz_store.cc:276] 0709 13:05:58.884433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.890341 (+  5908us) service_pool.cc:224] Handling call
0709 13:05:58.890705 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:58.891060 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.891092 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.891566 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:05:59.139899 (+248333us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:59.139944 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.140044 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.076161 (+936117us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:06:00.213254 (+137093us) raft_consensus.cc:1685] finished
0709 13:06:00.213278 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.213614 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2196,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":7494912,"thread_start_us":248020,"threads_started":1,"wal-append.queue_time_us":495544}
W20260709 13:06:00.245322 23708 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: Time spent flushing consensus metadata: real 0.949s	user 0.013s	sys 0.006s
I20260709 13:06:00.247251 23708 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:00.248802 15290 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.255015 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:00.256395 23818 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:00.256860 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:00.258315 23644 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:00.245515 23750 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.260897 23750 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:00.226848 23720 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.263366 15319 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:06:00.264460 23720 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.265460 23792 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.235245 23709 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:00.266067 23792 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.267182 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:00.268142 15324 raft_consensus.cc:2393] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 24: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:06:00.268656 23792 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.271787 23646 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:00.274447 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:06:00.274020 23651 consensus_meta.cc:287] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Time spent flushing consensus metadata: real 0.616s	user 0.006s	sys 0.009s
I20260709 13:06:00.283052 23711 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:00.284154 23711 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.241194 23816 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.286458 23818 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:00.297931 23720 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:00.315471 15245 raft_consensus.cc:2368] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23.
I20260709 13:06:00.318902 23524 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.287618 23651 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.296291 23644 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:00.319569 23524 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.325708 23708 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:00.327409 15319 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3959) took 1048 ms. Trace:
I20260709 13:06:00.328081 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.329303 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:00.327917 15319 rpcz_store.cc:276] 0709 13:05:59.278898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.285189 (+  6291us) service_pool.cc:224] Handling call
0709 13:06:00.327169 (+1041980us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54004042d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:06:00.327333 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2246836480}
I20260709 13:06:00.330437 15390 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:00.329775 23720 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.331815 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.321123 23770 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:00.334796 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.335590 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.358143 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.336505 15318 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:00.340611 15319 raft_consensus.cc:2468] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:06:00.337143 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.349507 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:00.376771 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 105381us
I20260709 13:06:00.317255 23646 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.378751 15324 raft_consensus.cc:2410] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 29 because replica has last-logged OpId of term: 27 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 14.
I20260709 13:06:00.336704 15391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 4073) took 1028 ms. Trace:
I20260709 13:06:00.338122 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.359684 15396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 4075) took 1051 ms. Trace:
W20260709 13:06:00.341740 23690 consensus_meta.cc:287] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.947s	user 0.017s	sys 0.002s
I20260709 13:06:00.338090 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:00.349447 23876 log.cc:927] Time spent T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:06:00.380077 15391 rpcz_store.cc:276] 0709 13:05:59.307682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.311047 (+  3365us) service_pool.cc:224] Handling call
0709 13:06:00.336326 (+1025279us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b5400328cd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:06:00.336483 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093441792}
W20260709 13:06:00.340505 23874 log.cc:927] Time spent T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.002s
I20260709 13:06:00.334185 23720 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.391992 15316 raft_consensus.cc:2393] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 24: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:06:00.382851 15396 rpcz_store.cc:276] 0709 13:05:59.308325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.314858 (+  6533us) service_pool.cc:224] Handling call
0709 13:06:00.359434 (+1044576us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54003d90d4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:06:00.359619 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1977976704}
I20260709 13:06:00.335460 23524 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.340075 23709 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:00.398782 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 113346us
I20260709 13:06:00.400770 23709 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.401090 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:00.338035 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:00.345839 23340 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:00.402613 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 131768us
I20260709 13:06:00.343109 23818 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.347329 23770 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.340628 23711 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:00.404091 23690 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.404665 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:06:00.404872 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.405264 16033 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:00.405584 23770 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.401993 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.410424 23646 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.411147 15318 raft_consensus.cc:1275] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:00.402675 23340 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:00.413028 23646 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.360183 23816 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.351667 23717 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
W20260709 13:06:00.418532 23873 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:06:00.403810 15999 leader_election.cc:400] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 24. Current term is 25.
I20260709 13:06:00.419618 15323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39714 (request call id 3957) took 1141 ms. Trace:
I20260709 13:06:00.419803 15999 leader_election.cc:403] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:06:00.420131 15323 rpcz_store.cc:276] 0709 13:05:59.278251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.280842 (+  2591us) service_pool.cc:224] Handling call
0709 13:06:00.419371 (+1138529us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b540016dd54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:06:00.419534 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2076018560}
I20260709 13:06:00.401472 23709 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.423787 23709 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.424798 15393 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:00.424194 15392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51818 (request call id 1272) took 1174 ms. Trace:
I20260709 13:06:00.425976 15392 rpcz_store.cc:276] 0709 13:05:59.249354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.249513 (+   159us) service_pool.cc:224] Handling call
0709 13:06:00.423944 (+1174431us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54002bdc54. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:06:00.424119 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880235264}
I20260709 13:06:00.429386 15215 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:06:00.431843 16033 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:06:00.431625 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:00.412953 23818 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.436110 16027 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:06:00.436887 15363 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:00.439742 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.444276 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.433444 23690 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.452775 15363 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:00.445999 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:00.455101 15316 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39722 (request call id 2717) took 1154 ms. Trace:
I20260709 13:06:00.445465 23646 raft_consensus.cc:2804] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:00.438513 23717 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:00.450927 23711 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:00.461736 23877 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:06:00.466110 23646 raft_consensus.cc:697] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:06:00.467501 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 66557us
I20260709 13:06:00.457062 15316 rpcz_store.cc:276] 0709 13:05:59.301152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.880771 (+579619us) service_pool.cc:224] Handling call
0709 13:06:00.454894 (+574123us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54001c6bd4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bfe2fa 00007f366ebbfb17 00007f366813a6d4 00007f366813a662 00007f366813a591 00007f366813a50c 00007f36681397c2 00007f3667f3548c 00007f3667f348c6 00007f3667f3426f
0709 13:06:00.455037 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147266432}
I20260709 13:06:00.467597 23646 consensus_queue.cc:237] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:00.468325 23878 log.cc:927] Time spent T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:06:00.468606 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:00.469353 23799 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:00.469854 23799 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.470384 23799 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:00.470935 23064 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:00.461694 15140 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 140) took 33019 ms (client timeout 15000 ms). Trace:
W20260709 13:06:00.474335 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 50188.5us
I20260709 13:06:00.474838 23709 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:00.460703 23545 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.457855 23864 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:00.477324 15318 raft_consensus.cc:2393] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 28: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:06:00.477423 23545 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.478308 23864 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.480576 23864 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.481227 23711 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 for earlier term 24. Current term is 25.
W20260709 13:06:00.482054 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 54783.5us
I20260709 13:06:00.483067 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:00.483892 23690 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:06:00.484354 15143 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:00.492291 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.493724 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.520628 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.521525 15390 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:06:00.519419 15289 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:00.523519 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.525888 15365 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:00.526127 15318 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:06:00.485941 15143 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 14 to 15, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 15 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.458112 23818 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:00.531530 15392 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:06:00.513721 23545 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.536630 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:00.528636 23709 raft_consensus.cc:493] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:00.551669 15390 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:00.553092 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:00.554744 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 151130us
I20260709 13:06:00.538627 23651 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.530926 23524 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:00.531733 23818 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:00.559280 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.560350 15323 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:06:00.561877 23709 raft_consensus.cc:515] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:00.474525 15140 rpcz_store.cc:269] 0709 13:05:27.481312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.514214 (+ 32902us) service_pool.cc:224] Handling call
0709 13:05:28.106510 (+592296us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b64090 00007f3669c02f3a 00007f366f9b91cc 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc 00007f366df77392 00007f3667f3548c 00007f3667f348c6
0709 13:06:00.461429 (+32354919us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:51.895046 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:51.956547 (+ 61501us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:51.956612 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:05:51.956639 (+    27us) tablet.cc:662] Decoding operations
0709 13:05:51.958302 (+  1663us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:51.958442 (+   140us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:51.958482 (+    40us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:05:51.960142 (+  1660us) tablet.cc:701] Row locks acquired
0709 13:05:51.960209 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:05:51.960447 (+   238us) write_op.cc:270] Start()
0709 13:05:51.960624 (+   177us) write_op.cc:276] Timestamp: P: 1783602351960366 usec, L: 0
0709 13:05:51.960670 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:05:52.161101 (+200431us) log.cc:844] Serialized 5236 byte log entry
0709 13:05:53.228156 (+1067055us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b63571 00007f3669bf5e28 00007f366d630581 00007f366d62fd58 00007f366d6349f1 00007f366d6349a9 00007f366d634939 00007f366d634901 00007f366d633b2d 000000000038f354 000000000038f199
0709 13:05:53.554850 (+326694us) op_driver.cc:464] REPLICATION: finished
0709 13:05:53.960062 (+405212us) write_op.cc:301] APPLY: starting
0709 13:05:53.965790 (+  5728us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:54.562310 (+596520us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:54.562358 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:54.724708 (+162350us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:54.738169 (+ 13461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:05:54.738274 (+   105us) write_op.cc:312] APPLY: finished
0709 13:05:54.738714 (+   440us) log.cc:844] Serialized 121 byte log entry
0709 13:05:54.823011 (+ 84297us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:54.846937 (+ 23926us) write_op.cc:454] Released schema lock
0709 13:05:54.867099 (+ 20162us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:54.923105 (+ 56006us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:54.932858 (+  9753us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4745361,"reported_tablets":27,"spinlock_wait_cycles":42079104,"child_traces":[["op",{"apply.queue_time_us":404832,"apply.run_cpu_time_us":43937,"apply.run_wall_time_us":946092,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58441,"num_ops":13,"prepare.queue_time_us":633211,"prepare.run_cpu_time_us":48189,"prepare.run_wall_time_us":1333375,"raft.queue_time_us":395373,"raft.run_cpu_time_us":13295,"raft.run_wall_time_us":413281,"replication_time_us":1563810,"spinlock_wait_cycles":54051072,"thread_start_us":1351124,"threads_started":5,"wal-append.queue_time_us":692663,"wal-append.run_cpu_time_us":24759,"wal-append.run_wall_time_us":2343961}]]}
I20260709 13:06:00.572185 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:00.572811 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:00.573581 15320 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 26: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:06:00.577665 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.581427 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:00.587679 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 76963.3us
I20260709 13:06:00.566999 15143 catalog_manager.cc:5697] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 10 to 19. New cstate: current_term: 19 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:00.565332 23818 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:00.592644 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:00.597935 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 87553.6us
I20260709 13:06:00.613106 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:06:00.612434 15291 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
I20260709 13:06:00.616899 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:00.616225 15143 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:00.620668 23650 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:00.627707 15143 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 17 to 18, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 18 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:00.628290 23650 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.629384 15143 catalog_manager.cc:5697] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:00.634060 15324 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 25: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:06:00.608628 23853 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:00.621539 23587 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:00.633148 23709 leader_election.cc:290] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.642581 15143 catalog_manager.cc:5697] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 6 to 18. New cstate: current_term: 18 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
W20260709 13:06:00.643371 15140 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 141) took 16994 ms (client timeout 15000 ms). Trace:
W20260709 13:06:00.649390 15140 rpcz_store.cc:269] 0709 13:05:43.649385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.643130 (+16993745us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:00.643293 (+   163us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:00.649751 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:00.653764 15143 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 14 to 17, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 17 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.638548 23809 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:00.658404 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:00.662410 23587 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:00.664019 15143 catalog_manager.cc:5697] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 13 to 19, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 19 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.664927 15213 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:06:00.665560 23854 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:06:00.666160 23709 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:00.667960 15398 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 14. (term mismatch)
I20260709 13:06:00.659818 15365 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:06:00.677367 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.674373 15398 pending_rounds.cc:85] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Aborting all ops after (but not including) 13
I20260709 13:06:00.650209 23340 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:00.679509 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:00.669348 23809 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.679042 15398 pending_rounds.cc:107] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:06:00.703511 15398 raft_consensus.cc:2889] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.706940 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:06:00.709550 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 97136.5us
I20260709 13:06:00.715318 15393 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:06:00.717417 15319 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:06:00.709925 23690 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:00.719064 23690 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.721419 23690 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.723397 23818 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.728696 23818 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.723922 23773 consensus_queue.cc:1048] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.093s
I20260709 13:06:00.707090 23809 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:00.730191 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:00.730398 23837 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:00.730810 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:00.731820 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 90519us
I20260709 13:06:00.706050 23587 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.733778 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:06:00.734411 23646 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:00.734623 23587 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.734930 23646 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.706177 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:00.735380 23646 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:00.735694 15316 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:00.735404 23799 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.731669 15319 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:06:00.741914 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:00.742192 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:00.743044 23545 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:00.743255 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 83684us
I20260709 13:06:00.744709 23340 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:06:00.695392 23880 log.cc:927] Time spent T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.137s	user 0.000s	sys 0.002s
I20260709 13:06:00.745724 15319 raft_consensus.cc:3060] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:06:00.750790 15391 raft_consensus.cc:2393] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 26: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:06:00.745332 23340 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.753016 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.749800 23650 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:00.710180 15143 catalog_manager.cc:5697] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:00.760120 15390 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:06:00.763923 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:00.766011 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 124223us
I20260709 13:06:00.762874 15213 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:00.677052 23853 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.777033 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:00.762697 23717 raft_consensus.cc:2764] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260709 13:06:00.781278 15143 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:00.778797 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:00.783582 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.757236 23709 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.782434 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51018c5b04518b8cb7f3e5f2ca694" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:00.778323 23587 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:00.791896 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:00.793027 15325 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:06:00.781893 23837 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:00.783092 23650 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:06:00.797194 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 29 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.800262 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:06:00.802503 16033 raft_consensus.cc:3060] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:00.803452 15291 consensus_peers.cc:597] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.789633 23799 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.794854 15143 catalog_manager.cc:5697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 15 to 18, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 18 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.795447 23477 raft_consensus.cc:2804] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:00.801515 23854 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:00.810179 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:00.811869 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 52512.7us
W20260709 13:06:00.813226 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 79557.6us
I20260709 13:06:00.812489 23477 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:00.805130 23524 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:06:00.811328 15291 leader_election.cc:336] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:00.802075 23650 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:00.806604 23818 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:00.803809 23837 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.824333 23650 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:06:00.824468 23524 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.836956 15319 raft_consensus.cc:2468] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:06:00.841076 15316 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
W20260709 13:06:00.821614 15291 consensus_peers.cc:597] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.821239 23477 raft_consensus.cc:3060] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:00.849076 23816 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:00.852412 15317 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:06:00.853960 23818 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:06:00.843747 23708 consensus_queue.cc:1048] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.015s
W20260709 13:06:00.846401 15291 consensus_peers.cc:597] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.869664 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.871348 23690 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:00.872103 23709 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:00.872097 23690 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.878392 23854 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:00.879182 23837 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.879496 23690 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.879070 23854 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.879820 23837 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:00.880414 23837 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.883502 23854 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.883802 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:00.885916 15213 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:06:00.887157 23799 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:00.888109 23644 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:00.888661 23644 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:06:00.889534 23644 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.893134 23816 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:00.896066 23853 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:00.900024 23524 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.904711 23340 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.907573 23818 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:00.913667 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.915659 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.920794 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:00.922421 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:00.923400 23709 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:00.923761 23837 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:00.875331 15143 catalog_manager.cc:5697] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 11 to 14, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 14 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:00.924964 15143 catalog_manager.cc:5697] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 7 to 13, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 13 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.926569 23708 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:06:00.928817 15362 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:00.916848 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:00.916410 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.940991 23545 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:00.946097 15362 leader_election.cc:304] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:00.951094 15325 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:06:00.946385 16033 raft_consensus.cc:2468] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:06:00.947237 15317 raft_consensus.cc:2368] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24.
W20260709 13:06:00.948401 15291 leader_election.cc:336] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:00.958076 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.962000 15143 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:00.905742 23477 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:00.955175 15291 consensus_peers.cc:597] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:00.932322 23646 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.952332 23708 raft_consensus.cc:2749] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:00.950992 23717 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:00.977754 15363 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:00.977631 15143 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:01.007184 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 182637us
I20260709 13:06:01.007933 15213 leader_election.cc:400] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24.
I20260709 13:06:01.008309 15213 leader_election.cc:403] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:06:00.973877 23792 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.010490 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:01.015586 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:00.985209 23717 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:01.009297 15143 catalog_manager.cc:5697] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 10 to 15, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 15 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:00.974360 23650 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:00.948928 23809 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:01.035632 15143 catalog_manager.cc:5697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 16 to 18, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 18 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:01.024191 23717 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.020251 23711 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:01.025205 23837 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:01.043180 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 101084us
I20260709 13:06:01.022672 23587 raft_consensus.cc:2804] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:01.037765 23643 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.050932 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:01.054644 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 76970.9us
I20260709 13:06:01.055572 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:01.060920 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:06:01.050022 23477 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:01.072623 16033 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:01.071803 15143 catalog_manager.cc:5697] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 15 to 17, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 17 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:01.067476 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 70277.9us
W20260709 13:06:01.069905 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 87268.2us
I20260709 13:06:01.030607 23792 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.077958 15998 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:01.060091 23690 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:01.092392 15325 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:06:01.067085 23587 raft_consensus.cc:697] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:06:01.111202 23646 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:01.115185 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:01.121309 15143 catalog_manager.cc:5697] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 13 to 14, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 14 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:01.127065 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 67409.3us
I20260709 13:06:01.093065 23827 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:01.065734 23643 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:01.142297 15143 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 17 to 18, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 18 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:01.142645 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 103609us
I20260709 13:06:01.125399 23545 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:01.128767 23799 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:01.153018 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:01.153342 23587 consensus_queue.cc:237] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.153975 15321 raft_consensus.cc:3060] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:01.158676 23898 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:06:01.167462 15321 raft_consensus.cc:2468] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:06:01.170853 23904 consensus_queue.cc:1048] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:01.144462 23861 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:01.177412 23650 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:01.177872 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:01.177968 23861 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.179018 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:01.180740 23861 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:01.172441 16028 raft_consensus.cc:1240] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Rejecting Update request from peer 89940175e5444593aab6b3a025624b5b for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:01.183324 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.185670 23905 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:01.187352 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:01.188346 16032 raft_consensus.cc:2468] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 27.
I20260709 13:06:01.188529 23809 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:01.193212 15143 catalog_manager.cc:5697] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 10 to 13, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 13 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:01.181974 23545 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.197175 23545 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:01.198968 15291 leader_election.cc:336] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:01.199714 15291 leader_election.cc:336] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:01.200260 23792 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:01.213097 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:01.213433 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:01.215060 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:01.215243 23909 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:01.215837 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:01.217960 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:06:01.216303 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:06:01.200317 15291 consensus_peers.cc:597] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:01.223657 16024 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 25.
I20260709 13:06:01.228463 23809 raft_consensus.cc:2804] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:01.228971 23809 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:01.225353 23818 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:01.229417 23809 raft_consensus.cc:3060] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:01.231168 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:01.231938 16032 raft_consensus.cc:2368] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 25. Current term is 26.
I20260709 13:06:01.213145 23709 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:01.235481 15318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:01.236346 15318 raft_consensus.cc:2393] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 26: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:06:01.238768 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:01.243254 15289 leader_election.cc:400] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 25. Current term is 26.
I20260709 13:06:01.243650 15289 leader_election.cc:403] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:01.243371 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:06:01.226131 15291 consensus_peers.cc:597] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:01.247743 15291 consensus_peers.cc:597] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:01.248152 15214 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:06:01.257184 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 126438us
I20260709 13:06:01.256840 23809 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:01.258167 15291 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:01.260273 15291 consensus_peers.cc:597] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:01.261837 15289 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:01.264021 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:01.267320 15362 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:01.250267 23524 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: Vote denied by peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543) with higher term. Message: Invalid argument: T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 25. Current term is 26.
W20260709 13:06:01.267733 15291 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:01.278976 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:01.246343 23644 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:06:01.272965 23690 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:01.285388 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 30 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:01.269198 23709 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.017s
I20260709 13:06:01.227811 23717 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:01.276615 15291 consensus_peers.cc:597] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:01.285998 23477 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:01.284251 15215 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:01.316624 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:01.318025 15399 raft_consensus.cc:1240] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer edcf4a6bae7e4781bce325a586109ca5 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:01.333388 23633 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:01.340159 23751 raft_consensus.cc:2804] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:01.341225 23717 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:06:01.341753 23910 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:06:01.342878 23809 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:06:01.345175 23911 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:06:01.360603 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 179275us
I20260709 13:06:01.314482 23908 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:01.320158 23477 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:01.376662 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:01.380410 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:06:01.391671 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 94871.5us
I20260709 13:06:01.394145 15365 leader_election.cc:400] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213) with higher term. Message: Invalid argument: T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 for earlier term 22. Current term is 23.
I20260709 13:06:01.365386 23751 raft_consensus.cc:697] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:06:01.328150 23818 consensus_queue.cc:1059] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.065s
I20260709 13:06:01.396507 23643 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:01.412503 23837 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635) with higher term. Message: Invalid argument: T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24.
I20260709 13:06:01.421496 23545 consensus_queue.cc:1059] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:01.422813 23913 raft_consensus.cc:3055] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:01.423269 23913 raft_consensus.cc:740] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:06:01.424234 23913 consensus_queue.cc:260] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.425812 23913 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.428833 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
W20260709 13:06:01.431246 15291 leader_election.cc:336] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:01.392618 23908 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:06:01.445575 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:01.458360 15391 raft_consensus.cc:1240] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:01.450803 15363 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:01.473630 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 29 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.474198 15321 raft_consensus.cc:1275] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:01.481880 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
W20260709 13:06:01.478466 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 193834us
I20260709 13:06:01.430365 23751 consensus_queue.cc:237] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:01.497774 15393 raft_consensus.cc:1240] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 30 FOLLOWER]: Rejecting Update request from peer 45ddec37d9e741a598bf32f6c9d7e0ee for earlier term 29. Current term is 30. Ops: []
I20260709 13:06:01.499051 23477 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:06:01.501662 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:01.507210 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.507747 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:01.511183 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.530690 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:01.530748 15291 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:01.483325 23905 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:06:01.555199 15291 consensus_peers.cc:597] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:01.520217 23908 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.570825 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:01.586452 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.603921 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.591704 23717 consensus_queue.cc:1048] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260709 13:06:01.621215 23854 raft_consensus.cc:3055] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:01.622650 23854 raft_consensus.cc:740] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:06:01.623793 23854 consensus_queue.cc:260] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.625499 23854 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:01.642356 15396 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:06:01.634251 23809 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:01.675347 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 168150us
I20260709 13:06:01.676643 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:01.680048 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.667565 15396 raft_consensus.cc:1275] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:06:01.637009 23837 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:06:01.661366 23919 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:01.686844 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:01.705226 23922 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:01.712447 23709 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:01.713281 23709 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:01.716921 23709 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:01.726536 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.735348 15396 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 26.
W20260709 13:06:01.775343 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 288209us
I20260709 13:06:01.783679 23919 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.784626 23927 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:01.791152 23837 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:01.801918 23816 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:01.793190 23909 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:06:01.824172 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:01.826915 15390 raft_consensus.cc:2368] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24.
I20260709 13:06:01.828419 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.797163 23644 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:06:01.831754 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.813711 23932 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:01.845278 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:01.847383 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:01.849874 15391 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:06:01.851150 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:01.824222 23919 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:01.848524 23935 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:01.833881 23816 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.883985 23179 consensus_queue.cc:1059] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:06:01.885622 23643 raft_consensus.cc:3055] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:01.886065 23643 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:01.886466 23935 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:01.887024 23643 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:01.889377 23935 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:01.921672 23524 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.922333 23524 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:01.924482 23524 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:01.860174 23932 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.939966 23932 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:01.944017 23919 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:01.967504 23768 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:01.968397 23768 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.971712 23768 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:01.870179 23931 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:01.973110 23931 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.976006 23931 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:01.983485 23909 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:01.984290 23909 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:01.986737 23816 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:01.987146 23909 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:01.990732 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:06:01.993086 15213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 189105us
W20260709 13:06:01.966102 23929 log.cc:927] Time spent T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.157s	user 0.003s	sys 0.000s
I20260709 13:06:02.000839 15325 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:02.011360 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.015558 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.018833 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.024933 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.034669 23931 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:02.035307 23931 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:02.040735 23818 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:02.041431 23818 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:02.042436 23930 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:02.043287 23930 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.044262 23818 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:02.044888 23818 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:02.018030 23816 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.058548 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.037938 23931 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:02.046190 23930 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:02.065696 23930 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.068043 23930 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.078581 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.047322 23644 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.050737 23927 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:02.088315 23644 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.098189 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.099076 15320 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 26.
I20260709 13:06:02.060964 23816 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:02.103873 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 290825us
I20260709 13:06:02.088250 23932 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:02.104904 15290 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.091203 23930 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:02.107897 23768 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:02.108991 23644 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:02.115361 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.096868 23913 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:02.118150 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:02.094069 23927 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:02.123564 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:02.121120 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:02.128032 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:02.131011 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:06:02.144389 15365 leader_election.cc:336] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.146420 23927 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:02.146987 15365 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:02.154021 23799 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:02.118016 23932 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:02.149679 16024 raft_consensus.cc:1275] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:06:02.119397 23913 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:02.161639 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:02.164999 15365 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:02.165791 15365 leader_election.cc:336] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.166337 15365 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:02.166564 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:06:02.172564 15365 leader_election.cc:336] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:02.172170 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 292256us
I20260709 13:06:02.173285 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:02.169749 23908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.008s	sys 0.020s
W20260709 13:06:02.174929 15999 leader_election.cc:336] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Timed out: RequestConsensusVote RPC to 127.13.206.193:43213 timed out after 1.544s (SENT)
I20260709 13:06:02.174852 15290 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.177524 16029 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:06:02.175004 23903 consensus_queue.cc:1048] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.007s
I20260709 13:06:02.190613 15999 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:02.186681 15365 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.187234 23709 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:02.179625 23792 consensus_queue.cc:1059] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: INVALID_TERM, Last received: 29.18, Next index: 19, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 13:06:02.173401 23902 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:02.191486 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:02.195813 15290 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
W20260709 13:06:02.196657 15365 leader_election.cc:336] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.197191 15365 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:02.191618 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:06:02.191581 23908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.008s	sys 0.021s
W20260709 13:06:02.198390 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.202096 23941 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:02.203644 23643 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.204895 23927 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:02.205665 23633 raft_consensus.cc:2749] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:02.207506 15365 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.193647 23896 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:02.209019 15365 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:02.208225 23708 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
I20260709 13:06:02.210026 23709 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:06:02.211762 15365 leader_election.cc:336] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.212330 15365 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:02.213092 23708 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:02.213801 15365 leader_election.cc:336] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.214320 15365 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:02.197027 23799 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:02.217110 23708 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:02.228430 15213 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b; no voters: 
I20260709 13:06:02.206437 23944 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:06:02.231267 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.239087 15391 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:06:02.237008 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:02.243875 15365 leader_election.cc:336] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.244680 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:02.246659 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:02.246101 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:02.247972 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 73073.4us
W20260709 13:06:02.251221 15365 leader_election.cc:336] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:02.253122 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:02.253754 15365 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.254258 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:02.251904 15214 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:02.232405 23927 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:02.255383 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.259704 23927 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.256875 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.260151 23927 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:02.261794 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:06:02.259254 23949 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:06:02.259168 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.270815 15324 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:06:02.257903 23816 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:02.247661 23903 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:02.277165 15214 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:02.280385 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.285995 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:02.285393 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.294391 23768 raft_consensus.cc:3055] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:06:02.291033 23708 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:06:02.295820 23908 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:02.294899 23768 raft_consensus.cc:740] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:02.301049 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.317173 15390 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:06:02.305936 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.308241 23920 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:02.309918 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.320796 15394 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 26.
I20260709 13:06:02.312191 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.312372 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.314101 15215 leader_election.cc:400] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 election: Vote denied by peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417) with higher term. Message: Invalid argument: T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for earlier term 23. Current term is 24.
I20260709 13:06:02.321944 15393 raft_consensus.cc:2468] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 23.
I20260709 13:06:02.304045 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.322795 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:02.319276 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 119199us
I20260709 13:06:02.329365 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.334080 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.332146 23690 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:02.336182 23932 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:02.287020 23816 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.051s
I20260709 13:06:02.339383 23913 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:02.342909 15290 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.362447 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:02.333185 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:02.380278 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47165.7us
I20260709 13:06:02.381975 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.383927 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.388322 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:02.391515 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 129278us
I20260709 13:06:02.364010 23908 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:02.362861 23941 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:06:02.381206 15365 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:02.408192 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.404613 23837 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.405095 15215 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.408828 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:02.411871 16033 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:02.387730 23934 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:02.387598 23816 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:02.430434 15215 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:02.418740 15365 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:02.435632 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.445354 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:02.441424 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.454772 16027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:06:02.459113 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 116306us
I20260709 13:06:02.460196 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.429167 23524 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:02.464470 15215 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.437011 23854 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:02.405334 23909 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:06:02.475947 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:06:02.461037 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:02.474828 15998 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:02.469660 15196 auto_rebalancer.cc:629] Failed to schedule move for tablet 8f6ca66a81d04e56bccbc22cab55f4de: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.481663 23633 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:02.487983 15215 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.489223 15290 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.490185 23792 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:02.462774 23932 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:02.496383 15291 leader_election.cc:336] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:02.481240 23945 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:02.482710 23931 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:02.452150 23941 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.538771 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:06:02.540421 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.488209 23897 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:02.499454 23690 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:02.559571 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 71958.1us
I20260709 13:06:02.474049 23908 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.066s
I20260709 13:06:02.536051 23854 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:02.486326 23524 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:02.617074 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 127922us
I20260709 13:06:02.550918 23818 raft_consensus.cc:2804] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:06:02.615764 23922 log.cc:927] Time spent T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:06:02.559916 23816 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:02.560571 23633 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:02.621863 23958 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:06:02.635958 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 95653.3us
I20260709 13:06:02.636338 15290 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:02.559911 23943 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:02.637764 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.570156 23970 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:02.652495 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.629426 23792 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.657262 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.634300 23818 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.666162 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:02.647658 23953 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:02.690681 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.632330 23942 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.039s
I20260709 13:06:02.656478 23816 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:02.666728 23179 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:02.677109 23818 raft_consensus.cc:3060] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:02.667240 23633 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:02.666070 23934 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:02.717095 23960 log.cc:927] Time spent T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:06:02.723906 23524 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:02.665270 23970 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.747556 23768 consensus_queue.cc:260] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.749333 23927 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.750205 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.752934 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e82f23e062ad47fe80fac622dd633649" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.684962 23477 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:06:02.800647 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 267495us
I20260709 13:06:02.711748 23954 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:02.806380 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.651755 23943 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:02.803642 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 119407us
I20260709 13:06:02.676080 23792 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:02.821033 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20d2caf56534c1ebcf23935582a5f03" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:02.706439 23643 consensus_queue.cc:1048] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 13:06:02.798990 23179 raft_consensus.cc:697] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:06:02.828192 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 74416.5us
I20260709 13:06:02.801352 23979 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:02.839395 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:02.840488 23943 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:02.842293 23971 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:02.845050 23970 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:02.839463 23979 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.849257 23979 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:02.821195 23477 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.853106 23927 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:02.828609 23768 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:06:02.853901 23477 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:02.856729 23792 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:02.857930 15321 raft_consensus.cc:1275] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:06:02.838035 23941 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:02.838804 23968 log.cc:927] Time spent T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:06:02.815268 23954 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.860908 23954 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:02.701699 23953 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.875313 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:02.876703 23953 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:02.878672 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.880149 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.880960 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:02.882457 23179 consensus_queue.cc:237] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.882951 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.890020 23913 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.906594 23913 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:02.908839 23913 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:02.931952 15394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.949121 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:02.938930 23935 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.954768 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:02.954921 23935 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:02.955863 15393 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:02.957481 23935 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:02.958439 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.961485 23967 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.940459 23837 consensus_meta.cc:287] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.001s
I20260709 13:06:02.962128 23967 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:02.962963 23837 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:02.971274 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.939195 23931 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.967284 23980 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.945539 23909 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:02.985807 23909 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:02.988864 23909 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:02.992676 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:02.975399 23818 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.026660 16027 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:06:03.030027 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:02.990309 23980 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:03.039664 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.044543 15393 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 27.
I20260709 13:06:03.045701 16029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:03.046803 23980 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.049532 23818 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:03.055430 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 286297us
I20260709 13:06:03.056502 15290 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.062963 15290 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:02.981065 23931 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.070751 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.068799 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:03.071703 15390 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:06:03.077340 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:03.086354 15215 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.088325 15290 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.097045 15323 raft_consensus.cc:2410] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b for term 30 because replica has last-logged OpId of term: 29 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 28 index: 17.
I20260709 13:06:03.068730 23927 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:03.115236 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.115937 15319 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 20.
I20260709 13:06:03.121820 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 29 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.078447 23972 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.125741 23709 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:03.103127 23981 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:03.078697 23989 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:03.132745 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5704803490ae4e7bb7f8229734bd20df" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.132050 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.110641 23988 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:03.122490 23809 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:03.150938 15290 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.127876 23967 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.143523 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.145073 15316 raft_consensus.cc:1275] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 13:06:03.143545 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57361.5us
I20260709 13:06:03.161187 15215 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:06:03.143306 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 66075.5us
I20260709 13:06:03.151659 15214 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:03.135241 23981 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.134095 23792 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:03.164393 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:03.169094 15999 leader_election.cc:336] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.169807 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.171269 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:03.173058 15999 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.173709 15999 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:03.173993 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:06:03.175102 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:03.166688 15398 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:06:03.178472 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.179816 15398 raft_consensus.cc:2393] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 30: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:06:03.146912 23644 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:03.127867 23972 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.142899 23992 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:03.193128 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:03.163829 23179 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:03.137722 23709 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.175689 23981 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.156059 23971 consensus_queue.cc:1048] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260709 13:06:03.182361 23854 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:03.204758 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:03.175706 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:03.205288 15998 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:03.209769 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.184826 23967 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:03.197422 23943 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 13:06:03.184723 23927 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:03.171806 23809 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.187673 23897 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:03.207005 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 60987.1us
I20260709 13:06:03.199450 23690 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:03.211402 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:03.186115 23975 consensus_queue.cc:1048] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
W20260709 13:06:03.221328 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:03.214771 23979 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:06:03.215294 23986 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:03.199241 23992 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:03.214295 23854 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 27 LEADER]: Becoming Leader. State: Replica: 89940175e5444593aab6b3a025624b5b, State: Running, Role: LEADER
I20260709 13:06:03.219077 23644 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:06:03.232445 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:03.239475 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:03.241494 23984 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:06:03.256871 23709 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:03.260615 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.261912 15322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.264668 23809 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.266377 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.267568 23854 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.273289 23931 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.275502 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:03.278101 23993 log.cc:927] Time spent T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:06:03.280294 23972 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:03.281383 15213 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:03.283028 23997 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:06:03.285240 23994 log.cc:927] Time spent T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:06:03.287432 23477 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:03.288211 23954 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.289474 15324 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 27: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:06:03.233793 23986 raft_consensus.cc:493] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.290124 23986 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:03.294313 23981 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:03.296643 23981 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.300736 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:03.301431 15393 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.303663 23992 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:03.310277 23943 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.310889 23943 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:03.311678 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:03.312105 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 72134.4us
I20260709 13:06:03.312471 15393 raft_consensus.cc:2468] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 21.
I20260709 13:06:03.313916 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.318885 15998 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:03.322562 23909 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:03.322554 23981 raft_consensus.cc:2804] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:03.323323 23909 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.324730 23981 raft_consensus.cc:697] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:06:03.325471 23909 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.325778 23981 consensus_queue.cc:237] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:03.326695 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:03.327137 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 131421us
I20260709 13:06:03.327517 23943 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:03.329248 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.329572 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.332973 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:03.318944 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:03.343917 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.345475 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:03.343518 15999 leader_election.cc:336] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.352401 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.360603 15213 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:03.361141 15291 leader_election.cc:336] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:03.361685 15999 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.363051 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:03.362666 15291 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:06:03.371505 15291 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.335975 23931 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:03.373056 15291 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.364593 23992 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:03.381574 23980 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:03.394539 23897 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:03.416167 23979 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:06:03.394476 23816 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:03.424434 23954 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.455664 23935 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.456540 23935 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:03.462698 23935 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:03.467739 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.468861 15393 raft_consensus.cc:2393] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89940175e5444593aab6b3a025624b5b in current term 21: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
W20260709 13:06:03.472720 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 79460.8us
I20260709 13:06:03.493710 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.497351 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.526600 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.498628 23973 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:03.500980 23477 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.482648 23986 raft_consensus.cc:515] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:03.522900 23979 raft_consensus.cc:493] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.561954 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:03.524820 23969 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:03.564858 15398 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 27: Already voted for candidate 89940175e5444593aab6b3a025624b5b in this term.
I20260709 13:06:03.530509 23708 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.537840 23644 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:03.582976 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 198150us
I20260709 13:06:03.577572 23690 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:03.569126 23837 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:03.568135 23992 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.564357 23477 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.572943 23708 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.567193 23979 raft_consensus.cc:515] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.595150 23837 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.597920 23992 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.616500 16032 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:03.618664 23992 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.578285 23644 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.625422 15214 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.626922 23854 raft_consensus.cc:3060] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.592356 23690 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:03.642740 24000 log.cc:927] Time spent T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:03.646467 23708 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:03.646736 23986 leader_election.cc:290] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.649691 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:03.650784 15316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.652586 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79fb071c9f56456cade8cf3a14c85fc3" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:03.661634 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:03.662348 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:03.660756 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.663990 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.664563 15323 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:06:03.663746 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.656814 23931 raft_consensus.cc:493] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:03.670245 23931 raft_consensus.cc:515] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.672696 23931 leader_election.cc:290] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:03.686336 14139 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 15275)
W20260709 13:06:03.689621 24002 log.cc:927] Time spent T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:06:03.667207 23920 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:03.699144 23854 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:03.707022 15323 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
W20260709 13:06:03.714824 15196 auto_rebalancer.cc:629] Failed to schedule move for tablet d44715ddcb564012b7a6c6eedb94b8e2: Illegal state: Replica 45ddec37d9e741a598bf32f6c9d7e0ee is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 27 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
W20260709 13:06:03.741973 15196 auto_rebalancer.cc:629] Failed to schedule move for tablet 907f0d82d81845029df5f0613caae65c: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.743057 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:03.715559 15291 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.717752 23690 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.729457 23477 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.730089 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4342f068b244466e9d599b81fd154374" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:03.747057 15391 raft_consensus.cc:3060] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:03.732182 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 124621us
I20260709 13:06:03.747722 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.733110 23837 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.735330 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:03.735755 23644 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.736598 23979 leader_election.cc:290] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.751772 15290 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.753388 23970 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:03.759004 15291 consensus_peers.cc:597] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:03.759807 15196 auto_rebalancer.cc:629] Failed to schedule move for tablet f3f21223b98c4cc6b8699008b5c6edc8: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.766938 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.767565 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:03.767750 15999 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.768299 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:03.768658 23954 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:06:03.769801 24017 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:03.770136 15390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.770921 15390 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 21.
W20260709 13:06:03.771432 15999 leader_election.cc:336] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.768262 15396 raft_consensus.cc:2468] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89940175e5444593aab6b3a025624b5b in term 24.
I20260709 13:06:03.773828 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.777179 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "907f0d82d81845029df5f0613caae65c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 29 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.782006 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.786158 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92362862adca4227bb6dad04afd638cc" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:03.791831 15999 leader_election.cc:336] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.794845 15393 raft_consensus.cc:1275] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:06:03.796818 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:03.798892 15996 leader_election.cc:304] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
W20260709 13:06:03.803530 15291 leader_election.cc:336] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.805924 15399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de7f843f60914a58b8b7e5a4a5e2ea6a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.808203 15215 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee
I20260709 13:06:03.810310 15391 raft_consensus.cc:2468] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:06:03.818814 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.820369 23953 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:03.825683 15215 leader_election.cc:304] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.813434 23644 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:03.814569 23986 raft_consensus.cc:2804] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:03.813480 23643 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.821952 23854 raft_consensus.cc:2804] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:03.827448 23953 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.835820 23931 raft_consensus.cc:2749] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:03.843957 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:03.840787 24018 log.cc:927] Time spent T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:03.848181 15215 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.830031 23927 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:03.847430 23953 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:03.853427 23818 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:03.853523 23919 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:03.845402 23854 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.848770 23986 raft_consensus.cc:697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:06:03.864938 23854 raft_consensus.cc:3060] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:03.834308 23644 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.846824 23643 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:03.888903 23643 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:03.891920 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:03.905450 15215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 53209.6us
I20260709 13:06:03.907563 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:03.912680 15215 leader_election.cc:304] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.913844 23935 raft_consensus.cc:2749] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:03.914784 15325 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:06:03.914976 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:03.915083 15395 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Refusing update from remote peer 89940175e5444593aab6b3a025624b5b: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
W20260709 13:06:03.921468 15291 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.921945 23818 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:03.925488 23816 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:03.895452 23644 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:03.928822 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 125845us
W20260709 13:06:03.933089 15365 leader_election.cc:336] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.934551 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:03.935493 15365 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:03.935901 15365 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:03.936508 23909 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:03.939810 23650 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:03.936767 23975 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:03.944190 23986 consensus_queue.cc:237] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:03.945636 24019 log.cc:927] Time spent T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.063s	user 0.003s	sys 0.000s
I20260709 13:06:03.950551 23643 consensus_queue.cc:1048] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:06:03.973104 15291 consensus_peers.cc:597] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:04.005996 15399 raft_consensus.cc:1275] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:06:04.008699 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:04.009387 15397 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 30.
W20260709 13:06:04.012379 15365 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:04.012885 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:04.015805 23953 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.015863 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:04.020684 23179 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:06:04.021112 23179 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.021451 23179 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 30 FOLLOWER]: Advancing to term 31
W20260709 13:06:04.028918 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.035689 23854 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:04.037202 15291 leader_election.cc:336] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:04.040508 24014 consensus_queue.cc:1048] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:04.042160 23477 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.043951 23477 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.046677 23953 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:04.048303 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:04.052503 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:04.038146 23854 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:04.067144 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1389463201b74b128d916816a1d7c24c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:04.070824 23477 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:04.071946 15213 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:04.074425 23477 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:04.075780 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:04.077580 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:04.083909 23854 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:04.097621 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:04.098199 15395 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:04.142498 23816 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:04.177268 15143 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49186 (request call id 219) took 52505 ms (client timeout 15000 ms). Trace:
I20260709 13:06:04.173995 23709 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:04.184863 23644 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:04.199669 23644 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.201865 23644 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:04.176687 23816 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.233976 23816 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:04.211982 23909 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:04.218597 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:04.225963 15291 consensus_peers.cc:597] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:04.235886 23909 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.236421 15395 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
W20260709 13:06:04.177806 15143 rpcz_store.cc:269] 0709 13:05:11.667845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.707345 (+ 39500us) service_pool.cc:224] Handling call
0709 13:05:12.096065 (+388720us) spinlock_profiling.cc:243] Waited 69.3 ms on lock 0x7b54002c0010. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666ad5b71 00007f3666ad60b2 00007f366fa4fa89 00007f366f9e7da6 00007f366f9b9088 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc
0709 13:06:04.173276 (+52077211us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:01.737507 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:01.738475 (+   968us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:01.738547 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:06:01.738578 (+    31us) tablet.cc:662] Decoding operations
0709 13:06:01.824249 (+ 85671us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:01.837543 (+ 13294us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:01.841789 (+  4246us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:06:01.970244 (+128455us) tablet.cc:701] Row locks acquired
0709 13:06:01.970313 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:06:01.970567 (+   254us) write_op.cc:270] Start()
0709 13:06:01.970754 (+   187us) write_op.cc:276] Timestamp: P: 1783602361970482 usec, L: 0
0709 13:06:01.970801 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:06:01.971819 (+  1018us) log.cc:844] Serialized 8711 byte log entry
0709 13:06:02.671315 (+699496us) op_driver.cc:464] REPLICATION: finished
0709 13:06:02.975969 (+304654us) write_op.cc:301] APPLY: starting
0709 13:06:02.983093 (+  7124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:03.359820 (+376727us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:03.395438 (+ 35618us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:03.675071 (+279633us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:03.675697 (+   626us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:06:03.675785 (+    88us) write_op.cc:312] APPLY: finished
0709 13:06:03.676491 (+   706us) log.cc:844] Serialized 196 byte log entry
0709 13:06:03.850398 (+173907us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:03.866471 (+ 16073us) write_op.cc:454] Released schema lock
0709 13:06:03.882394 (+ 15923us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:03.889324 (+  6930us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:03.889373 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":81238,"reported_tablets":51,"spinlock_wait_cycles":159416064,"child_traces":[["op",{"apply.queue_time_us":277628,"apply.run_cpu_time_us":64805,"apply.run_wall_time_us":917991,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96043,"num_ops":22,"prepare.queue_time_us":310250,"prepare.run_cpu_time_us":30508,"prepare.run_wall_time_us":452941,"raft.queue_time_us":343734,"raft.run_cpu_time_us":33725,"raft.run_wall_time_us":170174,"replication_time_us":700228,"thread_start_us":761957,"threads_started":5,"wal-append.queue_time_us":421919,"wal-append.run_cpu_time_us":47124,"wal-append.run_wall_time_us":1241015}]]}
W20260709 13:06:04.236256 15291 consensus_peers.cc:597] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:04.225805 23179 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.238193 23909 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:04.239863 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:04.240160 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:04.240466 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:04.244676 23179 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 31 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:04.252499 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:04.255335 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:04.252593 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:04.258745 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:04.256673 23644 raft_consensus.cc:493] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:04.260962 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 31 candidate_status { last_received { term: 29 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:04.261262 15290 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:06:04.257519 15291 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:04.263463 15395 raft_consensus.cc:3060] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:06:04.264163 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:04.270149 23643 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:04.270831 23643 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:04.271739 23643 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.271798 15145 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 12 to 15, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 15 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:04.263835 24024 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:04.277051 15145 catalog_manager.cc:5697] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 12 to 15, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 15 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:04.278437 23477 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:04.259640 23909 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:04.286159 15395 raft_consensus.cc:2468] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 31.
I20260709 13:06:04.289361 15290 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:04.265744 23644 raft_consensus.cc:515] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:04.294760 23792 raft_consensus.cc:2804] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:06:04.295343 23792 raft_consensus.cc:697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 31 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
W20260709 13:06:04.305914 15144 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 237) took 120953 ms (client timeout 15000 ms). Trace:
W20260709 13:06:04.306434 15144 rpcz_store.cc:269] 0709 13:04:03.352952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.353170 (+   218us) service_pool.cc:224] Handling call
0709 13:06:04.305714 (+120952544us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40126,"reported_tablets":50}
I20260709 13:06:04.306736 23644 leader_election.cc:290] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:04.307668 23792 consensus_queue.cc:237] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 29.18, Last appended by leader: 18, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.308511 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:04.310683 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68e68ea4eb05497288804ad7aefb241e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:04.314553 15214 leader_election.cc:304] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:04.315832 23909 raft_consensus.cc:2749] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:04.328723 23909 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:04.329340 23909 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:04.332098 23909 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:04.334174 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:04.337423 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:04.339813 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:04.340781 23644 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:04.444552 24024 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:04.445241 24024 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:04.449065 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:04.449995 24024 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:04.450111 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:04.452572 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:04.454475 23644 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:04.480738 24024 raft_consensus.cc:493] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:04.481432 24024 raft_consensus.cc:515] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:04.486792 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:04.487218 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e71ec5b3198446c0a387428e2a4eb753" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:04.489462 15213 leader_election.cc:304] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:04.490334 23644 raft_consensus.cc:2749] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:04.490367 24024 leader_election.cc:290] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:04.509671 15321 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:04.513413 24016 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:06:04.521082 15145 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49186 (request call id 218) took 73002 ms (client timeout 15000 ms). Trace:
I20260709 13:06:04.529198 15395 raft_consensus.cc:1275] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:04.532346 23981 consensus_queue.cc:1048] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:06:04.521696 15145 rpcz_store.cc:269] 0709 13:04:51.518852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.519104 (+   252us) service_pool.cc:224] Handling call
0709 13:06:04.520995 (+73001891us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:04.366902 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:04.370293 (+  3391us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:04.370330 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:06:04.370347 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:04.370761 (+   414us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:04.370841 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:04.370866 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:04.371167 (+   301us) tablet.cc:701] Row locks acquired
0709 13:06:04.371182 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:06:04.371314 (+   132us) write_op.cc:270] Start()
0709 13:06:04.371426 (+   112us) write_op.cc:276] Timestamp: P: 1783602364371268 usec, L: 0
0709 13:06:04.371452 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:06:04.372143 (+   691us) log.cc:844] Serialized 926 byte log entry
0709 13:06:04.403944 (+ 31801us) op_driver.cc:464] REPLICATION: finished
0709 13:06:04.421556 (+ 17612us) write_op.cc:301] APPLY: starting
0709 13:06:04.421646 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:04.423398 (+  1752us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:04.423510 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:04.424812 (+  1302us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:04.425029 (+   217us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:06:04.425081 (+    52us) write_op.cc:312] APPLY: finished
0709 13:06:04.425316 (+   235us) log.cc:844] Serialized 33 byte log entry
0709 13:06:04.426111 (+   795us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:04.426622 (+   511us) write_op.cc:454] Released schema lock
0709 13:06:04.426668 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:04.429830 (+  3162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:04.429857 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":721,"reported_tablets":51,"spinlock_wait_cycles":9088,"child_traces":[["op",{"apply.queue_time_us":17230,"apply.run_cpu_time_us":4661,"apply.run_wall_time_us":6921,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12483,"num_ops":2,"prepare.queue_time_us":17285,"prepare.run_cpu_time_us":2884,"prepare.run_wall_time_us":5550,"replication_time_us":32315,"thread_start_us":35307,"threads_started":2}]]}
W20260709 13:06:04.595942 15291 consensus_peers.cc:597] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:04.678318 15291 consensus_peers.cc:597] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.665608 15147 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 11 to 12, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 12 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:04.681708 15146 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49174 (request call id 241) took 106065 ms (client timeout 15000 ms). Trace:
W20260709 13:06:04.682111 15146 rpcz_store.cc:269] 0709 13:04:18.601468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.604669 (+  3201us) service_pool.cc:224] Handling call
0709 13:06:04.666654 (+106061985us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":50}
W20260709 13:06:04.686923 14139 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 15275)
I20260709 13:06:04.687353 23909 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:04.688417 23909 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.692068 23909 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:04.696288 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:04.698406 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ab819064aa4b6faba9dff78296aa66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:04.700141 15291 consensus_peers.cc:597] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:04.703325 15213 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:04.704263 23909 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:04.706512 15291 consensus_peers.cc:597] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:04.717413 15291 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:04.727923 15397 raft_consensus.cc:1275] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 29 index: 18. Preceding OpId from leader: term: 31 index: 19. (index mismatch)
I20260709 13:06:04.736353 23643 consensus_queue.cc:1048] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:06:04.741679 15291 consensus_peers.cc:597] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:04.753257 23909 raft_consensus.cc:493] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.753923 23909 raft_consensus.cc:515] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:04.757375 15145 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 18 to 21, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 21 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.760636 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:04.759826 15145 catalog_manager.cc:5697] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 19 to 21, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 21 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:04.762702 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6d786e7c4904b39b63a5862d5a7e6f4" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:04.765024 15215 leader_election.cc:304] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:04.765187 23909 leader_election.cc:290] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:04.766290 24024 raft_consensus.cc:2749] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:04.777272 23909 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.777812 23909 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.782912 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:04.784047 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6ca66a81d04e56bccbc22cab55f4de" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:04.786368 15215 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:04.788102 23644 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:04.788679 23909 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:04.795344 15145 catalog_manager.cc:5697] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:04.797227 15145 catalog_manager.cc:5697] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 23 to 24, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 24 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:04.800346 15291 consensus_peers.cc:597] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:04.799536 15145 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 16 to 17, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 17 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:04.809895 15291 consensus_peers.cc:597] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:04.823097 15398 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:06:04.824712 23643 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:04.824913 15145 catalog_manager.cc:5697] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 18 to 25, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 25 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.827696 15145 catalog_manager.cc:5697] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 15 to 27. New cstate: current_term: 27 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.849361 15145 catalog_manager.cc:5697] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.852799 15145 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 17 to 20, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 20 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.858330 15145 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 24 to 27, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 27 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:04.864765 15145 catalog_manager.cc:5697] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.866433 15145 catalog_manager.cc:5697] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 15 to 24, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 24 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.868359 15145 catalog_manager.cc:5697] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 17 to 27, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 27 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:04.869859 15147 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 238) took 90419 ms (client timeout 15000 ms). Trace:
W20260709 13:06:04.871681 15147 rpcz_store.cc:269] 0709 13:04:34.450919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.454473 (+  3554us) service_pool.cc:224] Handling call
0709 13:06:04.869792 (+90415319us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:04.719417 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:04.719907 (+   490us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:04.719930 (+    23us) write_op.cc:435] Acquired schema lock
0709 13:06:04.719940 (+    10us) tablet.cc:662] Decoding operations
0709 13:06:04.720176 (+   236us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:04.720213 (+    37us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:04.720231 (+    18us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:04.720355 (+   124us) tablet.cc:701] Row locks acquired
0709 13:06:04.720365 (+    10us) write_op.cc:260] PREPARE: finished
0709 13:06:04.720465 (+   100us) write_op.cc:270] Start()
0709 13:06:04.720550 (+    85us) write_op.cc:276] Timestamp: P: 1783602364720430 usec, L: 0
0709 13:06:04.720563 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 13:06:04.721102 (+   539us) log.cc:844] Serialized 544 byte log entry
0709 13:06:04.723526 (+  2424us) op_driver.cc:464] REPLICATION: finished
0709 13:06:04.724062 (+   536us) write_op.cc:301] APPLY: starting
0709 13:06:04.724156 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:04.725086 (+   930us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:04.725206 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:04.725887 (+   681us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:04.726034 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:06:04.726076 (+    42us) write_op.cc:312] APPLY: finished
0709 13:06:04.726285 (+   209us) log.cc:844] Serialized 25 byte log entry
0709 13:06:04.726444 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:04.726536 (+    92us) write_op.cc:454] Released schema lock
0709 13:06:04.726574 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:04.726925 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:04.726950 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1168256,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":290,"apply.run_cpu_time_us":2820,"apply.run_wall_time_us":2820,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4178,"num_ops":1,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":1961,"prepare.run_wall_time_us":1961,"replication_time_us":2808}]]}
I20260709 13:06:04.875943 24024 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:04.880842 24024 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:04.874965 15145 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 15 to 19, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 19 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:04.883184 24024 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:04.882740 15145 catalog_manager.cc:5697] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 17 to 24, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 24 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.885821 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:04.887384 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f72ca1a62ac74338a0ec5abd5a427bbf" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:04.891296 15145 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 17 to 24, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 24 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:04.892880 15145 catalog_manager.cc:5697] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.895920 15145 catalog_manager.cc:5697] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 18 to 25, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 25 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.901788 15145 catalog_manager.cc:5697] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.905027 15145 catalog_manager.cc:5697] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 22 to 27, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 27 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:04.905773 15215 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:04.915812 23644 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:04.916922 15145 catalog_manager.cc:5697] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:04.994820 15365 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.040004 15196 auto_rebalancer.cc:629] Failed to schedule move for tablet 7ac2109e25f8401baf7141ea474e8bc4: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:05.045714 15196 auto_rebalancer.cc:629] Failed to schedule move for tablet 4365018e298c4531b7d90e25d9d6d144: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:05.050382 15196 auto_rebalancer.cc:629] Failed to schedule move for tablet 705321025dc74b199219f4e541a68efa: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:05.074863 24024 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:05.075524 24024 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:05.079476 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.079686 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:05.081532 15213 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.082415 23644 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:05.083626 24024 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:06:05.084355 15196 auto_rebalancer.cc:629] Failed to schedule move for tablet fad3ad4002954af28c1eccdf62948088: Illegal state: Replica ee9654803379434388de45d4693e6b16 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 26 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.084882 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:05.091519 15145 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54066 (request call id 142) took 4292 ms. Trace:
I20260709 13:06:05.092060 15145 rpcz_store.cc:276] 0709 13:06:00.805957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.534221 (+3728264us) service_pool.cc:224] Handling call
0709 13:06:05.091403 (+557182us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:04.940095 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:04.940613 (+   518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:04.940646 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:06:04.940663 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:04.942207 (+  1544us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:04.942283 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:04.942309 (+    26us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:06:04.943765 (+  1456us) tablet.cc:701] Row locks acquired
0709 13:06:04.943784 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:04.943923 (+   139us) write_op.cc:270] Start()
0709 13:06:04.944052 (+   129us) write_op.cc:276] Timestamp: P: 1783602364943880 usec, L: 0
0709 13:06:04.944075 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:04.944740 (+   665us) log.cc:844] Serialized 8320 byte log entry
0709 13:06:04.947368 (+  2628us) op_driver.cc:464] REPLICATION: finished
0709 13:06:04.947834 (+   466us) write_op.cc:301] APPLY: starting
0709 13:06:04.947910 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:04.962058 (+ 14148us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:04.962153 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:05.015616 (+ 53463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:05.015947 (+   331us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:06:05.015998 (+    51us) write_op.cc:312] APPLY: finished
0709 13:06:05.016489 (+   491us) log.cc:844] Serialized 188 byte log entry
0709 13:06:05.045540 (+ 29051us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.050892 (+  5352us) write_op.cc:454] Released schema lock
0709 13:06:05.050965 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:05.051374 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.051406 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":97315,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":242,"apply.run_cpu_time_us":26815,"apply.run_wall_time_us":103489,"cfile_cache_hit":84,"cfile_cache_hit_bytes":87738,"num_ops":21,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":4924,"prepare.run_wall_time_us":4924,"replication_time_us":3171}]]}
I20260709 13:06:05.109458 24024 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:05.110045 24024 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:05.112862 24024 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:05.114727 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.124096 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0387b757aa040099c98e877245b7bfd" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:05.142554 15214 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.144263 23644 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:05.193889 15148 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 239) took 67081 ms (client timeout 15000 ms). Trace:
W20260709 13:06:05.194463 15148 rpcz_store.cc:269] 0709 13:04:58.112113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.159232 (+ 47119us) service_pool.cc:224] Handling call
0709 13:06:05.193678 (+67034446us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2592,"reported_tablets":50}
I20260709 13:06:05.200091 23644 raft_consensus.cc:493] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.200616 23644 raft_consensus.cc:515] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:05.202950 23644 leader_election.cc:290] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:05.205008 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:05.205709 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9161d42f4f04ce8a5234d5b1cfeab22" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.209407 15215 leader_election.cc:304] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.211369 24024 raft_consensus.cc:2749] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:05.211659 23644 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.212417 23644 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:05.215142 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:05.215698 24024 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:05.216325 24024 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:05.217670 23644 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:05.218703 24024 leader_election.cc:290] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:05.219944 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.221067 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.229426 15215 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.225135 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:05.231254 15213 leader_election.cc:304] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.232167 24024 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:05.233357 24024 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:05.199626 15139 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 16 to 20, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 20 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.237223 15139 catalog_manager.cc:5697] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.239053 15139 catalog_manager.cc:5697] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.240994 15139 catalog_manager.cc:5697] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 14 to 22, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 22 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.245226 15139 catalog_manager.cc:5697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.248047 15139 catalog_manager.cc:5697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.254837 15139 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.256661 15139 catalog_manager.cc:5697] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 19 to 20, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 20 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.258880 15139 catalog_manager.cc:5697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 17 to 22, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 22 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.260763 15139 catalog_manager.cc:5697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.264304 23644 raft_consensus.cc:493] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.264879 23644 raft_consensus.cc:515] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:05.268316 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:05.269604 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d6106766cf4009837f848b4f8cbb1f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.269129 23644 leader_election.cc:290] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:05.270519 15139 catalog_manager.cc:5697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.271231 15215 leader_election.cc:304] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.272076 23644 raft_consensus.cc:2749] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:05.275152 15139 catalog_manager.cc:5697] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 14 to 15, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 15 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.277362 15139 catalog_manager.cc:5697] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 19 to 21, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 21 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.284138 15139 catalog_manager.cc:5697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.286392 15139 catalog_manager.cc:5697] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 14 to 16, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 16 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:05.328209 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.341976 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.361711 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.378573 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:05.388650 24024 raft_consensus.cc:493] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:05.389297 24024 raft_consensus.cc:515] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:05.392908 24024 leader_election.cc:290] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:05.394344 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:05.394207 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "521a10ac7e184bf1978bbe6947d0ca8d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.396417 15215 leader_election.cc:304] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.397627 23644 raft_consensus.cc:2749] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:05.419555 15139 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49174 (request call id 244) took 35765 ms (client timeout 15000 ms). Trace:
I20260709 13:06:05.418955 15141 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.420919 15141 catalog_manager.cc:5697] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 20 to 22, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 22 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:05.420178 15139 rpcz_store.cc:269] 0709 13:05:29.654010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.654436 (+   426us) service_pool.cc:224] Handling call
0709 13:06:05.419454 (+35765018us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:05.301982 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:05.302617 (+   635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:05.302661 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:06:05.302680 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:05.304073 (+  1393us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:05.304134 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:05.304171 (+    37us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:06:05.305280 (+  1109us) tablet.cc:701] Row locks acquired
0709 13:06:05.305294 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:06:05.305435 (+   141us) write_op.cc:270] Start()
0709 13:06:05.305569 (+   134us) write_op.cc:276] Timestamp: P: 1783602365305389 usec, L: 0
0709 13:06:05.305584 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:06:05.306279 (+   695us) log.cc:844] Serialized 6019 byte log entry
0709 13:06:05.309167 (+  2888us) op_driver.cc:464] REPLICATION: finished
0709 13:06:05.310516 (+  1349us) write_op.cc:301] APPLY: starting
0709 13:06:05.310606 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:05.321769 (+ 11163us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:05.321896 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:05.332928 (+ 11032us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:05.333255 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:06:05.333313 (+    58us) write_op.cc:312] APPLY: finished
0709 13:06:05.335970 (+  2657us) log.cc:844] Serialized 139 byte log entry
0709 13:06:05.336167 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.336338 (+   171us) write_op.cc:454] Released schema lock
0709 13:06:05.336391 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:05.382534 (+ 46143us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.382572 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1848417,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":1066,"apply.run_cpu_time_us":19581,"apply.run_wall_time_us":71985,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62670,"num_ops":15,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":4572,"prepare.run_wall_time_us":4582,"replication_time_us":3462}]]}
I20260709 13:06:05.422888 15141 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 12 to 21, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 21 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.425549 15141 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 17 to 20, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 20 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.427335 15141 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.433230 15141 catalog_manager.cc:5697] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 15 to 19, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 19 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.443354 15141 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:05.444993 15141 catalog_manager.cc:5697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.447047 15141 catalog_manager.cc:5697] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:05.453675 15141 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.457163 15141 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:05.460093 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:05.486362 23909 raft_consensus.cc:493] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:05.486981 23909 raft_consensus.cc:515] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:05.489127 23909 leader_election.cc:290] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:05.499811 23644 raft_consensus.cc:493] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.500385 23644 raft_consensus.cc:515] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:05.501579 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.503193 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa77b7aa76c4cce87f6d985fe8e1d3a" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:05.510212 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:05.514896 23644 leader_election.cc:290] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:05.552690 24040 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:05.554334 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "525e3bab033946a090787fa86d1292aa" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.554987 24040 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:05.567736 24040 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:05.579557 15215 leader_election.cc:304] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:05.580224 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:05.580538 24040 raft_consensus.cc:2749] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:05.587878 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.573593 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da67615b960b446d8df50fe1de2a0b3e" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:05.589598 15214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 85270.9us
I20260709 13:06:05.594077 15214 leader_election.cc:304] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.595726 15215 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.596599 24024 raft_consensus.cc:2749] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:05.597266 24024 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:05.599958 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.602497 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.609953 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.610996 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.616428 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:05.639024 24041 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:05.639693 24041 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:05.639150 15142 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 19 to 20, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 20 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.641526 15142 catalog_manager.cc:5697] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 18 to 21, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 21 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.643401 15142 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.644460 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:05.647076 15141 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49186 (request call id 220) took 23230 ms (client timeout 15000 ms). Trace:
I20260709 13:06:05.647715 24041 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:05.648514 15365 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 246 similar messages]
I20260709 13:06:05.655113 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcb1955ebaf442cb75dba3471600141" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.656701 15142 catalog_manager.cc:5697] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 20 to 24, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 24 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.659718 15142 catalog_manager.cc:5697] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 15 to 21, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 21 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:05.647572 15141 rpcz_store.cc:269] 0709 13:05:42.416562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.967912 (+9551350us) service_pool.cc:224] Handling call
0709 13:05:53.590190 (+1622278us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54000eced4. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3669b64090 00007f3669c02f3a 00007f366f9b91cc 00007f366fab737e 00007f366df782a4 00007f366df78232 00007f366df78161 00007f366df780dc 00007f366df77392 00007f3667f3548c 00007f3667f348c6
0709 13:06:05.646968 (+12056778us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:05.471843 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:05.472396 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:05.472427 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:06:05.472447 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:05.473489 (+  1042us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:05.473563 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:05.473596 (+    33us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:06:05.474623 (+  1027us) tablet.cc:701] Row locks acquired
0709 13:06:05.474644 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:05.474785 (+   141us) write_op.cc:270] Start()
0709 13:06:05.474895 (+   110us) write_op.cc:276] Timestamp: P: 1783602365474743 usec, L: 0
0709 13:06:05.474917 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:05.475597 (+   680us) log.cc:844] Serialized 4436 byte log entry
0709 13:06:05.478547 (+  2950us) op_driver.cc:464] REPLICATION: finished
0709 13:06:05.483545 (+  4998us) write_op.cc:301] APPLY: starting
0709 13:06:05.483631 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:05.513240 (+ 29609us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:05.513329 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:05.539851 (+ 26522us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:05.540088 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:06:05.540136 (+    48us) write_op.cc:312] APPLY: finished
0709 13:06:05.548866 (+  8730us) log.cc:844] Serialized 105 byte log entry
0709 13:06:05.549864 (+   998us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.551028 (+  1164us) write_op.cc:454] Released schema lock
0709 13:06:05.551082 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:05.551421 (+   339us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.551457 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4798,"reported_tablets":51,"spinlock_wait_cycles":671040768,"child_traces":[["op",{"apply.queue_time_us":4769,"apply.run_cpu_time_us":14362,"apply.run_wall_time_us":67845,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45958,"num_ops":11,"prepare.queue_time_us":130,"prepare.run_cpu_time_us":4050,"prepare.run_wall_time_us":4049,"replication_time_us":3512}]]}
I20260709 13:06:05.669852 15142 catalog_manager.cc:5697] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.663378 15215 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:05.679705 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:05.680620 24024 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:05.681910 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.687423 14139 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 15275)
W20260709 13:06:05.687981 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.724476 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.730813 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:05.732915 24024 raft_consensus.cc:493] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:05.733541 24024 raft_consensus.cc:515] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:05.735704 24024 leader_election.cc:290] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:05.736759 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:05.740326 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88815123db2d4b648ca4b8cc3257aa37" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.742158 15215 leader_election.cc:304] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.743947 24041 raft_consensus.cc:2749] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:05.753228 15365 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.758154 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:05.769639 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:05.788530 24024 raft_consensus.cc:493] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:05.788249 15145 catalog_manager.cc:5697] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.789201 24024 raft_consensus.cc:515] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:05.790558 15145 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 21 to 25, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 25 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:05.791798 24024 leader_election.cc:290] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:05.792910 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.793390 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4365018e298c4531b7d90e25d9d6d144" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:05.795572 15213 leader_election.cc:304] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.792330 15145 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 20 to 25, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 25 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:05.796670 24024 raft_consensus.cc:2749] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:05.797467 15145 catalog_manager.cc:5697] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 19 to 21, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 21 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:05.824241 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:05.825716 15145 catalog_manager.cc:5697] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 18 to 22, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 22 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:05.827570 15145 catalog_manager.cc:5697] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 22 to 26, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 26 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:05.829476 15145 catalog_manager.cc:5697] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 22 to 26, leader changed from edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 26 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:05.831372 15145 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 27 to 28, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 28 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:05.832482 15142 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 240) took 33195 ms (client timeout 15000 ms). Trace:
W20260709 13:06:05.841531 15142 rpcz_store.cc:269] 0709 13:05:32.636648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.811070 (+3174422us) service_pool.cc:224] Handling call
0709 13:06:05.832415 (+30021345us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:05.688232 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:05.688818 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:05.688859 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:06:05.688881 (+    22us) tablet.cc:662] Decoding operations
0709 13:06:05.689736 (+   855us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:05.689800 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:05.689835 (+    35us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:05.690566 (+   731us) tablet.cc:701] Row locks acquired
0709 13:06:05.690589 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:06:05.690753 (+   164us) write_op.cc:270] Start()
0709 13:06:05.690875 (+   122us) write_op.cc:276] Timestamp: P: 1783602365690702 usec, L: 0
0709 13:06:05.690898 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:05.691645 (+   747us) log.cc:844] Serialized 2495 byte log entry
0709 13:06:05.695264 (+  3619us) op_driver.cc:464] REPLICATION: finished
0709 13:06:05.696202 (+   938us) write_op.cc:301] APPLY: starting
0709 13:06:05.696285 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:05.698616 (+  2331us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:05.698710 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:05.704709 (+  5999us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:05.704887 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:06:05.704931 (+    44us) write_op.cc:312] APPLY: finished
0709 13:06:05.705177 (+   246us) log.cc:844] Serialized 65 byte log entry
0709 13:06:05.754333 (+ 49156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.754464 (+   131us) write_op.cc:454] Released schema lock
0709 13:06:05.754507 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:05.754896 (+   389us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.754928 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16411,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":718,"apply.run_cpu_time_us":7255,"apply.run_wall_time_us":58628,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25068,"num_ops":6,"prepare.queue_time_us":130,"prepare.run_cpu_time_us":3611,"prepare.run_wall_time_us":3704,"replication_time_us":4223}]]}
W20260709 13:06:05.850821 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:05.862989 24024 raft_consensus.cc:493] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.863664 24024 raft_consensus.cc:515] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:05.866964 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:05.870265 24024 leader_election.cc:290] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:05.871374 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41098c861400432692b47f484ad4dd2d" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:05.873117 15215 leader_election.cc:304] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:05.874305 24024 raft_consensus.cc:2749] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:05.941808 24024 raft_consensus.cc:493] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:05.942446 24024 raft_consensus.cc:515] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:05.944599 24024 leader_election.cc:290] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:05.944478 15140 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.945892 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:05.946386 15140 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.947435 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a64e06dc30ff4dfebdb052a6f7228046" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:05.948392 15140 catalog_manager.cc:5697] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 21 to 26, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 26 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.950352 15213 leader_election.cc:304] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:05.950143 15140 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 20 to 22, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 22 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.952113 24041 raft_consensus.cc:2749] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:05.951972 15140 catalog_manager.cc:5697] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 21 to 24, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 24 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.954739 15140 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.956084 15140 catalog_manager.cc:5697] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 20 to 22, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 22 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.957528 15140 catalog_manager.cc:5697] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 17 to 22, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 22 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.958864 15140 catalog_manager.cc:5697] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.960726 15140 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.963181 15140 catalog_manager.cc:5697] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.964463 15140 catalog_manager.cc:5697] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 22 to 26, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 26 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:05.965834 15140 catalog_manager.cc:5697] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.967314 15140 catalog_manager.cc:5697] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.969295 15140 catalog_manager.cc:5697] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 15 to 19, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 19 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.971737 15140 catalog_manager.cc:5697] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 24 to 28, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 28 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:05.973490 15140 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 20 to 22, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 22 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.975279 15140 catalog_manager.cc:5697] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 14 to 17, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 17 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:05.976820 15140 catalog_manager.cc:5697] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b reported cstate change: term changed from 15 to 17, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 17 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.085848 15140 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49174 (request call id 245) took 10302 ms. Trace:
I20260709 13:06:06.087210 15144 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 21 to 23, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 23 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.090164 15144 catalog_manager.cc:5697] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 19 to 27, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 27 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.100704 15144 catalog_manager.cc:5697] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.105337 15144 catalog_manager.cc:5697] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 22 to 24, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 24 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.107949 15144 catalog_manager.cc:5697] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.101851 15140 rpcz_store.cc:276] 0709 13:05:55.783725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.660672 (+4876947us) service_pool.cc:224] Handling call
0709 13:06:06.085731 (+5425059us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:05.984620 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:05.985214 (+   594us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:05.985260 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:06:05.985281 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:05.986990 (+  1709us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:05.987056 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:05.987088 (+    32us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:06:05.988507 (+  1419us) tablet.cc:701] Row locks acquired
0709 13:06:05.988528 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:05.988693 (+   165us) write_op.cc:270] Start()
0709 13:06:05.988807 (+   114us) write_op.cc:276] Timestamp: P: 1783602365988641 usec, L: 0
0709 13:06:05.988827 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:06:05.989519 (+   692us) log.cc:844] Serialized 7583 byte log entry
0709 13:06:05.992166 (+  2647us) op_driver.cc:464] REPLICATION: finished
0709 13:06:05.992632 (+   466us) write_op.cc:301] APPLY: starting
0709 13:06:05.992704 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:06.006587 (+ 13883us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:06.006700 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:06.027856 (+ 21156us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:06.028186 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:06:06.028241 (+    55us) write_op.cc:312] APPLY: finished
0709 13:06:06.028707 (+   466us) log.cc:844] Serialized 172 byte log entry
0709 13:06:06.029609 (+   902us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:06.029801 (+   192us) write_op.cc:454] Released schema lock
0709 13:06:06.029868 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:06.058554 (+ 28686us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:06.058598 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":277,"apply.run_cpu_time_us":24259,"apply.run_wall_time_us":65865,"cfile_cache_hit":76,"cfile_cache_hit_bytes":79382,"num_ops":19,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":5218,"prepare.run_wall_time_us":14254,"replication_time_us":3219}]]}
I20260709 13:06:06.109598 15144 catalog_manager.cc:5697] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 19 to 20, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 20 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.114627 15144 catalog_manager.cc:5697] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 26 to 27, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 27 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.119351 24041 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.120163 24024 raft_consensus.cc:493] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:06.120546 24041 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:06.120771 24024 raft_consensus.cc:515] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:06.125106 24024 leader_election.cc:290] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:06.125130 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:06.128891 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a9a9eccfa9436c993e85bfe0343332" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:06.130705 15214 leader_election.cc:304] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:06.136507 24024 raft_consensus.cc:2749] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:06.123507 15144 catalog_manager.cc:5697] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.143604 15144 catalog_manager.cc:5697] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 21 to 25, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 25 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.146735 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:06.145872 15144 catalog_manager.cc:5697] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 22 to 27, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 27 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.154366 14139 tablet_replica.cc:333] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.152611 15144 catalog_manager.cc:5697] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 17 to 18, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 18 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.156590 24041 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:06.156843 14139 raft_consensus.cc:2243] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.158008 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:06.184054 14139 raft_consensus.cc:2272] T 2d3f2b48b18a47388a0e1497a84803ff P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.187508 15144 catalog_manager.cc:5697] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.198915 14139 tablet_replica.cc:333] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.199889 14139 raft_consensus.cc:2243] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.200848 14139 raft_consensus.cc:2272] T 2fe8125185eb4429a9a0a58b14dd8636 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.205014 14139 tablet_replica.cc:333] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.205971 14139 raft_consensus.cc:2243] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:06.216886 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 70926.3us
I20260709 13:06:06.218684 14139 raft_consensus.cc:2272] T b0387b757aa040099c98e877245b7bfd P 89940175e5444593aab6b3a025624b5b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.221899 14139 tablet_replica.cc:333] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.236099 14139 raft_consensus.cc:2243] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.237272 24040 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:06.238198 24040 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:06.239308 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f21223b98c4cc6b8699008b5c6edc8" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:06.240450 24040 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:06.242357 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:06.251260 24041 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:06.251976 24041 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:06.255061 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:06.255517 24041 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:06.257665 24041 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:06.261910 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76857f06f24d4d9183e84f52d83bf070" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:06.269284 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:06.258221 24041 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:06.272737 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:06.274936 24041 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:06.276787 15214 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:06.277601 15215 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:06.277707 14139 pending_rounds.cc:70] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Trying to abort 1 pending ops.
I20260709 13:06:06.281289 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:06.280798 14139 pending_rounds.cc:77] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b: Aborting op as it isn't in flight: id { term: 24 index: 13 } timestamp: 7305635255018545152 op_type: NO_OP noop_request { }
I20260709 13:06:06.283087 14139 raft_consensus.cc:2889] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:06.284741 14139 raft_consensus.cc:2272] T 92362862adca4227bb6dad04afd638cc P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.281302 24024 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:06.283440 24041 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:06:06.284024 15215 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:06.300376 24040 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:06.302178 15215 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:06.302975 24040 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:06.314623 15395 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:06.324462 14139 tablet_replica.cc:333] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.326678 24040 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:06.331317 24040 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:06.333950 24024 raft_consensus.cc:493] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.334610 24024 raft_consensus.cc:515] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:06.336684 24024 leader_election.cc:290] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:06.337602 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:06.337920 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:06.335621 24040 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:06.342739 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fad3ad4002954af28c1eccdf62948088" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:06.349445 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a96142637d944dd8747c019a86e4864" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:06.354346 14139 raft_consensus.cc:2243] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.356753 15215 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:06.369761 15215 leader_election.cc:304] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:06.370376 24040 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:06.368610 14139 raft_consensus.cc:2272] T 8b6884fe16f4431a8b08af8e659ece9e P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.376469 24024 raft_consensus.cc:2749] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:06.374928 15291 consensus_peers.cc:597] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:06.389051 14139 tablet_replica.cc:333] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.394425 14139 raft_consensus.cc:2243] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.395506 14139 raft_consensus.cc:2272] T 87a9a9eccfa9436c993e85bfe0343332 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.401432 14139 tablet_replica.cc:333] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.402486 14139 raft_consensus.cc:2243] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 27 LEADER]: Raft consensus shutting down.
W20260709 13:06:06.402748 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:06.404393 14139 raft_consensus.cc:2272] T 49a44991403a4f8a851f90729c6ca783 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.407510 14139 tablet_replica.cc:333] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.408461 14139 raft_consensus.cc:2243] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.409904 14139 raft_consensus.cc:2272] T 76857f06f24d4d9183e84f52d83bf070 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:06.412182 15363 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 529df4c4ec9d4e33b83b594284860b0f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.413138 14139 tablet_replica.cc:333] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.414101 14139 raft_consensus.cc:2243] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.414495 15317 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:06:06.415321 14139 raft_consensus.cc:2272] T c0024621f21043e889d114f180f1dccb P 89940175e5444593aab6b3a025624b5b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.416131 24043 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:06.418469 14139 tablet_replica.cc:333] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
W20260709 13:06:06.428274 15365 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.434659 14139 raft_consensus.cc:2243] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.435938 14139 raft_consensus.cc:2272] T 195ee90b7e844a81920e312f95fdda67 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.438977 14139 tablet_replica.cc:333] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.439926 14139 raft_consensus.cc:2243] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.440321 15143 catalog_manager.cc:5697] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 16 to 27, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 27 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.449738 14139 raft_consensus.cc:2272] T 66ab819064aa4b6faba9dff78296aa66 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.452761 14139 tablet_replica.cc:333] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.453740 14139 raft_consensus.cc:2243] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.454455 14139 raft_consensus.cc:2272] T 907f0d82d81845029df5f0613caae65c P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.457233 14139 tablet_replica.cc:333] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.458079 14139 raft_consensus.cc:2243] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.458033 15143 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.459084 14139 raft_consensus.cc:2272] T 8dcb1955ebaf442cb75dba3471600141 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.462285 14139 tablet_replica.cc:333] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.463426 14139 raft_consensus.cc:2243] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.464347 14139 raft_consensus.cc:2272] T 4365018e298c4531b7d90e25d9d6d144 P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.474794 15144 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49186 (request call id 221) took 7243 ms. Trace:
W20260709 13:06:06.476639 15291 consensus_peers.cc:597] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:06.477979 24024 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:06.478582 24024 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:06.480813 24024 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:06.481760 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:06.483325 14139 tablet_replica.cc:333] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.484349 14139 raft_consensus.cc:2243] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.488703 14139 raft_consensus.cc:2272] T b9e997bc5c2942178cde4c670df97100 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.485158 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b3be1966cf543b3b9832118d5f11aa2" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:06.491469 15214 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:06.493105 24040 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:06.497632 14139 tablet_replica.cc:333] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.506695 14139 raft_consensus.cc:2243] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.507474 14139 raft_consensus.cc:2272] T 529df4c4ec9d4e33b83b594284860b0f P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.510416 14139 tablet_replica.cc:333] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.511272 14139 raft_consensus.cc:2243] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.512024 14139 raft_consensus.cc:2272] T 1389463201b74b128d916816a1d7c24c P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.513638 24048 raft_consensus.cc:2955] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Committing config change with OpId 27.17: config changed from index -1 to 17, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:06.531188 14139 tablet_replica.cc:333] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.532146 14139 raft_consensus.cc:2243] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.534499 14139 raft_consensus.cc:2272] T 41098c861400432692b47f484ad4dd2d P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.535983 24040 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.536614 24040 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:06.537323 14139 tablet_replica.cc:333] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.538282 14139 raft_consensus.cc:2243] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.538829 14139 raft_consensus.cc:2272] T e71ec5b3198446c0a387428e2a4eb753 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.540341 24040 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:06.540834 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:06.541636 14139 tablet_replica.cc:333] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.548059 15143 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:49180 (request call id 241) took 9899 ms. Trace:
I20260709 13:06:06.550787 24040 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:06.548542 15143 rpcz_store.cc:276] 0709 13:05:56.648890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.241336 (+7592446us) service_pool.cc:224] Handling call
0709 13:06:06.547996 (+2306660us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:06.486710 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:06.487347 (+   637us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:06.487384 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:06:06.487403 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:06.487844 (+   441us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:06.487902 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:06.487934 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:06.488272 (+   338us) tablet.cc:701] Row locks acquired
0709 13:06:06.488289 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:06:06.488449 (+   160us) write_op.cc:270] Start()
0709 13:06:06.488571 (+   122us) write_op.cc:276] Timestamp: P: 1783602366488402 usec, L: 0
0709 13:06:06.488591 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:06:06.489244 (+   653us) log.cc:844] Serialized 935 byte log entry
0709 13:06:06.491003 (+  1759us) op_driver.cc:464] REPLICATION: finished
0709 13:06:06.491455 (+   452us) write_op.cc:301] APPLY: starting
0709 13:06:06.491535 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:06.492809 (+  1274us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:06.492904 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:06.494105 (+  1201us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:06.494290 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:06:06.494337 (+    47us) write_op.cc:312] APPLY: finished
0709 13:06:06.494546 (+   209us) log.cc:844] Serialized 33 byte log entry
0709 13:06:06.494703 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:06.495540 (+   837us) write_op.cc:454] Released schema lock
0709 13:06:06.495580 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:06.495921 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:06.495949 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":405,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":253,"apply.run_cpu_time_us":3721,"apply.run_wall_time_us":4438,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8356,"num_ops":2,"prepare.queue_time_us":112,"prepare.run_cpu_time_us":2820,"prepare.run_wall_time_us":2820,"replication_time_us":2283}]]}
I20260709 13:06:06.551558 24040 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:06.563499 24040 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:06.564833 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:06.566169 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd1b68b8eb8145ee8bd4d3629784110f" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:06.567494 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abb86a150e844b848bc103f128d39a82" candidate_uuid: "89940175e5444593aab6b3a025624b5b" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:06.578372 14139 raft_consensus.cc:2243] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.591105 14139 raft_consensus.cc:2272] T abeddff35e5145ef927db00bd12f7cff P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.591998 15323 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:06.594743 14139 tablet_replica.cc:333] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.595763 14139 raft_consensus.cc:2243] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.596648 14139 raft_consensus.cc:2272] T fad3ad4002954af28c1eccdf62948088 P 89940175e5444593aab6b3a025624b5b [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.603415 15215 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:06.604673 24040 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:06.604897 14139 tablet_replica.cc:333] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.605788 14139 raft_consensus.cc:2243] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.606494 14139 raft_consensus.cc:2272] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.475289 15144 rpcz_store.cc:276] 0709 13:05:59.231271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.307359 (+5076088us) service_pool.cc:224] Handling call
0709 13:06:06.474695 (+2167336us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:06.232687 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:06.233209 (+   522us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:06.233244 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:06:06.233262 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:06.241724 (+  8462us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:06.241785 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:06.241811 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:06:06.242871 (+  1060us) tablet.cc:701] Row locks acquired
0709 13:06:06.242887 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:06:06.243051 (+   164us) write_op.cc:270] Start()
0709 13:06:06.243190 (+   139us) write_op.cc:276] Timestamp: P: 1783602366242985 usec, L: 0
0709 13:06:06.243209 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:06:06.243847 (+   638us) log.cc:844] Serialized 4846 byte log entry
0709 13:06:06.246183 (+  2336us) op_driver.cc:464] REPLICATION: finished
0709 13:06:06.246625 (+   442us) write_op.cc:301] APPLY: starting
0709 13:06:06.246705 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:06.253018 (+  6313us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:06.253119 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:06.303508 (+ 50389us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:06.303688 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:06:06.303725 (+    37us) write_op.cc:312] APPLY: finished
0709 13:06:06.303988 (+   263us) log.cc:844] Serialized 113 byte log entry
0709 13:06:06.304144 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:06.304265 (+   121us) write_op.cc:454] Released schema lock
0709 13:06:06.304308 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:06.304623 (+   315us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:06.304646 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7168,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":241,"apply.run_cpu_time_us":14620,"apply.run_wall_time_us":57977,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50136,"num_ops":12,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":4120,"prepare.run_wall_time_us":11426,"replication_time_us":2851}]]}
I20260709 13:06:06.609184 14139 tablet_replica.cc:333] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.609714 15214 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89940175e5444593aab6b3a025624b5b; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:06.610090 14139 raft_consensus.cc:2243] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:06:06.610662 15214 raft_consensus.cc:2686] T abb86a150e844b848bc103f128d39a82 P 89940175e5444593aab6b3a025624b5b: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:06:06.611620 14139 raft_consensus.cc:2272] T f537e87ec99a4032a677e62627c567e2 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.614408 14139 tablet_replica.cc:333] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.615259 14139 raft_consensus.cc:2243] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.615901 14139 raft_consensus.cc:2272] T fd1b68b8eb8145ee8bd4d3629784110f P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.616369 15317 raft_consensus.cc:2955] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Committing config change with OpId 27.17: config changed from index -1 to 17, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:06.629711 14139 tablet_replica.cc:333] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.630759 14139 raft_consensus.cc:2243] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.631415 14139 pending_rounds.cc:70] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Trying to abort 1 pending ops.
I20260709 13:06:06.631780 14139 pending_rounds.cc:77] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b: Aborting op as it isn't in flight: id { term: 24 index: 14 } timestamp: 7305635254157783040 op_type: NO_OP noop_request { }
I20260709 13:06:06.632151 14139 raft_consensus.cc:2889] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:06.633661 14139 raft_consensus.cc:2272] T de7f843f60914a58b8b7e5a4a5e2ea6a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.636575 14139 tablet_replica.cc:333] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.637357 14139 raft_consensus.cc:2243] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.640241 14139 raft_consensus.cc:2272] T e5288c8dc0fe4b7aabc37377e0bc0371 P 89940175e5444593aab6b3a025624b5b [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:06.649639 15289 consensus_peers.cc:597] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fca62166204465d888036a111b60b66. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.650727 15395 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:06.652567 24049 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:06:06.655634 15291 consensus_peers.cc:597] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.654807 14139 tablet_replica.cc:333] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.658275 14139 raft_consensus.cc:2243] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.658994 14139 raft_consensus.cc:2272] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.673588 24045 raft_consensus.cc:2955] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:06.676683 14139 tablet_replica.cc:333] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.677634 14139 raft_consensus.cc:2243] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.678314 14139 raft_consensus.cc:2272] T 0a3760e6bdc5424685fc319a53f0c819 P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.684325 15395 raft_consensus.cc:2955] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:06.694056 14139 tablet_replica.cc:333] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.737859 14139 raft_consensus.cc:2243] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.740788 14139 raft_consensus.cc:2272] T f72ca1a62ac74338a0ec5abd5a427bbf P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.745389 14139 tablet_replica.cc:333] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.747530 14139 raft_consensus.cc:2243] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.748387 14139 raft_consensus.cc:2272] T 88815123db2d4b648ca4b8cc3257aa37 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.751539 14139 tablet_replica.cc:333] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.752545 14139 raft_consensus.cc:2243] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.753219 14139 raft_consensus.cc:2272] T 13d6106766cf4009837f848b4f8cbb1f P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.756078 14139 tablet_replica.cc:333] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.756966 14139 raft_consensus.cc:2243] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.757634 14139 raft_consensus.cc:2272] T a64e06dc30ff4dfebdb052a6f7228046 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.760828 14139 tablet_replica.cc:333] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.761723 14139 raft_consensus.cc:2243] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.762583 14139 pending_rounds.cc:70] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Trying to abort 2 pending ops.
I20260709 13:06:06.762989 14139 pending_rounds.cc:77] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Aborting op as it isn't in flight: id { term: 24 index: 19 } timestamp: 7305635243201454080 op_type: NO_OP noop_request { }
I20260709 13:06:06.763425 14139 raft_consensus.cc:2889] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:06.763788 14139 pending_rounds.cc:77] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b: Aborting op as it isn't in flight: id { term: 23 index: 18 } timestamp: 7305635219723943936 op_type: NO_OP noop_request { }
I20260709 13:06:06.764163 14139 raft_consensus.cc:2889] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:06.764533 14139 raft_consensus.cc:2272] T a6d786e7c4904b39b63a5862d5a7e6f4 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.767379 14139 tablet_replica.cc:333] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.768263 14139 raft_consensus.cc:2243] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.768961 14139 raft_consensus.cc:2272] T f3f21223b98c4cc6b8699008b5c6edc8 P 89940175e5444593aab6b3a025624b5b [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.772284 14139 tablet_replica.cc:333] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.773123 14139 raft_consensus.cc:2243] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.774385 14139 raft_consensus.cc:2272] T 4143f8a30ca74db8afb568dd88a99bc0 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.777817 14139 tablet_replica.cc:333] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.778825 14139 raft_consensus.cc:2243] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.779893 14139 raft_consensus.cc:2272] T 521a10ac7e184bf1978bbe6947d0ca8d P 89940175e5444593aab6b3a025624b5b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.782915 14139 tablet_replica.cc:333] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.783763 14139 raft_consensus.cc:2243] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.784423 14139 pending_rounds.cc:70] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Trying to abort 1 pending ops.
I20260709 13:06:06.784745 14139 pending_rounds.cc:77] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b: Aborting op as it isn't in flight: id { term: 24 index: 14 } timestamp: 7305635256962289664 op_type: NO_OP noop_request { }
I20260709 13:06:06.785202 14139 raft_consensus.cc:2889] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:06.785630 14139 raft_consensus.cc:2272] T 2a96142637d944dd8747c019a86e4864 P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.791913 14139 tablet_replica.cc:333] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.792850 14139 raft_consensus.cc:2243] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.794032 14139 raft_consensus.cc:2272] T d44715ddcb564012b7a6c6eedb94b8e2 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.797052 14139 tablet_replica.cc:333] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.797966 14139 raft_consensus.cc:2243] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.800172 14139 raft_consensus.cc:2272] T 99211c99c0ce4c1cb82fa7cea0ab410a P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.803216 14139 tablet_replica.cc:333] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.806645 14139 raft_consensus.cc:2243] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.807964 14139 raft_consensus.cc:2272] T 7ac2109e25f8401baf7141ea474e8bc4 P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.811089 14139 tablet_replica.cc:333] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.812047 14139 raft_consensus.cc:2243] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.812788 14139 raft_consensus.cc:2272] T 8f6ca66a81d04e56bccbc22cab55f4de P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.815903 14139 tablet_replica.cc:333] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.816924 14139 raft_consensus.cc:2243] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.818555 14139 raft_consensus.cc:2272] T 705321025dc74b199219f4e541a68efa P 89940175e5444593aab6b3a025624b5b [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.816931 15323 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:06.821877 14139 tablet_replica.cc:333] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.823046 14139 raft_consensus.cc:2243] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.823784 14139 raft_consensus.cc:2272] T 4fca62166204465d888036a111b60b66 P 89940175e5444593aab6b3a025624b5b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.827323 14139 tablet_replica.cc:333] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.828138 14139 raft_consensus.cc:2243] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.828670 14139 raft_consensus.cc:2272] T a9161d42f4f04ce8a5234d5b1cfeab22 P 89940175e5444593aab6b3a025624b5b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.831730 14139 tablet_replica.cc:333] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.832520 14139 raft_consensus.cc:2243] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.835150 14139 raft_consensus.cc:2272] T da67615b960b446d8df50fe1de2a0b3e P 89940175e5444593aab6b3a025624b5b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.838039 14139 tablet_replica.cc:333] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.838827 14139 raft_consensus.cc:2243] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.839458 14139 raft_consensus.cc:2272] T 68e68ea4eb05497288804ad7aefb241e P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.846496 14139 tablet_replica.cc:333] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.847254 14139 raft_consensus.cc:2243] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.847873 14139 raft_consensus.cc:2272] T c377e25836b14680beed769c143a593c P 89940175e5444593aab6b3a025624b5b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.850797 14139 tablet_replica.cc:333] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.851536 14139 raft_consensus.cc:2243] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.852617 14139 raft_consensus.cc:2272] T 6b3be1966cf543b3b9832118d5f11aa2 P 89940175e5444593aab6b3a025624b5b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.855976 14139 tablet_replica.cc:333] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.856696 14139 raft_consensus.cc:2243] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:06.857823 14139 raft_consensus.cc:2272] T ceb4d1b87e1c4966839d620a8aeaaf6a P 89940175e5444593aab6b3a025624b5b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:06.861240 14139 tablet_replica.cc:333] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b: stopping tablet replica
I20260709 13:06:06.861985 14139 raft_consensus.cc:2243] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:06.862540 14139 raft_consensus.cc:2272] T 525e3bab033946a090787fa86d1292aa P 89940175e5444593aab6b3a025624b5b [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:06.872092 15291 consensus_peers.cc:597] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:06.887784 15289 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c377e25836b14680beed769c143a593c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:06.890882 15395 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:06.897657 23953 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:06.894749 15143 catalog_manager.cc:5697] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 22 to 24, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 24 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.902442 15143 catalog_manager.cc:5697] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 22 to 24, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 24 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.904021 15143 catalog_manager.cc:5697] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 22 to 24, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 24 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.905510 15143 catalog_manager.cc:5697] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 17, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 27 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.907395 15143 catalog_manager.cc:5697] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 24 to 26, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 26 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.909144 15143 catalog_manager.cc:5697] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 27 to 28, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 28 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:06.910974 15143 catalog_manager.cc:5697] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 21 to 23, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to 89940175e5444593aab6b3a025624b5b (127.13.206.193). New cstate: current_term: 23 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.912678 15143 catalog_manager.cc:5697] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.914036 15143 catalog_manager.cc:5697] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 16 to 25. New cstate: current_term: 25 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.915551 15143 catalog_manager.cc:5697] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.917440 15143 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.938215 15143 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.943337 15143 catalog_manager.cc:5697] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 18 to 27. New cstate: current_term: 27 leader_uuid: "89940175e5444593aab6b3a025624b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.944897 15143 catalog_manager.cc:5697] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 22 to 23, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 23 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:06.953271 15143 catalog_manager.cc:5697] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 28 to 31, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 31 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } }
I20260709 13:06:07.012858 23953 raft_consensus.cc:2955] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:07.045419 24058 ts_tablet_manager.cc:933] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:07.075378 15291 connection.cc:769] client connection to 127.13.206.193:43213 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:06:07.075865 15291 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: sendmsg error: Broken pipe (error 32). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.079711 24058 tablet_copy_client.cc:323] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.195:44417
I20260709 13:06:07.081858 15409 tablet_copy_service.cc:140] P ee9654803379434388de45d4693e6b16: Received BeginTabletCopySession request for tablet 529df4c4ec9d4e33b83b594284860b0f from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:51818)
I20260709 13:06:07.082545 15409 tablet_copy_service.cc:161] P ee9654803379434388de45d4693e6b16: Beginning new tablet copy session on tablet 529df4c4ec9d4e33b83b594284860b0f from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:51818: session id = edcf4a6bae7e4781bce325a586109ca5-529df4c4ec9d4e33b83b594284860b0f
I20260709 13:06:07.093590 15409 tablet_copy_source_session.cc:215] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:07.099735 24058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 529df4c4ec9d4e33b83b594284860b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.099184 15144 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 13, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 22 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:07.110965 24062 ts_tablet_manager.cc:933] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.114362 15395 raft_consensus.cc:2955] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:07.117733 15398 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:07.137319 24062 tablet_copy_client.cc:323] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
W20260709 13:06:07.112336 15291 consensus_peers.cc:597] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:07.152843 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet 4fca62166204465d888036a111b60b66 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:06:07.153770 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet 4fca62166204465d888036a111b60b66 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-4fca62166204465d888036a111b60b66
I20260709 13:06:07.176963 15334 tablet_copy_source_session.cc:215] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:06:07.186628 15363 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a3760e6bdc5424685fc319a53f0c819. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.191157 15325 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:07.193120 24043 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:07.209734 24062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fca62166204465d888036a111b60b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.205801 15144 catalog_manager.cc:5697] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 14, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 18 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:06:07.226472 15291 consensus_peers.cc:597] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:07.229766 15291 consensus_peers.cc:597] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:07.231773 24058 tablet_copy_client.cc:806] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:07.232497 24058 tablet_copy_client.cc:670] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:07.253520 24058 tablet_copy_client.cc:538] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:07.252007 23799 raft_consensus.cc:2955] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:07.258601 15325 raft_consensus.cc:2955] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:06:07.302498 15365 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.307720 24062 tablet_copy_client.cc:806] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:07.308506 24062 tablet_copy_client.cc:670] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:07.316812 24058 tablet_bootstrap.cc:492] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:06:07.338465 24055 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.339334 24055 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:07.344276 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:07.346340 24055 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.350977 24062 tablet_copy_client.cc:538] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:07.354187 23953 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.354839 23953 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:07.357556 23953 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:07.359184 15143 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 14, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 23 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:06:07.363489 15291 consensus_peers.cc:597] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:07.364055 15291 consensus_peers.cc:597] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:07.370390 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
W20260709 13:06:07.373111 15999 leader_election.cc:336] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.373714 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:07.374660 24055 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:07.378127 15398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f"
dest_uuid: "ee9654803379434388de45d4693e6b16"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59684
I20260709 13:06:07.378844 15398 raft_consensus.cc:606] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Received request to transfer leadership
I20260709 13:06:07.393976 23953 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.394698 23953 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:07.397583 15291 consensus_peers.cc:597] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:07.403260 24055 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.407217 24055 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:07.403712 23953 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.410980 24055 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.411953 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:07.414683 15291 leader_election.cc:336] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.419317 15291 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:07.421319 23953 raft_consensus.cc:2749] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:07.422784 23953 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.424472 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:07.423300 23953 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.425132 15317 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 25.
I20260709 13:06:07.429101 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:06:07.429975 24055 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:07.430454 24055 raft_consensus.cc:493] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.430842 24055 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:07.418840 24062 tablet_bootstrap.cc:492] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
W20260709 13:06:07.435304 15999 leader_election.cc:336] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:07.439674 15291 leader_election.cc:336] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.440193 15291 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:07.447518 23953 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.448231 23953 raft_consensus.cc:2749] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:07.463219 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:07.463435 15291 leader_election.cc:336] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.469063 15290 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:07.470497 15317 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c377e25836b14680beed769c143a593c"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47924
I20260709 13:06:07.471336 15317 raft_consensus.cc:606] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Received request to transfer leadership
I20260709 13:06:07.473130 23953 raft_consensus.cc:2749] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:07.476265 15398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819"
dest_uuid: "ee9654803379434388de45d4693e6b16"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59684
I20260709 13:06:07.477177 15398 raft_consensus.cc:606] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Received request to transfer leadership
I20260709 13:06:07.480394 24048 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.481146 24048 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.485828 15398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f"
dest_uuid: "ee9654803379434388de45d4693e6b16"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59684
I20260709 13:06:07.486490 15398 raft_consensus.cc:606] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Received request to transfer leadership
I20260709 13:06:07.501686 24055 raft_consensus.cc:515] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:07.503589 15365 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.504946 23799 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.505446 23799 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.506721 24048 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.507308 23799 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.516579 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:07.518409 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d3f2b48b18a47388a0e1497a84803ff" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:07.518566 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:07.519030 15317 raft_consensus.cc:3060] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:07.521307 24055 leader_election.cc:290] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:07.522538 15291 consensus_peers.cc:597] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:07.527983 15317 raft_consensus.cc:2468] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 26.
I20260709 13:06:07.529254 15996 leader_election.cc:304] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:06:07.529516 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:07.541673 24017 raft_consensus.cc:2804] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:07.544862 24048 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:06:07.556228 15134 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 57842.2us
I20260709 13:06:07.595036 24070 ts_tablet_manager.cc:933] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:07.597836 15365 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.598435 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:07.604112 24048 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:07.636718 24017 raft_consensus.cc:697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 26 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:06:07.649175 24081 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.657328 15395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f"
dest_uuid: "ee9654803379434388de45d4693e6b16"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59684
I20260709 13:06:07.675491 15395 raft_consensus.cc:606] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Received request to transfer leadership
I20260709 13:06:07.658522 24077 raft_consensus.cc:993] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: : Instructing follower 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
I20260709 13:06:07.661553 24043 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.678992 23799 raft_consensus.cc:1081] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Signalling peer 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
I20260709 13:06:07.679955 24017 consensus_queue.cc:237] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:07.681893 24043 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:07.670655 15999 leader_election.cc:336] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.684523 24043 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.685870 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:07.686600 15325 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:06:07.679111 24081 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:07.675125 24049 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.688294 24049 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.687460 15317 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:06:07.689329 15317 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.689704 15317 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:07.690686 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:06:07.691447 15196 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:06:07.692314 15196 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 529df4c4ec9d4e33b83b594284860b0f already in progress
W20260709 13:06:07.692606 15196 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 529df4c4ec9d4e33b83b594284860b0f already in progress
I20260709 13:06:07.695504 15325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c377e25836b14680beed769c143a593c"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47924
I20260709 13:06:07.696122 15325 raft_consensus.cc:606] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Received request to transfer leadership
I20260709 13:06:07.689633 24081 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.706463 15317 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:07.708451 24069 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.708740 24045 raft_consensus.cc:993] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: : Instructing follower ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:06:07.710290 24049 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.694419 24070 tablet_copy_client.cc:323] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:06:07.717916 24045 raft_consensus.cc:1081] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Signalling peer ee9654803379434388de45d4693e6b16 to start an election
I20260709 13:06:07.709604 24048 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:07.718704 24048 raft_consensus.cc:493] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.719149 24048 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:07.709086 24069 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.724416 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:07.725246 15398 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 27.
I20260709 13:06:07.726328 15397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c377e25836b14680beed769c143a593c"
dest_uuid: "ee9654803379434388de45d4693e6b16"
 from {username='slave'} at 127.0.0.1:39732
I20260709 13:06:07.726892 15397 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.727262 15397 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:07.723992 24069 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:07.735111 15365 leader_election.cc:336] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.735867 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:07.737448 24049 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:07.737859 24049 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.738281 24049 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:06:07.739494 15999 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.739944 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:07.740584 15392 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 28.
I20260709 13:06:07.740633 15325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c377e25836b14680beed769c143a593c"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:47924
I20260709 13:06:07.741250 15325 raft_consensus.cc:606] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Received request to transfer leadership
I20260709 13:06:07.741458 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:07.744544 23953 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:06:07.744992 23953 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.745244 24079 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.745380 23953 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:07.754643 24077 raft_consensus.cc:993] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: : Instructing follower 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
I20260709 13:06:07.755187 24077 raft_consensus.cc:1081] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Signalling peer 45ddec37d9e741a598bf32f6c9d7e0ee to start an election
I20260709 13:06:07.757014 15323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819"
dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
 from {username='slave'} at 127.0.0.1:39722
I20260709 13:06:07.757623 15323 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:07.757980 15323 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:07.745936 24079 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.761518 24079 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.767234 15323 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:07.769078 24080 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.775646 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:07.775908 24080 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:07.776206 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:07.757393 15143 catalog_manager.cc:5697] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 25 to 26, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 26 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.776904 15321 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 28.
I20260709 13:06:07.780851 15317 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.782366 15323 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.784089 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:07.784744 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: true dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:07.785384 15395 raft_consensus.cc:3055] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:06:07.785652 15395 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:06:07.787310 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: true dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:07.787932 15392 raft_consensus.cc:3055] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:07.789415 23799 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:06:07.789844 23799 raft_consensus.cc:493] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.784617 24043 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.789911 15395 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:07.790597 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet c377e25836b14680beed769c143a593c from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:06:07.790714 24043 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.791141 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet c377e25836b14680beed769c143a593c from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-c377e25836b14680beed769c143a593c
I20260709 13:06:07.800866 15397 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:07.790294 23799 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:07.803368 24043 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.788234 15392 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:06:07.807538 15319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:07.793342 24080 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:07.808738 15392 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:07.791620 15395 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:07.810590 15392 raft_consensus.cc:3060] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:07.824558 15395 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 28.
I20260709 13:06:07.825536 24048 raft_consensus.cc:515] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.830658 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:07.820974 23953 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.831370 16024 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 17.
I20260709 13:06:07.835378 23799 raft_consensus.cc:515] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:07.836519 15291 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.836021 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:07.840911 24080 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:07.841359 24080 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.841751 24080 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:07.844348 15334 tablet_copy_source_session.cc:215] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:07.837357 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:07.847137 24086 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:07.851418 15392 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:06:07.851025 24049 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:07.855659 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:07.856124 24049 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.856493 24043 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.857197 24043 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:07.859331 15290 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:07.859829 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fe8125185eb4429a9a0a58b14dd8636" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:07.860885 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:07.863703 15392 raft_consensus.cc:3060] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:07.861409 24043 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:06:07.865134 15365 leader_election.cc:336] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.866863 24069 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.867657 24069 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.862190 23799 leader_election.cc:290] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.863607 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195ee90b7e844a81920e312f95fdda67" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:07.870630 15317 raft_consensus.cc:3060] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:07.871217 24069 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.860546 24080 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:07.864619 24049 raft_consensus.cc:2804] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:07.874806 15397 leader_election.cc:290] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.873641 15290 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:07.882747 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:07.883433 15398 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
I20260709 13:06:07.875597 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a44991403a4f8a851f90729c6ca783" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:07.878412 15392 raft_consensus.cc:2468] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 29.
I20260709 13:06:07.881616 15317 raft_consensus.cc:2468] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 29.
I20260709 13:06:07.884996 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c377e25836b14680beed769c143a593c" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:07.885836 15323 raft_consensus.cc:3055] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:07.886206 15323 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:07.886890 15362 leader_election.cc:304] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:07.832825 23953 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.884164 15395 raft_consensus.cc:3060] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:07.887279 15323 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:07.890214 15323 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:07.897033 23799 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.897578 23799 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.898401 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:06:07.899813 15196 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 13:06:07.900070 15395 raft_consensus.cc:2468] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 28.
W20260709 13:06:07.900656 15196 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c377e25836b14680beed769c143a593c already in progress
W20260709 13:06:07.900969 15196 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c377e25836b14680beed769c143a593c already in progress
I20260709 13:06:07.901047 15290 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:07.903395 15321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0024621f21043e889d114f180f1dccb" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:07.894822 24069 raft_consensus.cc:2804] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:07.904100 15321 raft_consensus.cc:3060] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:07.903978 15395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819"
dest_uuid: "ee9654803379434388de45d4693e6b16"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59684
I20260709 13:06:07.905853 15395 raft_consensus.cc:606] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Received request to transfer leadership
I20260709 13:06:07.906185 15395 raft_consensus.cc:614] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:07.901882 24048 leader_election.cc:290] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.907469 24080 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:06:07.908298 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:07.908926 15365 leader_election.cc:336] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.908996 24089 ts_tablet_manager.cc:933] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.909899 23799 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:07.910517 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6884fe16f4431a8b08af8e659ece9e" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:06:07.911093 16024 raft_consensus.cc:3060] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:07.912395 15291 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:07.912763 15365 leader_election.cc:336] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:07.913170 15291 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.914579 15321 raft_consensus.cc:2468] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 20.
I20260709 13:06:07.910046 24070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c377e25836b14680beed769c143a593c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:07.897521 24043 raft_consensus.cc:2804] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Leader election won for term 29
W20260709 13:06:07.920481 15291 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.922912 15323 raft_consensus.cc:2468] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 19.
I20260709 13:06:07.899801 24049 raft_consensus.cc:697] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:07.911152 23953 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:07.926548 24049 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:07.927174 24043 raft_consensus.cc:697] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 29 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:06:07.916690 24069 raft_consensus.cc:697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:07.928217 24043 consensus_queue.cc:237] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 28.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.929379 24069 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:07.918696 24083 raft_consensus.cc:2804] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:06:07.931058 24083 raft_consensus.cc:697] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:07.932018 24083 consensus_queue.cc:237] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:07.940707 15365 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.941206 15365 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:07.942147 23799 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:07.944931 24045 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.945528 24045 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:07.947687 24045 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:07.945963 24089 tablet_copy_client.cc:323] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.195:44417
I20260709 13:06:07.952391 15409 tablet_copy_service.cc:140] P ee9654803379434388de45d4693e6b16: Received BeginTabletCopySession request for tablet 0a3760e6bdc5424685fc319a53f0c819 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:51818)
I20260709 13:06:07.953025 15409 tablet_copy_service.cc:161] P ee9654803379434388de45d4693e6b16: Beginning new tablet copy session on tablet 0a3760e6bdc5424685fc319a53f0c819 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:51818: session id = edcf4a6bae7e4781bce325a586109ca5-0a3760e6bdc5424685fc319a53f0c819
W20260709 13:06:07.951292 15291 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:07.953783 15291 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:07.954321 15291 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.927165 23953 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:06:07.957517 15365 leader_election.cc:336] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:07.959435 15365 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:07.959874 15365 leader_election.cc:336] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.960175 15365 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:07.960807 23799 raft_consensus.cc:2749] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:07.961035 15365 leader_election.cc:336] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:07.961800 15365 leader_election.cc:336] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:07.962846 16024 raft_consensus.cc:2468] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 18.
I20260709 13:06:07.965989 23953 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:07.964267 15363 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:07.968031 24077 raft_consensus.cc:2804] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:07.968509 24077 raft_consensus.cc:697] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:06:07.969441 24077 consensus_queue.cc:237] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:07.973397 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:07.957594 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 56614.7us
I20260709 13:06:07.978585 15290 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:07.982630 15362 leader_election.cc:304] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:07.985695 15362 leader_election.cc:304] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:07.987228 23799 raft_consensus.cc:2804] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:07.988504 23799 raft_consensus.cc:697] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:06:07.989766 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:07.987892 15196 auto_rebalancer.cc:893] Removing replace marker failed: Replica ee9654803379434388de45d4693e6b16 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:06:07.990556 15196 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:06:07.990860 15196 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:06:07.981660 24045 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:07.997560 23799 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:07.984704 24087 raft_consensus.cc:2804] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:07.990126 24079 raft_consensus.cc:2804] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:06:08.010036 14139 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15271)
I20260709 13:06:08.024977 23953 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.029035 24079 raft_consensus.cc:697] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:06:08.032670 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.032505 24079 consensus_queue.cc:237] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.010473 24045 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.038146 24045 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.040056 15143 catalog_manager.cc:5697] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 27 to 28, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 28 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.044632 24086 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.045251 24086 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:08.047449 24086 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.048571 23953 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.049072 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:08.049536 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.049744 15397 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 25.
I20260709 13:06:08.050071 15409 tablet_copy_source_session.cc:215] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:06:08.050678 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.051851 15998 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:08.055819 24087 raft_consensus.cc:697] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:08.058050 23953 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:06:08.068534 15291 leader_election.cc:336] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.072913 24086 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:08.074433 24086 raft_consensus.cc:493] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.074815 24086 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:08.075268 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.075042 15143 catalog_manager.cc:5697] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 28 to 29, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 29 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.077229 24087 consensus_queue.cc:237] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:08.081853 15291 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.087039 15999 leader_election.cc:336] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.072105 24058 tablet_bootstrap.cc:492] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=19 overwritten=2 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:08.104368 24058 tablet_bootstrap.cc:492] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:06:08.105319 24058 ts_tablet_manager.cc:1403] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.789s	user 0.054s	sys 0.037s
I20260709 13:06:08.105494 24089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3760e6bdc5424685fc319a53f0c819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:08.109004 24058 raft_consensus.cc:359] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 27 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:08.112782 24043 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:06:08.114673 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:08.117602 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:08.118057 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.084432 23953 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.116791 24043 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.126245 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:08.109772 24086 raft_consensus.cc:515] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:08.119041 24058 raft_consensus.cc:740] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 27 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:06:08.148715 23799 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.149413 23799 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:08.151238 23799 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:08.151247 23953 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.138028 24081 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.157230 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:08.159406 15323 raft_consensus.cc:1275] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:06:08.143563 24079 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.160910 24079 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.163082 24083 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.163712 24083 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.165925 24083 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.167542 24070 tablet_copy_client.cc:806] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:08.180365 24070 tablet_copy_client.cc:670] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:08.169967 24079 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:08.169672 24074 consensus_queue.cc:1048] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:06:08.182350 24081 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:08.171298 15365 leader_election.cc:336] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.193621 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:08.173106 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f537e87ec99a4032a677e62627c567e2" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:08.194528 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abeddff35e5145ef927db00bd12f7cff" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:08.194926 15395 raft_consensus.cc:3060] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:08.195170 15398 raft_consensus.cc:3060] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:08.194528 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:08.196107 23799 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:08.174108 24043 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:08.186074 24081 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.202893 15398 raft_consensus.cc:2468] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
I20260709 13:06:08.204576 15395 raft_consensus.cc:2468] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 26.
I20260709 13:06:08.155781 15143 catalog_manager.cc:5697] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 28 to 29, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 29 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:08.186928 15999 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:08.222702 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.222569 15998 leader_election.cc:304] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:08.187808 24048 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.224421 24048 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.223539 15143 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 23 to 24, leader changed from ee9654803379434388de45d4693e6b16 (127.13.206.195) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 24 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.225431 15392 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 27.
I20260709 13:06:08.226653 24048 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:08.227255 24081 raft_consensus.cc:2804] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:08.227770 24081 raft_consensus.cc:697] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 26 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:06:08.228605 24081 consensus_queue.cc:237] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:08.187983 16033 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:06:08.189836 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:08.190557 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:08.232064 15317 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:06:08.172076 24086 leader_election.cc:290] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.206547 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:08.207705 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:08.212013 24089 tablet_copy_client.cc:806] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
W20260709 13:06:08.181357 15291 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.218432 24083 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.216290 15144 catalog_manager.cc:5697] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 17 to 18, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 18 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.220507 15290 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:06:08.221746 15365 leader_election.cc:336] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.187559 15397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:08.235357 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:08.235569 15391 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:06:08.240078 15397 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:06:08.235466 15393 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 24.
W20260709 13:06:08.237673 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 56420.9us
W20260709 13:06:08.240787 15291 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.241166 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
W20260709 13:06:08.243645 15365 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.226327 15143 catalog_manager.cc:5697] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 27 to 28, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 28 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.240278 15144 catalog_manager.cc:5697] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 18 to 19, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 19 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.247228 15144 catalog_manager.cc:5697] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 19 to 20, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 20 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:08.248263 15290 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:08.248185 23953 raft_consensus.cc:2749] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:08.237389 24089 tablet_copy_client.cc:670] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:08.259720 23953 raft_consensus.cc:2804] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:06:08.262413 15999 leader_election.cc:336] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:08.263379 15999 leader_election.cc:336] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:08.264163 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.265342 23953 raft_consensus.cc:697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:08.247993 24077 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:08.265866 24086 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:08.282876 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:08.248931 24083 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:08.277176 24077 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.275327 24095 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.291054 24083 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:08.294919 24095 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.232669 24058 consensus_queue.cc:260] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 27.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:08.297451 24095 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:08.297995 24083 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:08.298527 24083 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.298935 24083 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:08.300866 24062 tablet_bootstrap.cc:492] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:08.274736 23953 consensus_queue.cc:237] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.283936 24086 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.301712 24086 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:08.301914 24062 tablet_bootstrap.cc:492] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:06:08.302937 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:08.303369 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:08.304716 24077 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:08.304955 24099 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:08.305459 24099 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.305841 24099 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:08.303963 16024 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 28.
I20260709 13:06:08.309818 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:06:08.310747 24069 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:06:08.311152 24069 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
W20260709 13:06:08.313107 15291 leader_election.cc:336] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.311084 24089 tablet_copy_client.cc:538] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:08.313191 24069 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:06:08.322630 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.326828 24062 ts_tablet_manager.cc:1403] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.908s	user 0.039s	sys 0.047s
I20260709 13:06:08.303941 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:08.330581 24099 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.331461 24058 ts_tablet_manager.cc:1434] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.226s	user 0.008s	sys 0.000s
I20260709 13:06:08.331787 24101 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:06:08.333849 15291 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.322384 24069 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:08.334466 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.336689 24086 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:08.336831 24077 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:08.338379 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:06:08.359560 15365 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:08.360126 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.360512 15362 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:08.360791 24069 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:08.349357 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:08.362250 24048 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:08.362715 24048 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.363116 24048 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:08.364856 24069 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.365501 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:08.350651 15320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:08.362262 24095 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:08.366791 15320 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 21.
I20260709 13:06:08.351985 24101 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.333922 24083 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:08.357479 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.358567 15409 tablet_copy_service.cc:342] P ee9654803379434388de45d4693e6b16: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-529df4c4ec9d4e33b83b594284860b0f received from {username='slave'} at 127.0.0.1:51818
W20260709 13:06:08.360670 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.365443 24069 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.368161 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:08.338995 24062 raft_consensus.cc:359] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:08.354022 24099 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.403518 15393 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate edcf4a6bae7e4781bce325a586109ca5 in current term 25: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
I20260709 13:06:08.390928 15395 raft_consensus.cc:1275] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 13:06:08.392076 15392 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:06:08.393604 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:08.396250 23799 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:08.396603 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5288c8dc0fe4b7aabc37377e0bc0371" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:06:08.405283 23799 raft_consensus.cc:493] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.405447 16024 raft_consensus.cc:3060] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:08.405715 23799 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:08.407487 15317 raft_consensus.cc:2393] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 28: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:06:08.394915 15409 tablet_copy_service.cc:434] P ee9654803379434388de45d4693e6b16: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-529df4c4ec9d4e33b83b594284860b0f on tablet 529df4c4ec9d4e33b83b594284860b0f with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:08.335213 24089 tablet_bootstrap.cc:492] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:06:08.384002 24101 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:08.399515 24062 raft_consensus.cc:740] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:06:08.383850 24086 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.433319 23799 raft_consensus.cc:515] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.430943 16024 raft_consensus.cc:2468] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 29.
I20260709 13:06:08.447201 23799 leader_election.cc:290] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:08.434854 24070 tablet_copy_client.cc:538] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:08.480449 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.480901 15289 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5; no voters: 
I20260709 13:06:08.474136 15143 catalog_manager.cc:5697] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 25 to 26, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 26 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:08.488864 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 55676.6us
I20260709 13:06:08.495460 16024 raft_consensus.cc:3060] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 27 LEARNER]: Advancing to term 28
W20260709 13:06:08.496946 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 103667us
I20260709 13:06:08.498054 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:08.486434 24087 raft_consensus.cc:2804] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:06:08.508924 24043 raft_consensus.cc:3060] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:08.512368 24069 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.512122 24101 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.517655 15323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4143f8a30ca74db8afb568dd88a99bc0" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:08.523922 15323 raft_consensus.cc:3060] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:08.525410 15289 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.543898 24043 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:08.546519 15323 raft_consensus.cc:2468] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 22.
I20260709 13:06:08.458918 24062 consensus_queue.cc:260] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:08.517361 24087 raft_consensus.cc:697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:08.553789 24070 tablet_bootstrap.cc:492] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:06:08.553305 24087 consensus_queue.cc:237] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:08.548686 24083 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:08.560149 15999 leader_election.cc:336] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:08.572773 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:08.574443 15317 raft_consensus.cc:1275] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 28 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:06:08.558846 16024 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:06:08.567772 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:06:08.585202 16028 raft_consensus.cc:2393] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 25: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:06:08.565127 24062 ts_tablet_manager.cc:1434] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.238s	user 0.009s	sys 0.000s
W20260709 13:06:08.599241 15291 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:08.604115 15291 leader_election.cc:336] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:08.605370 15291 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:08.606252 15291 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.561167 24077 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:08.567121 24101 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:08.611815 15143 catalog_manager.cc:5697] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 23 to 24, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 24 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.569559 24048 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.664232 15391 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 45ddec37d9e741a598bf32f6c9d7e0ee in current term 26: Already voted for candidate ee9654803379434388de45d4693e6b16 in this term.
W20260709 13:06:08.667130 15365 leader_election.cc:336] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.631538 24069 consensus_queue.cc:1048] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:06:08.641240 24108 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:06:08.671288 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-4fca62166204465d888036a111b60b66 received from {username='slave'} at 127.0.0.1:46848
I20260709 13:06:08.633661 24105 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.060s
I20260709 13:06:08.694906 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-4fca62166204465d888036a111b60b66 on tablet 4fca62166204465d888036a111b60b66 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:08.709447 24048 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:08.722142 15999 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:08.727205 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 93368.1us
I20260709 13:06:08.738684 15362 leader_election.cc:304] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:08.739614 24106 raft_consensus.cc:2804] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:08.740188 24106 raft_consensus.cc:697] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
W20260709 13:06:08.736122 15291 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:08.741978 15291 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:08.742534 15291 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.742980 15323 raft_consensus.cc:1275] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:06:08.745225 24110 consensus_queue.cc:1048] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:08.741075 24106 consensus_queue.cc:237] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.752959 15325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
W20260709 13:06:08.754500 15291 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:08.758101 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 90160us
I20260709 13:06:08.759313 15325 raft_consensus.cc:2393] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 26: Already voted for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in this term.
I20260709 13:06:08.760583 15320 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:06:08.763912 15391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:08.764251 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d44715ddcb564012b7a6c6eedb94b8e2" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:08.764629 15391 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 22.
I20260709 13:06:08.768889 15392 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:06:08.770432 15392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:08.771049 15392 raft_consensus.cc:3060] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:08.763324 15291 consensus_peers.cc:597] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.775863 24043 consensus_queue.cc:1048] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:08.785094 23799 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:08.789673 15395 raft_consensus.cc:1275] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 28 index: 15. (index mismatch)
W20260709 13:06:08.793740 15363 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.798588 15393 raft_consensus.cc:2468] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 28.
I20260709 13:06:08.799643 15392 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 25.
I20260709 13:06:08.813457 15144 catalog_manager.cc:5697] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 28 to 29, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 29 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:08.834265 15998 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:08.848469 15290 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:08.850149 15393 raft_consensus.cc:1275] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:06:08.843138 24081 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:08.855881 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:06:08.856019 15365 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:08.858327 15365 leader_election.cc:336] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.861577 15365 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:08.864398 24120 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:08.860997 23953 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:08.878844 23953 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting leader election (detected failure of leader 89940175e5444593aab6b3a025624b5b)
I20260709 13:06:08.879274 23953 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:08.854341 24049 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:08.859975 24017 consensus_queue.cc:1048] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.040s
W20260709 13:06:08.920377 15291 consensus_peers.cc:597] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.927135 15290 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:08.922869 24083 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 13:06:08.928320 15290 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:08.929546 24108 raft_consensus.cc:2804] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:08.930087 24108 raft_consensus.cc:697] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:08.930137 24105 raft_consensus.cc:2804] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:08.930819 24101 consensus_queue.cc:1048] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:08.931118 24108 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:08.931161 24105 raft_consensus.cc:697] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:08.935253 24105 consensus_queue.cc:237] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:08.939030 15365 leader_election.cc:336] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.939724 15365 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:08.943445 23799 raft_consensus.cc:2749] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:06:08.948064 15365 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:08.948961 15365 leader_election.cc:336] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:08.955082 15393 raft_consensus.cc:1275] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:06:08.962344 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:08.963274 15365 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.963006 16028 consensus_queue.cc:237] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:08.963861 15365 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:08.973869 24090 raft_consensus.cc:1064] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:06:08.977120 16024 raft_consensus.cc:1275] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:09.003162 24048 consensus_queue.cc:1048] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:06:09.012079 14139 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:09.023535 15291 consensus_peers.cc:597] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:09.002584 24090 raft_consensus.cc:1068] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: Unable to promote non-voter edcf4a6bae7e4781bce325a586109ca5: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:08.968827 24049 consensus_queue.cc:1048] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
W20260709 13:06:09.045123 24129 log.cc:927] Time spent T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:06:09.062362 15143 catalog_manager.cc:5697] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 21 to 22, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 22 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:09.108884 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 84535us
W20260709 13:06:09.109685 15291 consensus_peers.cc:597] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:09.146472 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:09.148434 16024 raft_consensus.cc:1217] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.12->[22.13-22.13]   Dedup: 22.13->[]
I20260709 13:06:09.145327 23953 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:09.332016 24131 log.cc:927] Time spent T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: Append to log took a long time: real 0.110s	user 0.004s	sys 0.005s
W20260709 13:06:09.350705 24070 log.cc:927] Time spent T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:06:09.368899 23953 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:09.373047 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 179351us
I20260709 13:06:09.392917 15325 raft_consensus.cc:1275] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:06:09.396253 15291 consensus_peers.cc:597] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:09.397171 15291 consensus_peers.cc:597] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:09.397595 15291 consensus_peers.cc:597] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.426689 15398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:09.427378 15398 raft_consensus.cc:3060] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:09.429662 15143 catalog_manager.cc:5697] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 27 to 28, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 28 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.435880 15143 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 24 to 25, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 25 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:09.449816 15398 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45ddec37d9e741a598bf32f6c9d7e0ee in term 23.
W20260709 13:06:09.492974 15289 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 303748us
I20260709 13:06:09.513512 15319 raft_consensus.cc:1275] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:06:09.540824 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 110264us
W20260709 13:06:09.541694 15365 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:09.563833 15291 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:09.544982 24111 consensus_queue.cc:1048] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 13:06:09.573725 15291 consensus_peers.cc:597] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:09.579195 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:09.589915 24139 log.cc:927] Time spent T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:06:09.613234 15291 consensus_peers.cc:597] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:09.625901 16029 raft_consensus.cc:1275] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
W20260709 13:06:09.650772 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 106395us
I20260709 13:06:09.652513 15290 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
W20260709 13:06:09.726662 24144 log.cc:927] Time spent T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:09.730993 24112 raft_consensus.cc:2804] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:09.731676 24112 raft_consensus.cc:697] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Becoming Leader. State: Replica: 45ddec37d9e741a598bf32f6c9d7e0ee, State: Running, Role: LEADER
I20260709 13:06:09.732678 24112 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:09.736420 15398 raft_consensus.cc:1275] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
W20260709 13:06:09.750211 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 189524us
I20260709 13:06:09.754719 23799 consensus_queue.cc:1048] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:09.780335 15398 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:06:09.782614 24101 consensus_queue.cc:1048] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
W20260709 13:06:09.826934 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 89487.2us
I20260709 13:06:09.781975 24069 consensus_queue.cc:1048] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 13:06:09.847774 24087 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:09.907572 24161 raft_consensus.cc:1064] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:06:09.910220 24161 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:09.945823 24089 tablet_bootstrap.cc:492] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:06:09.950269 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 95865.7us
I20260709 13:06:09.980283 23953 raft_consensus.cc:1064] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:06:09.980413 24089 tablet_bootstrap.cc:492] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:06:09.981385 24089 ts_tablet_manager.cc:1403] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 1.647s	user 0.086s	sys 0.029s
W20260709 13:06:09.995222 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 229110us
W20260709 13:06:10.013454 14139 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15271)
I20260709 13:06:10.099210 24089 raft_consensus.cc:359] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:10.100243 24089 raft_consensus.cc:740] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:06:10.101122 24070 tablet_bootstrap.cc:492] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:10.102136 24070 tablet_bootstrap.cc:492] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:06:10.100998 24089 consensus_queue.cc:260] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:10.102952 24070 ts_tablet_manager.cc:1403] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 1.549s	user 0.054s	sys 0.023s
I20260709 13:06:10.104519 24089 ts_tablet_manager.cc:1434] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.001s
I20260709 13:06:10.105135 23953 consensus_queue.cc:237] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 17, Current term: 28, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:10.110828 24070 raft_consensus.cc:359] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:10.111537 24070 raft_consensus.cc:740] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:06:10.112035 24070 consensus_queue.cc:260] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:10.191792 15409 tablet_copy_service.cc:342] P ee9654803379434388de45d4693e6b16: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-0a3760e6bdc5424685fc319a53f0c819 received from {username='slave'} at 127.0.0.1:51818
I20260709 13:06:10.192981 15409 tablet_copy_service.cc:434] P ee9654803379434388de45d4693e6b16: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-0a3760e6bdc5424685fc319a53f0c819 on tablet 0a3760e6bdc5424685fc319a53f0c819 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:10.221613 24102 raft_consensus.cc:2955] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Committing config change with OpId 21.12: config changed from index 3 to 12, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:10.272241 24090 raft_consensus.cc:1027] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 LEADER]: attempt to promote peer edcf4a6bae7e4781bce325a586109ca5: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:06:10.280380 16024 raft_consensus.cc:3060] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [term 18 LEARNER]: Advancing to term 19
I20260709 13:06:10.320034 24070 ts_tablet_manager.cc:1434] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.217s	user 0.005s	sys 0.001s
I20260709 13:06:10.355691 15398 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:06:10.361435 15393 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:06:10.403039 16028 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:06:10.405323 16028 raft_consensus.cc:1275] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:06:10.414026 24169 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:10.416553 24169 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:06:10.471845 24102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:52384 (request call id 0) took 1515 ms. Trace:
I20260709 13:06:10.472491 24102 rpcz_store.cc:276] 0709 13:06:08.955947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.956524 (+   577us) service_pool.cc:224] Handling call
0709 13:06:08.967215 (+ 10691us) log.cc:844] Serialized 508 byte log entry
0709 13:06:09.589161 (+621946us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b4400022b4c. stack: 00007f3666adb343 00007f3666adb240 00007f366646a1d4 00007f36701a8304 00007f36701a8299 00007f3666995db1 00007f3666a33c85 00007f3666a346a2 00007f36697a61db 00007f36697a1aaf 00007f366979586e 00007f3669794bb6 00007f36697947d8 00007f366979e221 00007f366979e1d9 00007f366979e169
0709 13:06:10.471682 (+882521us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137264,"raft.queue_time_us":155373,"raft.run_cpu_time_us":971,"raft.run_wall_time_us":970,"spinlock_wait_cycles":3856640,"thread_start_us":179704,"threads_started":1,"wal-append.queue_time_us":401274}
I20260709 13:06:10.512037 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-c377e25836b14680beed769c143a593c received from {username='slave'} at 127.0.0.1:46848
I20260709 13:06:10.512709 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-c377e25836b14680beed769c143a593c on tablet c377e25836b14680beed769c143a593c with peer edcf4a6bae7e4781bce325a586109ca5
W20260709 13:06:10.516410 15291 consensus_peers.cc:597] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:10.520673 15291 consensus_peers.cc:597] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:10.524261 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:10.539618 15133 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9e997bc5c2942178cde4c670df97100 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 15)
I20260709 13:06:10.498943 15319 raft_consensus.cc:2955] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Committing config change with OpId 21.12: config changed from index 3 to 12, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:10.549554 24114 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.550495 24114 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:10.565915 24114 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:10.566864 23953 consensus_queue.cc:1048] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:06:10.579597 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
I20260709 13:06:10.580646 15317 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
W20260709 13:06:10.605310 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:10.596885 24101 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
W20260709 13:06:10.626118 15288 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.611107 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 78563.1us
W20260709 13:06:10.655597 15999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111) [suppressed 394 similar messages]
I20260709 13:06:10.690557 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:10.692790 24079 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:10.693233 24079 raft_consensus.cc:493] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.694291 24079 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:06:10.715512 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:10.716444 24176 raft_consensus.cc:493] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:10.717155 24176 raft_consensus.cc:515] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:10.720790 24176 leader_election.cc:290] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:10.726467 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:10.689777 15144 catalog_manager.cc:5697] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 3 to 12, VOTER ee9654803379434388de45d4693e6b16 (127.13.206.195) evicted. New cstate: current_term: 21 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:10.738947 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:10.748450 15291 consensus_peers.cc:597] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:10.768558 15317 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e997bc5c2942178cde4c670df97100" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" is_pre_election: true
W20260709 13:06:10.800468 15365 leader_election.cc:336] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:10.810011 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:10.828284 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 65424.4us
W20260709 13:06:10.834049 15291 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:10.834587 15291 consensus_peers.cc:597] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:10.835130 15291 consensus_peers.cc:597] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:10.842381 15397 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:06:10.838665 15291 consensus_peers.cc:597] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:10.852545 15362 leader_election.cc:304] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:10.869307 24048 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.869937 24048 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:10.883968 24048 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:06:10.885083 24184 log.cc:927] Time spent T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:06:10.889622 24169 raft_consensus.cc:2955] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index 13 to 14, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:10.893093 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:10.893893 16024 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:06:10.870507 24114 raft_consensus.cc:2749] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:10.895862 24114 raft_consensus.cc:1064] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:06:10.902693 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:10.903884 24121 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:10.904345 24121 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.904675 24121 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:10.908622 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:10.911096 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 44816.7us
W20260709 13:06:10.911965 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:10.913115 15365 leader_election.cc:336] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:10.918905 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:10.914649 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:10.885761 24079 raft_consensus.cc:515] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:10.951004 15291 consensus_peers.cc:597] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:10.984261 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:10.987106 24114 consensus_queue.cc:237] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 14, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:10.952662 15291 consensus_peers.cc:597] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:11.010859 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 58557.6us
W20260709 13:06:11.000433 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:11.007296 24079 leader_election.cc:290] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:11.014278 14139 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:11.014900 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:11.039126 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 179336us
I20260709 13:06:11.044939 24090 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:06:11.047299 15365 leader_election.cc:336] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:11.048437 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:11.049475 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:11.051586 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:11.051821 23953 raft_consensus.cc:2955] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 LEADER]: Committing config change with OpId 28.19: config changed from index 17 to 19, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:11.072522 15365 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:11.073158 15365 leader_election.cc:336] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:11.079524 15999 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:11.080089 16033 raft_consensus.cc:2955] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Committing config change with OpId 28.19: config changed from index 17 to 19, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.082749 15324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceb4d1b87e1c4966839d620a8aeaaf6a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 27 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee"
I20260709 13:06:11.083462 15324 raft_consensus.cc:3060] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:11.034837 16028 raft_consensus.cc:2955] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.099323 15392 raft_consensus.cc:2955] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:11.092054 15291 consensus_peers.cc:597] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:11.038130 24121 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:11.119262 15393 raft_consensus.cc:2955] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Committing config change with OpId 28.19: config changed from index 17 to 19, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.128221 16033 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [term 19 LEARNER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:06:11.139572 24110 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:11.148532 15317 raft_consensus.cc:1275] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:06:11.151136 15291 consensus_peers.cc:597] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:11.156558 24048 consensus_queue.cc:1048] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:06:11.163388 15365 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:11.180346 24121 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Requested vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:11.183444 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99211c99c0ce4c1cb82fa7cea0ab410a" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5"
I20260709 13:06:11.184195 16033 raft_consensus.cc:3060] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:11.190091 15324 raft_consensus.cc:2468] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 27.
I20260709 13:06:11.205395 15362 leader_election.cc:304] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:11.210481 24121 raft_consensus.cc:2804] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:11.211408 24121 raft_consensus.cc:697] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:06:11.230752 24121 consensus_queue.cc:237] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:11.244203 15143 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: term changed from 22 to 23, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194). New cstate: current_term: 23 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.248222 15385 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e997bc5c2942178cde4c670df97100 with delete_type TABLET_DATA_TOMBSTONED (TS ee9654803379434388de45d4693e6b16 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:59684
W20260709 13:06:11.248816 15365 leader_election.cc:336] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:11.284313 16033 raft_consensus.cc:2468] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 26.
I20260709 13:06:11.298858 15363 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 89940175e5444593aab6b3a025624b5b
I20260709 13:06:11.319329 15144 catalog_manager.cc:5697] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 17 to 19, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 28 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:11.331203 15365 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:11.331938 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:11.332484 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:11.334446 15999 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:11.321394 15144 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 13 to 14, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } attrs { replace: true } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.341787 24200 tablet_replica.cc:333] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:11.338789 24110 raft_consensus.cc:2804] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:11.349555 24110 raft_consensus.cc:697] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Becoming Leader. State: Replica: ee9654803379434388de45d4693e6b16, State: Running, Role: LEADER
I20260709 13:06:11.350616 24110 consensus_queue.cc:237] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:11.390499 15144 catalog_manager.cc:5697] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 25 to 27, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 27 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:11.395319 23953 raft_consensus.cc:1064] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:06:11.398116 23953 consensus_queue.cc:237] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:11.400533 24174 raft_consensus.cc:2955] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 14 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.403733 15324 raft_consensus.cc:2955] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 14 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.418534 15320 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:11.431137 16033 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:06:11.498768 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 46093.2us
I20260709 13:06:11.502712 15395 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:11.503928 24193 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:06:11.507839 24200 raft_consensus.cc:2243] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:11.508703 24200 raft_consensus.cc:2272] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:11.527619 24101 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:06:11.551673 16024 raft_consensus.cc:2955] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 14 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.540174 15143 catalog_manager.cc:5697] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 reported cstate change: term changed from 24 to 26, leader changed from 89940175e5444593aab6b3a025624b5b (127.13.206.193) to ee9654803379434388de45d4693e6b16 (127.13.206.195). New cstate: current_term: 26 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:11.564581 16028 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:06:11.566666 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:11.541013 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:11.536267 24200 ts_tablet_manager.cc:1916] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:11.595602 15144 catalog_manager.cc:5697] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 14 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:11.598448 15291 consensus_peers.cc:597] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:11.610209 24191 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:06:11.612169 15291 consensus_peers.cc:597] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:11.616039 24101 raft_consensus.cc:2955] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.631377 15395 raft_consensus.cc:1275] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
W20260709 13:06:11.632943 15365 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:11.637998 16029 raft_consensus.cc:2955] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.648933 24169 consensus_queue.cc:1048] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:06:11.668587 15291 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:11.671416 15132 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4fca62166204465d888036a111b60b66 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:11.695514 15392 raft_consensus.cc:2955] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.716678 15143 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: config changed from index 14 to 15, VOTER 89940175e5444593aab6b3a025624b5b (127.13.206.193) evicted. New cstate: current_term: 22 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.733907 15317 raft_consensus.cc:1275] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
W20260709 13:06:11.741482 15365 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:11.749476 24200 ts_tablet_manager.cc:1929] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.11
I20260709 13:06:11.750169 24200 log.cc:1199] T b9e997bc5c2942178cde4c670df97100 P ee9654803379434388de45d4693e6b16: Deleting WAL directory at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/wals/b9e997bc5c2942178cde4c670df97100
I20260709 13:06:11.761879 15134 catalog_manager.cc:5028] TS ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): tablet b9e997bc5c2942178cde4c670df97100 (table test-workload [id=7eb50c407c0b4f14bb0b64dc8d55569a]) successfully deleted
W20260709 13:06:11.763590 15365 consensus_peers.cc:597] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:11.784760 24110 consensus_queue.cc:1048] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:11.796681 16024 raft_consensus.cc:1275] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:06:11.801757 24110 consensus_queue.cc:1048] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:06:11.806455 24101 raft_consensus.cc:2955] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 14 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:11.820029 15397 raft_consensus.cc:2955] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 14 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:11.848178 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:11.854983 15135 catalog_manager.cc:4755] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4fca62166204465d888036a111b60b66: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:11.887804 16024 raft_consensus.cc:2955] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 14 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:11.900449 15291 consensus_peers.cc:597] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:11.903436 15365 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:11.899147 15143 catalog_manager.cc:5697] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 14 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:12.015264 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 59812.7us
W20260709 13:06:12.015981 14139 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:12.031590 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:12.137766 15291 consensus_peers.cc:597] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:12.313265 15291 consensus_peers.cc:597] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:12.499118 15291 consensus_peers.cc:597] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:12.673311 15291 consensus_peers.cc:597] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:12.724843 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:12.879994 15291 consensus_peers.cc:597] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:12.922452 15291 consensus_peers.cc:597] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:12.947407 15291 consensus_peers.cc:597] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:13.017117 14139 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 15271)
I20260709 13:06:13.028112 15321 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
W20260709 13:06:13.037340 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.088263 15289 consensus_peers.cc:597] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7ac2109e25f8401baf7141ea474e8bc4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.114344 15392 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:06:13.128724 15291 consensus_peers.cc:597] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.138685 24207 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:06:13.149878 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.141944 15291 consensus_peers.cc:597] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.170055 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.179418 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.191041 15291 consensus_peers.cc:597] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.209702 15291 consensus_peers.cc:597] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.218910 15135 catalog_manager.cc:4755] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4fca62166204465d888036a111b60b66: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:13.234961 24223 raft_consensus.cc:2955] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Committing config change with OpId 25.18: config changed from index -1 to 18, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:13.250703 15392 raft_consensus.cc:2955] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index -1 to 18, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:06:13.257593 15291 consensus_peers.cc:597] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:13.279557 15140 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 18, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 25 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:13.281634 15392 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
W20260709 13:06:13.292855 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.309311 15363 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f72ca1a62ac74338a0ec5abd5a427bbf. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:13.311156 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.315882 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.322885 15321 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:06:13.325507 24174 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:13.353267 24110 raft_consensus.cc:2955] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:06:13.365628 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:13.366806 15321 raft_consensus.cc:2955] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index -1 to 16, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:06:13.385601 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:13.398993 15397 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
W20260709 13:06:13.420919 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.475302 15363 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da67615b960b446d8df50fe1de2a0b3e. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:13.476078 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:13.484179 15291 consensus_peers.cc:597] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.495218 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 54181.1us
I20260709 13:06:13.498160 15321 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:13.500135 15144 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 16, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 24 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:13.509460 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:13.511226 24110 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:13.535979 24095 raft_consensus.cc:2955] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:06:13.575889 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:13.588212 24235 ts_tablet_manager.cc:933] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:13.591737 15291 consensus_peers.cc:597] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:13.600813 24235 tablet_copy_client.cc:323] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:06:13.603863 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet 7ac2109e25f8401baf7141ea474e8bc4 from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:06:13.604436 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet 7ac2109e25f8401baf7141ea474e8bc4 from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-7ac2109e25f8401baf7141ea474e8bc4
I20260709 13:06:13.608852 15319 raft_consensus.cc:2955] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index -1 to 15, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:13.614109 15334 tablet_copy_source_session.cc:215] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:06:13.620496 15365 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:13.637665 24235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ac2109e25f8401baf7141ea474e8bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:13.645385 15144 catalog_manager.cc:5697] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index -1 to 15, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 20 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:13.650640 15319 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:13.681854 24235 tablet_copy_client.cc:806] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:13.682719 24235 tablet_copy_client.cc:670] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
W20260709 13:06:13.687041 15291 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:13.689154 15397 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:06:13.693687 24235 tablet_copy_client.cc:538] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:13.697299 15291 consensus_peers.cc:597] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:13.699460 24223 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:13.706593 24235 tablet_bootstrap.cc:492] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
W20260709 13:06:13.720816 15365 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:13.735924 15289 consensus_peers.cc:597] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543): Couldn't send request to peer edcf4a6bae7e4781bce325a586109ca5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 705321025dc74b199219f4e541a68efa. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:13.829309 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:13.830933 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:13.831704 24207 raft_consensus.cc:2955] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
I20260709 13:06:13.835589 15392 raft_consensus.cc:2955] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:06:13.872215 15365 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:13.876688 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 45800.2us
W20260709 13:06:13.910790 15291 consensus_peers.cc:597] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:13.922835 24235 tablet_bootstrap.cc:492] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=19 overwritten=1 applied=18 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:06:13.963326 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 52598.2us
I20260709 13:06:13.964251 24235 tablet_bootstrap.cc:492] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:06:13.965211 24235 ts_tablet_manager.cc:1403] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.259s	user 0.050s	sys 0.019s
I20260709 13:06:13.969192 24235 raft_consensus.cc:359] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:13.974858 24235 raft_consensus.cc:740] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
W20260709 13:06:13.975344 15999 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:13.995234 15999 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:13.990849 24235 consensus_queue.cc:260] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:14.016600 24235 ts_tablet_manager.cc:1434] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.007s
W20260709 13:06:14.017652 14139 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 15271)
I20260709 13:06:14.047832 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-7ac2109e25f8401baf7141ea474e8bc4 received from {username='slave'} at 127.0.0.1:46848
I20260709 13:06:14.048396 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-7ac2109e25f8401baf7141ea474e8bc4 on tablet 7ac2109e25f8401baf7141ea474e8bc4 with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:14.051630 15144 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index -1 to 15, NON_VOTER edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) added. New cstate: current_term: 23 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } } }
W20260709 13:06:14.062152 15291 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:14.094507 16029 raft_consensus.cc:1217] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEARNER]: Deduplicated request from leader. Original: 25.17->[25.18-25.18]   Dedup: 25.18->[]
I20260709 13:06:14.097330 24235 ts_tablet_manager.cc:933] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:14.122318 15365 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:14.134788 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:14.137122 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:14.145176 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:14.152439 24250 ts_tablet_manager.cc:933] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:14.170976 24250 tablet_copy_client.cc:323] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.195:44417
I20260709 13:06:14.173884 15409 tablet_copy_service.cc:140] P ee9654803379434388de45d4693e6b16: Received BeginTabletCopySession request for tablet da67615b960b446d8df50fe1de2a0b3e from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:51818)
I20260709 13:06:14.174520 15409 tablet_copy_service.cc:161] P ee9654803379434388de45d4693e6b16: Beginning new tablet copy session on tablet da67615b960b446d8df50fe1de2a0b3e from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:51818: session id = edcf4a6bae7e4781bce325a586109ca5-da67615b960b446d8df50fe1de2a0b3e
I20260709 13:06:14.178941 24235 tablet_copy_client.cc:323] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.195:44417
I20260709 13:06:14.180954 15408 tablet_copy_service.cc:140] P ee9654803379434388de45d4693e6b16: Received BeginTabletCopySession request for tablet f72ca1a62ac74338a0ec5abd5a427bbf from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:51818)
I20260709 13:06:14.181602 15408 tablet_copy_service.cc:161] P ee9654803379434388de45d4693e6b16: Beginning new tablet copy session on tablet f72ca1a62ac74338a0ec5abd5a427bbf from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:51818: session id = edcf4a6bae7e4781bce325a586109ca5-f72ca1a62ac74338a0ec5abd5a427bbf
I20260709 13:06:14.187974 15409 tablet_copy_source_session.cc:215] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:14.191558 15408 tablet_copy_source_session.cc:215] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:14.194705 24250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da67615b960b446d8df50fe1de2a0b3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.197194 24235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f72ca1a62ac74338a0ec5abd5a427bbf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:14.218609 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:14.231597 15365 consensus_peers.cc:597] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:14.234409 24235 tablet_copy_client.cc:806] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:14.235168 24235 tablet_copy_client.cc:670] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:14.242270 24235 tablet_copy_client.cc:538] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:14.251979 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:14.268857 24235 tablet_bootstrap.cc:492] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
I20260709 13:06:14.302980 24250 tablet_copy_client.cc:806] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:14.308898 24250 tablet_copy_client.cc:670] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:14.313901 24250 tablet_copy_client.cc:538] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:14.327150 24250 tablet_bootstrap.cc:492] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
W20260709 13:06:14.366503 15135 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 52667.6us
I20260709 13:06:14.368929 24256 ts_tablet_manager.cc:933] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: Initiating tablet copy from peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:14.376941 15135 catalog_manager.cc:4755] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4fca62166204465d888036a111b60b66: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:14.403971 15291 consensus_peers.cc:597] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:14.411082 24256 tablet_copy_client.cc:323] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Beginning tablet copy session from remote peer at address 127.13.206.194:34635
I20260709 13:06:14.416424 15334 tablet_copy_service.cc:140] P 45ddec37d9e741a598bf32f6c9d7e0ee: Received BeginTabletCopySession request for tablet 705321025dc74b199219f4e541a68efa from peer edcf4a6bae7e4781bce325a586109ca5 ({username='slave'} at 127.0.0.1:46848)
I20260709 13:06:14.417095 15334 tablet_copy_service.cc:161] P 45ddec37d9e741a598bf32f6c9d7e0ee: Beginning new tablet copy session on tablet 705321025dc74b199219f4e541a68efa from peer edcf4a6bae7e4781bce325a586109ca5 at {username='slave'} at 127.0.0.1:46848: session id = edcf4a6bae7e4781bce325a586109ca5-705321025dc74b199219f4e541a68efa
I20260709 13:06:14.428283 15334 tablet_copy_source_session.cc:215] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:14.436609 24256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705321025dc74b199219f4e541a68efa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:14.451597 15291 consensus_peers.cc:597] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:14.464634 15365 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:14.491283 15291 consensus_peers.cc:597] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:14.492635 24256 tablet_copy_client.cc:806] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:14.494416 24256 tablet_copy_client.cc:670] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:14.499042 24256 tablet_copy_client.cc:538] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:14.520812 24256 tablet_bootstrap.cc:492] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: Bootstrap starting.
W20260709 13:06:14.530110 15365 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:14.572978 24235 tablet_bootstrap.cc:492] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=1 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:14.574484 24235 tablet_bootstrap.cc:492] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:06:14.577566 24235 ts_tablet_manager.cc:1403] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.309s	user 0.055s	sys 0.031s
I20260709 13:06:14.604394 24235 raft_consensus.cc:359] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:14.605752 24235 raft_consensus.cc:740] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
I20260709 13:06:14.609656 24235 consensus_queue.cc:260] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:14.619931 24235 ts_tablet_manager.cc:1434] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:06:14.626415 15408 tablet_copy_service.cc:342] P ee9654803379434388de45d4693e6b16: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-f72ca1a62ac74338a0ec5abd5a427bbf received from {username='slave'} at 127.0.0.1:51818
I20260709 13:06:14.633937 15408 tablet_copy_service.cc:434] P ee9654803379434388de45d4693e6b16: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-f72ca1a62ac74338a0ec5abd5a427bbf on tablet f72ca1a62ac74338a0ec5abd5a427bbf with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:14.648851 24223 raft_consensus.cc:1064] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:06:14.651547 24223 consensus_queue.cc:237] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 16, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:14.668375 16029 raft_consensus.cc:1217] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.15->[24.16-24.16]   Dedup: 24.16->[]
W20260709 13:06:14.685171 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:14.697986 16029 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 13:06:14.698608 15291 consensus_peers.cc:597] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:14.699700 24223 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:06:14.707639 24250 tablet_bootstrap.cc:492] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:14.708884 24250 tablet_bootstrap.cc:492] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:06:14.709388 15392 raft_consensus.cc:1275] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:06:14.717976 24250 ts_tablet_manager.cc:1403] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.391s	user 0.058s	sys 0.000s
I20260709 13:06:14.721407 24250 raft_consensus.cc:359] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:14.727571 24250 raft_consensus.cc:740] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
W20260709 13:06:14.730798 15291 consensus_peers.cc:597] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:14.734582 24223 consensus_queue.cc:1048] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:06:14.745426 24250 consensus_queue.cc:260] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:14.753522 24250 ts_tablet_manager.cc:1434] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:06:14.756409 15408 tablet_copy_service.cc:342] P ee9654803379434388de45d4693e6b16: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-da67615b960b446d8df50fe1de2a0b3e received from {username='slave'} at 127.0.0.1:51818
I20260709 13:06:14.756942 15408 tablet_copy_service.cc:434] P ee9654803379434388de45d4693e6b16: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-da67615b960b446d8df50fe1de2a0b3e on tablet da67615b960b446d8df50fe1de2a0b3e with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:14.812273 24256 tablet_bootstrap.cc:492] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:14.813324 24256 tablet_bootstrap.cc:492] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: Bootstrap complete.
I20260709 13:06:14.814083 24256 ts_tablet_manager.cc:1403] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: Time spent bootstrapping tablet: real 0.294s	user 0.043s	sys 0.015s
I20260709 13:06:14.817081 24241 raft_consensus.cc:2955] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Committing config change with OpId 25.19: config changed from index 18 to 19, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:14.837414 15395 raft_consensus.cc:2955] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Committing config change with OpId 25.19: config changed from index 18 to 19, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:14.848569 24256 raft_consensus.cc:359] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:14.853463 24256 raft_consensus.cc:740] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Initialized, Role: LEARNER
W20260709 13:06:14.849361 15291 consensus_peers.cc:597] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:14.880285 15140 catalog_manager.cc:5697] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 18 to 19, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:14.866631 24256 consensus_queue.cc:260] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: NON_VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: true } }
I20260709 13:06:14.909914 24256 ts_tablet_manager.cc:1434] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
I20260709 13:06:14.915177 15334 tablet_copy_service.cc:342] P 45ddec37d9e741a598bf32f6c9d7e0ee: Request end of tablet copy session edcf4a6bae7e4781bce325a586109ca5-705321025dc74b199219f4e541a68efa received from {username='slave'} at 127.0.0.1:46848
I20260709 13:06:14.915735 15334 tablet_copy_service.cc:434] P 45ddec37d9e741a598bf32f6c9d7e0ee: ending tablet copy session edcf4a6bae7e4781bce325a586109ca5-705321025dc74b199219f4e541a68efa on tablet 705321025dc74b199219f4e541a68efa with peer edcf4a6bae7e4781bce325a586109ca5
I20260709 13:06:14.931273 16024 raft_consensus.cc:1217] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEARNER]: Deduplicated request from leader. Original: 23.14->[23.15-23.15]   Dedup: 23.15->[]
I20260709 13:06:14.929559 16029 raft_consensus.cc:2955] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Committing config change with OpId 25.19: config changed from index 18 to 19, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:14.967701 16028 raft_consensus.cc:1217] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.14->[20.15-20.15]   Dedup: 20.15->[]
W20260709 13:06:14.980026 15290 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 60917.3us
W20260709 13:06:15.018141 14139 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:15.048084 15291 consensus_peers.cc:597] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:15.137903 15291 consensus_peers.cc:597] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:15.151948 24254 raft_consensus.cc:1064] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:06:15.154858 24254 consensus_queue.cc:237] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 14, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:15.201647 16028 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEARNER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:15.204267 24251 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:06:15.215020 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:15.217283 15321 raft_consensus.cc:1275] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:15.219055 24243 consensus_queue.cc:1048] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:06:15.278503 24243 raft_consensus.cc:2955] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 16 to 17, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:15.284495 15321 raft_consensus.cc:2955] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:15.315658 15143 catalog_manager.cc:5697] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 16 to 17, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:15.323897 16028 raft_consensus.cc:2955] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 16 to 17, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:15.388346 15291 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 53577us
W20260709 13:06:15.398406 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 61961.7us
I20260709 13:06:15.403872 24270 raft_consensus.cc:1064] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:06:15.439342 24270 consensus_queue.cc:237] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:15.499261 15291 consensus_peers.cc:597] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:15.508741 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:15.511749 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 47931.1us
I20260709 13:06:15.543759 16028 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEARNER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:15.545284 24223 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:06:15.636417 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:15.655792 15999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111) [suppressed 490 similar messages]
I20260709 13:06:15.682772 15395 raft_consensus.cc:1275] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer 45ddec37d9e741a598bf32f6c9d7e0ee: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:06:15.739537 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:15.768996 24191 consensus_queue.cc:1048] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:06:15.763154 15291 consensus_peers.cc:597] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:15.785087 24254 raft_consensus.cc:1064] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: attempting to promote NON_VOTER edcf4a6bae7e4781bce325a586109ca5 to VOTER
I20260709 13:06:15.787892 24254 consensus_queue.cc:237] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:15.800208 15291 consensus_peers.cc:597] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:15.802124 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:15.822983 16028 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEARNER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:06:15.827092 15319 raft_consensus.cc:1275] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Refusing update from remote peer ee9654803379434388de45d4693e6b16: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:06:15.835076 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:15.834916 24254 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:15.848358 24242 consensus_queue.cc:1048] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:06:15.875769 15291 consensus_peers.cc:597] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:15.898020 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:15.903899 15291 consensus_peers.cc:597] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:15.914716 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:15.967581 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:15.979544 24244 raft_consensus.cc:2955] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:15.987392 15319 raft_consensus.cc:2955] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:15.992199 15291 consensus_peers.cc:597] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:15.997629 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:15.996743 24270 raft_consensus.cc:2955] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
I20260709 13:06:15.998446 16028 raft_consensus.cc:2955] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:16.007700 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:16.008445 15397 raft_consensus.cc:2955] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:16.018661 14139 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 15271)
I20260709 13:06:16.024843 15143 catalog_manager.cc:5697] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 reported cstate change: config changed from index 15 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "ee9654803379434388de45d4693e6b16" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.063030 16029 raft_consensus.cc:2955] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } } }
W20260709 13:06:16.068655 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:16.080622 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:16.081240 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:16.145879 15142 catalog_manager.cc:5697] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee reported cstate change: config changed from index 15 to 16, edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:16.218689 15291 consensus_peers.cc:597] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:16.262024 15291 consensus_peers.cc:597] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:16.294262 15291 consensus_peers.cc:597] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:16.301506 15291 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:16.357180 15291 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:16.359678 15365 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:16.383118 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:16.401016 15365 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:16.452956 15999 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:16.479506 15999 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:16.506295 15135 catalog_manager.cc:4755] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4fca62166204465d888036a111b60b66: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:16.514851 15365 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:16.556073 15365 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:16.558478 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:16.676553 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:16.792155 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:16.824033 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:16.847781 15291 consensus_peers.cc:597] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:16.881356 15365 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:16.881963 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:16.887974 15291 consensus_peers.cc:597] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:16.895339 15365 consensus_peers.cc:597] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:17.019219 14139 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:17.027043 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 47007.1us
W20260709 13:06:17.147591 15291 consensus_peers.cc:597] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:17.171707 15291 consensus_peers.cc:597] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:17.194608 15365 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:17.243131 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 48568.9us
W20260709 13:06:17.198191 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:17.247721 15999 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 49586.1us
W20260709 13:06:17.375712 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 66656.6us
W20260709 13:06:17.474817 15291 consensus_peers.cc:597] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:17.525120 15291 consensus_peers.cc:597] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:17.525660 15291 consensus_peers.cc:597] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:17.552029 15291 consensus_peers.cc:597] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:17.852895 15291 consensus_peers.cc:597] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:17.985387 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.019778 14139 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:18.073000 15291 consensus_peers.cc:597] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.168711 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:18.172219 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 90178.4us
W20260709 13:06:18.186390 15291 consensus_peers.cc:597] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:18.205207 15291 consensus_peers.cc:597] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:18.206863 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.263938 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.317847 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.399552 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.443285 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.453801 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.486274 15291 consensus_peers.cc:597] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.509245 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.587314 15291 consensus_peers.cc:597] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.617749 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.625861 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.675734 15291 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:18.694141 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.708979 15291 consensus_peers.cc:597] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.741604 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:18.796451 15999 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:18.881748 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:18.903303 15365 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:18.940620 15291 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:19.020303 14139 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:19.020687 15291 consensus_peers.cc:597] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:19.020982 15365 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:19.023480 15365 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:19.082118 15291 consensus_peers.cc:597] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:19.124969 15999 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:19.195474 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:19.196316 15291 consensus_peers.cc:597] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:19.233086 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:19.384073 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:19.416273 15365 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:19.447911 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:19.630280 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:19.674158 15291 consensus_peers.cc:597] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:19.647346 15365 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:19.696080 15291 consensus_peers.cc:597] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:19.703804 15291 consensus_peers.cc:597] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:19.703006 15365 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:19.716532 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:19.767848 15291 consensus_peers.cc:597] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:19.812750 15365 consensus_peers.cc:597] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:19.904083 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:19.909116 15291 consensus_peers.cc:597] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:19.943423 15291 consensus_peers.cc:597] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:20.020877 14139 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:20.227118 15998 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:44417, user_credentials={real_user=slave}} blocked reactor thread for 88205us
W20260709 13:06:20.415333 15291 consensus_peers.cc:597] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:20.520692 15291 consensus_peers.cc:597] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:20.525357 15291 consensus_peers.cc:597] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:20.646080 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:20.646880 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:20.647603 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:20.657054 15365 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111) [suppressed 478 similar messages]
W20260709 13:06:20.690676 15291 consensus_peers.cc:597] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:20.724205 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:20.732127 15135 catalog_manager.cc:4755] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4fca62166204465d888036a111b60b66: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:20.738308 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:20.823151 15291 consensus_peers.cc:597] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:20.852546 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:20.864681 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.021626 14139 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:21.053429 15291 consensus_peers.cc:597] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.163715 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.180794 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.246809 15291 consensus_peers.cc:597] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.254171 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.269976 15291 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:21.276865 15999 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:21.270661 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.280089 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.422004 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.439092 15365 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:21.453653 15137 maintenance_manager.cc:419] P 6c48b19b0ac74d678c9f752e98013b9a: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033367
W20260709 13:06:21.487576 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:21.488119 15365 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:21.544654 15365 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:21.569840 15291 consensus_peers.cc:597] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.620697 15999 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:21.657334 15291 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:21.658986 15291 consensus_peers.cc:597] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.710304 15291 consensus_peers.cc:597] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:21.748531 15291 consensus_peers.cc:597] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:21.808791 15136 maintenance_manager.cc:643] P 6c48b19b0ac74d678c9f752e98013b9a: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.353s	user 0.040s	sys 0.011s Metrics: {"bytes_written":7690,"delete_count":0,"lbm_write_time_us":67225,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":3,"reinsert_count":0,"thread_start_us":35157,"threads_started":1,"update_count":304,"wal-append.queue_time_us":65552}
I20260709 13:06:21.820848 15137 maintenance_manager.cc:419] P 6c48b19b0ac74d678c9f752e98013b9a: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.373599
W20260709 13:06:21.879712 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.901974 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:21.946388 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:21.995335 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:22.012432 15365 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:22.022221 14139 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:22.115376 15291 consensus_peers.cc:597] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:22.178617 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:22.204051 15291 consensus_peers.cc:597] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:22.284706 15365 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:22.333171 15291 consensus_peers.cc:597] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:22.370949 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:22.431743 15365 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:22.438040 15291 consensus_peers.cc:597] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:22.518795 15291 consensus_peers.cc:597] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:06:22.587877 15136 maintenance_manager.cc:643] P 6c48b19b0ac74d678c9f752e98013b9a: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.766s	user 0.107s	sys 0.026s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":29089,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":38701,"dirs.run_cpu_time_us":663,"dirs.run_wall_time_us":4348,"lbm_read_time_us":2222,"lbm_reads_lt_1ms":26,"lbm_write_time_us":2029,"lbm_writes_lt_1ms":12,"peak_mem_usage":579419,"reinsert_count":0,"thread_start_us":13049,"threads_started":2,"update_count":322}
I20260709 13:06:22.591081 15137 maintenance_manager.cc:419] P 6c48b19b0ac74d678c9f752e98013b9a: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:06:22.591913 15136 maintenance_manager.cc:643] P 6c48b19b0ac74d678c9f752e98013b9a: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:06:22.653065 15365 consensus_peers.cc:597] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:22.673494 15291 consensus_peers.cc:597] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:22.699271 15291 consensus_peers.cc:597] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:22.731256 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:22.837908 15291 consensus_peers.cc:597] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:22.967519 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:22.981418 15291 consensus_peers.cc:597] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.022953 14139 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 15271)
W20260709 13:06:23.050601 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.239807 15291 consensus_peers.cc:597] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:23.298193 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.357106 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.410135 15291 consensus_peers.cc:597] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:23.426537 14139 tablet_server.cc:196] TabletServer@127.13.206.193:0 shutdown complete.
W20260709 13:06:23.466833 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.484879 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.561286 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.596801 15291 consensus_peers.cc:597] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:23.598826 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 109668us
W20260709 13:06:23.696270 15999 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:23.709271 15291 consensus_peers.cc:597] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.742174 15291 consensus_peers.cc:597] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.796372 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.811168 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.818907 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:06:23.833425 14139 tablet_server.cc:179] TabletServer@127.13.206.194:0 shutting down...
W20260709 13:06:23.857018 15362 consensus_peers.cc:597] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.859010 15996 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.881130 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.889601 15362 consensus_peers.cc:597] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.916278 15362 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.931236 15996 consensus_peers.cc:597] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.938637 15362 consensus_peers.cc:597] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.940475 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.948900 15996 consensus_peers.cc:597] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.958293 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:23.967489 15996 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:23.991920 15362 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.005143 15996 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.008421 15291 consensus_peers.cc:597] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:24.012358 15291 consensus_peers.cc:597] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:24.031893 15362 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.035113 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:24.042789 15291 consensus_peers.cc:597] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:24.047770 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:06:24.050562 15362 consensus_peers.cc:597] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.052637 14139 tablet_replica.cc:333] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
W20260709 13:06:24.059031 15996 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.060323 14139 raft_consensus.cc:2243] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:06:24.067409 15362 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.069891 14139 raft_consensus.cc:2272] T 92362862adca4227bb6dad04afd638cc P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.073865 14139 tablet_replica.cc:333] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
W20260709 13:06:24.074507 15362 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.099845 15999 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:24.105089 14139 raft_consensus.cc:2243] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.106057 14139 raft_consensus.cc:2272] T 2d3f2b48b18a47388a0e1497a84803ff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:24.111263 15362 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.111989 15362 consensus_peers.cc:597] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.103907 15365 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:24.135890 15362 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.136659 15362 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.143040 14139 tablet_replica.cc:333] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.144068 14139 raft_consensus.cc:2243] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.145612 14139 raft_consensus.cc:2272] T 2fe8125185eb4429a9a0a58b14dd8636 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:24.150452 15365 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:24.153200 14139 tablet_replica.cc:333] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.154363 14139 raft_consensus.cc:2243] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.155845 14139 raft_consensus.cc:2272] T abb86a150e844b848bc103f128d39a82 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:24.162863 15362 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.166216 15362 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.169418 14139 tablet_replica.cc:333] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
W20260709 13:06:24.174743 15362 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.175498 14139 raft_consensus.cc:2243] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.180852 14139 raft_consensus.cc:2272] T 529df4c4ec9d4e33b83b594284860b0f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:24.184432 15291 consensus_peers.cc:597] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:06:24.192054 14139 tablet_replica.cc:333] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.193113 14139 raft_consensus.cc:2243] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:24.196719 15996 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.201944 15362 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.200362 14139 raft_consensus.cc:2272] T 6183201d0cfc47c68ab021f085302aab P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.277268 14139 tablet_replica.cc:333] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.278795 14139 raft_consensus.cc:2243] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.279973 14139 raft_consensus.cc:2272] T f20d2caf56534c1ebcf23935582a5f03 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:24.285694 15362 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.357005 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 71380.5us
W20260709 13:06:24.286641 15365 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:24.358381 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 71789.2us
W20260709 13:06:24.380596 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:24.382388 15291 consensus_peers.cc:597] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:24.423893 15362 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.437294 14139 tablet_replica.cc:333] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
W20260709 13:06:24.444183 15362 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.465663 14139 raft_consensus.cc:2243] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.485842 14139 raft_consensus.cc:2272] T e5288c8dc0fe4b7aabc37377e0bc0371 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:24.348619 15996 consensus_peers.cc:597] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.488004 15996 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 139438us
W20260709 13:06:24.492492 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:24.508726 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:24.512152 14139 tablet_replica.cc:333] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
W20260709 13:06:24.513501 15996 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:24.521713 15996 consensus_peers.cc:597] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:24.528024 14139 raft_consensus.cc:2243] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:06:24.528707 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:24.529063 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:24.543565 15289 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.558279 14139 raft_consensus.cc:2272] T 76857f06f24d4d9183e84f52d83bf070 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.571794 14139 tablet_replica.cc:333] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.583771 14139 raft_consensus.cc:2243] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.584633 14139 raft_consensus.cc:2272] T 87a9a9eccfa9436c993e85bfe0343332 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.601383 14139 tablet_replica.cc:333] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.607893 14139 raft_consensus.cc:2243] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.617457 14139 raft_consensus.cc:2272] T 49a44991403a4f8a851f90729c6ca783 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.633036 14139 tablet_replica.cc:333] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
W20260709 13:06:24.632933 15365 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.13.206.254:45539, user_credentials={real_user=slave}} blocked reactor thread for 57167us
I20260709 13:06:24.644549 14139 raft_consensus.cc:2243] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.645239 14139 raft_consensus.cc:2272] T c0024621f21043e889d114f180f1dccb P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:24.648540 15365 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:24.656461 14139 tablet_replica.cc:333] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.657500 14139 raft_consensus.cc:2243] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.658646 14139 raft_consensus.cc:2272] T b9e997bc5c2942178cde4c670df97100 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.661458 14139 tablet_replica.cc:333] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
W20260709 13:06:24.681263 15365 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:24.685233 15291 consensus_peers.cc:597] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:24.682407 14139 raft_consensus.cc:2243] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.692104 14139 raft_consensus.cc:2272] T 907f0d82d81845029df5f0613caae65c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.695313 14139 tablet_replica.cc:333] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.696251 14139 raft_consensus.cc:2243] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.697474 14139 raft_consensus.cc:2272] T 8dcb1955ebaf442cb75dba3471600141 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.700438 14139 tablet_replica.cc:333] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.706918 14139 raft_consensus.cc:2243] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.707979 14139 raft_consensus.cc:2272] T 79fb071c9f56456cade8cf3a14c85fc3 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.711265 14139 tablet_replica.cc:333] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.714880 14139 raft_consensus.cc:2243] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.715863 14139 raft_consensus.cc:2272] T 195ee90b7e844a81920e312f95fdda67 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.724900 14139 tablet_replica.cc:333] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.725793 14139 raft_consensus.cc:2243] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.727384 14139 raft_consensus.cc:2272] T 1389463201b74b128d916816a1d7c24c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.731468 14139 tablet_replica.cc:333] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.744204 14139 raft_consensus.cc:2243] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.745092 14139 raft_consensus.cc:2272] T 41098c861400432692b47f484ad4dd2d P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.748185 14139 tablet_replica.cc:333] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.749112 14139 raft_consensus.cc:2243] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.749859 14139 raft_consensus.cc:2272] T e71ec5b3198446c0a387428e2a4eb753 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.756316 14139 tablet_replica.cc:333] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.757295 14139 raft_consensus.cc:2243] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.758296 14139 raft_consensus.cc:2272] T e82f23e062ad47fe80fac622dd633649 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.761089 14139 tablet_replica.cc:333] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.767653 14139 raft_consensus.cc:2243] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.768877 14139 raft_consensus.cc:2272] T abeddff35e5145ef927db00bd12f7cff P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.783825 14139 tablet_replica.cc:333] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.784781 14139 raft_consensus.cc:2243] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.785849 14139 raft_consensus.cc:2272] T fad3ad4002954af28c1eccdf62948088 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.788760 14139 tablet_replica.cc:333] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.789676 14139 raft_consensus.cc:2243] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.790429 14139 raft_consensus.cc:2272] T 4365018e298c4531b7d90e25d9d6d144 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.795120 14139 tablet_replica.cc:333] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.796041 14139 raft_consensus.cc:2243] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.797514 14139 raft_consensus.cc:2272] T 66ab819064aa4b6faba9dff78296aa66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.823426 24331 raft_consensus.cc:493] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election (detected failure of leader edcf4a6bae7e4781bce325a586109ca5)
I20260709 13:06:24.824075 24331 raft_consensus.cc:515] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:24.830900 24331 leader_election.cc:290] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:24.832320 14139 tablet_replica.cc:333] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.832237 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:24.839263 14139 raft_consensus.cc:2243] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.840478 14139 raft_consensus.cc:2272] T fd1b68b8eb8145ee8bd4d3629784110f P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.843991 14139 tablet_replica.cc:333] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.844892 14139 raft_consensus.cc:2243] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.845675 14139 raft_consensus.cc:2272] T de7f843f60914a58b8b7e5a4a5e2ea6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.848435 14139 tablet_replica.cc:333] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.849309 14139 raft_consensus.cc:2243] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.850605 14139 raft_consensus.cc:2272] T d44715ddcb564012b7a6c6eedb94b8e2 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.853554 14139 tablet_replica.cc:333] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.854439 14139 raft_consensus.cc:2243] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.855187 14139 raft_consensus.cc:2272] T a64e06dc30ff4dfebdb052a6f7228046 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.858944 14139 tablet_replica.cc:333] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.859824 14139 raft_consensus.cc:2243] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.860885 14139 raft_consensus.cc:2272] T c377e25836b14680beed769c143a593c P 45ddec37d9e741a598bf32f6c9d7e0ee [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.864651 14139 tablet_replica.cc:333] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.865484 14139 raft_consensus.cc:2243] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.866788 14139 raft_consensus.cc:2272] T f3f21223b98c4cc6b8699008b5c6edc8 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.868456 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29a6f3425a941868726620486fe7013" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:24.871479 14139 tablet_replica.cc:333] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.872509 14139 raft_consensus.cc:2243] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.877239 14139 raft_consensus.cc:2272] T 525e3bab033946a090787fa86d1292aa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.889345 14139 tablet_replica.cc:333] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.890323 14139 raft_consensus.cc:2243] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.896399 14139 raft_consensus.cc:2272] T ceb4d1b87e1c4966839d620a8aeaaf6a P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.899747 14139 tablet_replica.cc:333] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.900651 14139 raft_consensus.cc:2243] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.901485 14139 raft_consensus.cc:2272] T 88815123db2d4b648ca4b8cc3257aa37 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.904309 14139 tablet_replica.cc:333] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.906078 14139 raft_consensus.cc:2243] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.906852 14139 raft_consensus.cc:2272] T 5db51018c5b04518b8cb7f3e5f2ca694 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.909788 15290 leader_election.cc:304] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:24.909896 14139 tablet_replica.cc:333] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.913327 14139 raft_consensus.cc:2243] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.913853 24331 raft_consensus.cc:2749] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:24.917443 14139 raft_consensus.cc:2272] T 4143f8a30ca74db8afb568dd88a99bc0 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.921729 14139 tablet_replica.cc:333] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.922608 14139 raft_consensus.cc:2243] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.923470 14139 raft_consensus.cc:2272] T 68e68ea4eb05497288804ad7aefb241e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.926687 14139 tablet_replica.cc:333] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.928128 14139 raft_consensus.cc:2243] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.929049 14139 raft_consensus.cc:2272] T 4342f068b244466e9d599b81fd154374 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.932260 14139 tablet_replica.cc:333] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.933106 14139 raft_consensus.cc:2243] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.934397 14139 raft_consensus.cc:2272] T b29a6f3425a941868726620486fe7013 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.940201 14139 tablet_replica.cc:333] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.941031 14139 raft_consensus.cc:2243] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:24.944643 14139 raft_consensus.cc:2272] T 7ac2109e25f8401baf7141ea474e8bc4 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:24.947992 14139 tablet_replica.cc:333] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:24.986971 14139 raft_consensus.cc:2243] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:24.988497 24331 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:24.989131 24331 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:24.992669 24331 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers ee9654803379434388de45d4693e6b16 (127.13.206.195:44417), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:24.988124 14139 raft_consensus.cc:2272] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:24.993976 24328 raft_consensus.cc:670] T f72ca1a62ac74338a0ec5abd5a427bbf P 45ddec37d9e741a598bf32f6c9d7e0ee: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 13:06:24.994042 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:24.999920 14139 tablet_replica.cc:333] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:25.000845 14139 raft_consensus.cc:2243] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:25.002430 14139 raft_consensus.cc:2272] T 8f6ca66a81d04e56bccbc22cab55f4de P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.004805 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b4a8d6a569c4998877fabab1b180c59" candidate_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:25.005836 14139 tablet_replica.cc:333] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:25.006719 14139 raft_consensus.cc:2243] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:25.010444 15290 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45ddec37d9e741a598bf32f6c9d7e0ee; no voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16
I20260709 13:06:25.011423 14139 raft_consensus.cc:2272] T 705321025dc74b199219f4e541a68efa P 45ddec37d9e741a598bf32f6c9d7e0ee [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.011680 24328 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:25.016247 14139 tablet_replica.cc:333] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:25.017439 14139 raft_consensus.cc:2243] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.018512 14139 raft_consensus.cc:2272] T 5704803490ae4e7bb7f8229734bd20df P 45ddec37d9e741a598bf32f6c9d7e0ee [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.021502 14139 tablet_replica.cc:333] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:25.022439 14139 raft_consensus.cc:2243] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:25.026913 14139 raft_consensus.cc:2272] T 0a3760e6bdc5424685fc319a53f0c819 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.029549 14139 tablet_replica.cc:333] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:25.030567 14139 raft_consensus.cc:2243] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.031301 14139 raft_consensus.cc:2272] T 2a96142637d944dd8747c019a86e4864 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.038739 14139 tablet_replica.cc:333] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:25.039500 14139 raft_consensus.cc:2243] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:25.040614 14139 raft_consensus.cc:2272] T 4fca62166204465d888036a111b60b66 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.043460 14139 tablet_replica.cc:333] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:25.044409 14139 raft_consensus.cc:2243] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.045063 14139 raft_consensus.cc:2272] T a9161d42f4f04ce8a5234d5b1cfeab22 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.047685 14139 tablet_replica.cc:333] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:25.048400 14139 raft_consensus.cc:2243] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.049796 14139 raft_consensus.cc:2272] T da67615b960b446d8df50fe1de2a0b3e P 45ddec37d9e741a598bf32f6c9d7e0ee [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:25.052556 14139 tablet_replica.cc:333] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee: stopping tablet replica
I20260709 13:06:25.056097 14139 raft_consensus.cc:2243] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:25.057871 14139 raft_consensus.cc:2272] T 3b4a8d6a569c4998877fabab1b180c59 P 45ddec37d9e741a598bf32f6c9d7e0ee [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:25.078265 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:06:25.186324 24323 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:25.186996 24323 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:25.202018 15362 leader_election.cc:336] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:25.206450 24323 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:25.207059 15365 leader_election.cc:336] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:25.208205 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:25.210278 24329 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:25.223228 15365 consensus_peers.cc:597] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:25.234655 15365 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:25.319092 24319 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:25.319736 24319 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:25.322255 24319 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:25.500126 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:06:25.518968 24337 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:25.519647 24337 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:25.523695 24337 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:25.524282 24337 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:25.524950 24337 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:25.528692 24337 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:25.530645 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:25.531484 16033 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 28.
W20260709 13:06:25.538980 15999 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:25.574328 15365 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:25.576121 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:25.576630 15365 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:25.584563 15362 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:25.587016 15362 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:25.591784 15362 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:25.596424 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:25.592341 24337 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:25.602805 24329 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:06:25.610580 15996 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:25.615011 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:25.617412 24333 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:25.629572 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:25.656358 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:25.658613 15999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111) [suppressed 562 similar messages]
W20260709 13:06:25.665488 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:25.830441 24339 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:25.831087 24339 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:25.833096 24341 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:25.833652 24341 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:25.836012 24341 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:25.848590 15996 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:25.850085 24339 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:25.850679 15999 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:25.853152 15999 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:25.851356 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:25.856181 24339 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:06:25.860859 15996 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:25.863487 24327 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:06:25.864302 15999 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:25.864189 24327 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:25.864944 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:25.865525 24337 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:25.865728 24339 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:25.866114 24337 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:25.868703 24337 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:25.875877 24329 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:25.876500 24329 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:25.880453 24329 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:25.884295 24327 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:25.896205 15362 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:25.898068 15365 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:25.901088 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:25.904290 15362 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:25.905578 15362 leader_election.cc:336] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:25.906548 24323 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:06:25.922096 15996 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:25.932687 15365 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:25.938458 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:25.943348 24323 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:25.944586 15365 leader_election.cc:336] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:25.945163 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:25.948294 24323 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:25.987967 24323 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:25.988600 24323 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:25.991031 24323 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:26.002149 24327 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.002789 24327 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:26.005023 24327 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:26.015492 15365 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:26.024325 15362 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:26.030090 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:26.031611 15365 leader_election.cc:336] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:26.034032 24327 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 13:06:26.063645 15362 leader_election.cc:336] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:26.067211 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.077317 24327 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:26.077980 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:26.080224 24327 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.080907 24327 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:26.083093 24327 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:26.094455 24323 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.095170 24323 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:26.097461 24323 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:26.117398 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:26.130929 15365 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:26.134312 15365 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:26.142323 15362 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:26.143646 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.147559 24323 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:26.147794 15362 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:26.148373 15362 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.158322 24323 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:26.195473 24319 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.196123 24319 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:26.219007 24319 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:26.221849 15999 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:26.223137 15996 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:26.224896 15999 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:26.225688 15999 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.227957 24339 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:26.244216 24341 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.244853 24341 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:26.248648 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:26.248838 24341 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:26.251421 15999 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:26.253748 15996 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:26.254173 15996 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.254911 24341 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:26.281340 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:26.301597 15395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
W20260709 13:06:26.324092 14139 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15346)
I20260709 13:06:26.332262 24323 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.332954 24323 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:26.336617 24323 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:26.337261 24323 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.337845 24323 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:26.340188 24323 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:26.370025 24337 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.370803 24337 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:26.374887 24337 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:26.481242 24337 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.482131 24337 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:26.485316 24337 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:26.514968 24343 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:06:26.517263 16054 debug-util.cc:398] Leaking SignalData structure 0x7b080026d3a0 after lost signal to thread 14142
W20260709 13:06:26.554826 16054 debug-util.cc:398] Leaking SignalData structure 0x7b080026ee40 after lost signal to thread 15182
W20260709 13:06:26.556457 16054 debug-util.cc:398] Leaking SignalData structure 0x7b0800351480 after lost signal to thread 15423
W20260709 13:06:26.557857 16054 debug-util.cc:398] Leaking SignalData structure 0x7b0800230940 after lost signal to thread 16057
I20260709 13:06:26.566452 24343 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:26.571700 24343 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:26.592619 24319 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.593356 24319 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:26.596283 24319 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:26.597718 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 386865us
I20260709 13:06:26.604066 24319 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.604660 24319 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:26.606812 24319 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:26.609053 15393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:26.609714 15393 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:06:26.610522 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:26.611186 15396 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 22.
I20260709 13:06:26.625511 15998 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:26.626534 24319 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:26.626979 24319 raft_consensus.cc:493] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.627339 24319 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:26.635390 24319 raft_consensus.cc:515] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:26.643294 15999 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:26.654371 24343 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.655061 24343 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:26.657328 24343 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:26.669098 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:26.669504 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:26.669951 16028 raft_consensus.cc:2393] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee9654803379434388de45d4693e6b16 in current term 23: Already voted for candidate edcf4a6bae7e4781bce325a586109ca5 in this term.
I20260709 13:06:26.670118 16024 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 24.
I20260709 13:06:26.676294 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:26.676857 24327 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:26.677091 16028 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
I20260709 13:06:26.677474 24327 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:26.680313 24327 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:26.641312 24319 leader_election.cc:290] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Requested vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:26.650624 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fca62166204465d888036a111b60b66" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16"
I20260709 13:06:26.696038 15396 raft_consensus.cc:3060] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:26.699613 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:26.700353 16028 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
W20260709 13:06:26.704952 15996 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:26.726352 15996 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:26.711453 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:26.733904 15999 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:06:26.734908 24319 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:26.735893 15996 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.758023 15996 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.758594 15996 leader_election.cc:336] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:26.750840 15362 leader_election.cc:336] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:26.760480 15362 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, edcf4a6bae7e4781bce325a586109ca5
W20260709 13:06:26.761797 15362 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.762411 15362 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:26.763181 15362 leader_election.cc:336] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:26.763720 15362 leader_election.cc:336] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:26.759176 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:26.765731 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:26.756646 15396 raft_consensus.cc:2468] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
I20260709 13:06:26.766896 24327 raft_consensus.cc:2749] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:26.759896 15996 consensus_peers.cc:597] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:26.771095 15998 leader_election.cc:304] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 
I20260709 13:06:26.772302 24319 raft_consensus.cc:2804] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:26.774377 24319 raft_consensus.cc:697] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Becoming Leader. State: Replica: edcf4a6bae7e4781bce325a586109ca5, State: Running, Role: LEADER
I20260709 13:06:26.775605 24319 consensus_queue.cc:237] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:26.789915 15996 leader_election.cc:336] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:26.828032 15996 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.835357 15362 consensus_peers.cc:597] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.835953 15362 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.836371 15362 consensus_peers.cc:597] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.836767 15362 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:26.837247 15362 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.837883 15362 consensus_peers.cc:597] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:26.843163 15142 catalog_manager.cc:5697] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 reported cstate change: term changed from 22 to 23, leader changed from 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194) to edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196). New cstate: current_term: 23 leader_uuid: "edcf4a6bae7e4781bce325a586109ca5" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:26.764462 15365 leader_election.cc:336] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:26.852097 15996 consensus_peers.cc:597] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:26.852286 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.856153 24327 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:26.857420 15365 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 92986.1us
W20260709 13:06:26.858121 15365 leader_election.cc:336] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:26.860391 15365 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.861399 24327 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:26.867218 15365 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:26.867961 15365 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.871659 24327 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:26.873195 15365 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:26.880626 15365 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:26.884663 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.885682 24327 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:26.883538 15362 leader_election.cc:336] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:26.892246 15362 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.911592 15362 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:26.913923 15362 consensus_peers.cc:597] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.915069 15362 consensus_peers.cc:597] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.917886 15362 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.930554 15362 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.934976 15362 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.943784 15365 leader_election.cc:336] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:26.945660 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.950474 24327 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:26.953279 15362 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.952147 15365 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:26.954886 15365 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:26.960281 24337 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:26.964243 15362 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.993005 15362 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:26.998160 15362 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:27.015578 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:27.017856 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:27.017567 15362 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:27.018478 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:27.038340 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:27.093896 15996 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:27.095516 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:27.096302 15365 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:27.120893 15365 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:27.136669 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:06:27.161643 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:27.172228 24329 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:27.172780 24329 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:27.174852 24329 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:27.182416 15362 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:27.211509 15996 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:27.216312 24329 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:27.216923 24329 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:27.221768 24329 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:27.223569 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:27.224291 16028 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 28.
W20260709 13:06:27.234864 15362 leader_election.cc:336] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:27.239262 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 51477.2us
W20260709 13:06:27.247256 15365 leader_election.cc:336] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:27.251446 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:27.255757 24337 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:27.258270 15996 consensus_peers.cc:597] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:27.280022 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:27.283437 15996 consensus_peers.cc:597] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:27.287248 15362 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:27.300336 15362 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:27.300807 15365 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:27.304998 15365 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:27.308494 15420 debug-util.cc:398] Leaking SignalData structure 0x7b080012e3e0 after lost signal to thread 14142
I20260709 13:06:27.309105 24337 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:06:27.309688 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08001d68e0 after lost signal to thread 15182
W20260709 13:06:27.311398 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08003352e0 after lost signal to thread 15423
W20260709 13:06:27.312863 15420 debug-util.cc:398] Leaking SignalData structure 0x7b08000b07c0 after lost signal to thread 16057
W20260709 13:06:27.312747 15362 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:27.321305 15996 consensus_peers.cc:597] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:27.324612 14139 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15346)
I20260709 13:06:27.330202 15395 raft_consensus.cc:1275] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Refusing update from remote peer edcf4a6bae7e4781bce325a586109ca5: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:27.333607 24339 consensus_queue.cc:1048] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:06:27.448338 15365 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:27.489248 24337 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:27.489801 24337 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:27.497143 24337 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:27.515082 15365 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:27.542606 15362 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:27.543205 15362 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:27.545214 24329 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:27.573324 24327 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:27.580503 24327 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:27.587030 24327 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:27.588760 24329 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:27.589534 24329 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:27.592622 24329 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:27.598590 15365 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:27.610437 15365 leader_election.cc:336] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:27.611949 24339 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:06:27.621747 15362 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:27.626084 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:27.627494 15362 leader_election.cc:336] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:27.628036 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:27.636251 24359 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:06:27.643008 24359 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:27.612568 24339 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:27.649909 24339 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:27.656598 15999 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:27.678768 15365 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:27.658529 24327 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:27.681512 24327 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:27.684047 24327 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:27.689625 15365 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:27.696833 15362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:34635, user_credentials={real_user=slave}} blocked reactor thread for 69361.4us
W20260709 13:06:27.727149 15996 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:27.727873 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:27.732470 24339 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:27.749853 15365 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:06:27.759802 24327 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:27.760710 24327 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:27.763244 24327 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:27.765657 15362 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:27.766484 15362 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:27.769367 15365 leader_election.cc:336] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:27.772981 24337 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:27.784673 24339 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:27.785420 24339 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:27.788609 24339 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:27.797232 15999 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:27.822548 15996 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:27.828752 15362 leader_election.cc:336] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:27.825763 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:27.838083 24339 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:27.837191 15362 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:27.861084 24337 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:27.884449 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:27.892383 24339 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:27.893090 24339 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:27.895531 24339 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:27.905112 15999 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:27.918216 24337 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:06:27.918284 15996 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:27.919245 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:27.919118 24337 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:27.921521 24337 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:27.927034 15362 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:27.930399 24319 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:06:27.938592 15365 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:27.939301 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:27.940490 24337 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:06:28.010598 15365 consensus_peers.cc:597] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:28.043937 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:28.104347 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:28.191588 24339 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:28.192425 24339 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:28.212013 24337 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:28.218675 24337 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:28.228694 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:28.233604 15396 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 23.
W20260709 13:06:28.247535 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:28.248236 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:28.255246 15996 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:28.260952 15365 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:28.261840 24339 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:28.274716 15999 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:28.277240 15999 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:28.262786 24337 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:28.281992 24339 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:28.283260 15362 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:28.285646 15362 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:28.288722 24337 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 13:06:28.357440 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:06:28.361114 24359 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:28.361658 24359 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:28.373374 24359 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:28.374064 15365 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:28.384789 15362 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:28.385329 15362 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:28.386101 24359 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:28.449414 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:06:28.482479 24319 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:28.483045 24319 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:28.490828 15999 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:28.499383 15996 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:28.499878 15996 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:28.500968 24339 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:28.504634 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:28.505280 15396 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:06:28.513041 24319 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:28.561601 15996 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:28.647850 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:28.657895 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:06:28.706593 24359 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:28.707330 24359 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:28.729344 24359 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:28.743880 15999 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:28.750296 15365 leader_election.cc:336] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:28.756532 15362 leader_election.cc:336] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:28.757594 15362 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:28.763530 24359 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:28.788249 24359 raft_consensus.cc:493] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:28.788841 24359 raft_consensus.cc:515] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:28.791227 24359 leader_election.cc:290] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:28.798113 15365 leader_election.cc:336] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:28.810716 15362 leader_election.cc:336] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:28.811257 15362 leader_election.cc:304] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:28.812541 24359 raft_consensus.cc:2749] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:28.873258 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:28.883450 15999 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:28.963477 15362 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:28.979969 15996 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:29.013760 24337 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:29.014492 24337 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:29.016799 24337 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:29.027992 15365 leader_election.cc:336] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:29.028983 15362 leader_election.cc:336] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:29.029479 15362 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:29.045857 24359 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:29.052469 15135 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.206.193:43213, user_credentials={real_user=slave}} blocked reactor thread for 46043.1us
W20260709 13:06:29.068948 15362 consensus_peers.cc:597] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.072381 15135 catalog_manager.cc:4755] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4fca62166204465d888036a111b60b66: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:29.073777 15362 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.099069 15362 consensus_peers.cc:597] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.118425 15365 consensus_peers.cc:597] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:29.119832 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:29.138322 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:29.140658 15362 consensus_peers.cc:597] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.143395 15362 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.147708 15362 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.160857 15996 consensus_peers.cc:597] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.172752 15365 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:29.196841 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:06:29.197172 24359 raft_consensus.cc:493] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:29.197752 24359 raft_consensus.cc:515] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:29.199611 24359 leader_election.cc:290] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:29.205127 15365 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:29.205767 15362 consensus_peers.cc:597] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:29.207512 24359 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:29.211156 24359 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:29.213883 15362 leader_election.cc:336] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:29.214437 15362 leader_election.cc:304] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:29.226892 15996 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.233223 15365 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:29.236129 16028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:29.236857 16028 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 25.
I20260709 13:06:29.238600 24327 raft_consensus.cc:2749] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:06:29.246634 24359 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
W20260709 13:06:29.260847 15362 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.268247 15996 consensus_peers.cc:597] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.272801 15362 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:29.273494 15362 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:29.274361 24359 raft_consensus.cc:493] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:29.276701 24359 raft_consensus.cc:515] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:29.279479 24359 leader_election.cc:290] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:29.280009 24327 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:29.296108 15362 leader_election.cc:336] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:29.300084 15365 leader_election.cc:336] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:29.300683 15365 leader_election.cc:304] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:29.301558 24359 raft_consensus.cc:2749] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:29.321954 15362 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.336068 15362 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.348294 15365 consensus_peers.cc:597] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:29.363220 15365 consensus_peers.cc:597] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:29.385907 15362 consensus_peers.cc:597] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.408983 15996 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.426000 15362 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.434463 15362 consensus_peers.cc:597] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:29.454485 24364 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:29.455171 24364 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
W20260709 13:06:29.461282 15362 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.467311 15365 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:29.473276 15996 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:29.474129 15999 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:29.474629 15999 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:29.476562 24339 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:29.481050 24364 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:29.482338 24359 raft_consensus.cc:493] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:29.482915 24359 raft_consensus.cc:515] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:29.489120 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "529df4c4ec9d4e33b83b594284860b0f" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:29.489810 15396 raft_consensus.cc:2468] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 28.
W20260709 13:06:29.490274 15996 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:29.501008 24359 leader_election.cc:290] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:29.509531 15365 leader_election.cc:336] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:29.514977 15996 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.515763 15362 leader_election.cc:336] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:29.516225 15362 leader_election.cc:304] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:29.517453 24359 raft_consensus.cc:2749] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:29.520115 15365 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:29.566656 15996 consensus_peers.cc:597] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.589368 15365 consensus_peers.cc:597] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:29.652273 15362 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.658954 15365 consensus_peers.cc:597] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:29.662285 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:06:29.699641 24337 raft_consensus.cc:493] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:29.700217 24337 raft_consensus.cc:515] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:29.702311 24337 leader_election.cc:290] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:29.703572 15362 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.710569 15362 leader_election.cc:336] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:29.714514 15365 consensus_peers.cc:597] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:29.717514 15362 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.728955 15365 leader_election.cc:336] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:29.730151 15365 leader_election.cc:304] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:29.732090 24359 raft_consensus.cc:2749] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:29.735014 15363 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:38543, user_credentials={real_user=slave}} blocked reactor thread for 57287.7us
W20260709 13:06:29.749390 15365 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:29.831225 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:29.854346 15362 consensus_peers.cc:597] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.902130 15362 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:29.925889 15996 consensus_peers.cc:597] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:29.930426 24327 raft_consensus.cc:493] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:29.931087 24327 raft_consensus.cc:515] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:29.935761 24327 leader_election.cc:290] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), edcf4a6bae7e4781bce325a586109ca5 (127.13.206.196:38543)
I20260709 13:06:29.937275 16024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705321025dc74b199219f4e541a68efa" candidate_uuid: "ee9654803379434388de45d4693e6b16" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "edcf4a6bae7e4781bce325a586109ca5" is_pre_election: true
I20260709 13:06:29.938050 16024 raft_consensus.cc:2468] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee9654803379434388de45d4693e6b16 in term 23.
W20260709 13:06:29.945896 15362 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:29.947919 15365 leader_election.cc:336] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:29.948370 15365 leader_election.cc:304] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:29.949074 24327 raft_consensus.cc:2749] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:30.091914 15365 consensus_peers.cc:597] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:30.127382 15365 consensus_peers.cc:597] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:30.195047 15996 consensus_peers.cc:597] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:30.255211 24365 raft_consensus.cc:493] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:30.255837 24365 raft_consensus.cc:515] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:30.257936 24365 leader_election.cc:290] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:30.269675 15362 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:30.270777 15365 leader_election.cc:336] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:30.271376 15365 leader_election.cc:304] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:30.272295 24365 raft_consensus.cc:2749] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:30.273667 15365 consensus_peers.cc:597] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:06:30.426954 24364 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:30.428532 24364 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:30.432251 24364 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:30.443841 15996 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:30.444621 15999 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:30.445170 15999 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:30.446434 24348 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:30.499449 15365 consensus_peers.cc:597] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:06:30.508090 24348 raft_consensus.cc:493] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:30.508880 14139 tablet_server.cc:196] TabletServer@127.13.206.194:0 shutdown complete.
I20260709 13:06:30.509058 24348 raft_consensus.cc:515] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:30.513304 24364 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:30.514384 24364 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:30.515560 24369 raft_consensus.cc:493] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:30.516489 24369 raft_consensus.cc:515] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:30.521351 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3760e6bdc5424685fc319a53f0c819" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:30.522787 15396 raft_consensus.cc:2468] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 24.
I20260709 13:06:30.523998 24369 leader_election.cc:290] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:30.521375 15999 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:30.526643 24348 leader_election.cc:290] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:30.531409 24327 raft_consensus.cc:493] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
W20260709 13:06:30.532912 15362 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:30.539037 24327 raft_consensus.cc:515] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:30.529606 24364 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:30.541764 24327 leader_election.cc:290] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:30.537721 15999 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:30.558714 15362 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:30.608973 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:06:30.617054 15996 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:30.618394 15996 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:30.619400 24348 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:30.628006 15365 leader_election.cc:336] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:30.628726 15365 leader_election.cc:304] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:30.630126 15365 leader_election.cc:336] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:30.631157 24369 raft_consensus.cc:2749] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:06:30.631278 24348 raft_consensus.cc:493] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:30.630620 15365 leader_election.cc:304] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:30.632728 24369 raft_consensus.cc:2749] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:30.632455 24348 raft_consensus.cc:515] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:30.635676 24348 leader_election.cc:290] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:30.638846 24369 raft_consensus.cc:493] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:30.639518 24369 raft_consensus.cc:515] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:30.642514 24369 leader_election.cc:290] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:30.642680 15999 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:30.646196 15362 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:30.654834 15365 leader_election.cc:336] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:30.655467 15365 leader_election.cc:304] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:30.656342 24369 raft_consensus.cc:2749] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:06:30.662734 15999 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111) [suppressed 673 similar messages]
W20260709 13:06:30.652421 15996 leader_election.cc:336] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:30.663781 15996 leader_election.cc:304] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:30.665406 24373 raft_consensus.cc:2749] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:06:30.684120 15996 leader_election.cc:336] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:30.684793 15996 leader_election.cc:304] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:30.685729 24373 raft_consensus.cc:2749] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:30.738890 15365 consensus_peers.cc:597] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:06:30.750427 15365 consensus_peers.cc:597] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:30.772003 24373 raft_consensus.cc:493] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:30.772841 24373 raft_consensus.cc:515] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:30.777053 15396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ac2109e25f8401baf7141ea474e8bc4" candidate_uuid: "edcf4a6bae7e4781bce325a586109ca5" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "ee9654803379434388de45d4693e6b16" is_pre_election: true
I20260709 13:06:30.777812 15396 raft_consensus.cc:2468] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edcf4a6bae7e4781bce325a586109ca5 in term 25.
I20260709 13:06:30.780591 24373 leader_election.cc:290] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:30.781867 15999 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:30.782867 15996 leader_election.cc:336] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:30.783313 15996 leader_election.cc:304] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5, ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:30.784149 24373 raft_consensus.cc:2749] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:30.870425 15999 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:06:30.879763 15365 consensus_peers.cc:597] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:06:30.919104 15365 consensus_peers.cc:597] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:06:30.958724 15999 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:31.033231 14139 tablet_server.cc:179] TabletServer@127.13.206.195:0 shutting down...
W20260709 13:06:31.093041 15998 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:31.096240 15999 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:06:31.118906 24369 raft_consensus.cc:493] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:31.119611 24369 raft_consensus.cc:515] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:31.121696 15998 consensus_peers.cc:597] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:31.121869 24369 leader_election.cc:290] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:31.131109 15362 leader_election.cc:336] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:31.139375 15365 leader_election.cc:336] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:31.139850 15365 leader_election.cc:304] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:31.140780 24367 raft_consensus.cc:493] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:31.141443 24367 raft_consensus.cc:515] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
I20260709 13:06:31.144811 24327 raft_consensus.cc:2749] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:31.146273 24367 leader_election.cc:290] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
I20260709 13:06:31.146847 24367 raft_consensus.cc:493] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:31.147401 24367 raft_consensus.cc:515] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } }
W20260709 13:06:31.153278 15362 leader_election.cc:336] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:31.152920 24367 leader_election.cc:290] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:31.156719 15362 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:31.167146 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:31.169050 14139 tablet_replica.cc:333] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.170317 14139 raft_consensus.cc:2243] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.171082 14139 raft_consensus.cc:2272] T 92362862adca4227bb6dad04afd638cc P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.174300 15365 leader_election.cc:336] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:31.174928 15365 leader_election.cc:304] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:31.175793 24369 raft_consensus.cc:2749] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:31.177194 15365 leader_election.cc:336] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:31.177714 15365 leader_election.cc:304] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee9654803379434388de45d4693e6b16; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:31.178582 24369 raft_consensus.cc:2749] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:06:31.198925 15996 consensus_peers.cc:597] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:31.201759 14139 tablet_replica.cc:333] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.211858 14139 raft_consensus.cc:2243] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.213299 14139 raft_consensus.cc:2272] T 2fe8125185eb4429a9a0a58b14dd8636 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.213970 15998 consensus_peers.cc:597] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:31.221405 15365 consensus_peers.cc:597] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:06:31.224301 14139 tablet_replica.cc:333] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.225368 14139 raft_consensus.cc:2243] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:06:31.225778 15999 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:06:31.226877 14139 raft_consensus.cc:2272] T 8b6884fe16f4431a8b08af8e659ece9e P ee9654803379434388de45d4693e6b16 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.243178 15362 consensus_peers.cc:597] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:31.243980 15362 consensus_peers.cc:597] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:31.236843 14139 tablet_replica.cc:333] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16: stopping tablet replica
W20260709 13:06:31.243597 15998 consensus_peers.cc:597] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:31.245594 14139 raft_consensus.cc:2243] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.247251 14139 raft_consensus.cc:2272] T b0387b757aa040099c98e877245b7bfd P ee9654803379434388de45d4693e6b16 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.250690 15998 consensus_peers.cc:597] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:31.260053 14139 tablet_replica.cc:333] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.261094 14139 raft_consensus.cc:2243] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.261792 14139 raft_consensus.cc:2272] T 6183201d0cfc47c68ab021f085302aab P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.273700 14139 tablet_replica.cc:333] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.274660 14139 raft_consensus.cc:2243] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.275935 14139 raft_consensus.cc:2272] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.289804 14139 tablet_replica.cc:333] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.290864 14139 raft_consensus.cc:2243] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.292309 14139 raft_consensus.cc:2272] T f20d2caf56534c1ebcf23935582a5f03 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.299731 14139 tablet_replica.cc:333] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.300863 14139 raft_consensus.cc:2243] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.301944 14139 raft_consensus.cc:2272] T 49a44991403a4f8a851f90729c6ca783 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.302613 15998 consensus_peers.cc:597] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:31.317730 14139 tablet_replica.cc:333] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.318739 14139 raft_consensus.cc:2243] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.321750 14139 raft_consensus.cc:2272] T c0024621f21043e889d114f180f1dccb P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.325011 14139 tablet_replica.cc:333] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.325855 14139 raft_consensus.cc:2243] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.327248 14139 raft_consensus.cc:2272] T 907f0d82d81845029df5f0613caae65c P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.330437 14139 tablet_replica.cc:333] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.331225 14139 raft_consensus.cc:2243] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.332053 14139 raft_consensus.cc:2272] T 8dcb1955ebaf442cb75dba3471600141 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.334892 14139 tablet_replica.cc:333] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.335680 14139 raft_consensus.cc:2243] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.336985 14139 raft_consensus.cc:2272] T 79fb071c9f56456cade8cf3a14c85fc3 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.339828 14139 tablet_replica.cc:333] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.340636 14139 raft_consensus.cc:2243] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.342566 14139 raft_consensus.cc:2272] T 195ee90b7e844a81920e312f95fdda67 P ee9654803379434388de45d4693e6b16 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.343683 15999 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:31.345274 14139 tablet_replica.cc:333] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.346089 14139 raft_consensus.cc:2243] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.347090 14139 raft_consensus.cc:2272] T 66ab819064aa4b6faba9dff78296aa66 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.350150 14139 tablet_replica.cc:333] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.351011 14139 raft_consensus.cc:2243] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.351874 14139 raft_consensus.cc:2272] T fd1b68b8eb8145ee8bd4d3629784110f P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.354951 14139 tablet_replica.cc:333] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.356153 14139 raft_consensus.cc:2243] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.357440 14139 raft_consensus.cc:2272] T de7f843f60914a58b8b7e5a4a5e2ea6a P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.360163 14139 tablet_replica.cc:333] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.361006 14139 raft_consensus.cc:2243] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.362442 14139 raft_consensus.cc:2272] T 4365018e298c4531b7d90e25d9d6d144 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.365200 14139 tablet_replica.cc:333] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.365970 14139 raft_consensus.cc:2243] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.367238 14139 raft_consensus.cc:2272] T e82f23e062ad47fe80fac622dd633649 P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.369930 14139 tablet_replica.cc:333] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.370841 14139 raft_consensus.cc:2243] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.372246 14139 raft_consensus.cc:2272] T abeddff35e5145ef927db00bd12f7cff P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.375352 14139 tablet_replica.cc:333] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.376143 14139 raft_consensus.cc:2243] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.376844 14139 raft_consensus.cc:2272] T fad3ad4002954af28c1eccdf62948088 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.379720 14139 tablet_replica.cc:333] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.380532 14139 raft_consensus.cc:2243] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.381310 14139 raft_consensus.cc:2272] T f537e87ec99a4032a677e62627c567e2 P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.381755 15996 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:31.384244 14139 tablet_replica.cc:333] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.385229 14139 raft_consensus.cc:2243] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.386726 14139 raft_consensus.cc:2272] T 529df4c4ec9d4e33b83b594284860b0f P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.389856 14139 tablet_replica.cc:333] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.390698 14139 raft_consensus.cc:2243] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.391389 14139 raft_consensus.cc:2272] T 1389463201b74b128d916816a1d7c24c P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.394274 14139 tablet_replica.cc:333] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.395066 14139 raft_consensus.cc:2243] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.396749 14139 raft_consensus.cc:2272] T 41098c861400432692b47f484ad4dd2d P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.399672 14139 tablet_replica.cc:333] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.400506 14139 raft_consensus.cc:2243] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.401881 14139 raft_consensus.cc:2272] T 88815123db2d4b648ca4b8cc3257aa37 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.405082 14139 tablet_replica.cc:333] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.405875 14139 raft_consensus.cc:2243] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.407276 14139 raft_consensus.cc:2272] T 6b3be1966cf543b3b9832118d5f11aa2 P ee9654803379434388de45d4693e6b16 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.408154 15998 consensus_peers.cc:597] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:31.410120 14139 tablet_replica.cc:333] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.410989 14139 raft_consensus.cc:2243] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.413048 14139 raft_consensus.cc:2272] T c377e25836b14680beed769c143a593c P ee9654803379434388de45d4693e6b16 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.415948 14139 tablet_replica.cc:333] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.416738 14139 raft_consensus.cc:2243] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.417353 14139 raft_consensus.cc:2272] T 5db51018c5b04518b8cb7f3e5f2ca694 P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.420181 14139 tablet_replica.cc:333] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.420953 14139 raft_consensus.cc:2243] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:06:31.421936 15998 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:31.422495 14139 raft_consensus.cc:2272] T 4143f8a30ca74db8afb568dd88a99bc0 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.425532 14139 tablet_replica.cc:333] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.426419 14139 raft_consensus.cc:2243] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.427373 14139 raft_consensus.cc:2272] T a6d786e7c4904b39b63a5862d5a7e6f4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.430444 14139 tablet_replica.cc:333] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.431311 14139 raft_consensus.cc:2243] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.432107 14139 raft_consensus.cc:2272] T f3f21223b98c4cc6b8699008b5c6edc8 P ee9654803379434388de45d4693e6b16 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.435128 14139 tablet_replica.cc:333] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.435976 14139 raft_consensus.cc:2243] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.436802 14139 raft_consensus.cc:2272] T 4342f068b244466e9d599b81fd154374 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.439780 14139 tablet_replica.cc:333] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.440598 14139 raft_consensus.cc:2243] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.441748 14139 raft_consensus.cc:2272] T d44715ddcb564012b7a6c6eedb94b8e2 P ee9654803379434388de45d4693e6b16 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.444727 14139 tablet_replica.cc:333] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.445602 14139 raft_consensus.cc:2243] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.447099 14139 raft_consensus.cc:2272] T 99211c99c0ce4c1cb82fa7cea0ab410a P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.441834 15362 consensus_peers.cc:597] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:31.450053 14139 tablet_replica.cc:333] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.450910 14139 raft_consensus.cc:2243] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.452188 14139 raft_consensus.cc:2272] T 5704803490ae4e7bb7f8229734bd20df P ee9654803379434388de45d4693e6b16 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.455317 14139 tablet_replica.cc:333] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.457221 14139 raft_consensus.cc:2243] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.458678 14139 raft_consensus.cc:2272] T 705321025dc74b199219f4e541a68efa P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.461551 14139 tablet_replica.cc:333] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.462327 14139 raft_consensus.cc:2243] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.464222 14139 raft_consensus.cc:2272] T a9161d42f4f04ce8a5234d5b1cfeab22 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.468014 14139 tablet_replica.cc:333] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.468813 14139 raft_consensus.cc:2243] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.471024 14139 raft_consensus.cc:2272] T da67615b960b446d8df50fe1de2a0b3e P ee9654803379434388de45d4693e6b16 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.474056 14139 tablet_replica.cc:333] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.474939 14139 raft_consensus.cc:2243] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.476657 14139 raft_consensus.cc:2272] T 4fca62166204465d888036a111b60b66 P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.479734 14139 tablet_replica.cc:333] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.480506 14139 raft_consensus.cc:2243] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.481746 14139 raft_consensus.cc:2272] T 2a96142637d944dd8747c019a86e4864 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.484349 14139 tablet_replica.cc:333] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.485152 14139 raft_consensus.cc:2243] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.485754 14139 raft_consensus.cc:2272] T 521a10ac7e184bf1978bbe6947d0ca8d P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.488554 14139 tablet_replica.cc:333] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.489328 14139 raft_consensus.cc:2243] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.491179 14139 raft_consensus.cc:2272] T f72ca1a62ac74338a0ec5abd5a427bbf P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.493847 14139 tablet_replica.cc:333] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.494657 14139 raft_consensus.cc:2243] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.495877 14139 raft_consensus.cc:2272] T b29a6f3425a941868726620486fe7013 P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.498973 14139 tablet_replica.cc:333] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16: stopping tablet replica
W20260709 13:06:31.499687 15998 consensus_peers.cc:597] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:31.499727 14139 raft_consensus.cc:2243] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.509115 14139 raft_consensus.cc:2272] T 7ac2109e25f8401baf7141ea474e8bc4 P ee9654803379434388de45d4693e6b16 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.512200 14139 tablet_replica.cc:333] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.513185 14139 raft_consensus.cc:2243] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.513919 14139 raft_consensus.cc:2272] T 8f6ca66a81d04e56bccbc22cab55f4de P ee9654803379434388de45d4693e6b16 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.516995 14139 tablet_replica.cc:333] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.517968 14139 raft_consensus.cc:2243] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.519464 14139 raft_consensus.cc:2272] T 3b4a8d6a569c4998877fabab1b180c59 P ee9654803379434388de45d4693e6b16 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.522192 14139 tablet_replica.cc:333] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.522943 14139 raft_consensus.cc:2243] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.524420 14139 raft_consensus.cc:2272] T 0a3760e6bdc5424685fc319a53f0c819 P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.528131 14139 tablet_replica.cc:333] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.528431 24374 raft_consensus.cc:493] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:31.529090 14139 raft_consensus.cc:2243] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:06:31.529178 24374 raft_consensus.cc:515] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:31.531165 14139 raft_consensus.cc:2272] T ceb4d1b87e1c4966839d620a8aeaaf6a P ee9654803379434388de45d4693e6b16 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.534122 14139 tablet_replica.cc:333] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.535012 14139 raft_consensus.cc:2243] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:06:31.536767 15996 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:31.536866 14139 raft_consensus.cc:2272] T 525e3bab033946a090787fa86d1292aa P ee9654803379434388de45d4693e6b16 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.537475 15998 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:31.538097 15998 leader_election.cc:304] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:31.538983 24348 raft_consensus.cc:2749] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:06:31.539134 15999 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:06:31.537168 24374 leader_election.cc:290] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:31.541709 15999 leader_election.cc:336] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:31.542614 14139 tablet_replica.cc:333] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16: stopping tablet replica
I20260709 13:06:31.543259 14139 raft_consensus.cc:2243] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.543845 14139 raft_consensus.cc:2272] T 13d6106766cf4009837f848b4f8cbb1f P ee9654803379434388de45d4693e6b16 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:31.570909 15999 consensus_peers.cc:597] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:06:31.624416 15998 consensus_peers.cc:597] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 -> Peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Couldn't send request to peer ee9654803379434388de45d4693e6b16. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:31.644300 15996 consensus_peers.cc:597] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:31.666563 15996 consensus_peers.cc:597] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:31.688889 15996 consensus_peers.cc:597] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:31.757565 15999 consensus_peers.cc:597] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:06:31.842471 15996 consensus_peers.cc:597] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:31.952421 15996 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:32.102742 15996 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:32.134305 15996 consensus_peers.cc:597] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:32.229858 24373 raft_consensus.cc:493] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:32.230515 24373 raft_consensus.cc:515] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.232811 24373 leader_election.cc:290] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635)
W20260709 13:06:32.237793 15999 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:32.239893 15996 leader_election.cc:336] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:32.240363 15996 leader_election.cc:304] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:32.240376 15999 consensus_peers.cc:597] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:06:32.241178 24373 raft_consensus.cc:2749] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:32.370152 15999 consensus_peers.cc:597] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:06:32.476480 15996 consensus_peers.cc:597] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:32.514178 24375 raft_consensus.cc:493] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.514807 24375 raft_consensus.cc:515] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.517488 24375 leader_election.cc:290] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.523418 15996 leader_election.cc:336] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:32.524065 15999 leader_election.cc:336] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:32.524485 15999 leader_election.cc:304] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
I20260709 13:06:32.525393 24375 raft_consensus.cc:2749] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:32.527961 15998 leader_election.cc:336] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
I20260709 13:06:32.543781 24375 raft_consensus.cc:493] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.544365 24375 raft_consensus.cc:515] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.545616 24348 raft_consensus.cc:493] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.546445 24375 leader_election.cc:290] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
I20260709 13:06:32.546262 24348 raft_consensus.cc:515] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.548517 24348 leader_election.cc:290] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.555048 15999 leader_election.cc:336] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:32.556406 15998 leader_election.cc:336] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
W20260709 13:06:32.556574 15996 leader_election.cc:336] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:32.556979 15998 leader_election.cc:304] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:32.557776 24348 raft_consensus.cc:2749] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:32.557943 15998 leader_election.cc:336] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
I20260709 13:06:32.558494 15998 leader_election.cc:304] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:32.559212 24348 raft_consensus.cc:2749] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:32.564194 24348 raft_consensus.cc:493] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.564778 24348 raft_consensus.cc:515] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.567056 24348 leader_election.cc:290] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.571898 15998 leader_election.cc:336] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
W20260709 13:06:32.572866 15996 leader_election.cc:336] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:32.573307 15996 leader_election.cc:304] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:32.574002 24348 raft_consensus.cc:2749] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:32.579973 24348 raft_consensus.cc:493] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.580576 24348 raft_consensus.cc:515] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.582931 24348 leader_election.cc:290] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.587533 15996 leader_election.cc:336] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:32.588373 15998 leader_election.cc:336] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
I20260709 13:06:32.588792 15998 leader_election.cc:304] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:32.589517 24348 raft_consensus.cc:2749] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:32.630280 24373 raft_consensus.cc:493] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.630883 24373 raft_consensus.cc:515] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.633077 24373 leader_election.cc:290] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.639889 15998 leader_election.cc:336] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
W20260709 13:06:32.643564 15999 leader_election.cc:336] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:32.644029 15999 leader_election.cc:304] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:32.645808 24373 raft_consensus.cc:2749] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:32.650024 24373 raft_consensus.cc:493] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.650594 24373 raft_consensus.cc:515] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.652851 24373 leader_election.cc:290] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.657660 15998 leader_election.cc:336] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
W20260709 13:06:32.658193 15999 leader_election.cc:336] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:32.658644 15999 leader_election.cc:304] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:32.659269 24373 raft_consensus.cc:2749] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:32.660166 24373 raft_consensus.cc:493] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.660635 24373 raft_consensus.cc:515] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.666961 24373 leader_election.cc:290] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.668992 15996 leader_election.cc:336] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
W20260709 13:06:32.670388 15999 leader_election.cc:336] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:32.670959 15999 leader_election.cc:304] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, 89940175e5444593aab6b3a025624b5b
W20260709 13:06:32.672331 15998 leader_election.cc:336] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
I20260709 13:06:32.672730 24373 raft_consensus.cc:2749] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:32.716636 24373 raft_consensus.cc:493] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 45ddec37d9e741a598bf32f6c9d7e0ee)
I20260709 13:06:32.717198 24373 raft_consensus.cc:515] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } attrs { replace: true } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.719374 24348 raft_consensus.cc:493] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.719981 24348 raft_consensus.cc:515] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } attrs { replace: true } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.725649 24348 leader_election.cc:290] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.727386 15999 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
W20260709 13:06:32.729768 15998 leader_election.cc:336] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
W20260709 13:06:32.731930 15999 leader_election.cc:336] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:32.733688 15999 leader_election.cc:304] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:06:32.734447 15996 leader_election.cc:336] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:32.735950 24348 raft_consensus.cc:2749] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:32.739203 24373 leader_election.cc:290] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.741658 15998 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
I20260709 13:06:32.742338 15998 leader_election.cc:304] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
W20260709 13:06:32.742918 15996 leader_election.cc:336] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:32.744234 24348 raft_consensus.cc:2749] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:32.758519 24373 raft_consensus.cc:493] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.759166 24373 raft_consensus.cc:515] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89940175e5444593aab6b3a025624b5b" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 43213 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.764909 24373 leader_election.cc:290] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.766680 15998 leader_election.cc:336] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
I20260709 13:06:32.768759 24373 raft_consensus.cc:493] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
W20260709 13:06:32.768926 15999 leader_election.cc:336] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:32.769558 15999 leader_election.cc:304] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 89940175e5444593aab6b3a025624b5b, ee9654803379434388de45d4693e6b16
I20260709 13:06:32.769543 24373 raft_consensus.cc:515] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.770654 24348 raft_consensus.cc:2749] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:32.777328 15996 leader_election.cc:336] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:32.775211 24373 leader_election.cc:290] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.778059 15998 leader_election.cc:336] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
I20260709 13:06:32.778510 15998 leader_election.cc:304] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
W20260709 13:06:32.779039 15179 debug-util.cc:398] Leaking SignalData structure 0x7b0800174720 after lost signal to thread 14142
I20260709 13:06:32.779446 24373 raft_consensus.cc:2749] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:32.780195 15179 debug-util.cc:398] Leaking SignalData structure 0x7b08003b4cc0 after lost signal to thread 15182
W20260709 13:06:32.781605 15179 debug-util.cc:398] Leaking SignalData structure 0x7b08001f39a0 after lost signal to thread 16057
W20260709 13:06:32.836185 15996 consensus_peers.cc:597] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 -> Peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Couldn't send request to peer 45ddec37d9e741a598bf32f6c9d7e0ee. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:32.916392 24373 raft_consensus.cc:493] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader ee9654803379434388de45d4693e6b16)
I20260709 13:06:32.917055 24373 raft_consensus.cc:515] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "45ddec37d9e741a598bf32f6c9d7e0ee" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 34635 } } peers { permanent_uuid: "ee9654803379434388de45d4693e6b16" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 44417 } } peers { permanent_uuid: "edcf4a6bae7e4781bce325a586109ca5" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 38543 } attrs { promote: false } }
I20260709 13:06:32.919835 14139 tablet_server.cc:196] TabletServer@127.13.206.195:0 shutdown complete.
I20260709 13:06:32.920763 24373 leader_election.cc:290] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635), ee9654803379434388de45d4693e6b16 (127.13.206.195:44417)
W20260709 13:06:32.929250 15998 leader_election.cc:336] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer ee9654803379434388de45d4693e6b16 (127.13.206.195:44417): Network error: Client connection negotiation failed: client connection to 127.13.206.195:44417: connect: Connection refused (error 111)
W20260709 13:06:32.936421 15996 leader_election.cc:336] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 45ddec37d9e741a598bf32f6c9d7e0ee (127.13.206.194:34635): Network error: Client connection negotiation failed: client connection to 127.13.206.194:34635: connect: Connection refused (error 111)
I20260709 13:06:32.937062 15996 leader_election.cc:304] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edcf4a6bae7e4781bce325a586109ca5; no voters: 45ddec37d9e741a598bf32f6c9d7e0ee, ee9654803379434388de45d4693e6b16
I20260709 13:06:32.937915 24373 raft_consensus.cc:2749] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:32.967568 15999 consensus_peers.cc:597] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 -> Peer 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): Couldn't send request to peer 89940175e5444593aab6b3a025624b5b. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:06:33.033322 14139 tablet_server.cc:179] TabletServer@127.13.206.196:0 shutting down...
I20260709 13:06:33.090860 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:33.091831 14139 tablet_replica.cc:333] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.093116 14139 raft_consensus.cc:2243] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.094273 14139 raft_consensus.cc:2272] T 705321025dc74b199219f4e541a68efa P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.098802 14139 tablet_replica.cc:333] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.100052 14139 raft_consensus.cc:2243] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.100914 14139 raft_consensus.cc:2272] T f72ca1a62ac74338a0ec5abd5a427bbf P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.104694 14139 tablet_replica.cc:333] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.105849 14139 raft_consensus.cc:2243] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.106938 14139 raft_consensus.cc:2272] T 7ac2109e25f8401baf7141ea474e8bc4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.111195 14139 tablet_replica.cc:333] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.112273 14139 raft_consensus.cc:2243] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.113312 14139 raft_consensus.cc:2272] T 0a3760e6bdc5424685fc319a53f0c819 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.117146 14139 tablet_replica.cc:333] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.118186 14139 raft_consensus.cc:2243] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.119907 14139 raft_consensus.cc:2272] T 4fca62166204465d888036a111b60b66 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.123823 14139 tablet_replica.cc:333] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.125022 14139 raft_consensus.cc:2243] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.125993 14139 raft_consensus.cc:2272] T 529df4c4ec9d4e33b83b594284860b0f P edcf4a6bae7e4781bce325a586109ca5 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.130098 14139 tablet_replica.cc:333] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.131093 14139 raft_consensus.cc:2243] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.132525 14139 raft_consensus.cc:2272] T b9e997bc5c2942178cde4c670df97100 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.137105 14139 tablet_replica.cc:333] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.139071 14139 raft_consensus.cc:2243] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.139922 14139 raft_consensus.cc:2272] T f20d2caf56534c1ebcf23935582a5f03 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.143173 14139 tablet_replica.cc:333] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.144083 14139 raft_consensus.cc:2243] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.146155 14139 raft_consensus.cc:2272] T e5288c8dc0fe4b7aabc37377e0bc0371 P edcf4a6bae7e4781bce325a586109ca5 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.150337 14139 tablet_replica.cc:333] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.151242 14139 raft_consensus.cc:2243] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.152566 14139 raft_consensus.cc:2272] T 13d6106766cf4009837f848b4f8cbb1f P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.155812 14139 tablet_replica.cc:333] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.156774 14139 raft_consensus.cc:2243] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.157554 14139 raft_consensus.cc:2272] T 79fb071c9f56456cade8cf3a14c85fc3 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.160964 14139 tablet_replica.cc:333] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.162000 14139 raft_consensus.cc:2243] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.163483 14139 raft_consensus.cc:2272] T b29a6f3425a941868726620486fe7013 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.166724 14139 tablet_replica.cc:333] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.167665 14139 raft_consensus.cc:2243] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.169108 14139 raft_consensus.cc:2272] T a6d786e7c4904b39b63a5862d5a7e6f4 P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.172802 14139 tablet_replica.cc:333] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.173713 14139 raft_consensus.cc:2243] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.174463 14139 raft_consensus.cc:2272] T b0387b757aa040099c98e877245b7bfd P edcf4a6bae7e4781bce325a586109ca5 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.177460 14139 tablet_replica.cc:333] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.178392 14139 raft_consensus.cc:2243] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.179077 14139 raft_consensus.cc:2272] T e82f23e062ad47fe80fac622dd633649 P edcf4a6bae7e4781bce325a586109ca5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.182142 14139 tablet_replica.cc:333] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.183077 14139 raft_consensus.cc:2243] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.184350 14139 raft_consensus.cc:2272] T 99211c99c0ce4c1cb82fa7cea0ab410a P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.187394 14139 tablet_replica.cc:333] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.188210 14139 raft_consensus.cc:2243] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.189397 14139 raft_consensus.cc:2272] T 5db51018c5b04518b8cb7f3e5f2ca694 P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.192359 14139 tablet_replica.cc:333] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.193274 14139 raft_consensus.cc:2243] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.194608 14139 raft_consensus.cc:2272] T 0fa77b7aa76c4cce87f6d985fe8e1d3a P edcf4a6bae7e4781bce325a586109ca5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.197700 14139 tablet_replica.cc:333] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.198583 14139 raft_consensus.cc:2243] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.199477 14139 raft_consensus.cc:2272] T c377e25836b14680beed769c143a593c P edcf4a6bae7e4781bce325a586109ca5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.202877 14139 tablet_replica.cc:333] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.203671 14139 raft_consensus.cc:2243] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.204267 14139 raft_consensus.cc:2272] T 6b3be1966cf543b3b9832118d5f11aa2 P edcf4a6bae7e4781bce325a586109ca5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.207146 14139 tablet_replica.cc:333] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.207839 14139 raft_consensus.cc:2243] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.208994 14139 raft_consensus.cc:2272] T 87a9a9eccfa9436c993e85bfe0343332 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.211936 14139 tablet_replica.cc:333] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.212711 14139 raft_consensus.cc:2243] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.213922 14139 raft_consensus.cc:2272] T 4342f068b244466e9d599b81fd154374 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.216862 14139 tablet_replica.cc:333] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.217626 14139 raft_consensus.cc:2243] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.218775 14139 raft_consensus.cc:2272] T 6183201d0cfc47c68ab021f085302aab P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.221576 14139 tablet_replica.cc:333] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.222326 14139 raft_consensus.cc:2243] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.225013 14139 raft_consensus.cc:2272] T 3b4a8d6a569c4998877fabab1b180c59 P edcf4a6bae7e4781bce325a586109ca5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.228247 14139 tablet_replica.cc:333] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.228996 14139 raft_consensus.cc:2243] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.230329 14139 raft_consensus.cc:2272] T e71ec5b3198446c0a387428e2a4eb753 P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.233372 14139 tablet_replica.cc:333] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.234123 14139 raft_consensus.cc:2243] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.234786 14139 raft_consensus.cc:2272] T 5704803490ae4e7bb7f8229734bd20df P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.237614 14139 tablet_replica.cc:333] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.238415 14139 raft_consensus.cc:2243] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.239859 14139 raft_consensus.cc:2272] T f537e87ec99a4032a677e62627c567e2 P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.243117 14139 tablet_replica.cc:333] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.243903 14139 raft_consensus.cc:2243] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.244678 14139 raft_consensus.cc:2272] T abb86a150e844b848bc103f128d39a82 P edcf4a6bae7e4781bce325a586109ca5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.247701 14139 tablet_replica.cc:333] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.248488 14139 raft_consensus.cc:2243] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.249856 14139 raft_consensus.cc:2272] T 2d3f2b48b18a47388a0e1497a84803ff P edcf4a6bae7e4781bce325a586109ca5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.253011 14139 tablet_replica.cc:333] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.253791 14139 raft_consensus.cc:2243] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.255050 14139 raft_consensus.cc:2272] T a64e06dc30ff4dfebdb052a6f7228046 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.258204 14139 tablet_replica.cc:333] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.258988 14139 raft_consensus.cc:2243] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.260176 14139 raft_consensus.cc:2272] T 68e68ea4eb05497288804ad7aefb241e P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.263144 14139 tablet_replica.cc:333] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.263849 14139 raft_consensus.cc:2243] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:33.264982 14139 raft_consensus.cc:2272] T 521a10ac7e184bf1978bbe6947d0ca8d P edcf4a6bae7e4781bce325a586109ca5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.268888 14139 tablet_replica.cc:333] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.269659 14139 raft_consensus.cc:2243] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.270517 14139 raft_consensus.cc:2272] T da67615b960b446d8df50fe1de2a0b3e P edcf4a6bae7e4781bce325a586109ca5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.273876 14139 tablet_replica.cc:333] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.274600 14139 raft_consensus.cc:2243] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.275533 14139 raft_consensus.cc:2272] T 8b6884fe16f4431a8b08af8e659ece9e P edcf4a6bae7e4781bce325a586109ca5 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.278425 14139 tablet_replica.cc:333] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5: stopping tablet replica
I20260709 13:06:33.279122 14139 raft_consensus.cc:2243] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:33.279942 14139 raft_consensus.cc:2272] T 76857f06f24d4d9183e84f52d83bf070 P edcf4a6bae7e4781bce325a586109ca5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:33.815796 14139 tablet_server.cc:196] TabletServer@127.13.206.196:0 shutdown complete.
I20260709 13:06:33.883030 14139 master.cc:562] Master@127.13.206.254:45539 shutting down...
W20260709 13:06:33.921612 15196 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:06:33.921949 15196 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:06:33.922160 15196 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:06:45.462472 15135 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111) [suppressed 273 similar messages]
W20260709 13:06:45.466351 15135 catalog_manager.cc:4755] TS 89940175e5444593aab6b3a025624b5b (127.13.206.193:43213): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 4fca62166204465d888036a111b60b66: Network error: Client connection negotiation failed: client connection to 127.13.206.193:43213: connect: Connection refused (error 111)
I20260709 13:06:47.540030 14139 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:06:47.541175 14139 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:47.541582 14139 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6c48b19b0ac74d678c9f752e98013b9a: stopping tablet replica
I20260709 13:06:47.756505 14139 master.cc:584] Master@127.13.206.254:45539 shutdown complete.
I20260709 13:06:47.810972 14139 test_util.cc:182] -----------------------------------------------
I20260709 13:06:47.811189 14139 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602098938719-14139-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (285133 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:06:47.814989 14139 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.206.254:42253
I20260709 13:06:47.816182 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:47.822350 24380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:47.822386 24381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:47.822669 24383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:47.824087 14139 server_base.cc:1061] running on GCE node
I20260709 13:06:47.827376 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:47.827610 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:47.827723 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602407827712 us; error 0 us; skew 500 ppm
I20260709 13:06:47.828190 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:47.830696 14139 webserver.cc:533] Webserver started at http://127.13.206.254:43977/ using document root <none> and password file <none>
I20260709 13:06:47.831171 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:47.831327 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:47.831559 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:47.832957 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/master-0-root/instance:
uuid: "8363ad02838347f2863b396b0be1ea69"
format_stamp: "Formatted at 2026-07-09 13:06:47 on dist-test-slave-ml7r"
I20260709 13:06:47.838374 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.007s
I20260709 13:06:47.841935 24388 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:47.842833 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:06:47.843189 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/master-0-root
uuid: "8363ad02838347f2863b396b0be1ea69"
format_stamp: "Formatted at 2026-07-09 13:06:47 on dist-test-slave-ml7r"
I20260709 13:06:47.843473 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:47.863897 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:47.865172 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:47.905578 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.254:42253
I20260709 13:06:47.905684 24439 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.254:42253 every 8 connection(s)
I20260709 13:06:47.909912 24440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:47.922691 24440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69: Bootstrap starting.
I20260709 13:06:47.927675 24440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:47.932199 24440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69: No bootstrap required, opened a new log
I20260709 13:06:47.934562 24440 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8363ad02838347f2863b396b0be1ea69" member_type: VOTER }
I20260709 13:06:47.935017 24440 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:47.935202 24440 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8363ad02838347f2863b396b0be1ea69, State: Initialized, Role: FOLLOWER
I20260709 13:06:47.935797 24440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8363ad02838347f2863b396b0be1ea69" member_type: VOTER }
I20260709 13:06:47.936269 24440 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:06:47.936471 24440 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:06:47.936690 24440 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:47.941529 24440 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8363ad02838347f2863b396b0be1ea69" member_type: VOTER }
I20260709 13:06:47.942044 24440 leader_election.cc:304] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8363ad02838347f2863b396b0be1ea69; no voters: 
I20260709 13:06:47.943214 24440 leader_election.cc:290] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:06:47.943569 24443 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:47.945080 24443 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 1 LEADER]: Becoming Leader. State: Replica: 8363ad02838347f2863b396b0be1ea69, State: Running, Role: LEADER
I20260709 13:06:47.945917 24443 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8363ad02838347f2863b396b0be1ea69" member_type: VOTER }
I20260709 13:06:47.946687 24440 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:06:47.952844 24445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8363ad02838347f2863b396b0be1ea69. Latest consensus state: current_term: 1 leader_uuid: "8363ad02838347f2863b396b0be1ea69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8363ad02838347f2863b396b0be1ea69" member_type: VOTER } }
I20260709 13:06:47.952903 24444 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8363ad02838347f2863b396b0be1ea69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8363ad02838347f2863b396b0be1ea69" member_type: VOTER } }
I20260709 13:06:47.953709 24445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:47.953861 24444 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [sys.catalog]: This master's current role is: LEADER
I20260709 13:06:47.956035 24451 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:06:47.961383 24451 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:06:47.964035 14139 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:06:47.971040 24451 catalog_manager.cc:1383] Generated new cluster ID: 524786b694eb4e409c203c9b7c36dadc
I20260709 13:06:47.971340 24451 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:06:47.997045 24451 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:06:47.998415 24451 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:06:48.011092 24451 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69: Generated new TSK 0
I20260709 13:06:48.011750 24451 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:06:48.030789 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:48.037168 24461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:48.038108 24462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:48.040107 24464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:48.041412 14139 server_base.cc:1061] running on GCE node
I20260709 13:06:48.043916 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:48.044179 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:48.044363 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602408044342 us; error 0 us; skew 500 ppm
I20260709 13:06:48.044970 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:48.047508 14139 webserver.cc:533] Webserver started at http://127.13.206.193:35079/ using document root <none> and password file <none>
I20260709 13:06:48.048008 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:48.048210 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:48.048525 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:48.050345 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/instance:
uuid: "7e0390f5bd00484985fa5469e25be18d"
format_stamp: "Formatted at 2026-07-09 13:06:48 on dist-test-slave-ml7r"
I20260709 13:06:48.055094 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:06:48.058816 24469 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.059788 14139 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:06:48.060185 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-0-root
uuid: "7e0390f5bd00484985fa5469e25be18d"
format_stamp: "Formatted at 2026-07-09 13:06:48 on dist-test-slave-ml7r"
I20260709 13:06:48.060521 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:48.087909 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:48.089087 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:48.090596 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:48.093039 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:48.093237 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.093567 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:48.093776 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.136420 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.193:40253
I20260709 13:06:48.136528 24531 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.193:40253 every 8 connection(s)
I20260709 13:06:48.141798 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:48.150374 24536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:48.151666 24537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:48.155097 24539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:48.156421 14139 server_base.cc:1061] running on GCE node
I20260709 13:06:48.158140 24532 heartbeater.cc:344] Connected to a master server at 127.13.206.254:42253
I20260709 13:06:48.158627 24532 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:48.159462 24532 heartbeater.cc:507] Master 127.13.206.254:42253 requested a full tablet report, sending...
I20260709 13:06:48.159811 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:48.160089 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:48.160271 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602408160254 us; error 0 us; skew 500 ppm
I20260709 13:06:48.161036 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:48.161953 24405 ts_manager.cc:194] Registered new tserver with Master: 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:48.163992 14139 webserver.cc:533] Webserver started at http://127.13.206.194:43957/ using document root <none> and password file <none>
I20260709 13:06:48.164400 24405 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45160
I20260709 13:06:48.164589 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:48.164955 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:48.165264 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:48.166777 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/instance:
uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
format_stamp: "Formatted at 2026-07-09 13:06:48 on dist-test-slave-ml7r"
I20260709 13:06:48.171383 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:06:48.175158 24544 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.176077 14139 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:06:48.176493 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-1-root
uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
format_stamp: "Formatted at 2026-07-09 13:06:48 on dist-test-slave-ml7r"
I20260709 13:06:48.176916 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:48.194674 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:48.195914 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:48.197391 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:48.199923 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:48.200145 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.200424 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:48.200591 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.243726 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.194:46385
I20260709 13:06:48.243831 24606 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.194:46385 every 8 connection(s)
I20260709 13:06:48.249320 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:48.258520 24611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:48.258977 24610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:48.262099 24607 heartbeater.cc:344] Connected to a master server at 127.13.206.254:42253
I20260709 13:06:48.262720 24607 heartbeater.cc:461] Registering TS with master...
W20260709 13:06:48.263051 24613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:48.263255 14139 server_base.cc:1061] running on GCE node
I20260709 13:06:48.263842 24607 heartbeater.cc:507] Master 127.13.206.254:42253 requested a full tablet report, sending...
I20260709 13:06:48.264398 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:48.264662 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:48.264853 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602408264838 us; error 0 us; skew 500 ppm
I20260709 13:06:48.265465 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:48.266148 24405 ts_manager.cc:194] Registered new tserver with Master: 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:48.267872 24405 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45170
I20260709 13:06:48.268289 14139 webserver.cc:533] Webserver started at http://127.13.206.195:34843/ using document root <none> and password file <none>
I20260709 13:06:48.268867 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:48.269088 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:48.269397 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:48.271157 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/instance:
uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
format_stamp: "Formatted at 2026-07-09 13:06:48 on dist-test-slave-ml7r"
I20260709 13:06:48.275905 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:06:48.279562 24618 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.280388 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:06:48.280678 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-2-root
uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
format_stamp: "Formatted at 2026-07-09 13:06:48 on dist-test-slave-ml7r"
I20260709 13:06:48.280925 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:48.296963 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:48.298334 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:48.299826 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:48.302297 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:48.302548 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.302836 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:48.303001 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.347617 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.195:41635
I20260709 13:06:48.347714 24680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.195:41635 every 8 connection(s)
I20260709 13:06:48.352979 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:06:48.361544 24684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:48.362399 24685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:06:48.364952 24687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:06:48.365003 14139 server_base.cc:1061] running on GCE node
I20260709 13:06:48.366737 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:06:48.367064 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:06:48.367308 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602408367291 us; error 0 us; skew 500 ppm
I20260709 13:06:48.368042 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:06:48.368052 24681 heartbeater.cc:344] Connected to a master server at 127.13.206.254:42253
I20260709 13:06:48.368631 24681 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:48.369716 24681 heartbeater.cc:507] Master 127.13.206.254:42253 requested a full tablet report, sending...
I20260709 13:06:48.370942 14139 webserver.cc:533] Webserver started at http://127.13.206.196:39807/ using document root <none> and password file <none>
I20260709 13:06:48.371688 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:06:48.371896 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:06:48.372174 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:06:48.372150 24405 ts_manager.cc:194] Registered new tserver with Master: 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:48.373664 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-3-root/instance:
uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
format_stamp: "Formatted at 2026-07-09 13:06:48 on dist-test-slave-ml7r"
I20260709 13:06:48.373692 24405 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45174
I20260709 13:06:48.378752 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:06:48.382544 24692 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.383332 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:06:48.383685 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-3-root
uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
format_stamp: "Formatted at 2026-07-09 13:06:48 on dist-test-slave-ml7r"
I20260709 13:06:48.383993 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:06:48.400714 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:06:48.402065 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:06:48.403683 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:06:48.406284 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:06:48.406550 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.406823 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:06:48.407011 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:06:48.450949 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.196:34879
I20260709 13:06:48.451046 24754 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.196:34879 every 8 connection(s)
I20260709 13:06:48.465751 24755 heartbeater.cc:344] Connected to a master server at 127.13.206.254:42253
I20260709 13:06:48.466339 24755 heartbeater.cc:461] Registering TS with master...
I20260709 13:06:48.467161 24755 heartbeater.cc:507] Master 127.13.206.254:42253 requested a full tablet report, sending...
I20260709 13:06:48.469275 24405 ts_manager.cc:194] Registered new tserver with Master: 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:48.469632 14139 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01539681s
I20260709 13:06:48.470860 24405 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45190
I20260709 13:06:48.498616 24405 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45202:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:06:48.754566 24571 tablet_service.cc:1511] Processing CreateTablet for tablet df4698536ba648bb9b505f77a4cef71b (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:48.755791 24572 tablet_service.cc:1511] Processing CreateTablet for tablet 90e8fa226feb408abe09d6269eafb209 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:48.757849 24570 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7db6e3ae894339b05d8598c9df859e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:48.760617 24569 tablet_service.cc:1511] Processing CreateTablet for tablet 56de0c37502d4e8d80b19f4427f256b0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:48.761690 24716 tablet_service.cc:1511] Processing CreateTablet for tablet b66a54bd402a430e8012e83b9926ed3c (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:48.763329 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66a54bd402a430e8012e83b9926ed3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.763530 24720 tablet_service.cc:1511] Processing CreateTablet for tablet 44c7563825eb4e418fa6c9e6a8488191 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:48.765164 24720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c7563825eb4e418fa6c9e6a8488191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.765002 24717 tablet_service.cc:1511] Processing CreateTablet for tablet 508d2533e8754d53924aecd87664e4fa (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:48.767657 24567 tablet_service.cc:1511] Processing CreateTablet for tablet 6357dd272feb4d93ab11f73b1e3bead5 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:48.770584 24718 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7db6e3ae894339b05d8598c9df859e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:48.770781 24497 tablet_service.cc:1511] Processing CreateTablet for tablet 44c7563825eb4e418fa6c9e6a8488191 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:48.772219 24718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7db6e3ae894339b05d8598c9df859e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.772361 24497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c7563825eb4e418fa6c9e6a8488191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.774658 24717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508d2533e8754d53924aecd87664e4fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.775633 24496 tablet_service.cc:1511] Processing CreateTablet for tablet 90e8fa226feb408abe09d6269eafb209 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:48.777423 24496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e8fa226feb408abe09d6269eafb209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.775727 24719 tablet_service.cc:1511] Processing CreateTablet for tablet df4698536ba648bb9b505f77a4cef71b (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:48.778038 24568 tablet_service.cc:1511] Processing CreateTablet for tablet 508d2533e8754d53924aecd87664e4fa (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:48.779279 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4698536ba648bb9b505f77a4cef71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.756304 24571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4698536ba648bb9b505f77a4cef71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.780539 24568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508d2533e8754d53924aecd87664e4fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.781232 24572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e8fa226feb408abe09d6269eafb209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.782217 24570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7db6e3ae894339b05d8598c9df859e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.786173 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56de0c37502d4e8d80b19f4427f256b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.787248 24495 tablet_service.cc:1511] Processing CreateTablet for tablet df4698536ba648bb9b505f77a4cef71b (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:06:48.788857 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4698536ba648bb9b505f77a4cef71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.789687 24567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6357dd272feb4d93ab11f73b1e3bead5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.792104 24494 tablet_service.cc:1511] Processing CreateTablet for tablet 56de0c37502d4e8d80b19f4427f256b0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:48.795929 24493 tablet_service.cc:1511] Processing CreateTablet for tablet 508d2533e8754d53924aecd87664e4fa (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:06:48.797559 24493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 508d2533e8754d53924aecd87664e4fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.798867 24494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56de0c37502d4e8d80b19f4427f256b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.799503 24492 tablet_service.cc:1511] Processing CreateTablet for tablet b66a54bd402a430e8012e83b9926ed3c (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:48.801187 24492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66a54bd402a430e8012e83b9926ed3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.803562 24566 tablet_service.cc:1511] Processing CreateTablet for tablet 3106acd049af4538a29a53f816570f50 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:48.805164 24566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3106acd049af4538a29a53f816570f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.807832 24715 tablet_service.cc:1511] Processing CreateTablet for tablet 6357dd272feb4d93ab11f73b1e3bead5 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:48.809870 24715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6357dd272feb4d93ab11f73b1e3bead5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.831676 24565 tablet_service.cc:1511] Processing CreateTablet for tablet 6061c3782cb742d0895cd3cb6892588e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:48.833315 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6061c3782cb742d0895cd3cb6892588e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.837105 24644 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7db6e3ae894339b05d8598c9df859e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:06:48.838608 24714 tablet_service.cc:1511] Processing CreateTablet for tablet 6061c3782cb742d0895cd3cb6892588e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:48.839612 24642 tablet_service.cc:1511] Processing CreateTablet for tablet b66a54bd402a430e8012e83b9926ed3c (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:06:48.840197 24714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6061c3782cb742d0895cd3cb6892588e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.841660 24713 tablet_service.cc:1511] Processing CreateTablet for tablet 58f9a01ed3924f7e8f9e3b4e2cd343d0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:48.841784 24641 tablet_service.cc:1511] Processing CreateTablet for tablet 6357dd272feb4d93ab11f73b1e3bead5 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:06:48.843330 24713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f9a01ed3924f7e8f9e3b4e2cd343d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.843602 24646 tablet_service.cc:1511] Processing CreateTablet for tablet 44c7563825eb4e418fa6c9e6a8488191 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:06:48.844045 24640 tablet_service.cc:1511] Processing CreateTablet for tablet 3106acd049af4538a29a53f816570f50 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:48.844303 24491 tablet_service.cc:1511] Processing CreateTablet for tablet 3106acd049af4538a29a53f816570f50 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:06:48.845715 24491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3106acd049af4538a29a53f816570f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.845757 24645 tablet_service.cc:1511] Processing CreateTablet for tablet 90e8fa226feb408abe09d6269eafb209 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:06:48.847064 24643 tablet_service.cc:1511] Processing CreateTablet for tablet 56de0c37502d4e8d80b19f4427f256b0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:06:48.849845 24644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7db6e3ae894339b05d8598c9df859e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.856263 24490 tablet_service.cc:1511] Processing CreateTablet for tablet 6061c3782cb742d0895cd3cb6892588e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:06:48.856318 24639 tablet_service.cc:1511] Processing CreateTablet for tablet 58f9a01ed3924f7e8f9e3b4e2cd343d0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:48.857944 24490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6061c3782cb742d0895cd3cb6892588e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.863833 24564 tablet_service.cc:1511] Processing CreateTablet for tablet 29f50121b46a470a88a2ca466f285339 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:48.865556 24564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f50121b46a470a88a2ca466f285339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.870975 24640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3106acd049af4538a29a53f816570f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.871901 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6357dd272feb4d93ab11f73b1e3bead5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.871675 24489 tablet_service.cc:1511] Processing CreateTablet for tablet 58f9a01ed3924f7e8f9e3b4e2cd343d0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:06:48.873209 24489 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f9a01ed3924f7e8f9e3b4e2cd343d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.874975 24645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90e8fa226feb408abe09d6269eafb209. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.878659 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66a54bd402a430e8012e83b9926ed3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.879459 24639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58f9a01ed3924f7e8f9e3b4e2cd343d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.880265 24643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56de0c37502d4e8d80b19f4427f256b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.880978 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44c7563825eb4e418fa6c9e6a8488191. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.891274 24638 tablet_service.cc:1511] Processing CreateTablet for tablet 29f50121b46a470a88a2ca466f285339 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:48.891903 24720 tablet_service.cc:1511] Processing CreateTablet for tablet 29f50121b46a470a88a2ca466f285339 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:06:48.892885 24638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f50121b46a470a88a2ca466f285339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.893260 24720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29f50121b46a470a88a2ca466f285339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.898898 24488 tablet_service.cc:1511] Processing CreateTablet for tablet d1987f47fa594dbbac6f13e3ffaac7ba (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:48.900561 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1987f47fa594dbbac6f13e3ffaac7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.903456 24637 tablet_service.cc:1511] Processing CreateTablet for tablet d1987f47fa594dbbac6f13e3ffaac7ba (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:48.903640 24563 tablet_service.cc:1511] Processing CreateTablet for tablet d1987f47fa594dbbac6f13e3ffaac7ba (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:06:48.905165 24637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1987f47fa594dbbac6f13e3ffaac7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.905289 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1987f47fa594dbbac6f13e3ffaac7ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:48.910940 24775 tablet_bootstrap.cc:492] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:48.948458 24716 tablet_service.cc:1511] Processing CreateTablet for tablet adface6ea0a7412bab90d65a3ed77df8 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:48.950090 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adface6ea0a7412bab90d65a3ed77df8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:48.960592 24453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:49.011847 24565 tablet_service.cc:1511] Processing CreateTablet for tablet adface6ea0a7412bab90d65a3ed77df8 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:49.023676 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adface6ea0a7412bab90d65a3ed77df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.033263 24646 tablet_service.cc:1511] Processing CreateTablet for tablet 827bf9c0d4a14d209cbef1837ddb425d (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:49.043896 24778 tablet_bootstrap.cc:492] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:49.044945 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827bf9c0d4a14d209cbef1837ddb425d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.049443 24488 tablet_service.cc:1511] Processing CreateTablet for tablet adface6ea0a7412bab90d65a3ed77df8 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:06:49.093883 24565 tablet_service.cc:1511] Processing CreateTablet for tablet 419e360ee50f470b8f48831ac5316b40 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:49.095124 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adface6ea0a7412bab90d65a3ed77df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.095536 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419e360ee50f470b8f48831ac5316b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.064755 24569 tablet_service.cc:1511] Processing CreateTablet for tablet 8aba850266fd46739f0f92ff3ac0de00 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:49.090461 24775 tablet_bootstrap.cc:654] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.099130 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aba850266fd46739f0f92ff3ac0de00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.067065 24712 tablet_service.cc:1511] Processing CreateTablet for tablet 8aba850266fd46739f0f92ff3ac0de00 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:49.072134 24497 tablet_service.cc:1511] Processing CreateTablet for tablet 419e360ee50f470b8f48831ac5316b40 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:49.105693 24641 tablet_service.cc:1511] Processing CreateTablet for tablet 419e360ee50f470b8f48831ac5316b40 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:06:49.107223 24497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419e360ee50f470b8f48831ac5316b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.075258 24719 tablet_service.cc:1511] Processing CreateTablet for tablet 827bf9c0d4a14d209cbef1837ddb425d (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:49.107257 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 419e360ee50f470b8f48831ac5316b40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.115537 24714 tablet_service.cc:1511] Processing CreateTablet for tablet 563bd2fd6aae48ba994effc0e9e35427 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:49.117501 24496 tablet_service.cc:1511] Processing CreateTablet for tablet 563bd2fd6aae48ba994effc0e9e35427 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:49.118155 24564 tablet_service.cc:1511] Processing CreateTablet for tablet 563bd2fd6aae48ba994effc0e9e35427 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:06:49.057026 24491 tablet_service.cc:1511] Processing CreateTablet for tablet 827bf9c0d4a14d209cbef1837ddb425d (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:06:49.122509 24776 tablet_bootstrap.cc:492] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:49.123505 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827bf9c0d4a14d209cbef1837ddb425d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.132507 24777 tablet_bootstrap.cc:492] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:49.135155 24712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aba850266fd46739f0f92ff3ac0de00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.126040 24639 tablet_service.cc:1511] Processing CreateTablet for tablet df168e3caa0d42c896ca63b19c3438d7 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:49.140770 24639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df168e3caa0d42c896ca63b19c3438d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.143814 24778 tablet_bootstrap.cc:654] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.127247 24564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563bd2fd6aae48ba994effc0e9e35427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.150308 24642 tablet_service.cc:1511] Processing CreateTablet for tablet 8aba850266fd46739f0f92ff3ac0de00 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:06:49.156517 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8aba850266fd46739f0f92ff3ac0de00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.163029 24717 tablet_service.cc:1511] Processing CreateTablet for tablet df168e3caa0d42c896ca63b19c3438d7 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:49.163219 24570 tablet_service.cc:1511] Processing CreateTablet for tablet ee94f042219e46ecb9ac23aebbf326b9 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:49.164321 24717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df168e3caa0d42c896ca63b19c3438d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.164613 24570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee94f042219e46ecb9ac23aebbf326b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.166774 24714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563bd2fd6aae48ba994effc0e9e35427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.167634 24532 heartbeater.cc:499] Master 127.13.206.254:42253 was elected leader, sending a full tablet report...
I20260709 13:06:49.174008 24641 tablet_service.cc:1511] Processing CreateTablet for tablet ee94f042219e46ecb9ac23aebbf326b9 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:49.185664 24775 tablet_bootstrap.cc:492] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:49.187376 24775 ts_tablet_manager.cc:1403] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.277s	user 0.020s	sys 0.018s
I20260709 13:06:49.189152 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee94f042219e46ecb9ac23aebbf326b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.191896 24775 raft_consensus.cc:359] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:49.192747 24775 raft_consensus.cc:385] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.193070 24775 raft_consensus.cc:740] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.196899 24488 tablet_service.cc:1511] Processing CreateTablet for tablet a078959f5dc84592b3f57c5e621ceb3d (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:49.150375 24496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563bd2fd6aae48ba994effc0e9e35427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.210210 24491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 827bf9c0d4a14d209cbef1837ddb425d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.214498 24646 tablet_service.cc:1511] Processing CreateTablet for tablet a078959f5dc84592b3f57c5e621ceb3d (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:49.216121 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a078959f5dc84592b3f57c5e621ceb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.215795 24718 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcff4066e9b4592a94b0522794d5365 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:49.217267 24718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcff4066e9b4592a94b0522794d5365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.219877 24492 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcff4066e9b4592a94b0522794d5365 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:49.221339 24492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcff4066e9b4592a94b0522794d5365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.198514 24775 consensus_queue.cc:260] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:49.222129 24563 tablet_service.cc:1511] Processing CreateTablet for tablet 8fcff4066e9b4592a94b0522794d5365 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:06:49.223587 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fcff4066e9b4592a94b0522794d5365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.198760 24495 tablet_service.cc:1511] Processing CreateTablet for tablet df168e3caa0d42c896ca63b19c3438d7 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:06:49.225513 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df168e3caa0d42c896ca63b19c3438d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.207175 24565 tablet_service.cc:1511] Processing CreateTablet for tablet a078959f5dc84592b3f57c5e621ceb3d (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:06:49.239054 24643 tablet_service.cc:1511] Processing CreateTablet for tablet 2b8dffdf450843a0a7cf0e91c3bd3861 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:49.239677 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a078959f5dc84592b3f57c5e621ceb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.241333 24643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b8dffdf450843a0a7cf0e91c3bd3861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.204787 24717 tablet_service.cc:1511] Processing CreateTablet for tablet ee94f042219e46ecb9ac23aebbf326b9 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:06:49.243670 24717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee94f042219e46ecb9ac23aebbf326b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.247138 24777 tablet_bootstrap.cc:654] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.253209 24712 tablet_service.cc:1511] Processing CreateTablet for tablet 2b8dffdf450843a0a7cf0e91c3bd3861 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:49.256713 24712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b8dffdf450843a0a7cf0e91c3bd3861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.250877 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a078959f5dc84592b3f57c5e621ceb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.271106 24607 heartbeater.cc:499] Master 127.13.206.254:42253 was elected leader, sending a full tablet report...
I20260709 13:06:49.292012 24497 tablet_service.cc:1511] Processing CreateTablet for tablet 2b8dffdf450843a0a7cf0e91c3bd3861 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:06:49.293432 24497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b8dffdf450843a0a7cf0e91c3bd3861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.294305 24776 tablet_bootstrap.cc:654] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.294708 24781 raft_consensus.cc:493] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.295269 24781 raft_consensus.cc:515] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:49.296269 24775 ts_tablet_manager.cc:1434] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.109s	user 0.025s	sys 0.011s
I20260709 13:06:49.298559 24755 heartbeater.cc:499] Master 127.13.206.254:42253 was elected leader, sending a full tablet report...
I20260709 13:06:49.308940 24638 tablet_service.cc:1511] Processing CreateTablet for tablet c2adce7a2cbc4be09cbebfdcb64b4438 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:49.298092 24781 leader_election.cc:290] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:49.310479 24638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2adce7a2cbc4be09cbebfdcb64b4438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.311195 24716 tablet_service.cc:1511] Processing CreateTablet for tablet c2adce7a2cbc4be09cbebfdcb64b4438 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:49.312656 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2adce7a2cbc4be09cbebfdcb64b4438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.313139 24493 tablet_service.cc:1511] Processing CreateTablet for tablet bffa83e4678e4efcbe8b21ee2c2a48ad (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:49.314536 24493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffa83e4678e4efcbe8b21ee2c2a48ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.317210 24564 tablet_service.cc:1511] Processing CreateTablet for tablet c2adce7a2cbc4be09cbebfdcb64b4438 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:06:49.318672 24564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2adce7a2cbc4be09cbebfdcb64b4438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.352548 24569 tablet_service.cc:1511] Processing CreateTablet for tablet bffa83e4678e4efcbe8b21ee2c2a48ad (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:49.353667 24775 tablet_bootstrap.cc:492] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:49.354079 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffa83e4678e4efcbe8b21ee2c2a48ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.359385 24719 tablet_service.cc:1511] Processing CreateTablet for tablet e775c3cec51d4d2ab3dfc17e2109ef87 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:49.360913 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e775c3cec51d4d2ab3dfc17e2109ef87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.367944 24641 tablet_service.cc:1511] Processing CreateTablet for tablet bffa83e4678e4efcbe8b21ee2c2a48ad (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:06:49.369479 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bffa83e4678e4efcbe8b21ee2c2a48ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.376492 24681 heartbeater.cc:499] Master 127.13.206.254:42253 was elected leader, sending a full tablet report...
I20260709 13:06:49.392436 24778 tablet_bootstrap.cc:492] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:49.393059 24778 ts_tablet_manager.cc:1403] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.350s	user 0.025s	sys 0.000s
I20260709 13:06:49.396735 24778 raft_consensus.cc:359] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.397599 24778 raft_consensus.cc:385] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.397975 24778 raft_consensus.cc:740] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.409235 24777 tablet_bootstrap.cc:492] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:49.410060 24777 ts_tablet_manager.cc:1403] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.278s	user 0.015s	sys 0.004s
I20260709 13:06:49.418849 24775 tablet_bootstrap.cc:654] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.429721 24776 tablet_bootstrap.cc:492] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:49.430205 24778 consensus_queue.cc:260] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.443181 24495 tablet_service.cc:1511] Processing CreateTablet for tablet e775c3cec51d4d2ab3dfc17e2109ef87 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:49.449285 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e775c3cec51d4d2ab3dfc17e2109ef87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.437377 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66a54bd402a430e8012e83b9926ed3c" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:49.445921 24776 ts_tablet_manager.cc:1403] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.324s	user 0.013s	sys 0.014s
W20260709 13:06:49.455900 24756 tablet.cc:2406] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:06:49.456673 24563 tablet_service.cc:1511] Processing CreateTablet for tablet e775c3cec51d4d2ab3dfc17e2109ef87 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:06:49.458160 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e775c3cec51d4d2ab3dfc17e2109ef87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:49.459537 24694 leader_election.cc:343] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.459661 24776 raft_consensus.cc:359] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:49.460587 24776 raft_consensus.cc:385] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.460934 24776 raft_consensus.cc:740] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.462750 24719 tablet_service.cc:1511] Processing CreateTablet for tablet bf0b10f5f3b44ddd821edcf5236589ed (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:49.465313 24497 tablet_service.cc:1511] Processing CreateTablet for tablet bf0b10f5f3b44ddd821edcf5236589ed (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:49.466636 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0b10f5f3b44ddd821edcf5236589ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.473229 24639 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1b47e2ca4046dabceebdf5efd6ae27 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:49.474709 24569 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1b47e2ca4046dabceebdf5efd6ae27 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:49.476775 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1b47e2ca4046dabceebdf5efd6ae27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.475082 24716 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1b47e2ca4046dabceebdf5efd6ae27 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:06:49.493949 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1b47e2ca4046dabceebdf5efd6ae27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.494128 24775 tablet_bootstrap.cc:492] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:49.494921 24775 ts_tablet_manager.cc:1403] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.147s	user 0.010s	sys 0.021s
I20260709 13:06:49.475051 24638 tablet_service.cc:1511] Processing CreateTablet for tablet bf0b10f5f3b44ddd821edcf5236589ed (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:06:49.482986 24639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1b47e2ca4046dabceebdf5efd6ae27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.499115 24638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0b10f5f3b44ddd821edcf5236589ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.432062 24777 raft_consensus.cc:359] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.502528 24777 raft_consensus.cc:385] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.503047 24777 raft_consensus.cc:740] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.504420 24777 consensus_queue.cc:260] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.486011 24776 consensus_queue.cc:260] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:49.490798 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66a54bd402a430e8012e83b9926ed3c" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:49.506994 24775 raft_consensus.cc:359] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.490854 24497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf0b10f5f3b44ddd821edcf5236589ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:49.508356 24693 leader_election.cc:343] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.511991 24693 leader_election.cc:304] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:49.513065 24782 raft_consensus.cc:2749] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.519176 24495 tablet_service.cc:1511] Processing CreateTablet for tablet f17522023e1e45c5bb9bae9be809cb3b (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:49.524652 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17522023e1e45c5bb9bae9be809cb3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.525637 24565 tablet_service.cc:1511] Processing CreateTablet for tablet f17522023e1e45c5bb9bae9be809cb3b (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:49.527064 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17522023e1e45c5bb9bae9be809cb3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.521378 24775 raft_consensus.cc:385] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.530395 24775 raft_consensus.cc:740] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.535359 24776 ts_tablet_manager.cc:1434] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 13:06:49.536605 24776 tablet_bootstrap.cc:492] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:49.542641 24778 ts_tablet_manager.cc:1434] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.149s	user 0.016s	sys 0.041s
I20260709 13:06:49.543994 24778 tablet_bootstrap.cc:492] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:49.546768 24790 raft_consensus.cc:493] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.547406 24776 tablet_bootstrap.cc:654] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.547374 24790 raft_consensus.cc:515] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:49.556481 24790 leader_election.cc:290] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:49.556783 24777 ts_tablet_manager.cc:1434] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.140s	user 0.013s	sys 0.000s
I20260709 13:06:49.540501 24775 consensus_queue.cc:260] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.573083 24777 tablet_bootstrap.cc:492] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:49.577082 24775 ts_tablet_manager.cc:1434] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.082s	user 0.004s	sys 0.004s
I20260709 13:06:49.567272 24646 tablet_service.cc:1511] Processing CreateTablet for tablet f17522023e1e45c5bb9bae9be809cb3b (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:06:49.582270 24717 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae22b5647eb41b083a1184bcc60bca0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:49.589536 24775 tablet_bootstrap.cc:492] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:49.591876 24493 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae22b5647eb41b083a1184bcc60bca0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:49.593595 24493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae22b5647eb41b083a1184bcc60bca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.588649 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f17522023e1e45c5bb9bae9be809cb3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.599685 24776 tablet_bootstrap.cc:492] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:49.600327 24776 ts_tablet_manager.cc:1403] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.014s
I20260709 13:06:49.589599 24717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae22b5647eb41b083a1184bcc60bca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.603989 24778 tablet_bootstrap.cc:654] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.602203 24777 tablet_bootstrap.cc:654] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.622675 24563 tablet_service.cc:1511] Processing CreateTablet for tablet 9ae22b5647eb41b083a1184bcc60bca0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:06:49.624221 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ae22b5647eb41b083a1184bcc60bca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.630386 24638 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2b2b10c2a8445da974e94ac66be680 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:49.631901 24638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2b2b10c2a8445da974e94ac66be680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.631564 24716 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2b2b10c2a8445da974e94ac66be680 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:49.633080 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2b2b10c2a8445da974e94ac66be680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.636021 24776 raft_consensus.cc:359] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:49.636886 24776 raft_consensus.cc:385] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.637216 24776 raft_consensus.cc:740] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.638252 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7db6e3ae894339b05d8598c9df859e" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:49.640450 24546 leader_election.cc:343] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.642277 24488 tablet_service.cc:1511] Processing CreateTablet for tablet 6b2b2b10c2a8445da974e94ac66be680 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:06:49.638020 24776 consensus_queue.cc:260] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:49.644618 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b2b2b10c2a8445da974e94ac66be680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.646615 24564 tablet_service.cc:1511] Processing CreateTablet for tablet 1b05be5fc3d34aa0ae910d5a99463f49 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:49.647970 24564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b05be5fc3d34aa0ae910d5a99463f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.667923 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7db6e3ae894339b05d8598c9df859e" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
W20260709 13:06:49.669663 24545 leader_election.cc:343] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.670171 24545 leader_election.cc:304] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:49.674288 24495 tablet_service.cc:1511] Processing CreateTablet for tablet 612adbf2e5c7415abb570cbce1f934dd (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:49.675834 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 612adbf2e5c7415abb570cbce1f934dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.674335 24790 raft_consensus.cc:2749] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:49.683033 24716 tablet_service.cc:1511] Processing CreateTablet for tablet 1b05be5fc3d34aa0ae910d5a99463f49 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:49.683940 24570 tablet_service.cc:1511] Processing CreateTablet for tablet 612adbf2e5c7415abb570cbce1f934dd (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:49.687354 24570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 612adbf2e5c7415abb570cbce1f934dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.689685 24641 tablet_service.cc:1511] Processing CreateTablet for tablet 612adbf2e5c7415abb570cbce1f934dd (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:06:49.691787 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 612adbf2e5c7415abb570cbce1f934dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.696525 24719 tablet_service.cc:1511] Processing CreateTablet for tablet 59192aeb6ab34cdb81981c7024b885c1 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:49.699399 24497 tablet_service.cc:1511] Processing CreateTablet for tablet 59192aeb6ab34cdb81981c7024b885c1 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:49.700274 24775 tablet_bootstrap.cc:654] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.700846 24497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59192aeb6ab34cdb81981c7024b885c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.679157 24639 tablet_service.cc:1511] Processing CreateTablet for tablet 1b05be5fc3d34aa0ae910d5a99463f49 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:06:49.703406 24639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b05be5fc3d34aa0ae910d5a99463f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.711409 24776 ts_tablet_manager.cc:1434] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.111s	user 0.006s	sys 0.004s
I20260709 13:06:49.714905 24565 tablet_service.cc:1511] Processing CreateTablet for tablet 59192aeb6ab34cdb81981c7024b885c1 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:06:49.716300 24776 tablet_bootstrap.cc:492] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:49.716392 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59192aeb6ab34cdb81981c7024b885c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.715926 24643 tablet_service.cc:1511] Processing CreateTablet for tablet baca274246424542b0d38cdab6cb25a5 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:49.721992 24643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baca274246424542b0d38cdab6cb25a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.728256 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59192aeb6ab34cdb81981c7024b885c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.729089 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b05be5fc3d34aa0ae910d5a99463f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.730386 24778 tablet_bootstrap.cc:492] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:49.731078 24778 ts_tablet_manager.cc:1403] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.187s	user 0.013s	sys 0.026s
I20260709 13:06:49.733634 24718 tablet_service.cc:1511] Processing CreateTablet for tablet baca274246424542b0d38cdab6cb25a5 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:49.735671 24718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baca274246424542b0d38cdab6cb25a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.741540 24496 tablet_service.cc:1511] Processing CreateTablet for tablet baca274246424542b0d38cdab6cb25a5 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:06:49.743011 24496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baca274246424542b0d38cdab6cb25a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.744830 24778 raft_consensus.cc:359] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:49.753049 24777 tablet_bootstrap.cc:492] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:49.753710 24777 ts_tablet_manager.cc:1403] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.181s	user 0.011s	sys 0.023s
I20260709 13:06:49.755574 24569 tablet_service.cc:1511] Processing CreateTablet for tablet fae7b1c100f1488cbbaafece940169fa (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:49.756999 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae7b1c100f1488cbbaafece940169fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.757640 24642 tablet_service.cc:1511] Processing CreateTablet for tablet fae7b1c100f1488cbbaafece940169fa (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:49.759122 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae7b1c100f1488cbbaafece940169fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.758767 24712 tablet_service.cc:1511] Processing CreateTablet for tablet fae7b1c100f1488cbbaafece940169fa (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:06:49.760221 24712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae7b1c100f1488cbbaafece940169fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.776027 24776 tablet_bootstrap.cc:654] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:49.750208 24778 raft_consensus.cc:385] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.782655 24778 raft_consensus.cc:740] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.783003 24789 raft_consensus.cc:493] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.782866 24488 tablet_service.cc:1511] Processing CreateTablet for tablet 06805e79e8c04d6cbbf3fb892cad56cd (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:49.783574 24789 raft_consensus.cc:515] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.784560 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06805e79e8c04d6cbbf3fb892cad56cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.783551 24778 consensus_queue.cc:260] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:49.787890 24789 leader_election.cc:290] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:49.822121 24571 tablet_service.cc:1511] Processing CreateTablet for tablet 06805e79e8c04d6cbbf3fb892cad56cd (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:49.824128 24571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06805e79e8c04d6cbbf3fb892cad56cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.819837 24777 raft_consensus.cc:359] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.834672 24788 raft_consensus.cc:493] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.837731 24788 raft_consensus.cc:515] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.842171 24777 raft_consensus.cc:385] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:49.842013 24788 leader_election.cc:290] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:49.864179 24565 tablet_service.cc:1511] Processing CreateTablet for tablet ccd41fd6be624ea6bc27b249b0619443 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:49.865674 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd41fd6be624ea6bc27b249b0619443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.867481 24778 ts_tablet_manager.cc:1434] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.001s
I20260709 13:06:49.867805 24493 tablet_service.cc:1511] Processing CreateTablet for tablet ccd41fd6be624ea6bc27b249b0619443 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:49.869334 24493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd41fd6be624ea6bc27b249b0619443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.872270 24778 tablet_bootstrap.cc:492] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:49.878686 24782 raft_consensus.cc:493] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.879345 24782 raft_consensus.cc:515] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.880857 24643 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfd4cea52324105ba39f2e3d7e4c330 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:49.881990 24782 leader_election.cc:290] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:49.883226 24643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfd4cea52324105ba39f2e3d7e4c330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.883314 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c7563825eb4e418fa6c9e6a8488191" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:49.887283 24719 tablet_service.cc:1511] Processing CreateTablet for tablet ccd41fd6be624ea6bc27b249b0619443 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:06:49.888742 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccd41fd6be624ea6bc27b249b0619443. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.892501 24639 tablet_service.cc:1511] Processing CreateTablet for tablet 06805e79e8c04d6cbbf3fb892cad56cd (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:06:49.894112 24639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06805e79e8c04d6cbbf3fb892cad56cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.851016 24777 raft_consensus.cc:740] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:49.899011 24777 consensus_queue.cc:260] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.899268 24496 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfd4cea52324105ba39f2e3d7e4c330 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:49.901643 24656 raft_consensus.cc:2468] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 0.
I20260709 13:06:49.906962 24694 leader_election.cc:304] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:06:49.907012 24496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfd4cea52324105ba39f2e3d7e4c330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.910276 24782 raft_consensus.cc:2804] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:49.923682 24782 raft_consensus.cc:493] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.924108 24782 raft_consensus.cc:3060] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:49.926103 24718 tablet_service.cc:1511] Processing CreateTablet for tablet 401126e2c8324c69961e005862f0b23f (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:49.927567 24718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401126e2c8324c69961e005862f0b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.927670 24777 ts_tablet_manager.cc:1434] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.174s	user 0.001s	sys 0.014s
I20260709 13:06:49.928262 24775 tablet_bootstrap.cc:492] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:49.928836 24775 ts_tablet_manager.cc:1403] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.340s	user 0.012s	sys 0.016s
I20260709 13:06:49.931535 24642 tablet_service.cc:1511] Processing CreateTablet for tablet 401126e2c8324c69961e005862f0b23f (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:49.933764 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401126e2c8324c69961e005862f0b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.918206 24563 tablet_service.cc:1511] Processing CreateTablet for tablet 401126e2c8324c69961e005862f0b23f (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:06:49.936244 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401126e2c8324c69961e005862f0b23f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.928838 24777 tablet_bootstrap.cc:492] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:49.944063 24495 tablet_service.cc:1511] Processing CreateTablet for tablet 933347c92a6c4612a65f9a7c365bc170 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:49.944448 24569 tablet_service.cc:1511] Processing CreateTablet for tablet 933347c92a6c4612a65f9a7c365bc170 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:49.945614 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 933347c92a6c4612a65f9a7c365bc170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.945735 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 933347c92a6c4612a65f9a7c365bc170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.958334 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1987f47fa594dbbac6f13e3ffaac7ba" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:49.960371 24716 tablet_service.cc:1511] Processing CreateTablet for tablet 709f942ac0144fc6b272c4a71b5bc224 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:49.961027 24641 tablet_service.cc:1511] Processing CreateTablet for tablet 933347c92a6c4612a65f9a7c365bc170 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:06:49.961813 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709f942ac0144fc6b272c4a71b5bc224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:49.962419 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 933347c92a6c4612a65f9a7c365bc170. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:49.963533 24453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:49.919140 24712 tablet_service.cc:1511] Processing CreateTablet for tablet 7cfd4cea52324105ba39f2e3d7e4c330 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:06:49.964846 24712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cfd4cea52324105ba39f2e3d7e4c330. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:49.967103 24622 leader_election.cc:343] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.957846 24782 raft_consensus.cc:515] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:49.971830 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c7563825eb4e418fa6c9e6a8488191" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:49.972502 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1987f47fa594dbbac6f13e3ffaac7ba" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:49.975134 24776 tablet_bootstrap.cc:492] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:49.974565 24496 tablet_service.cc:1511] Processing CreateTablet for tablet 709f942ac0144fc6b272c4a71b5bc224 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:49.983264 24646 tablet_service.cc:1511] Processing CreateTablet for tablet 5945ceca673541d8a363891cbb6ac97e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:49.984503 24571 tablet_service.cc:1511] Processing CreateTablet for tablet 709f942ac0144fc6b272c4a71b5bc224 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:06:50.001344 24506 raft_consensus.cc:2468] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:50.004814 24782 leader_election.cc:290] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:50.005188 24571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709f942ac0144fc6b272c4a71b5bc224. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:50.005623 24693 leader_election.cc:343] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:49.985930 24777 tablet_bootstrap.cc:654] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.006049 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c7563825eb4e418fa6c9e6a8488191" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:49.938148 24775 raft_consensus.cc:359] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.008312 24656 raft_consensus.cc:3060] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.018426 24775 raft_consensus.cc:385] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.018800 24775 raft_consensus.cc:740] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.019613 24775 consensus_queue.cc:260] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.021201 24488 tablet_service.cc:1511] Processing CreateTablet for tablet 5945ceca673541d8a363891cbb6ac97e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:50.021908 24775 ts_tablet_manager.cc:1434] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.000s
I20260709 13:06:50.009629 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5945ceca673541d8a363891cbb6ac97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.047359 24788 raft_consensus.cc:493] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.047969 24788 raft_consensus.cc:515] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:50.002553 24776 ts_tablet_manager.cc:1403] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.287s	user 0.018s	sys 0.008s
I20260709 13:06:50.053988 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:50.010217 24717 tablet_service.cc:1511] Processing CreateTablet for tablet 5945ceca673541d8a363891cbb6ac97e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:06:50.054749 24563 tablet_service.cc:1511] Processing CreateTablet for tablet af12d98819104c6ba6cbc1353f5d5970 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:50.012885 24619 leader_election.cc:304] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:50.056255 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af12d98819104c6ba6cbc1353f5d5970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.017704 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1987f47fa594dbbac6f13e3ffaac7ba" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:50.055841 24717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5945ceca673541d8a363891cbb6ac97e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:50.056550 24619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 43922.5us
I20260709 13:06:50.008867 24496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709f942ac0144fc6b272c4a71b5bc224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.057489 24789 raft_consensus.cc:2804] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.057957 24789 raft_consensus.cc:493] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.058180 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5945ceca673541d8a363891cbb6ac97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.058403 24789 raft_consensus.cc:3060] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:50.063318 24473 leader_election.cc:343] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.054782 24581 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:50.065701 24473 leader_election.cc:304] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:50.066828 24788 leader_election.cc:290] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:50.026911 24778 tablet_bootstrap.cc:654] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.031477 24641 tablet_service.cc:1511] Processing CreateTablet for tablet 652a4c910b344866bc517d7c4e994536 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:50.067464 24788 raft_consensus.cc:2804] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.068008 24788 raft_consensus.cc:493] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.068428 24788 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.055835 24497 tablet_service.cc:1511] Processing CreateTablet for tablet af12d98819104c6ba6cbc1353f5d5970 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:50.069607 24497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af12d98819104c6ba6cbc1353f5d5970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.070515 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
W20260709 13:06:50.072288 24470 leader_election.cc:343] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.014364 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44c7563825eb4e418fa6c9e6a8488191" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:50.025933 24565 tablet_service.cc:1511] Processing CreateTablet for tablet 652a4c910b344866bc517d7c4e994536 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:50.075480 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652a4c910b344866bc517d7c4e994536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.080329 24789 raft_consensus.cc:515] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.066526 24776 raft_consensus.cc:359] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.068557 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652a4c910b344866bc517d7c4e994536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.082437 24776 raft_consensus.cc:385] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.082962 24776 raft_consensus.cc:740] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.083848 24776 consensus_queue.cc:260] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.039667 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1987f47fa594dbbac6f13e3ffaac7ba" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:50.085340 24655 raft_consensus.cc:2393] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e0390f5bd00484985fa5469e25be18d in current term 1: Already voted for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in this term.
I20260709 13:06:50.090881 24471 leader_election.cc:304] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:50.026041 24656 raft_consensus.cc:2468] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:06:50.091400 24716 tablet_service.cc:1511] Processing CreateTablet for tablet 652a4c910b344866bc517d7c4e994536 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:06:50.106925 24694 leader_election.cc:304] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:06:50.108556 24775 tablet_bootstrap.cc:492] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:50.093890 24642 tablet_service.cc:1511] Processing CreateTablet for tablet af12d98819104c6ba6cbc1353f5d5970 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:06:50.108951 24782 raft_consensus.cc:2804] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.109930 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af12d98819104c6ba6cbc1353f5d5970. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.110219 24488 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6dec4aa0e24123bf8fb5a0cd30dd77 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:50.111543 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6dec4aa0e24123bf8fb5a0cd30dd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.094017 24714 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6dec4aa0e24123bf8fb5a0cd30dd77 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:50.115777 24714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6dec4aa0e24123bf8fb5a0cd30dd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.118119 24716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652a4c910b344866bc517d7c4e994536. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.093086 24776 ts_tablet_manager.cc:1434] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:06:50.122361 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1987f47fa594dbbac6f13e3ffaac7ba" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
W20260709 13:06:50.126129 24622 leader_election.cc:343] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.133193 24790 raft_consensus.cc:493] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.133965 24790 raft_consensus.cc:515] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.129426 24776 tablet_bootstrap.cc:492] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:50.122804 24777 tablet_bootstrap.cc:492] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:50.124593 24789 leader_election.cc:290] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:50.157217 24777 ts_tablet_manager.cc:1403] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.229s	user 0.006s	sys 0.019s
I20260709 13:06:50.171311 24563 tablet_service.cc:1511] Processing CreateTablet for tablet 6c6dec4aa0e24123bf8fb5a0cd30dd77 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:06:50.172844 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c6dec4aa0e24123bf8fb5a0cd30dd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.194101 24777 raft_consensus.cc:359] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.195031 24777 raft_consensus.cc:385] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.195369 24777 raft_consensus.cc:740] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.196199 24777 consensus_queue.cc:260] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.201867 24775 tablet_bootstrap.cc:654] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.203867 24776 tablet_bootstrap.cc:654] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.205518 24777 ts_tablet_manager.cc:1434] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.003s
I20260709 13:06:50.169909 24788 raft_consensus.cc:515] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:50.206542 24782 raft_consensus.cc:697] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:06:50.212481 24782 consensus_queue.cc:237] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.217630 24778 tablet_bootstrap.cc:492] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:50.218314 24778 ts_tablet_manager.cc:1403] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.346s	user 0.035s	sys 0.011s
I20260709 13:06:50.221839 24778 raft_consensus.cc:359] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.222700 24778 raft_consensus.cc:385] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.223032 24778 raft_consensus.cc:740] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.223815 24778 consensus_queue.cc:260] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.228966 24646 tablet_service.cc:1511] Processing CreateTablet for tablet fefa199c339342a7a12607fe3298ffce (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:50.229545 24806 raft_consensus.cc:3060] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.231500 24788 leader_election.cc:290] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:50.231703 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
W20260709 13:06:50.233310 24470 leader_election.cc:343] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.237386 24639 tablet_service.cc:1511] Processing CreateTablet for tablet c43fdc79e19f4cf69e4689b91e9df7e1 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:50.238811 24639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43fdc79e19f4cf69e4689b91e9df7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.242298 24643 tablet_service.cc:1511] Processing CreateTablet for tablet d25a32222ca44ec493cfc78f7a31824e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:50.243800 24643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25a32222ca44ec493cfc78f7a31824e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.243755 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:50.245448 24777 tablet_bootstrap.cc:492] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
W20260709 13:06:50.245528 24546 leader_election.cc:343] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.242520 24790 leader_election.cc:290] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:50.248250 24718 tablet_service.cc:1511] Processing CreateTablet for tablet fefa199c339342a7a12607fe3298ffce (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
W20260709 13:06:50.207453 24473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 141857us
I20260709 13:06:50.262073 24488 tablet_service.cc:1511] Processing CreateTablet for tablet fefa199c339342a7a12607fe3298ffce (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:06:50.263664 24488 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fefa199c339342a7a12607fe3298ffce. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:50.263808 24693 leader_election.cc:343] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.265944 24718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fefa199c339342a7a12607fe3298ffce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.269351 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fefa199c339342a7a12607fe3298ffce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.259943 24712 tablet_service.cc:1511] Processing CreateTablet for tablet c43fdc79e19f4cf69e4689b91e9df7e1 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:50.271610 24493 tablet_service.cc:1511] Processing CreateTablet for tablet d25a32222ca44ec493cfc78f7a31824e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:50.273298 24712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43fdc79e19f4cf69e4689b91e9df7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.273626 24493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25a32222ca44ec493cfc78f7a31824e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.285629 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:50.286710 24581 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.287886 24806 raft_consensus.cc:2749] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.293512 24719 tablet_service.cc:1511] Processing CreateTablet for tablet cb8100c9df824b0383fbb5f05b846b61 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:50.294934 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1987f47fa594dbbac6f13e3ffaac7ba" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:50.294976 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8100c9df824b0383fbb5f05b846b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.300316 24571 tablet_service.cc:1511] Processing CreateTablet for tablet c43fdc79e19f4cf69e4689b91e9df7e1 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:06:50.300495 24565 tablet_service.cc:1511] Processing CreateTablet for tablet d25a32222ca44ec493cfc78f7a31824e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:06:50.307446 24571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c43fdc79e19f4cf69e4689b91e9df7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.307505 24715 tablet_service.cc:1511] Processing CreateTablet for tablet 074fffdc7884498f9ef3ed6915f8dbc0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:50.300932 24569 tablet_service.cc:1511] Processing CreateTablet for tablet cb8100c9df824b0383fbb5f05b846b61 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:50.310436 24565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d25a32222ca44ec493cfc78f7a31824e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.313261 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8100c9df824b0383fbb5f05b846b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.318837 24715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074fffdc7884498f9ef3ed6915f8dbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.319887 24776 tablet_bootstrap.cc:492] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:50.320503 24776 ts_tablet_manager.cc:1403] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.191s	user 0.013s	sys 0.003s
I20260709 13:06:50.325152 24497 tablet_service.cc:1511] Processing CreateTablet for tablet cb8100c9df824b0383fbb5f05b846b61 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:06:50.326296 24808 raft_consensus.cc:493] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.326660 24497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8100c9df824b0383fbb5f05b846b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.326951 24808 raft_consensus.cc:515] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.332679 24495 tablet_service.cc:1511] Processing CreateTablet for tablet 074fffdc7884498f9ef3ed6915f8dbc0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:50.334348 24808 leader_election.cc:290] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:50.334175 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074fffdc7884498f9ef3ed6915f8dbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.335886 24642 tablet_service.cc:1511] Processing CreateTablet for tablet 074fffdc7884498f9ef3ed6915f8dbc0 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:06:50.337544 24777 tablet_bootstrap.cc:654] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.337867 24642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 074fffdc7884498f9ef3ed6915f8dbc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.343827 24506 raft_consensus.cc:2468] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:50.347720 24778 ts_tablet_manager.cc:1434] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.129s	user 0.011s	sys 0.007s
I20260709 13:06:50.352346 24563 tablet_service.cc:1511] Processing CreateTablet for tablet 2f37afc8b3624bd09784565977fef62c (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:50.353758 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f37afc8b3624bd09784565977fef62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.353571 24641 tablet_service.cc:1511] Processing CreateTablet for tablet 2f37afc8b3624bd09784565977fef62c (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:06:50.354485 24778 tablet_bootstrap.cc:492] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:50.355021 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f37afc8b3624bd09784565977fef62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.358461 24619 leader_election.cc:304] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:50.359803 24789 raft_consensus.cc:2804] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.370487 24789 raft_consensus.cc:697] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:50.371701 24789 consensus_queue.cc:237] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.388510 24776 raft_consensus.cc:359] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:50.389424 24776 raft_consensus.cc:385] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.389782 24776 raft_consensus.cc:740] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.394285 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4698536ba648bb9b505f77a4cef71b" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
W20260709 13:06:50.396232 24693 leader_election.cc:343] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.404354 24581 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:50.362625 24806 raft_consensus.cc:493] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.439060 24473 leader_election.cc:304] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:50.440537 24810 raft_consensus.cc:2804] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.441073 24810 raft_consensus.cc:697] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:50.441960 24810 consensus_queue.cc:237] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:50.428692 24775 tablet_bootstrap.cc:492] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:50.451017 24806 raft_consensus.cc:515] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.452527 24403 catalog_manager.cc:5697] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 1 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.455003 24806 leader_election.cc:290] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:50.465119 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:50.468721 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:50.469779 24581 raft_consensus.cc:2468] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:50.471364 24715 tablet_service.cc:1511] Processing CreateTablet for tablet 2f37afc8b3624bd09784565977fef62c (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:06:50.472337 24471 leader_election.cc:343] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.473433 24715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f37afc8b3624bd09784565977fef62c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.461265 24775 ts_tablet_manager.cc:1403] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.353s	user 0.027s	sys 0.028s
I20260709 13:06:50.480865 24778 tablet_bootstrap.cc:654] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.455637 24776 consensus_queue.cc:260] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:50.490523 24777 tablet_bootstrap.cc:492] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:50.474339 24473 leader_election.cc:304] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:50.498221 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:50.498935 24506 raft_consensus.cc:2468] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:50.502946 24545 leader_election.cc:304] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:50.504217 24790 raft_consensus.cc:2804] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.504612 24790 raft_consensus.cc:493] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.504936 24790 raft_consensus.cc:3060] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.507265 24777 ts_tablet_manager.cc:1403] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.262s	user 0.032s	sys 0.029s
I20260709 13:06:50.511865 24777 raft_consensus.cc:359] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.513027 24777 raft_consensus.cc:385] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.513439 24777 raft_consensus.cc:740] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.511857 24646 tablet_service.cc:1511] Processing CreateTablet for tablet edb6450ef5924cec9eacb07c5c4a79ed (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:50.519882 24405 catalog_manager.cc:5697] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.531417 24775 raft_consensus.cc:359] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.532289 24775 raft_consensus.cc:385] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.532617 24775 raft_consensus.cc:740] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.522378 24810 raft_consensus.cc:2804] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.546430 24815 raft_consensus.cc:493] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.547291 24815 raft_consensus.cc:515] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.555240 24776 ts_tablet_manager.cc:1434] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.234s	user 0.010s	sys 0.001s
I20260709 13:06:50.554785 24571 tablet_service.cc:1511] Processing CreateTablet for tablet edb6450ef5924cec9eacb07c5c4a79ed (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:50.556325 24776 tablet_bootstrap.cc:492] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:50.557034 24571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb6450ef5924cec9eacb07c5c4a79ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.559253 24815 leader_election.cc:290] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:50.543897 24775 consensus_queue.cc:260] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.564563 24790 raft_consensus.cc:515] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.565156 24775 ts_tablet_manager.cc:1434] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.005s
I20260709 13:06:50.566785 24775 tablet_bootstrap.cc:492] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:50.569945 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb6450ef5924cec9eacb07c5c4a79ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.542788 24810 raft_consensus.cc:493] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.575399 24810 raft_consensus.cc:3060] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.575691 24790 leader_election.cc:290] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:50.542057 24777 consensus_queue.cc:260] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.582572 24778 tablet_bootstrap.cc:492] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:50.583304 24778 ts_tablet_manager.cc:1403] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.229s	user 0.026s	sys 0.027s
I20260709 13:06:50.585844 24775 tablet_bootstrap.cc:654] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.586997 24810 raft_consensus.cc:515] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.588012 24777 ts_tablet_manager.cc:1434] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 13:06:50.589419 24777 tablet_bootstrap.cc:492] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:50.589838 24810 leader_election.cc:290] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
W20260709 13:06:50.616246 24389 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 89437.9us
I20260709 13:06:50.632454 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:50.632840 24563 tablet_service.cc:1511] Processing CreateTablet for tablet df176e388c3e486e851d2450693d34ae (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:50.640374 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:50.641116 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66a54bd402a430e8012e83b9926ed3c" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:50.641562 24656 raft_consensus.cc:3060] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.641640 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:50.644476 24582 raft_consensus.cc:2393] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e0390f5bd00484985fa5469e25be18d in current term 1: Already voted for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in this term.
I20260709 13:06:50.644248 24641 tablet_service.cc:1511] Processing CreateTablet for tablet f04e8125d3094e3fbdf35b449e5afd2e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:06:50.645453 24619 leader_election.cc:343] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.646962 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:50.654436 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04e8125d3094e3fbdf35b449e5afd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.656009 24471 leader_election.cc:304] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:50.658388 24506 raft_consensus.cc:2393] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in current term 1: Already voted for candidate 7e0390f5bd00484985fa5469e25be18d in this term.
I20260709 13:06:50.668615 24563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df176e388c3e486e851d2450693d34ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.671195 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4698536ba648bb9b505f77a4cef71b" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:50.674755 24696 leader_election.cc:343] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.675880 24696 leader_election.cc:304] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:50.586057 24776 tablet_bootstrap.cc:654] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:50.683388 24821 log.cc:927] Time spent T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:06:50.684530 24808 raft_consensus.cc:2749] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.683539 24810 raft_consensus.cc:2749] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.693018 24778 raft_consensus.cc:359] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.701099 24778 raft_consensus.cc:385] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.701160 24782 consensus_queue.cc:1048] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:50.701692 24778 raft_consensus.cc:740] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.705331 24778 consensus_queue.cc:260] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.723582 24497 tablet_service.cc:1511] Processing CreateTablet for tablet edb6450ef5924cec9eacb07c5c4a79ed (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:06:50.732090 24569 tablet_service.cc:1511] Processing CreateTablet for tablet 5007dd79f86a4afcb717368e91865e27 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:50.725775 24719 tablet_service.cc:1511] Processing CreateTablet for tablet df176e388c3e486e851d2450693d34ae (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:50.735709 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df176e388c3e486e851d2450693d34ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.736687 24718 tablet_service.cc:1511] Processing CreateTablet for tablet f04e8125d3094e3fbdf35b449e5afd2e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:50.727205 24493 tablet_service.cc:1511] Processing CreateTablet for tablet df176e388c3e486e851d2450693d34ae (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:06:50.738392 24718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04e8125d3094e3fbdf35b449e5afd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.739511 24493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df176e388c3e486e851d2450693d34ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.741051 24775 tablet_bootstrap.cc:492] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:50.734140 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5007dd79f86a4afcb717368e91865e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.742003 24775 ts_tablet_manager.cc:1403] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.175s	user 0.031s	sys 0.042s
I20260709 13:06:50.743522 24777 tablet_bootstrap.cc:654] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.749063 24497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edb6450ef5924cec9eacb07c5c4a79ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.729103 24778 ts_tablet_manager.cc:1434] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.145s	user 0.009s	sys 0.003s
I20260709 13:06:50.756537 24778 tablet_bootstrap.cc:492] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:50.760357 24404 catalog_manager.cc:5697] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.762910 24495 tablet_service.cc:1511] Processing CreateTablet for tablet f04e8125d3094e3fbdf35b449e5afd2e (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:06:50.764806 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f04e8125d3094e3fbdf35b449e5afd2e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:50.771265 24693 consensus_peers.cc:597] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.776491 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66a54bd402a430e8012e83b9926ed3c" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:50.777449 24730 raft_consensus.cc:2468] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:50.778991 24775 raft_consensus.cc:359] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:50.779551 24619 leader_election.cc:304] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:50.780179 24775 raft_consensus.cc:385] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.780629 24775 raft_consensus.cc:740] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.781539 24776 tablet_bootstrap.cc:492] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:50.781710 24815 raft_consensus.cc:2804] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:50.782260 24815 raft_consensus.cc:493] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.782739 24815 raft_consensus.cc:3060] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.782873 24776 ts_tablet_manager.cc:1403] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.227s	user 0.015s	sys 0.014s
I20260709 13:06:50.783149 24656 raft_consensus.cc:2468] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:50.786085 24546 leader_election.cc:304] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:50.788300 24790 raft_consensus.cc:2804] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:50.790618 24775 consensus_queue.cc:260] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:50.789439 24776 raft_consensus.cc:359] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:50.794118 24776 raft_consensus.cc:385] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.794577 24776 raft_consensus.cc:740] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.805287 24646 tablet_service.cc:1511] Processing CreateTablet for tablet 5007dd79f86a4afcb717368e91865e27 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:50.800251 24790 raft_consensus.cc:697] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:50.806871 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5007dd79f86a4afcb717368e91865e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.807677 24790 consensus_queue.cc:237] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.820087 24775 ts_tablet_manager.cc:1434] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.003s
I20260709 13:06:50.823026 24715 tablet_service.cc:1511] Processing CreateTablet for tablet 5007dd79f86a4afcb717368e91865e27 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:06:50.824631 24715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5007dd79f86a4afcb717368e91865e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.801563 24776 consensus_queue.cc:260] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:50.828625 24776 ts_tablet_manager.cc:1434] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.003s
I20260709 13:06:50.834035 24815 raft_consensus.cc:515] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.830089 24776 tablet_bootstrap.cc:492] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:50.837592 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66a54bd402a430e8012e83b9926ed3c" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:50.844372 24730 raft_consensus.cc:3060] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.841874 24775 tablet_bootstrap.cc:492] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:50.869660 24830 raft_consensus.cc:493] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.870800 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66a54bd402a430e8012e83b9926ed3c" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:50.870579 24830 raft_consensus.cc:515] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:50.871955 24778 tablet_bootstrap.cc:654] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.879554 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6357dd272feb4d93ab11f73b1e3bead5" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:50.881145 24619 leader_election.cc:343] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.883354 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6357dd272feb4d93ab11f73b1e3bead5" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:50.884001 24495 tablet_service.cc:1511] Processing CreateTablet for tablet 4161a18cbe354021af90307a3789b890 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:50.870048 24777 tablet_bootstrap.cc:492] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:50.885432 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4161a18cbe354021af90307a3789b890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.885540 24777 ts_tablet_manager.cc:1403] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.296s	user 0.015s	sys 0.006s
W20260709 13:06:50.886668 24545 leader_election.cc:343] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.889225 24830 leader_election.cc:290] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
W20260709 13:06:50.892339 24546 leader_election.cc:343] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.893167 24546 leader_election.cc:304] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:50.893592 24569 tablet_service.cc:1511] Processing CreateTablet for tablet 4161a18cbe354021af90307a3789b890 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:50.895251 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4161a18cbe354021af90307a3789b890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.903507 24777 raft_consensus.cc:359] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.904474 24777 raft_consensus.cc:385] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:50.904785 24777 raft_consensus.cc:740] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:50.890753 24815 leader_election.cc:290] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:50.901583 24775 tablet_bootstrap.cc:654] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.916189 24830 raft_consensus.cc:2749] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:50.942428 24778 tablet_bootstrap.cc:492] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:50.943121 24778 ts_tablet_manager.cc:1403] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.187s	user 0.005s	sys 0.022s
I20260709 13:06:50.944768 24719 tablet_service.cc:1511] Processing CreateTablet for tablet 8fde674ca95f4161a7f741a822bfe6df (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:50.945279 24497 tablet_service.cc:1511] Processing CreateTablet for tablet 8fde674ca95f4161a7f741a822bfe6df (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:50.905701 24777 consensus_queue.cc:260] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.947805 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fde674ca95f4161a7f741a822bfe6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.947962 24497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fde674ca95f4161a7f741a822bfe6df. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:50.948459 24622 consensus_peers.cc:597] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.950512 24776 tablet_bootstrap.cc:654] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:50.962766 24808 raft_consensus.cc:493] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.963406 24808 raft_consensus.cc:515] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:50.967885 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f9a01ed3924f7e8f9e3b4e2cd343d0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:50.969010 24808 leader_election.cc:290] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
W20260709 13:06:50.969590 24453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:06:50.970665 24693 leader_election.cc:343] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:50.972831 24641 tablet_service.cc:1511] Processing CreateTablet for tablet 4161a18cbe354021af90307a3789b890 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:06:50.973832 24641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4161a18cbe354021af90307a3789b890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:50.974258 24729 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:50.983455 24810 raft_consensus.cc:493] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.984100 24810 raft_consensus.cc:515] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:50.989576 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f9a01ed3924f7e8f9e3b4e2cd343d0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:51.003765 24569 tablet_service.cc:1511] Processing CreateTablet for tablet 8fde674ca95f4161a7f741a822bfe6df (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:06:51.005241 24778 raft_consensus.cc:359] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.007205 24569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fde674ca95f4161a7f741a822bfe6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:51.007053 24719 tablet_service.cc:1511] Processing CreateTablet for tablet 90d88b79763a4db4a24e470a3d02f478 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:51.008638 24719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d88b79763a4db4a24e470a3d02f478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:51.015594 24495 tablet_service.cc:1511] Processing CreateTablet for tablet 90d88b79763a4db4a24e470a3d02f478 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:51.016925 24495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d88b79763a4db4a24e470a3d02f478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:51.016607 24789 consensus_queue.cc:1048] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.017575 24646 tablet_service.cc:1511] Processing CreateTablet for tablet 90d88b79763a4db4a24e470a3d02f478 (DEFAULT_TABLE table=test-workload [id=002f48a2a8ae41159e98207523e696a4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:06:51.018052 24730 raft_consensus.cc:2468] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:51.018847 24646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d88b79763a4db4a24e470a3d02f478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:51.023036 24619 leader_election.cc:304] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:51.000448 24655 raft_consensus.cc:2468] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 0.
I20260709 13:06:51.032539 24403 catalog_manager.cc:5697] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.033747 24694 leader_election.cc:304] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:51.034410 24789 raft_consensus.cc:2804] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.035009 24789 raft_consensus.cc:697] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:51.035116 24782 raft_consensus.cc:2804] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.035542 24782 raft_consensus.cc:493] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.035946 24782 raft_consensus.cc:3060] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.036185 24789 consensus_queue.cc:237] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.003811 24777 ts_tablet_manager.cc:1434] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.118s	user 0.005s	sys 0.004s
I20260709 13:06:51.006151 24778 raft_consensus.cc:385] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.044075 24776 tablet_bootstrap.cc:492] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:51.044687 24776 ts_tablet_manager.cc:1403] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.215s	user 0.010s	sys 0.013s
I20260709 13:06:51.040578 24778 raft_consensus.cc:740] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.050506 24778 consensus_queue.cc:260] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.051393 24776 raft_consensus.cc:359] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.059298 24776 raft_consensus.cc:385] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.059947 24776 raft_consensus.cc:740] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.072919 24777 tablet_bootstrap.cc:492] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:51.074369 24775 tablet_bootstrap.cc:492] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:51.074997 24775 ts_tablet_manager.cc:1403] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.253s	user 0.017s	sys 0.011s
I20260709 13:06:51.079496 24808 raft_consensus.cc:493] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.079610 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.061736 24776 consensus_queue.cc:260] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.080309 24808 raft_consensus.cc:515] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.081983 24775 raft_consensus.cc:359] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.087039 24581 raft_consensus.cc:2468] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:51.089167 24775 raft_consensus.cc:385] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.094295 24775 raft_consensus.cc:740] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.094775 24810 leader_election.cc:290] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:51.096839 24775 consensus_queue.cc:260] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.099989 24810 consensus_queue.cc:1048] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.103633 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.104342 24581 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:06:51.104377 24782 raft_consensus.cc:515] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.106017 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:51.107523 24696 leader_election.cc:304] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:51.108215 24808 leader_election.cc:290] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:51.106081 24473 leader_election.cc:304] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:51.110427 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f9a01ed3924f7e8f9e3b4e2cd343d0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:51.111311 24776 ts_tablet_manager.cc:1434] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.002s
W20260709 13:06:51.112074 24693 leader_election.cc:343] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.112959 24841 consensus_queue.cc:1048] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.114460 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:51.114506 24841 raft_consensus.cc:2804] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.115845 24841 raft_consensus.cc:493] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.116217 24841 raft_consensus.cc:3060] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.121935 24778 ts_tablet_manager.cc:1434] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.178s	user 0.018s	sys 0.014s
I20260709 13:06:51.117504 24776 tablet_bootstrap.cc:492] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
W20260709 13:06:51.129561 24471 leader_election.cc:343] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.120749 24782 leader_election.cc:290] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:51.132324 24782 raft_consensus.cc:493] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.132925 24782 raft_consensus.cc:515] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.140928 24782 leader_election.cc:290] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:51.132247 24777 tablet_bootstrap.cc:654] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.143452 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adface6ea0a7412bab90d65a3ed77df8" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:51.144320 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f9a01ed3924f7e8f9e3b4e2cd343d0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:51.144968 24655 raft_consensus.cc:3060] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.150944 24778 tablet_bootstrap.cc:492] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:51.151940 24776 tablet_bootstrap.cc:654] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:51.155540 24693 leader_election.cc:343] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:51.157346 24696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 49938.3us
I20260709 13:06:51.160094 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adface6ea0a7412bab90d65a3ed77df8" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:51.165977 24696 leader_election.cc:343] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.165654 24841 raft_consensus.cc:515] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.166570 24696 leader_election.cc:304] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:51.167558 24845 raft_consensus.cc:2749] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.168399 24790 raft_consensus.cc:493] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.168974 24790 raft_consensus.cc:515] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.170130 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
W20260709 13:06:51.171808 24471 leader_election.cc:343] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.172016 24790 leader_election.cc:290] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:51.174508 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508d2533e8754d53924aecd87664e4fa" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:51.177418 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508d2533e8754d53924aecd87664e4fa" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:51.175204 24775 ts_tablet_manager.cc:1434] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.100s	user 0.021s	sys 0.021s
W20260709 13:06:51.179425 24545 leader_election.cc:343] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.180547 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:51.172456 24841 leader_election.cc:290] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:51.190824 24581 raft_consensus.cc:3060] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.194818 24655 raft_consensus.cc:2468] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:06:51.196343 24694 leader_election.cc:304] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:51.197424 24845 raft_consensus.cc:2804] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.198155 24845 raft_consensus.cc:697] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
W20260709 13:06:51.198571 24545 leader_election.cc:343] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.199126 24545 leader_election.cc:304] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:51.201460 24778 tablet_bootstrap.cc:654] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.200621 24775 tablet_bootstrap.cc:492] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:51.202296 24790 raft_consensus.cc:2749] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.204233 24777 tablet_bootstrap.cc:492] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:51.199478 24845 consensus_queue.cc:237] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.204813 24777 ts_tablet_manager.cc:1403] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.154s	user 0.010s	sys 0.005s
I20260709 13:06:51.202989 24403 catalog_manager.cc:5697] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.208405 24777 raft_consensus.cc:359] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.210152 24776 tablet_bootstrap.cc:492] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:51.210963 24776 ts_tablet_manager.cc:1403] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.099s	user 0.019s	sys 0.000s
I20260709 13:06:51.209237 24777 raft_consensus.cc:385] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.215507 24777 raft_consensus.cc:740] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.216907 24830 raft_consensus.cc:493] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.217582 24830 raft_consensus.cc:515] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.219108 24775 tablet_bootstrap.cc:654] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.219101 24776 raft_consensus.cc:359] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.220587 24581 raft_consensus.cc:2468] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:51.221992 24776 raft_consensus.cc:385] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.234115 24473 leader_election.cc:304] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:51.238021 24841 raft_consensus.cc:2804] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.238433 24808 raft_consensus.cc:2804] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:51.238616 24841 raft_consensus.cc:697] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:51.239842 24841 consensus_queue.cc:237] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.230610 24790 consensus_queue.cc:1048] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:06:51.243485 24790 consensus_queue.cc:1048] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.219755 24777 consensus_queue.cc:260] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.228645 24776 raft_consensus.cc:740] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.261696 24830 leader_election.cc:290] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:51.268361 24776 consensus_queue.cc:260] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.270094 24777 ts_tablet_manager.cc:1434] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.065s	user 0.007s	sys 0.002s
I20260709 13:06:51.271523 24776 ts_tablet_manager.cc:1434] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.060s	user 0.010s	sys 0.000s
I20260709 13:06:51.272955 24776 tablet_bootstrap.cc:492] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:51.273306 24808 raft_consensus.cc:493] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:06:51.273828 24808 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:51.277040 24546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 46658us
I20260709 13:06:51.292920 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7db6e3ae894339b05d8598c9df859e" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
W20260709 13:06:51.294559 24545 leader_election.cc:343] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.305006 24778 tablet_bootstrap.cc:492] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:51.305665 24778 ts_tablet_manager.cc:1403] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.155s	user 0.029s	sys 0.014s
I20260709 13:06:51.307873 24507 raft_consensus.cc:3060] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.310948 24777 tablet_bootstrap.cc:492] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:51.313153 24808 raft_consensus.cc:515] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.317085 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7db6e3ae894339b05d8598c9df859e" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:51.317556 24776 tablet_bootstrap.cc:654] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.317870 24655 raft_consensus.cc:2468] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:51.326120 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:51.317894 24729 raft_consensus.cc:1240] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Rejecting Update request from peer 7e0390f5bd00484985fa5469e25be18d for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:51.328944 24546 leader_election.cc:304] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:51.330044 24854 raft_consensus.cc:2804] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.330500 24854 raft_consensus.cc:493] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.330852 24854 raft_consensus.cc:3060] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.335282 24778 raft_consensus.cc:359] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.319053 24405 catalog_manager.cc:5697] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 1 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.336494 24778 raft_consensus.cc:385] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.337054 24778 raft_consensus.cc:740] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.340867 24840 consensus_queue.cc:1059] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.342331 24840 raft_consensus.cc:3055] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:51.342852 24840 raft_consensus.cc:740] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:51.344132 24840 consensus_queue.cc:260] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.345995 24840 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:51.350392 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:51.320376 24808 leader_election.cc:290] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:51.353003 24696 leader_election.cc:304] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:51.357244 24775 tablet_bootstrap.cc:492] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:51.354981 24778 consensus_queue.cc:260] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.351328 24403 catalog_manager.cc:5697] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.359935 24808 raft_consensus.cc:2749] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:51.360960 24775 ts_tablet_manager.cc:1403] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.158s	user 0.043s	sys 0.022s
I20260709 13:06:51.364476 24775 raft_consensus.cc:359] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.365248 24775 raft_consensus.cc:385] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.365535 24775 raft_consensus.cc:740] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.360458 24778 ts_tablet_manager.cc:1434] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 13:06:51.371793 24778 tablet_bootstrap.cc:492] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:51.371869 24777 tablet_bootstrap.cc:654] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.371558 24775 consensus_queue.cc:260] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.375842 24854 raft_consensus.cc:515] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.380117 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7db6e3ae894339b05d8598c9df859e" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:51.382418 24655 raft_consensus.cc:3060] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.385667 24778 tablet_bootstrap.cc:654] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.380061 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7db6e3ae894339b05d8598c9df859e" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
W20260709 13:06:51.388325 24545 leader_election.cc:343] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.388592 24775 ts_tablet_manager.cc:1434] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:06:51.378415 24854 leader_election.cc:290] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:51.396412 24775 tablet_bootstrap.cc:492] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:51.403705 24777 tablet_bootstrap.cc:492] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:51.405803 24777 ts_tablet_manager.cc:1403] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.003s
I20260709 13:06:51.407533 24775 tablet_bootstrap.cc:654] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.414302 24778 tablet_bootstrap.cc:492] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:51.414981 24778 ts_tablet_manager.cc:1403] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.003s
I20260709 13:06:51.415609 24777 raft_consensus.cc:359] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.416769 24777 raft_consensus.cc:385] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.417091 24777 raft_consensus.cc:740] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.417940 24777 consensus_queue.cc:260] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.418968 24778 raft_consensus.cc:359] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.419945 24778 raft_consensus.cc:385] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.420703 24778 raft_consensus.cc:740] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.401116 24655 raft_consensus.cc:2468] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:51.423120 24546 leader_election.cc:304] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:51.421991 24778 consensus_queue.cc:260] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.424428 24854 raft_consensus.cc:2804] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.427017 24854 raft_consensus.cc:697] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:51.428001 24854 consensus_queue.cc:237] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.422012 24776 tablet_bootstrap.cc:492] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:51.430454 24775 tablet_bootstrap.cc:492] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:51.431068 24775 ts_tablet_manager.cc:1403] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.008s
I20260709 13:06:51.430512 24776 ts_tablet_manager.cc:1403] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.158s	user 0.025s	sys 0.010s
I20260709 13:06:51.433231 24777 ts_tablet_manager.cc:1434] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:06:51.434182 24789 raft_consensus.cc:493] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.434660 24777 tablet_bootstrap.cc:492] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:51.434406 24775 raft_consensus.cc:359] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.434828 24789 raft_consensus.cc:515] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.435528 24775 raft_consensus.cc:385] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.435686 24808 raft_consensus.cc:493] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.436134 24775 raft_consensus.cc:740] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.436560 24778 ts_tablet_manager.cc:1434] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:06:51.436304 24808 raft_consensus.cc:515] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.437259 24775 consensus_queue.cc:260] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.438035 24778 tablet_bootstrap.cc:492] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:51.438633 24808 leader_election.cc:290] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:51.439580 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6357dd272feb4d93ab11f73b1e3bead5" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.440487 24581 raft_consensus.cc:2468] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:51.442811 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6357dd272feb4d93ab11f73b1e3bead5" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:51.443550 24622 leader_election.cc:304] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:51.444566 24815 raft_consensus.cc:2804] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.444988 24815 raft_consensus.cc:493] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.445324 24815 raft_consensus.cc:3060] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.439664 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f50121b46a470a88a2ca466f285339" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.443611 24729 raft_consensus.cc:2468] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
W20260709 13:06:51.447440 24696 leader_election.cc:343] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.448499 24775 ts_tablet_manager.cc:1434] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:06:51.449834 24775 tablet_bootstrap.cc:492] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:51.450367 24789 leader_election.cc:290] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:51.452621 24777 tablet_bootstrap.cc:654] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.448464 24778 tablet_bootstrap.cc:654] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.454727 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f50121b46a470a88a2ca466f285339" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:51.456285 24694 leader_election.cc:343] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.456781 24694 leader_election.cc:304] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:51.457990 24808 raft_consensus.cc:2749] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.460755 24815 raft_consensus.cc:515] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.464056 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6357dd272feb4d93ab11f73b1e3bead5" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:51.464776 24582 raft_consensus.cc:3060] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.468233 24775 tablet_bootstrap.cc:654] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.471462 24778 tablet_bootstrap.cc:492] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:51.472126 24778 ts_tablet_manager.cc:1403] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.008s
I20260709 13:06:51.473387 24582 raft_consensus.cc:2468] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:51.474906 24622 leader_election.cc:304] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:51.475363 24778 raft_consensus.cc:359] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.475915 24789 raft_consensus.cc:2804] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.476150 24778 raft_consensus.cc:385] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.476559 24777 tablet_bootstrap.cc:492] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:51.476549 24778 raft_consensus.cc:740] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.476823 24775 tablet_bootstrap.cc:492] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:51.477195 24777 ts_tablet_manager.cc:1403] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.005s
I20260709 13:06:51.477756 24775 ts_tablet_manager.cc:1403] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.004s
I20260709 13:06:51.477454 24778 consensus_queue.cc:260] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.480129 24778 ts_tablet_manager.cc:1434] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 13:06:51.480432 24777 raft_consensus.cc:359] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.480811 24776 raft_consensus.cc:359] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.481624 24776 raft_consensus.cc:385] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.482297 24789 raft_consensus.cc:697] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:51.481242 24777 raft_consensus.cc:385] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.483253 24777 raft_consensus.cc:740] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.483377 24789 consensus_queue.cc:237] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.484179 24778 tablet_bootstrap.cc:492] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:51.484182 24777 consensus_queue.cc:260] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.486954 24777 ts_tablet_manager.cc:1434] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:06:51.488312 24777 tablet_bootstrap.cc:492] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:51.489743 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6357dd272feb4d93ab11f73b1e3bead5" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:51.490470 24729 raft_consensus.cc:3060] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.493304 24402 catalog_manager.cc:5697] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.495916 24777 tablet_bootstrap.cc:654] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.499136 24729 raft_consensus.cc:2468] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:51.500259 24775 raft_consensus.cc:359] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.481962 24776 raft_consensus.cc:740] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.501127 24775 raft_consensus.cc:385] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.501595 24775 raft_consensus.cc:740] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.501890 24776 consensus_queue.cc:260] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.502399 24775 consensus_queue.cc:260] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.504019 24815 leader_election.cc:290] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:51.504776 24775 ts_tablet_manager.cc:1434] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:06:51.505658 24776 ts_tablet_manager.cc:1434] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 13:06:51.506486 24775 tablet_bootstrap.cc:492] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:51.506755 24776 tablet_bootstrap.cc:492] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:51.513578 24775 tablet_bootstrap.cc:654] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:51.515502 24619 consensus_peers.cc:597] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:51.517298 24778 tablet_bootstrap.cc:654] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.524391 24776 tablet_bootstrap.cc:654] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.525904 24777 tablet_bootstrap.cc:492] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:51.526510 24777 ts_tablet_manager.cc:1403] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.008s
I20260709 13:06:51.526787 24775 tablet_bootstrap.cc:492] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:51.527377 24775 ts_tablet_manager.cc:1403] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.006s
I20260709 13:06:51.529927 24777 raft_consensus.cc:359] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.530328 24775 raft_consensus.cc:359] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.531047 24777 raft_consensus.cc:385] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.531522 24777 raft_consensus.cc:740] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.532830 24777 consensus_queue.cc:260] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.534436 24402 catalog_manager.cc:5697] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.536207 24777 ts_tablet_manager.cc:1434] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:06:51.537781 24777 tablet_bootstrap.cc:492] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:51.538208 24776 tablet_bootstrap.cc:492] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:51.538801 24776 ts_tablet_manager.cc:1403] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.006s
I20260709 13:06:51.531355 24775 raft_consensus.cc:385] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.541798 24776 raft_consensus.cc:359] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.542387 24775 raft_consensus.cc:740] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.542661 24776 raft_consensus.cc:385] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.542979 24776 raft_consensus.cc:740] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.543485 24775 consensus_queue.cc:260] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.543850 24776 consensus_queue.cc:260] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.545089 24777 tablet_bootstrap.cc:654] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.546259 24775 ts_tablet_manager.cc:1434] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:06:51.547797 24775 tablet_bootstrap.cc:492] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:51.550462 24778 tablet_bootstrap.cc:492] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:51.551241 24778 ts_tablet_manager.cc:1403] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.006s
I20260709 13:06:51.554374 24775 tablet_bootstrap.cc:654] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.555294 24789 consensus_queue.cc:1048] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.558081 24777 tablet_bootstrap.cc:492] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:51.558655 24777 ts_tablet_manager.cc:1403] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.010s
I20260709 13:06:51.561000 24854 raft_consensus.cc:493] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.561721 24854 raft_consensus.cc:515] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.566051 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56de0c37502d4e8d80b19f4427f256b0" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:51.567101 24507 raft_consensus.cc:2468] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:51.571378 24545 leader_election.cc:304] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:51.572218 24790 raft_consensus.cc:2804] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.572670 24790 raft_consensus.cc:493] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.573040 24790 raft_consensus.cc:3060] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.573820 24775 tablet_bootstrap.cc:492] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:51.574569 24775 ts_tablet_manager.cc:1403] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.008s
I20260709 13:06:51.576216 24778 raft_consensus.cc:359] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.576524 24777 raft_consensus.cc:359] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.577039 24778 raft_consensus.cc:385] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.577185 24777 raft_consensus.cc:385] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.577399 24778 raft_consensus.cc:740] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.577487 24777 raft_consensus.cc:740] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.578006 24775 raft_consensus.cc:359] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.578887 24775 raft_consensus.cc:385] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.579221 24775 raft_consensus.cc:740] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.580145 24775 consensus_queue.cc:260] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.582628 24775 ts_tablet_manager.cc:1434] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:06:51.583900 24775 tablet_bootstrap.cc:492] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:51.584759 24790 raft_consensus.cc:515] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.585790 24778 consensus_queue.cc:260] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.587652 24790 leader_election.cc:290] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:51.588909 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56de0c37502d4e8d80b19f4427f256b0" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:51.589294 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56de0c37502d4e8d80b19f4427f256b0" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:51.590433 24854 leader_election.cc:290] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:51.590951 24808 raft_consensus.cc:493] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.597445 24777 consensus_queue.cc:260] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.598580 24655 raft_consensus.cc:2468] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:51.592550 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56de0c37502d4e8d80b19f4427f256b0" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:51.599512 24507 raft_consensus.cc:3060] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.598079 24808 raft_consensus.cc:515] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.601943 24777 ts_tablet_manager.cc:1434] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:06:51.603194 24777 tablet_bootstrap.cc:492] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:51.603489 24775 tablet_bootstrap.cc:654] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.605952 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508d2533e8754d53924aecd87664e4fa" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:51.606805 24506 raft_consensus.cc:2468] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 0.
I20260709 13:06:51.606918 24505 raft_consensus.cc:3060] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.609544 24777 tablet_bootstrap.cc:654] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.591801 24778 ts_tablet_manager.cc:1434] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:06:51.612035 24693 leader_election.cc:304] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:51.613272 24845 raft_consensus.cc:2804] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.613687 24845 raft_consensus.cc:493] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.614037 24845 raft_consensus.cc:3060] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.618619 24778 tablet_bootstrap.cc:492] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:51.619693 24775 tablet_bootstrap.cc:492] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:51.620276 24775 ts_tablet_manager.cc:1403] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.003s
I20260709 13:06:51.623232 24775 raft_consensus.cc:359] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.623948 24775 raft_consensus.cc:385] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.624238 24775 raft_consensus.cc:740] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.626421 24775 consensus_queue.cc:260] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.627709 24777 tablet_bootstrap.cc:492] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:51.628276 24777 ts_tablet_manager.cc:1403] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.025s	user 0.005s	sys 0.017s
I20260709 13:06:51.629550 24778 tablet_bootstrap.cc:654] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.629350 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508d2533e8754d53924aecd87664e4fa" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.630098 24582 raft_consensus.cc:2468] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 0.
I20260709 13:06:51.628224 24808 leader_election.cc:290] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:51.630915 24775 ts_tablet_manager.cc:1434] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:06:51.631502 24777 raft_consensus.cc:359] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.632050 24775 tablet_bootstrap.cc:492] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:51.632908 24789 raft_consensus.cc:493] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.633441 24789 raft_consensus.cc:515] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.636797 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:51.632297 24777 raft_consensus.cc:385] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.638825 24777 raft_consensus.cc:740] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.641745 24775 tablet_bootstrap.cc:654] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.643896 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.644819 24582 raft_consensus.cc:2393] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 7e0390f5bd00484985fa5469e25be18d in this term.
I20260709 13:06:51.646368 24622 leader_election.cc:304] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:51.641741 24789 leader_election.cc:290] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:51.647850 24815 raft_consensus.cc:3060] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.650471 24843 consensus_queue.cc:1048] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:51.651823 24507 raft_consensus.cc:2468] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:51.653615 24545 leader_election.cc:304] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:51.654013 24845 raft_consensus.cc:515] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.655054 24840 consensus_queue.cc:1048] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:51.657618 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508d2533e8754d53924aecd87664e4fa" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:51.658324 24582 raft_consensus.cc:3060] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.660938 24790 raft_consensus.cc:2804] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.661551 24790 raft_consensus.cc:697] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:51.662204 24777 consensus_queue.cc:260] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.662495 24790 consensus_queue.cc:237] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.664841 24777 ts_tablet_manager.cc:1434] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:06:51.665567 24843 consensus_queue.cc:1048] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:06:51.672879 24777 tablet_bootstrap.cc:492] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:51.676272 24775 tablet_bootstrap.cc:492] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:51.676623 24776 ts_tablet_manager.cc:1434] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.001s
I20260709 13:06:51.676789 24775 ts_tablet_manager.cc:1403] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.006s
I20260709 13:06:51.666791 24845 leader_election.cc:290] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:51.689637 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "508d2533e8754d53924aecd87664e4fa" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:51.690448 24507 raft_consensus.cc:3060] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.692732 24582 raft_consensus.cc:2468] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:06:51.694003 24696 leader_election.cc:304] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:51.695828 24845 raft_consensus.cc:2804] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.697314 24845 raft_consensus.cc:697] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:06:51.698177 24845 consensus_queue.cc:237] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.707314 24776 tablet_bootstrap.cc:492] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:51.708124 24777 tablet_bootstrap.cc:654] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.704747 24815 raft_consensus.cc:2749] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.712167 24775 raft_consensus.cc:359] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.713467 24775 raft_consensus.cc:385] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.713877 24775 raft_consensus.cc:740] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.715993 24840 consensus_queue.cc:1048] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.723668 24778 tablet_bootstrap.cc:492] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:51.724268 24778 ts_tablet_manager.cc:1403] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.012s
I20260709 13:06:51.726639 24775 consensus_queue.cc:260] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.732348 24778 raft_consensus.cc:359] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.733227 24778 raft_consensus.cc:385] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.733536 24778 raft_consensus.cc:740] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.734754 24778 consensus_queue.cc:260] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.737318 24778 ts_tablet_manager.cc:1434] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:06:51.737767 24776 tablet_bootstrap.cc:654] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.733438 24404 catalog_manager.cc:5697] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.748267 24843 raft_consensus.cc:493] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.748940 24843 raft_consensus.cc:515] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.753575 24777 tablet_bootstrap.cc:492] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:51.754423 24775 ts_tablet_manager.cc:1434] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.001s
I20260709 13:06:51.754613 24777 ts_tablet_manager.cc:1403] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.013s
I20260709 13:06:51.761399 24843 leader_election.cc:290] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:51.762164 24778 tablet_bootstrap.cc:492] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:51.762415 24843 raft_consensus.cc:493] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.763015 24843 raft_consensus.cc:515] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.764235 24507 raft_consensus.cc:2468] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:06:51.766220 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7db6e3ae894339b05d8598c9df859e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.768527 24790 raft_consensus.cc:493] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.757573 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aba850266fd46739f0f92ff3ac0de00" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.769111 24790 raft_consensus.cc:515] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.770381 24778 tablet_bootstrap.cc:654] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.771522 24790 leader_election.cc:290] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:51.773939 24843 leader_election.cc:290] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:51.774139 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4698536ba648bb9b505f77a4cef71b" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:51.774931 24729 raft_consensus.cc:2468] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
W20260709 13:06:51.774158 24696 leader_election.cc:343] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.776270 24775 tablet_bootstrap.cc:492] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:51.776541 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4698536ba648bb9b505f77a4cef71b" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:51.777254 24545 leader_election.cc:304] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:51.778144 24790 raft_consensus.cc:2804] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.778595 24790 raft_consensus.cc:493] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.780081 24790 raft_consensus.cc:3060] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.777307 24507 raft_consensus.cc:2468] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:51.782397 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aba850266fd46739f0f92ff3ac0de00" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:51.789697 24790 raft_consensus.cc:515] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.791450 24403 catalog_manager.cc:5697] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 1 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:51.792189 24694 leader_election.cc:343] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.793766 24694 leader_election.cc:304] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:51.794577 24775 tablet_bootstrap.cc:654] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.795420 24892 raft_consensus.cc:2749] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.797129 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7db6e3ae894339b05d8598c9df859e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:51.800259 24656 raft_consensus.cc:2393] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3eeda3010ca44374a5bbf85e7980ba1c in current term 1: Already voted for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in this term.
I20260709 13:06:51.800768 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4698536ba648bb9b505f77a4cef71b" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:51.801390 24729 raft_consensus.cc:3060] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.801590 24694 leader_election.cc:304] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:51.802177 24778 tablet_bootstrap.cc:492] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:51.802718 24778 ts_tablet_manager.cc:1403] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.045s	user 0.001s	sys 0.012s
I20260709 13:06:51.803928 24790 leader_election.cc:290] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:51.804551 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4698536ba648bb9b505f77a4cef71b" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:51.805169 24507 raft_consensus.cc:3060] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.805876 24892 raft_consensus.cc:3060] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.806938 24776 tablet_bootstrap.cc:492] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:51.807456 24776 ts_tablet_manager.cc:1403] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.010s
I20260709 13:06:51.810429 24776 raft_consensus.cc:359] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.811127 24776 raft_consensus.cc:385] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.811410 24776 raft_consensus.cc:740] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.812100 24776 consensus_queue.cc:260] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:51.813387 24507 raft_consensus.cc:2468] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:51.814899 24545 leader_election.cc:304] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:51.816129 24790 raft_consensus.cc:2804] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.816704 24790 raft_consensus.cc:697] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:51.817629 24790 consensus_queue.cc:237] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.819821 24776 ts_tablet_manager.cc:1434] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:06:51.821012 24776 tablet_bootstrap.cc:492] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:51.824085 24729 raft_consensus.cc:2468] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:51.814785 24777 raft_consensus.cc:359] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.836051 24777 raft_consensus.cc:385] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.836524 24777 raft_consensus.cc:740] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.837165 24778 raft_consensus.cc:359] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.837986 24778 raft_consensus.cc:385] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.838274 24778 raft_consensus.cc:740] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.839013 24778 consensus_queue.cc:260] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.841141 24778 ts_tablet_manager.cc:1434] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.002s
I20260709 13:06:51.842284 24778 tablet_bootstrap.cc:492] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:51.832201 24775 tablet_bootstrap.cc:492] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:51.833874 24776 tablet_bootstrap.cc:654] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.832649 24892 raft_consensus.cc:2749] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:51.846010 24775 ts_tablet_manager.cc:1403] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.003s
I20260709 13:06:51.837548 24777 consensus_queue.cc:260] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.849640 24778 tablet_bootstrap.cc:654] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.852195 24777 ts_tablet_manager.cc:1434] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.000s
I20260709 13:06:51.853039 24775 raft_consensus.cc:359] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.853662 24777 tablet_bootstrap.cc:492] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:51.853830 24775 raft_consensus.cc:385] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.854993 24775 raft_consensus.cc:740] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.855857 24775 consensus_queue.cc:260] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.863138 24775 ts_tablet_manager.cc:1434] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:06:51.864385 24775 tablet_bootstrap.cc:492] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:51.865911 24778 tablet_bootstrap.cc:492] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:51.866540 24778 ts_tablet_manager.cc:1403] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 13:06:51.870365 24778 raft_consensus.cc:359] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.869942 24815 raft_consensus.cc:493] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.871496 24815 raft_consensus.cc:515] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.872786 24775 tablet_bootstrap.cc:654] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.875101 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419e360ee50f470b8f48831ac5316b40" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.875511 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419e360ee50f470b8f48831ac5316b40" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:51.876242 24815 leader_election.cc:290] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
W20260709 13:06:51.876739 24622 leader_election.cc:343] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.873708 24401 catalog_manager.cc:5697] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.876827 24778 raft_consensus.cc:385] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.877807 24778 raft_consensus.cc:740] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.878611 24778 consensus_queue.cc:260] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.879575 24507 raft_consensus.cc:2468] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:51.880630 24840 raft_consensus.cc:493] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.881192 24840 raft_consensus.cc:515] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.882416 24619 leader_election.cc:304] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:51.883602 24840 leader_election.cc:290] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:51.884326 24815 raft_consensus.cc:2804] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.884920 24815 raft_consensus.cc:493] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.885357 24815 raft_consensus.cc:3060] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.885406 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adface6ea0a7412bab90d65a3ed77df8" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.886301 24581 raft_consensus.cc:2468] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:51.887668 24473 leader_election.cc:304] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:51.888078 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adface6ea0a7412bab90d65a3ed77df8" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:51.888649 24840 raft_consensus.cc:2804] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.888808 24729 raft_consensus.cc:2468] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:51.889140 24840 raft_consensus.cc:493] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.889608 24840 raft_consensus.cc:3060] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.896672 24815 raft_consensus.cc:515] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.899467 24778 ts_tablet_manager.cc:1434] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:06:51.907935 24778 tablet_bootstrap.cc:492] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:51.903793 24840 raft_consensus.cc:515] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.908478 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419e360ee50f470b8f48831ac5316b40" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:51.909132 24843 raft_consensus.cc:493] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.912029 24815 leader_election.cc:290] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:51.910959 24843 raft_consensus.cc:515] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.913872 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419e360ee50f470b8f48831ac5316b40" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:51.916111 24776 tablet_bootstrap.cc:492] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:51.910912 24507 raft_consensus.cc:3060] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.917786 24776 ts_tablet_manager.cc:1403] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.097s	user 0.006s	sys 0.007s
I20260709 13:06:51.918862 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827bf9c0d4a14d209cbef1837ddb425d" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
W20260709 13:06:51.919389 24622 leader_election.cc:343] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:51.920289 24693 leader_election.cc:343] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.920660 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827bf9c0d4a14d209cbef1837ddb425d" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:51.921361 24656 raft_consensus.cc:2468] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 0.
I20260709 13:06:51.922403 24869 consensus_queue.cc:1048] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:51.922457 24694 leader_election.cc:304] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:51.923816 24808 raft_consensus.cc:2804] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:51.924225 24808 raft_consensus.cc:493] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.924564 24808 raft_consensus.cc:3060] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.924973 24775 tablet_bootstrap.cc:492] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:51.925518 24775 ts_tablet_manager.cc:1403] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.019s
I20260709 13:06:51.928519 24775 raft_consensus.cc:359] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.929230 24775 raft_consensus.cc:385] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.929512 24775 raft_consensus.cc:740] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.918370 24843 leader_election.cc:290] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:51.935000 24776 raft_consensus.cc:359] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.935812 24776 raft_consensus.cc:385] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:51.936133 24776 raft_consensus.cc:740] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:51.936230 24778 tablet_bootstrap.cc:654] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.930197 24775 consensus_queue.cc:260] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.938964 24775 ts_tablet_manager.cc:1434] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:06:51.939106 24840 leader_election.cc:290] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:51.940281 24775 tablet_bootstrap.cc:492] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:51.940477 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adface6ea0a7412bab90d65a3ed77df8" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:51.942483 24729 raft_consensus.cc:3060] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.942548 24776 consensus_queue.cc:260] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.946712 24776 ts_tablet_manager.cc:1434] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:06:51.947369 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adface6ea0a7412bab90d65a3ed77df8" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:51.948086 24581 raft_consensus.cc:3060] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:51.948177 24776 tablet_bootstrap.cc:492] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:51.954663 24776 tablet_bootstrap.cc:654] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.957130 24729 raft_consensus.cc:2468] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:51.961124 24808 raft_consensus.cc:515] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:51.960457 24777 tablet_bootstrap.cc:654] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.959489 24854 consensus_queue.cc:1048] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:51.963569 24790 raft_consensus.cc:493] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.964233 24581 raft_consensus.cc:2468] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:51.964125 24790 raft_consensus.cc:515] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:51.962347 24470 leader_election.cc:304] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:51.966368 24775 tablet_bootstrap.cc:654] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:51.966778 24840 raft_consensus.cc:2804] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:51.967319 24840 raft_consensus.cc:697] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:51.968242 24840 consensus_queue.cc:237] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.954730 24507 raft_consensus.cc:2468] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:51.983788 24808 leader_election.cc:290] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:51.985816 24808 raft_consensus.cc:493] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.986595 24808 raft_consensus.cc:515] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:51.989583 24808 leader_election.cc:290] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:51.991690 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827bf9c0d4a14d209cbef1837ddb425d" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:51.991729 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563bd2fd6aae48ba994effc0e9e35427" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:51.992646 24656 raft_consensus.cc:3060] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:51.993746 24696 leader_election.cc:343] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:51.996694 24619 leader_election.cc:304] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:51.998728 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "827bf9c0d4a14d209cbef1837ddb425d" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:52.000741 24815 raft_consensus.cc:2804] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.000986 24869 raft_consensus.cc:493] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.001336 24815 raft_consensus.cc:697] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:52.002677 24507 raft_consensus.cc:3060] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.003193 24815 consensus_queue.cc:237] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
W20260709 13:06:52.009578 24693 leader_election.cc:343] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.019294 24854 consensus_queue.cc:1048] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.015091 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1987f47fa594dbbac6f13e3ffaac7ba" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:52.000593 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563bd2fd6aae48ba994effc0e9e35427" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:52.029237 24808 raft_consensus.cc:493] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.001477 24869 raft_consensus.cc:515] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.034596 24790 leader_election.cc:290] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:52.041124 24808 raft_consensus.cc:515] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:52.056891 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1987f47fa594dbbac6f13e3ffaac7ba" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:52.060813 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:52.060844 24879 consensus_queue.cc:1048] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:52.061669 24693 leader_election.cc:343] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.062155 24693 leader_election.cc:304] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
W20260709 13:06:52.062536 24694 leader_election.cc:343] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.061216 24545 leader_election.cc:304] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:52.063716 24843 raft_consensus.cc:2749] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:52.067830 24790 raft_consensus.cc:2749] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:52.073451 24869 leader_election.cc:290] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:52.075675 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f50121b46a470a88a2ca466f285339" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:52.076660 24728 raft_consensus.cc:2468] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:52.064972 24808 leader_election.cc:290] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:52.081125 24776 tablet_bootstrap.cc:492] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:52.081969 24776 ts_tablet_manager.cc:1403] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.134s	user 0.021s	sys 0.017s
I20260709 13:06:52.083562 24619 leader_election.cc:304] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:06:52.086246 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f50121b46a470a88a2ca466f285339" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:52.086138 24776 raft_consensus.cc:359] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.087282 24581 raft_consensus.cc:2468] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:52.087523 24776 raft_consensus.cc:385] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.088030 24776 raft_consensus.cc:740] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.089035 24776 consensus_queue.cc:260] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.092338 24656 raft_consensus.cc:2468] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:06:52.086485 24869 raft_consensus.cc:2804] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.093421 24869 raft_consensus.cc:493] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.093793 24869 raft_consensus.cc:3060] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.096222 24694 leader_election.cc:304] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:52.097172 24808 raft_consensus.cc:2804] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.097733 24808 raft_consensus.cc:697] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:06:52.098898 24808 consensus_queue.cc:237] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:06:52.101938 24453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:52.117193 24843 consensus_queue.cc:1048] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.092563 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:52.102699 24402 catalog_manager.cc:5697] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.081105 24775 tablet_bootstrap.cc:492] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:52.120929 24775 ts_tablet_manager.cc:1403] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.181s	user 0.031s	sys 0.049s
I20260709 13:06:52.124935 24778 tablet_bootstrap.cc:492] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:52.125695 24778 ts_tablet_manager.cc:1403] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.218s	user 0.020s	sys 0.024s
I20260709 13:06:52.136966 24775 raft_consensus.cc:359] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.137768 24775 raft_consensus.cc:385] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.138084 24775 raft_consensus.cc:740] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.143565 24775 consensus_queue.cc:260] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
W20260709 13:06:52.145262 24693 leader_election.cc:343] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.145833 24693 leader_election.cc:304] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:52.146077 24775 ts_tablet_manager.cc:1434] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.004s
I20260709 13:06:52.147404 24775 tablet_bootstrap.cc:492] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:52.153901 24775 tablet_bootstrap.cc:654] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.154357 24777 tablet_bootstrap.cc:492] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:52.154938 24777 ts_tablet_manager.cc:1403] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.301s	user 0.023s	sys 0.006s
I20260709 13:06:52.159292 24892 raft_consensus.cc:2749] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:52.160399 24892 consensus_queue.cc:1048] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.165745 24776 ts_tablet_manager.cc:1434] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.083s	user 0.002s	sys 0.007s
I20260709 13:06:52.171175 24845 raft_consensus.cc:493] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.176601 24777 raft_consensus.cc:359] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.177431 24777 raft_consensus.cc:385] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.177744 24777 raft_consensus.cc:740] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.178442 24777 consensus_queue.cc:260] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.180586 24777 ts_tablet_manager.cc:1434] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 13:06:52.182113 24777 tablet_bootstrap.cc:492] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:52.177958 24778 raft_consensus.cc:359] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.180658 24776 tablet_bootstrap.cc:492] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:52.183702 24778 raft_consensus.cc:385] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.184105 24778 raft_consensus.cc:740] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.181715 24401 catalog_manager.cc:5697] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.195825 24845 raft_consensus.cc:515] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:52.196864 24777 tablet_bootstrap.cc:654] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.199182 24778 consensus_queue.cc:260] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.215291 24581 raft_consensus.cc:3060] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.222625 24857 consensus_queue.cc:1048] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.224973 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:52.230710 24845 leader_election.cc:290] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
W20260709 13:06:52.231073 24694 leader_election.cc:343] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.233287 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
W20260709 13:06:52.235472 24693 leader_election.cc:343] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.236166 24693 leader_election.cc:304] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:52.239954 24778 ts_tablet_manager.cc:1434] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.114s	user 0.010s	sys 0.001s
I20260709 13:06:52.242648 24845 raft_consensus.cc:2749] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:52.248862 24776 tablet_bootstrap.cc:654] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.250490 24857 consensus_queue.cc:1048] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:52.229580 24869 raft_consensus.cc:515] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.258411 24778 tablet_bootstrap.cc:492] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:52.271253 24775 tablet_bootstrap.cc:492] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:52.272090 24775 ts_tablet_manager.cc:1403] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.125s	user 0.025s	sys 0.013s
I20260709 13:06:52.273949 24854 raft_consensus.cc:493] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.274777 24854 raft_consensus.cc:515] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.277056 24854 leader_election.cc:290] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:52.278483 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aba850266fd46739f0f92ff3ac0de00" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:52.279296 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aba850266fd46739f0f92ff3ac0de00" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:52.280154 24730 raft_consensus.cc:2468] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
W20260709 13:06:52.280304 24546 leader_election.cc:343] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.282728 24545 leader_election.cc:304] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:52.283811 24857 raft_consensus.cc:2804] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.284253 24857 raft_consensus.cc:493] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.284759 24857 raft_consensus.cc:3060] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.295940 24839 raft_consensus.cc:493] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0e0c30b65a5d485e89552b4cb36da6b4)
I20260709 13:06:52.296653 24839 raft_consensus.cc:515] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:52.297394 24404 catalog_manager.cc:5697] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 1 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.308655 24775 raft_consensus.cc:359] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.309640 24775 raft_consensus.cc:385] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.310019 24775 raft_consensus.cc:740] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.311079 24775 consensus_queue.cc:260] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.313884 24775 ts_tablet_manager.cc:1434] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:06:52.317953 24655 raft_consensus.cc:3060] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.328202 24775 tablet_bootstrap.cc:492] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:52.339344 24775 tablet_bootstrap.cc:654] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.341037 24857 raft_consensus.cc:515] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.342547 24808 raft_consensus.cc:493] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.343142 24808 raft_consensus.cc:515] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.345453 24808 leader_election.cc:290] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:52.349165 24778 tablet_bootstrap.cc:654] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.353807 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f042219e46ecb9ac23aebbf326b9" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:52.355805 24696 leader_election.cc:343] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.357156 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f042219e46ecb9ac23aebbf326b9" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:52.357977 24654 raft_consensus.cc:2468] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 0.
I20260709 13:06:52.359346 24694 leader_election.cc:304] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:52.352468 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f50121b46a470a88a2ca466f285339" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:52.348269 24854 consensus_queue.cc:1048] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:06:52.365550 24581 raft_consensus.cc:3060] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.366957 24843 raft_consensus.cc:2804] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.382651 24843 raft_consensus.cc:493] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.383106 24843 raft_consensus.cc:3060] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.386809 24845 raft_consensus.cc:493] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.387454 24845 raft_consensus.cc:515] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.389770 24845 leader_election.cc:290] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:52.373116 24869 leader_election.cc:290] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:52.390463 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66a54bd402a430e8012e83b9926ed3c" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:52.391595 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcff4066e9b4592a94b0522794d5365" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:52.392373 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29f50121b46a470a88a2ca466f285339" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:52.393278 24730 raft_consensus.cc:3060] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.373824 24854 consensus_queue.cc:1048] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:06:52.395337 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcff4066e9b4592a94b0522794d5365" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:52.396268 24504 raft_consensus.cc:2468] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 0.
W20260709 13:06:52.398454 24696 leader_election.cc:343] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.387071 24776 tablet_bootstrap.cc:492] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:52.399694 24776 ts_tablet_manager.cc:1403] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.221s	user 0.023s	sys 0.022s
I20260709 13:06:52.399334 24693 leader_election.cc:304] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:52.372620 24839 leader_election.cc:290] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:52.399972 24581 raft_consensus.cc:2468] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:52.413270 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66a54bd402a430e8012e83b9926ed3c" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:52.421753 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aba850266fd46739f0f92ff3ac0de00" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:52.403851 24845 raft_consensus.cc:2804] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.422766 24845 raft_consensus.cc:493] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.422849 24471 leader_election.cc:304] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:52.423442 24845 raft_consensus.cc:3060] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.424013 24839 raft_consensus.cc:2749] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:52.425251 24622 leader_election.cc:304] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:52.425993 24775 tablet_bootstrap.cc:492] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:52.426561 24775 ts_tablet_manager.cc:1403] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.101s	user 0.026s	sys 0.000s
I20260709 13:06:52.427337 24879 raft_consensus.cc:2804] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:52.427677 24546 leader_election.cc:343] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.428625 24879 raft_consensus.cc:697] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:52.429242 24775 raft_consensus.cc:359] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.429826 24775 raft_consensus.cc:385] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.424077 24857 leader_election.cc:290] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:52.430130 24775 raft_consensus.cc:740] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.429890 24879 consensus_queue.cc:237] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.431484 24775 consensus_queue.cc:260] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.433339 24775 ts_tablet_manager.cc:1434] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:06:52.417464 24776 raft_consensus.cc:359] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:52.434461 24776 raft_consensus.cc:385] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.434587 24775 tablet_bootstrap.cc:492] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:52.434870 24776 raft_consensus.cc:740] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.436000 24776 consensus_queue.cc:260] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:52.441401 24775 tablet_bootstrap.cc:654] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.444386 24777 tablet_bootstrap.cc:492] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:52.444941 24777 ts_tablet_manager.cc:1403] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.263s	user 0.032s	sys 0.019s
I20260709 13:06:52.448516 24776 ts_tablet_manager.cc:1434] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
I20260709 13:06:52.449801 24776 tablet_bootstrap.cc:492] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:52.454420 24839 consensus_queue.cc:1048] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:52.454650 24843 raft_consensus.cc:515] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.457499 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f042219e46ecb9ac23aebbf326b9" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:52.453827 24777 raft_consensus.cc:359] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.459261 24777 raft_consensus.cc:385] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:52.459447 24696 leader_election.cc:343] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.459627 24777 raft_consensus.cc:740] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.460979 24777 consensus_queue.cc:260] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.464182 24777 ts_tablet_manager.cc:1434] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:06:52.465435 24845 raft_consensus.cc:515] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.466720 24730 raft_consensus.cc:2468] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:52.466511 24921 consensus_queue.cc:1048] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:52.467660 24693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 65209.1us
I20260709 13:06:52.473069 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aba850266fd46739f0f92ff3ac0de00" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:52.473773 24730 raft_consensus.cc:3060] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.465448 24777 tablet_bootstrap.cc:492] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:52.478188 24869 consensus_queue.cc:1048] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:06:52.492172 24843 leader_election.cc:290] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:52.492393 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f042219e46ecb9ac23aebbf326b9" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:52.493119 24656 raft_consensus.cc:3060] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.497113 24776 tablet_bootstrap.cc:654] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.502442 24845 leader_election.cc:290] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:52.503903 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcff4066e9b4592a94b0522794d5365" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:52.499399 24778 tablet_bootstrap.cc:492] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:52.501093 24730 raft_consensus.cc:2468] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:52.505086 24778 ts_tablet_manager.cc:1403] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.250s	user 0.017s	sys 0.013s
I20260709 13:06:52.511045 24778 raft_consensus.cc:359] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:52.512027 24778 raft_consensus.cc:385] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.512383 24778 raft_consensus.cc:740] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.518114 24778 consensus_queue.cc:260] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:06:52.521915 24696 leader_election.cc:343] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.525480 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcff4066e9b4592a94b0522794d5365" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:52.525626 24545 leader_election.cc:304] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:52.526466 24505 raft_consensus.cc:3060] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.526691 24830 raft_consensus.cc:2804] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.527542 24830 raft_consensus.cc:697] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:52.504626 24857 raft_consensus.cc:493] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.528564 24857 raft_consensus.cc:515] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:52.528740 24830 consensus_queue.cc:237] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.532393 24843 consensus_queue.cc:1048] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.539882 24582 raft_consensus.cc:3060] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.517625 24656 raft_consensus.cc:2468] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:06:52.543167 24694 leader_election.cc:304] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:52.544215 24845 raft_consensus.cc:2804] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.544979 24845 raft_consensus.cc:697] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:06:52.546114 24845 consensus_queue.cc:237] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.569187 24778 ts_tablet_manager.cc:1434] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.000s
I20260709 13:06:52.586334 24778 tablet_bootstrap.cc:492] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
W20260709 13:06:52.595165 24545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 69303.9us
I20260709 13:06:52.609324 24921 raft_consensus.cc:493] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.611567 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419e360ee50f470b8f48831ac5316b40" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:52.598145 24694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 55092.6us
I20260709 13:06:52.633826 24777 tablet_bootstrap.cc:654] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.607491 24857 leader_election.cc:290] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:52.645790 24776 tablet_bootstrap.cc:492] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:52.646389 24776 ts_tablet_manager.cc:1403] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.197s	user 0.032s	sys 0.031s
I20260709 13:06:52.651458 24776 raft_consensus.cc:359] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.655097 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419e360ee50f470b8f48831ac5316b40" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:52.652213 24776 raft_consensus.cc:385] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.659793 24776 raft_consensus.cc:740] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.629151 24921 raft_consensus.cc:515] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.661055 24776 consensus_queue.cc:260] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.665150 24776 ts_tablet_manager.cc:1434] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:06:52.666813 24776 tablet_bootstrap.cc:492] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:52.671617 24911 raft_consensus.cc:493] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.672531 24911 raft_consensus.cc:515] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.677378 24506 raft_consensus.cc:3060] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.692772 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aba850266fd46739f0f92ff3ac0de00" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:52.693569 24775 tablet_bootstrap.cc:492] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:52.694105 24775 ts_tablet_manager.cc:1403] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.260s	user 0.055s	sys 0.092s
I20260709 13:06:52.697063 24775 raft_consensus.cc:359] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.697806 24775 raft_consensus.cc:385] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.698088 24775 raft_consensus.cc:740] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.699095 24775 consensus_queue.cc:260] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.700250 24857 raft_consensus.cc:493] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.701508 24775 ts_tablet_manager.cc:1434] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:52.701032 24857 raft_consensus.cc:515] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.702852 24775 tablet_bootstrap.cc:492] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:52.705389 24921 leader_election.cc:290] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:52.706193 24857 leader_election.cc:290] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:52.708509 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:52.709367 24581 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:52.713287 24775 tablet_bootstrap.cc:654] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.731719 24473 leader_election.cc:304] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:52.738809 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:52.739784 24728 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 2.
I20260709 13:06:52.752874 24545 leader_election.cc:304] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:52.753873 24926 consensus_queue.cc:1048] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.756836 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563bd2fd6aae48ba994effc0e9e35427" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:52.757845 24728 raft_consensus.cc:2468] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:52.764712 24775 tablet_bootstrap.cc:492] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:52.765440 24775 ts_tablet_manager.cc:1403] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.007s
I20260709 13:06:52.766492 24505 raft_consensus.cc:2468] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:06:52.768153 24839 raft_consensus.cc:2804] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:52.768785 24839 raft_consensus.cc:493] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.769240 24839 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.777513 24924 raft_consensus.cc:2749] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:52.779151 24545 leader_election.cc:304] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:52.780190 24830 raft_consensus.cc:2804] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:52.780642 24830 raft_consensus.cc:493] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.781067 24830 raft_consensus.cc:3060] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.782408 24778 tablet_bootstrap.cc:654] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.787832 24776 tablet_bootstrap.cc:654] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.777076 24403 catalog_manager.cc:5697] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.791594 24869 consensus_queue.cc:1048] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.793253 24693 leader_election.cc:304] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:52.787556 24926 raft_consensus.cc:493] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.794826 24926 raft_consensus.cc:515] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.795882 24775 raft_consensus.cc:359] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:52.796939 24775 raft_consensus.cc:385] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.797312 24775 raft_consensus.cc:740] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.799134 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e775c3cec51d4d2ab3dfc17e2109ef87" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:52.799575 24843 raft_consensus.cc:2804] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.800174 24843 raft_consensus.cc:697] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
W20260709 13:06:52.801340 24696 leader_election.cc:343] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.801112 24843 consensus_queue.cc:237] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.799216 24926 leader_election.cc:290] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:52.798297 24775 consensus_queue.cc:260] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:52.817251 24775 ts_tablet_manager.cc:1434] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 13:06:52.818483 24775 tablet_bootstrap.cc:492] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:52.819573 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8aba850266fd46739f0f92ff3ac0de00" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:52.820796 24730 raft_consensus.cc:2393] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in this term.
I20260709 13:06:52.778138 24911 leader_election.cc:290] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:52.826802 24619 leader_election.cc:304] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:52.844225 24911 raft_consensus.cc:3060] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.855727 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563bd2fd6aae48ba994effc0e9e35427" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:52.858798 24404 catalog_manager.cc:5697] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 1 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.863334 24830 raft_consensus.cc:515] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.865381 24830 leader_election.cc:290] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:52.868449 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e775c3cec51d4d2ab3dfc17e2109ef87" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:52.855201 24839 raft_consensus.cc:515] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.871201 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563bd2fd6aae48ba994effc0e9e35427" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:52.871520 24839 leader_election.cc:290] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:52.872002 24729 raft_consensus.cc:3060] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:52.874070 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:52.874805 24730 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.878692 24911 raft_consensus.cc:2749] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:52.879944 24777 tablet_bootstrap.cc:492] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:52.880510 24777 ts_tablet_manager.cc:1403] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.415s	user 0.058s	sys 0.065s
I20260709 13:06:52.881700 24776 tablet_bootstrap.cc:492] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:52.882279 24776 ts_tablet_manager.cc:1403] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.216s	user 0.016s	sys 0.020s
I20260709 13:06:52.885239 24776 raft_consensus.cc:359] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.885846 24776 raft_consensus.cc:385] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.886132 24776 raft_consensus.cc:740] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.886909 24776 consensus_queue.cc:260] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
W20260709 13:06:52.887200 24693 leader_election.cc:343] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.887768 24693 leader_election.cc:304] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
W20260709 13:06:52.887964 24545 leader_election.cc:343] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.888923 24843 raft_consensus.cc:2749] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:52.890868 24869 consensus_queue.cc:1048] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:52.893424 24777 raft_consensus.cc:359] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:52.894217 24777 raft_consensus.cc:385] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.885538 24775 tablet_bootstrap.cc:654] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.898175 24777 raft_consensus.cc:740] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.901907 24776 ts_tablet_manager.cc:1434] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:06:52.903836 24776 tablet_bootstrap.cc:492] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:52.905826 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:52.906631 24581 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:06:52.907262 24730 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:06:52.911058 24777 consensus_queue.cc:260] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:52.912281 24403 catalog_manager.cc:5697] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.919212 24470 leader_election.cc:304] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:52.920657 24941 raft_consensus.cc:2804] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:52.921214 24941 raft_consensus.cc:697] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:52.922102 24941 consensus_queue.cc:237] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.903919 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563bd2fd6aae48ba994effc0e9e35427" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:52.928535 24777 ts_tablet_manager.cc:1434] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
I20260709 13:06:52.916563 24843 raft_consensus.cc:493] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.925833 24854 raft_consensus.cc:493] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.944509 24545 leader_election.cc:343] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.938220 24729 raft_consensus.cc:2468] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:52.938697 24843 raft_consensus.cc:515] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.949312 24843 leader_election.cc:290] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:52.949478 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2adce7a2cbc4be09cbebfdcb64b4438" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:52.960377 24778 tablet_bootstrap.cc:492] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:52.961439 24778 ts_tablet_manager.cc:1403] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.376s	user 0.018s	sys 0.014s
W20260709 13:06:52.962503 24694 leader_election.cc:343] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.939101 24854 raft_consensus.cc:515] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:52.963510 24911 consensus_queue.cc:1048] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:52.964861 24854 leader_election.cc:290] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:52.966694 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f042219e46ecb9ac23aebbf326b9" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:52.967629 24654 raft_consensus.cc:2393] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in current term 1: Already voted for candidate 3eeda3010ca44374a5bbf85e7980ba1c in this term.
I20260709 13:06:52.968290 24777 tablet_bootstrap.cc:492] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:52.951601 24545 leader_election.cc:304] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:52.971732 24830 raft_consensus.cc:2804] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:52.972298 24830 raft_consensus.cc:697] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:52.973150 24830 consensus_queue.cc:237] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.975190 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f042219e46ecb9ac23aebbf326b9" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:52.950321 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2adce7a2cbc4be09cbebfdcb64b4438" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:52.955351 24776 tablet_bootstrap.cc:654] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:52.977741 24545 leader_election.cc:304] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:52.978056 24581 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
W20260709 13:06:52.978386 24696 leader_election.cc:343] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:52.978910 24696 leader_election.cc:304] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:52.969094 24778 raft_consensus.cc:359] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.974606 24402 catalog_manager.cc:5697] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 1 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.979977 24778 raft_consensus.cc:385] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:52.980301 24778 raft_consensus.cc:740] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:52.984439 24778 consensus_queue.cc:260] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:52.986814 24854 raft_consensus.cc:3060] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.005003 24778 ts_tablet_manager.cc:1434] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.043s	user 0.002s	sys 0.005s
I20260709 13:06:52.989629 24843 raft_consensus.cc:2749] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.020874 24778 tablet_bootstrap.cc:492] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:53.023789 24854 raft_consensus.cc:2749] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.027601 24775 tablet_bootstrap.cc:492] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:53.029167 24775 ts_tablet_manager.cc:1403] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.211s	user 0.013s	sys 0.008s
I20260709 13:06:53.033733 24776 tablet_bootstrap.cc:492] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:53.034319 24776 ts_tablet_manager.cc:1403] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.131s	user 0.008s	sys 0.008s
I20260709 13:06:53.037946 24776 raft_consensus.cc:359] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.038945 24776 raft_consensus.cc:385] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.040051 24776 raft_consensus.cc:740] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.039700 24403 catalog_manager.cc:5697] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.040881 24776 consensus_queue.cc:260] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.046589 24776 ts_tablet_manager.cc:1434] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:06:53.047667 24776 tablet_bootstrap.cc:492] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:53.050458 24845 consensus_queue.cc:1048] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.051918 24778 tablet_bootstrap.cc:654] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.053692 24776 tablet_bootstrap.cc:654] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.041029 24777 tablet_bootstrap.cc:654] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.054841 24924 consensus_queue.cc:1048] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:53.082101 24778 tablet_bootstrap.cc:492] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:53.082101 24777 tablet_bootstrap.cc:492] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:53.082808 24777 ts_tablet_manager.cc:1403] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.008s
I20260709 13:06:53.082772 24778 ts_tablet_manager.cc:1403] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.016s
I20260709 13:06:53.084955 24775 raft_consensus.cc:359] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.085649 24775 raft_consensus.cc:385] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.086211 24404 catalog_manager.cc:5697] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.088078 24843 raft_consensus.cc:493] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.088611 24843 raft_consensus.cc:515] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.088873 24778 raft_consensus.cc:359] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.090445 24778 raft_consensus.cc:385] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.090745 24778 raft_consensus.cc:740] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.091459 24778 consensus_queue.cc:260] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.091765 24843 leader_election.cc:290] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:53.085878 24775 raft_consensus.cc:740] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.093672 24775 consensus_queue.cc:260] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.095292 24778 ts_tablet_manager.cc:1434] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:06:53.094151 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b10f5f3b44ddd821edcf5236589ed" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
W20260709 13:06:53.097728 24693 leader_election.cc:343] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.089010 24777 raft_consensus.cc:359] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.099452 24777 raft_consensus.cc:385] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.099715 24777 raft_consensus.cc:740] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.100353 24777 consensus_queue.cc:260] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.102381 24775 ts_tablet_manager.cc:1434] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.001s
I20260709 13:06:53.102428 24777 ts_tablet_manager.cc:1434] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:06:53.103688 24775 tablet_bootstrap.cc:492] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:53.103751 24777 tablet_bootstrap.cc:492] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:53.106992 24854 consensus_queue.cc:1048] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.107388 24808 consensus_queue.cc:1048] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.108084 24778 tablet_bootstrap.cc:492] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:53.110723 24777 tablet_bootstrap.cc:654] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.121225 24775 tablet_bootstrap.cc:654] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.121122 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b10f5f3b44ddd821edcf5236589ed" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:53.123960 24694 leader_election.cc:343] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.124601 24694 leader_election.cc:304] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:53.127235 24808 raft_consensus.cc:2749] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.135346 24941 raft_consensus.cc:493] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.135978 24941 raft_consensus.cc:515] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.153591 24776 tablet_bootstrap.cc:492] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:53.154168 24776 ts_tablet_manager.cc:1403] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.015s
I20260709 13:06:53.164152 24941 leader_election.cc:290] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:53.165316 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:53.166190 24729 raft_consensus.cc:2468] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:53.167328 24470 leader_election.cc:304] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:53.168932 24778 tablet_bootstrap.cc:654] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.172307 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:53.173012 24656 raft_consensus.cc:2468] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:53.178715 24941 raft_consensus.cc:2804] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.182623 24941 raft_consensus.cc:493] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.182997 24941 raft_consensus.cc:3060] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.187613 24776 raft_consensus.cc:359] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.188441 24776 raft_consensus.cc:385] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.188736 24776 raft_consensus.cc:740] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.191802 24776 consensus_queue.cc:260] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
W20260709 13:06:53.195286 24453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:53.203989 24776 ts_tablet_manager.cc:1434] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:06:53.203893 24941 raft_consensus.cc:515] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.205384 24776 tablet_bootstrap.cc:492] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:53.207911 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:53.208663 24656 raft_consensus.cc:3060] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.209316 24946 raft_consensus.cc:493] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.209900 24946 raft_consensus.cc:515] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.212235 24778 tablet_bootstrap.cc:492] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:53.212797 24778 ts_tablet_manager.cc:1403] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.005s
I20260709 13:06:53.213155 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563bd2fd6aae48ba994effc0e9e35427" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:53.217057 24941 leader_election.cc:290] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:53.216485 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563bd2fd6aae48ba994effc0e9e35427" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:53.217751 24729 raft_consensus.cc:2393] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e0390f5bd00484985fa5469e25be18d in current term 1: Already voted for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in this term.
I20260709 13:06:53.218509 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:53.218926 24470 leader_election.cc:304] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:53.213676 24946 leader_election.cc:290] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:53.219154 24728 raft_consensus.cc:3060] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.240351 24728 raft_consensus.cc:2468] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:53.241786 24470 leader_election.cc:304] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:53.242409 24808 consensus_queue.cc:1048] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.242769 24946 raft_consensus.cc:2804] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.243319 24946 raft_consensus.cc:697] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:53.244202 24946 consensus_queue.cc:237] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.226953 24941 raft_consensus.cc:3060] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.249372 24778 raft_consensus.cc:359] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.250140 24778 raft_consensus.cc:385] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.256912 24778 raft_consensus.cc:740] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.257081 24775 tablet_bootstrap.cc:492] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:53.258175 24775 ts_tablet_manager.cc:1403] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.155s	user 0.021s	sys 0.021s
I20260709 13:06:53.257753 24778 consensus_queue.cc:260] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.265178 24776 tablet_bootstrap.cc:654] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.262217 24911 raft_consensus.cc:493] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.268155 24911 raft_consensus.cc:515] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.275748 24778 ts_tablet_manager.cc:1434] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 13:06:53.278463 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:53.279618 24729 raft_consensus.cc:2468] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:53.281275 24619 leader_election.cc:304] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:06:53.284507 24775 raft_consensus.cc:359] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.285214 24775 raft_consensus.cc:385] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.285475 24775 raft_consensus.cc:740] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.282521 24815 raft_consensus.cc:2804] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.274410 24911 leader_election.cc:290] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:53.288142 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:53.285904 24656 raft_consensus.cc:2468] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:53.287497 24778 tablet_bootstrap.cc:492] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:53.286929 24775 consensus_queue.cc:260] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.287636 24815 raft_consensus.cc:493] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:53.294097 24619 leader_election.cc:343] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.294891 24775 ts_tablet_manager.cc:1434] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:06:53.295501 24815 raft_consensus.cc:3060] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.296249 24580 raft_consensus.cc:3060] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.300480 24777 tablet_bootstrap.cc:492] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:53.301196 24777 ts_tablet_manager.cc:1403] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.198s	user 0.007s	sys 0.038s
I20260709 13:06:53.305106 24775 tablet_bootstrap.cc:492] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:53.304929 24892 consensus_queue.cc:1048] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.306986 24777 raft_consensus.cc:359] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.307803 24777 raft_consensus.cc:385] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.308100 24777 raft_consensus.cc:740] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.308836 24777 consensus_queue.cc:260] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.311076 24777 ts_tablet_manager.cc:1434] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:06:53.313431 24775 tablet_bootstrap.cc:654] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.315904 24776 tablet_bootstrap.cc:492] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:53.316541 24776 ts_tablet_manager.cc:1403] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.008s
I20260709 13:06:53.320560 24776 raft_consensus.cc:359] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.321714 24776 raft_consensus.cc:385] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.322196 24776 raft_consensus.cc:740] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.314549 24815 raft_consensus.cc:515] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.327503 24777 tablet_bootstrap.cc:492] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:53.335232 24776 consensus_queue.cc:260] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.329541 24941 raft_consensus.cc:2749] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.342216 24777 tablet_bootstrap.cc:654] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.342829 24776 ts_tablet_manager.cc:1434] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.003s
I20260709 13:06:53.344045 24776 tablet_bootstrap.cc:492] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:53.345629 24778 tablet_bootstrap.cc:654] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.346684 24815 leader_election.cc:290] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:53.351984 24582 raft_consensus.cc:1275] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:53.352550 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:53.353652 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
W20260709 13:06:53.354851 24619 leader_election.cc:343] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.356390 24776 tablet_bootstrap.cc:654] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.356114 24946 consensus_queue.cc:1048] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:53.354601 24730 raft_consensus.cc:3060] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.332538 24775 tablet_bootstrap.cc:492] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:53.376184 24775 ts_tablet_manager.cc:1403] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.012s
I20260709 13:06:53.391603 24775 raft_consensus.cc:359] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.386682 24404 catalog_manager.cc:5697] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.395481 24730 raft_consensus.cc:2468] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:53.403986 24775 raft_consensus.cc:385] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.396443 24830 consensus_queue.cc:1048] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.404512 24775 raft_consensus.cc:740] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.405440 24775 consensus_queue.cc:260] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.406447 24619 leader_election.cc:304] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:53.409834 24730 raft_consensus.cc:1275] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:53.412361 24946 consensus_queue.cc:1048] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.414425 24815 raft_consensus.cc:2804] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.415262 24815 raft_consensus.cc:697] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:53.416181 24815 consensus_queue.cc:237] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.418030 24808 raft_consensus.cc:493] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.418599 24808 raft_consensus.cc:515] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.423197 24775 ts_tablet_manager.cc:1434] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:06:53.423017 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1b47e2ca4046dabceebdf5efd6ae27" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:53.423687 24808 leader_election.cc:290] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
W20260709 13:06:53.424749 24696 leader_election.cc:343] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.425177 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1b47e2ca4046dabceebdf5efd6ae27" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:53.426939 24775 tablet_bootstrap.cc:492] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
W20260709 13:06:53.427518 24694 leader_election.cc:343] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.428242 24694 leader_election.cc:304] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:53.429318 24808 raft_consensus.cc:2749] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.437101 24778 tablet_bootstrap.cc:492] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:53.439735 24778 ts_tablet_manager.cc:1403] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.154s	user 0.023s	sys 0.022s
I20260709 13:06:53.444111 24830 consensus_queue.cc:1048] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.444948 24778 raft_consensus.cc:359] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.445806 24778 raft_consensus.cc:385] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.446161 24778 raft_consensus.cc:740] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.447194 24776 tablet_bootstrap.cc:492] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:53.448432 24776 ts_tablet_manager.cc:1403] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.105s	user 0.029s	sys 0.047s
I20260709 13:06:53.450868 24778 consensus_queue.cc:260] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.452571 24778 ts_tablet_manager.cc:1434] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:06:53.460991 24778 tablet_bootstrap.cc:492] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:53.465299 24402 catalog_manager.cc:5697] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.475327 24776 raft_consensus.cc:359] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.476171 24776 raft_consensus.cc:385] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.476480 24776 raft_consensus.cc:740] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.477259 24776 consensus_queue.cc:260] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.480057 24777 tablet_bootstrap.cc:492] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:53.481608 24775 tablet_bootstrap.cc:654] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.485129 24830 raft_consensus.cc:493] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.479552 24776 ts_tablet_manager.cc:1434] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:06:53.486687 24777 ts_tablet_manager.cc:1403] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.159s	user 0.027s	sys 0.019s
I20260709 13:06:53.490049 24777 raft_consensus.cc:359] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.490835 24777 raft_consensus.cc:385] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.491112 24777 raft_consensus.cc:740] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.492844 24776 tablet_bootstrap.cc:492] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:53.493541 24778 tablet_bootstrap.cc:654] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.496492 24777 consensus_queue.cc:260] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.485718 24830 raft_consensus.cc:515] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.504665 24854 raft_consensus.cc:493] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.504968 24777 ts_tablet_manager.cc:1434] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:06:53.505381 24854 raft_consensus.cc:515] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.506124 24777 tablet_bootstrap.cc:492] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:53.507687 24854 leader_election.cc:290] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:53.514628 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffa83e4678e4efcbe8b21ee2c2a48ad" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:53.515329 24776 tablet_bootstrap.cc:654] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.515421 24830 leader_election.cc:290] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:53.515444 24506 raft_consensus.cc:2468] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:53.523027 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a078959f5dc84592b3f57c5e621ceb3d" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:53.523772 24506 raft_consensus.cc:2468] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:53.524941 24545 leader_election.cc:304] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:53.526074 24545 leader_election.cc:304] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:53.526933 24857 raft_consensus.cc:2804] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.527352 24857 raft_consensus.cc:493] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.527688 24857 raft_consensus.cc:3060] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.534389 24815 raft_consensus.cc:493] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.534992 24815 raft_consensus.cc:515] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.538693 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffa83e4678e4efcbe8b21ee2c2a48ad" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:53.541478 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a078959f5dc84592b3f57c5e621ceb3d" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:53.542269 24656 raft_consensus.cc:2468] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:53.543888 24778 tablet_bootstrap.cc:492] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:53.544503 24778 ts_tablet_manager.cc:1403] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.009s
I20260709 13:06:53.545346 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2adce7a2cbc4be09cbebfdcb64b4438" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:53.546054 24730 raft_consensus.cc:2468] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:53.547590 24778 raft_consensus.cc:359] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.547991 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2adce7a2cbc4be09cbebfdcb64b4438" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:53.548323 24778 raft_consensus.cc:385] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.548635 24778 raft_consensus.cc:740] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.548648 24581 raft_consensus.cc:2468] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:53.548974 24619 leader_election.cc:304] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:06:53.549417 24778 consensus_queue.cc:260] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.550194 24911 raft_consensus.cc:2804] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.550616 24911 raft_consensus.cc:493] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.550968 24911 raft_consensus.cc:3060] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.551788 24778 ts_tablet_manager.cc:1434] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:06:53.552906 24778 tablet_bootstrap.cc:492] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:53.554402 24815 leader_election.cc:290] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
W20260709 13:06:53.557052 24546 leader_election.cc:343] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.526635 24830 raft_consensus.cc:2804] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.558403 24830 raft_consensus.cc:493] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.562449 24830 raft_consensus.cc:3060] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.564003 24778 tablet_bootstrap.cc:654] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.573370 24776 tablet_bootstrap.cc:492] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:53.573931 24776 ts_tablet_manager.cc:1403] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.007s
I20260709 13:06:53.575337 24778 tablet_bootstrap.cc:492] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:53.575866 24778 ts_tablet_manager.cc:1403] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.007s
I20260709 13:06:53.576814 24776 raft_consensus.cc:359] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.577615 24776 raft_consensus.cc:385] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.577916 24776 raft_consensus.cc:740] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.578743 24778 raft_consensus.cc:359] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.579465 24778 raft_consensus.cc:385] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.579757 24778 raft_consensus.cc:740] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.577195 24911 raft_consensus.cc:515] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.585029 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2adce7a2cbc4be09cbebfdcb64b4438" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:53.585602 24778 consensus_queue.cc:260] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.585884 24581 raft_consensus.cc:3060] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.587728 24911 leader_election.cc:290] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:53.560653 24777 tablet_bootstrap.cc:654] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.589311 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2adce7a2cbc4be09cbebfdcb64b4438" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:53.590047 24775 tablet_bootstrap.cc:492] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:53.590713 24775 ts_tablet_manager.cc:1403] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.164s	user 0.014s	sys 0.009s
I20260709 13:06:53.591871 24830 raft_consensus.cc:515] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.591915 24857 raft_consensus.cc:515] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.595477 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffa83e4678e4efcbe8b21ee2c2a48ad" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:53.596149 24506 raft_consensus.cc:3060] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.597746 24778 ts_tablet_manager.cc:1434] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:06:53.598574 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffa83e4678e4efcbe8b21ee2c2a48ad" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
W20260709 13:06:53.600836 24546 leader_election.cc:343] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.602201 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a078959f5dc84592b3f57c5e621ceb3d" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:53.603133 24656 raft_consensus.cc:3060] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.607475 24778 tablet_bootstrap.cc:492] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:53.609598 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a078959f5dc84592b3f57c5e621ceb3d" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:53.610643 24507 raft_consensus.cc:3060] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.614341 24778 tablet_bootstrap.cc:654] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.589974 24729 raft_consensus.cc:3060] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.619930 24778 tablet_bootstrap.cc:492] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:53.614768 24857 leader_election.cc:290] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:53.620510 24778 ts_tablet_manager.cc:1403] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:06:53.620430 24808 raft_consensus.cc:493] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.621145 24808 raft_consensus.cc:515] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.624366 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:53.625275 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:53.625775 24693 leader_election.cc:343] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.623947 24778 raft_consensus.cc:359] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.626708 24778 raft_consensus.cc:385] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:06:53.626869 24696 leader_election.cc:343] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.627035 24778 raft_consensus.cc:740] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.627516 24696 leader_election.cc:304] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:53.624571 24808 leader_election.cc:290] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:53.578657 24776 consensus_queue.cc:260] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.627731 24506 raft_consensus.cc:2468] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:53.639602 24581 raft_consensus.cc:2468] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:53.627933 24778 consensus_queue.cc:260] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.645506 24545 leader_election.cc:304] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:53.640956 24775 raft_consensus.cc:359] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.647681 24775 raft_consensus.cc:385] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.595480 24830 leader_election.cc:290] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:53.648313 24840 raft_consensus.cc:493] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.648979 24840 raft_consensus.cc:515] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.649662 24778 ts_tablet_manager.cc:1434] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 13:06:53.650368 24776 ts_tablet_manager.cc:1434] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:06:53.650810 24778 tablet_bootstrap.cc:492] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:53.651373 24776 tablet_bootstrap.cc:492] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:53.654156 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:53.655800 24473 leader_election.cc:343] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.649655 24622 leader_election.cc:304] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:53.656816 24778 tablet_bootstrap.cc:654] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.657316 24879 raft_consensus.cc:2804] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.645524 24656 raft_consensus.cc:2468] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:53.641832 24892 raft_consensus.cc:493] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.657892 24879 raft_consensus.cc:697] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:53.647739 24857 raft_consensus.cc:2804] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.659502 24857 raft_consensus.cc:697] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:53.659713 24879 consensus_queue.cc:237] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.660171 24546 leader_election.cc:304] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:53.660375 24857 consensus_queue.cc:237] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.661132 24978 raft_consensus.cc:2804] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.648296 24775 raft_consensus.cc:740] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.661840 24978 raft_consensus.cc:697] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:53.658203 24892 raft_consensus.cc:515] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.663300 24775 consensus_queue.cc:260] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.663406 24978 consensus_queue.cc:237] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.666209 24775 ts_tablet_manager.cc:1434] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.075s	user 0.003s	sys 0.005s
I20260709 13:06:53.667454 24775 tablet_bootstrap.cc:492] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:53.667485 24892 leader_election.cc:290] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:53.668782 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b2b2b10c2a8445da974e94ac66be680" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:53.670106 24694 leader_election.cc:343] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.670368 24924 raft_consensus.cc:493] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.670980 24924 raft_consensus.cc:515] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.673240 24924 leader_election.cc:290] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:53.674038 24775 tablet_bootstrap.cc:654] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.675698 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e775c3cec51d4d2ab3dfc17e2109ef87" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:53.676640 24728 raft_consensus.cc:2468] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:53.678508 24840 leader_election.cc:290] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:53.679417 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e775c3cec51d4d2ab3dfc17e2109ef87" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:53.632926 24507 raft_consensus.cc:2468] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:53.628571 24843 raft_consensus.cc:2749] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.680230 24505 raft_consensus.cc:2468] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:53.680230 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:53.681975 24471 leader_election.cc:343] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.682508 24471 leader_election.cc:304] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:53.683741 24545 leader_election.cc:304] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:53.684748 24857 raft_consensus.cc:2804] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.685128 24857 raft_consensus.cc:493] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.685477 24857 raft_consensus.cc:3060] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.689317 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b2b2b10c2a8445da974e94ac66be680" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:53.688975 24405 catalog_manager.cc:5697] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.689998 24775 tablet_bootstrap.cc:492] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:53.690676 24775 ts_tablet_manager.cc:1403] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
W20260709 13:06:53.691021 24693 leader_election.cc:343] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.691550 24693 leader_election.cc:304] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:53.692380 24843 raft_consensus.cc:2749] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.693712 24840 raft_consensus.cc:2749] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.663909 24729 raft_consensus.cc:2468] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:53.694670 24775 raft_consensus.cc:359] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.698172 24776 tablet_bootstrap.cc:654] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.698251 24775 raft_consensus.cc:385] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.700004 24775 raft_consensus.cc:740] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.701120 24775 consensus_queue.cc:260] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.702190 24777 tablet_bootstrap.cc:492] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:53.702755 24777 ts_tablet_manager.cc:1403] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.197s	user 0.026s	sys 0.012s
I20260709 13:06:53.705574 24777 raft_consensus.cc:359] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.706337 24777 raft_consensus.cc:385] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.709067 24775 ts_tablet_manager.cc:1434] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:06:53.710208 24775 tablet_bootstrap.cc:492] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:53.708264 24857 raft_consensus.cc:515] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.713637 24857 leader_election.cc:290] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:53.715067 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e775c3cec51d4d2ab3dfc17e2109ef87" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:53.716053 24506 raft_consensus.cc:3060] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.706640 24777 raft_consensus.cc:740] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.718122 24777 consensus_queue.cc:260] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.719023 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e775c3cec51d4d2ab3dfc17e2109ef87" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:53.719944 24728 raft_consensus.cc:3060] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.720309 24777 ts_tablet_manager.cc:1434] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:06:53.721344 24777 tablet_bootstrap.cc:492] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:53.744890 24892 raft_consensus.cc:493] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.745566 24892 raft_consensus.cc:515] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.746505 24775 tablet_bootstrap.cc:654] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.747862 24892 leader_election.cc:290] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:53.749729 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:53.750496 24840 consensus_queue.cc:1048] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:53.751418 24694 leader_election.cc:343] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.751421 24777 tablet_bootstrap.cc:654] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.754634 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:53.758463 24808 raft_consensus.cc:493] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.759860 24775 tablet_bootstrap.cc:492] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:53.760803 24775 ts_tablet_manager.cc:1403] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.051s	user 0.017s	sys 0.000s
I20260709 13:06:53.759927 24808 raft_consensus.cc:515] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.764462 24808 leader_election.cc:290] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:53.764281 24840 consensus_queue.cc:1048] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:53.765297 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae7b1c100f1488cbbaafece940169fa" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:53.766034 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae7b1c100f1488cbbaafece940169fa" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:53.766963 24696 leader_election.cc:343] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.768021 24777 tablet_bootstrap.cc:492] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
W20260709 13:06:53.767886 24694 leader_election.cc:343] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.768584 24777 ts_tablet_manager.cc:1403] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.001s
I20260709 13:06:53.768560 24694 leader_election.cc:304] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:53.769693 24892 raft_consensus.cc:2749] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:53.765184 24693 leader_election.cc:343] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.771066 24693 leader_election.cc:304] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:53.772627 24777 raft_consensus.cc:359] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.777305 24777 raft_consensus.cc:385] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.776154 24728 raft_consensus.cc:2468] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:53.778548 24879 raft_consensus.cc:493] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.776224 24778 tablet_bootstrap.cc:492] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:53.772974 24892 raft_consensus.cc:2749] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.776393 24775 raft_consensus.cc:359] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.779311 24879 raft_consensus.cc:515] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.780489 24775 raft_consensus.cc:385] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.780853 24775 raft_consensus.cc:740] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.780987 24545 leader_election.cc:304] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:53.781697 24775 consensus_queue.cc:260] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.780082 24778 ts_tablet_manager.cc:1403] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.027s
I20260709 13:06:53.782011 24857 raft_consensus.cc:2804] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.783226 24857 raft_consensus.cc:697] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:53.783710 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffa83e4678e4efcbe8b21ee2c2a48ad" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:53.784576 24505 raft_consensus.cc:2393] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in this term.
I20260709 13:06:53.784191 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffa83e4678e4efcbe8b21ee2c2a48ad" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:53.784113 24857 consensus_queue.cc:237] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.782079 24879 leader_election.cc:290] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:53.778467 24777 raft_consensus.cc:740] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.786113 24619 leader_election.cc:304] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:53.786904 24777 consensus_queue.cc:260] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.787528 24879 raft_consensus.cc:3060] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.792121 24778 raft_consensus.cc:359] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.792862 24778 raft_consensus.cc:385] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.793524 24778 raft_consensus.cc:740] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.794402 24775 ts_tablet_manager.cc:1434] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:06:53.794552 24778 consensus_queue.cc:260] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.802012 24402 catalog_manager.cc:5697] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.803910 24775 tablet_bootstrap.cc:492] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:53.808017 24506 raft_consensus.cc:2468] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:53.822160 24777 ts_tablet_manager.cc:1434] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:06:53.822572 24775 tablet_bootstrap.cc:654] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.823448 24777 tablet_bootstrap.cc:492] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:53.828166 24946 raft_consensus.cc:493] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.829046 24946 raft_consensus.cc:515] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.803834 24402 catalog_manager.cc:5697] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:53.804636 24778 ts_tablet_manager.cc:1434] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.002s
I20260709 13:06:53.805960 24879 raft_consensus.cc:2749] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.831758 24778 tablet_bootstrap.cc:492] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:53.835036 24776 tablet_bootstrap.cc:492] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:53.835701 24776 ts_tablet_manager.cc:1403] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.185s	user 0.011s	sys 0.002s
I20260709 13:06:53.836637 24946 leader_election.cc:290] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:53.837512 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b10f5f3b44ddd821edcf5236589ed" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:53.838249 24728 raft_consensus.cc:2468] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:53.838409 24778 tablet_bootstrap.cc:654] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.839850 24470 leader_election.cc:304] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:53.842149 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b10f5f3b44ddd821edcf5236589ed" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:53.843016 24654 raft_consensus.cc:2468] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:53.843868 24946 raft_consensus.cc:2804] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:53.844528 24946 raft_consensus.cc:493] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.845467 24946 raft_consensus.cc:3060] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.846680 24775 tablet_bootstrap.cc:492] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:53.847282 24775 ts_tablet_manager.cc:1403] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.008s
I20260709 13:06:53.850394 24775 raft_consensus.cc:359] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.850850 24778 tablet_bootstrap.cc:492] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:53.842607 24776 raft_consensus.cc:359] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.851703 24775 raft_consensus.cc:385] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.851756 24776 raft_consensus.cc:385] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.852257 24775 raft_consensus.cc:740] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.852305 24776 raft_consensus.cc:740] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.853317 24775 consensus_queue.cc:260] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.853555 24777 tablet_bootstrap.cc:654] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.853534 24776 consensus_queue.cc:260] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:53.856227 24776 ts_tablet_manager.cc:1434] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:06:53.857352 24776 tablet_bootstrap.cc:492] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:53.858081 24775 ts_tablet_manager.cc:1434] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:06:53.859478 24775 tablet_bootstrap.cc:492] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:53.861928 24778 ts_tablet_manager.cc:1403] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.004s
I20260709 13:06:53.867159 24778 raft_consensus.cc:359] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.867904 24778 raft_consensus.cc:385] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.868189 24778 raft_consensus.cc:740] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.857750 24946 raft_consensus.cc:515] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.871811 24778 consensus_queue.cc:260] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.874615 24776 tablet_bootstrap.cc:654] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.877465 24778 ts_tablet_manager.cc:1434] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:06:53.879290 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b10f5f3b44ddd821edcf5236589ed" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:53.879980 24729 raft_consensus.cc:3060] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.880462 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b10f5f3b44ddd821edcf5236589ed" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:53.881183 24655 raft_consensus.cc:3060] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.878644 24778 tablet_bootstrap.cc:492] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:53.888168 24729 raft_consensus.cc:2468] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:53.888739 24778 tablet_bootstrap.cc:654] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.889545 24470 leader_election.cc:304] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:53.890544 24840 raft_consensus.cc:2804] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:53.891078 24840 raft_consensus.cc:697] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:53.891919 24840 consensus_queue.cc:237] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.892915 24775 tablet_bootstrap.cc:654] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.894595 24941 raft_consensus.cc:493] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.895371 24941 raft_consensus.cc:515] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.899928 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:53.901893 24405 catalog_manager.cc:5697] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.903909 24941 leader_election.cc:290] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:53.904503 24655 raft_consensus.cc:2468] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:53.908589 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:53.909386 24775 tablet_bootstrap.cc:492] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:53.909448 24728 raft_consensus.cc:2393] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e0390f5bd00484985fa5469e25be18d in current term 1: Already voted for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in this term.
I20260709 13:06:53.911679 24775 ts_tablet_manager.cc:1403] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.000s
I20260709 13:06:53.909322 24776 tablet_bootstrap.cc:492] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:53.912492 24776 ts_tablet_manager.cc:1403] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.006s
I20260709 13:06:53.914904 24775 raft_consensus.cc:359] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.915370 24776 raft_consensus.cc:359] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.915784 24775 raft_consensus.cc:385] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.916119 24776 raft_consensus.cc:385] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.916270 24775 raft_consensus.cc:740] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.916499 24776 raft_consensus.cc:740] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.917379 24776 consensus_queue.cc:260] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.920038 24946 leader_election.cc:290] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:53.918885 24470 leader_election.cc:304] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:53.923864 24776 ts_tablet_manager.cc:1434] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:06:53.925225 25000 raft_consensus.cc:3060] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:53.925347 24776 tablet_bootstrap.cc:492] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:53.935989 24778 tablet_bootstrap.cc:492] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:53.936550 24778 ts_tablet_manager.cc:1403] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.002s
I20260709 13:06:53.917979 24775 consensus_queue.cc:260] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.937292 24777 tablet_bootstrap.cc:492] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:53.938722 24402 catalog_manager.cc:5697] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.939333 24778 raft_consensus.cc:359] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.939983 24778 raft_consensus.cc:385] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.940233 24778 raft_consensus.cc:740] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.940837 24778 consensus_queue.cc:260] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.943044 24778 ts_tablet_manager.cc:1434] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.005s
I20260709 13:06:53.944167 24778 tablet_bootstrap.cc:492] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:53.934473 24776 tablet_bootstrap.cc:654] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.947261 24777 ts_tablet_manager.cc:1403] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.000s
I20260709 13:06:53.949237 25000 raft_consensus.cc:2749] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.950747 24778 tablet_bootstrap.cc:654] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.955847 24777 raft_consensus.cc:359] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.956656 24777 raft_consensus.cc:385] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.956945 24777 raft_consensus.cc:740] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:53.957623 24777 consensus_queue.cc:260] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:53.959785 24777 ts_tablet_manager.cc:1434] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:06:53.960810 24777 tablet_bootstrap.cc:492] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:53.963757 24892 raft_consensus.cc:493] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.964418 24892 raft_consensus.cc:515] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.966930 24777 tablet_bootstrap.cc:654] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.970427 24808 raft_consensus.cc:493] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.971190 24808 raft_consensus.cc:515] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:53.974499 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f942ac0144fc6b272c4a71b5bc224" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:53.976145 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59192aeb6ab34cdb81981c7024b885c1" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:53.977749 24696 leader_election.cc:343] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.978386 24808 leader_election.cc:290] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:53.978715 24777 tablet_bootstrap.cc:492] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:53.979238 24777 ts_tablet_manager.cc:1403] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:06:53.979346 24892 leader_election.cc:290] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:53.981161 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f942ac0144fc6b272c4a71b5bc224" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:53.982219 24777 raft_consensus.cc:359] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:06:53.982857 24696 leader_election.cc:343] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.982962 24777 raft_consensus.cc:385] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:53.983462 24777 raft_consensus.cc:740] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
W20260709 13:06:53.983572 24693 leader_election.cc:343] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:53.984201 24693 leader_election.cc:304] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:53.984239 24879 consensus_queue.cc:1048] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:53.984280 24777 consensus_queue.cc:260] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:53.986567 24892 raft_consensus.cc:2749] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:53.987318 24777 ts_tablet_manager.cc:1434] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:53.950963 24775 ts_tablet_manager.cc:1434] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:06:53.988507 24777 tablet_bootstrap.cc:492] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:53.995532 24777 tablet_bootstrap.cc:654] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:53.998703 24775 tablet_bootstrap.cc:492] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:53.999516 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59192aeb6ab34cdb81981c7024b885c1" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
W20260709 13:06:54.001411 24693 leader_election.cc:343] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.002527 24693 leader_election.cc:304] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:54.007248 24892 raft_consensus.cc:2749] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:54.007392 24777 tablet_bootstrap.cc:492] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:54.008114 24777 ts_tablet_manager.cc:1403] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:06:54.008494 24775 tablet_bootstrap.cc:654] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.011023 24777 raft_consensus.cc:359] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.011845 24777 raft_consensus.cc:385] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.012133 24777 raft_consensus.cc:740] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.013011 24777 consensus_queue.cc:260] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.015379 24777 ts_tablet_manager.cc:1434] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:06:54.020713 24777 tablet_bootstrap.cc:492] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:54.026913 24777 tablet_bootstrap.cc:654] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.027649 24911 consensus_queue.cc:1048] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:54.029790 24776 tablet_bootstrap.cc:492] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:54.030402 24776 ts_tablet_manager.cc:1403] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.105s	user 0.025s	sys 0.023s
I20260709 13:06:54.033905 24776 raft_consensus.cc:359] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.034684 24776 raft_consensus.cc:385] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.035050 24776 raft_consensus.cc:740] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.036140 24776 consensus_queue.cc:260] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.039367 24776 ts_tablet_manager.cc:1434] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:06:54.043244 24776 tablet_bootstrap.cc:492] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:54.057327 24775 tablet_bootstrap.cc:492] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:54.060117 24777 tablet_bootstrap.cc:492] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:54.060727 24775 ts_tablet_manager.cc:1403] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.016s
I20260709 13:06:54.060727 24777 ts_tablet_manager.cc:1403] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.002s
I20260709 13:06:54.063738 24775 raft_consensus.cc:359] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.063963 24777 raft_consensus.cc:359] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.064514 24775 raft_consensus.cc:385] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.064640 24777 raft_consensus.cc:385] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.065685 24776 tablet_bootstrap.cc:654] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.066185 24775 raft_consensus.cc:740] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.067122 24775 consensus_queue.cc:260] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.068722 24777 raft_consensus.cc:740] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.069410 24775 ts_tablet_manager.cc:1434] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:06:54.069456 24777 consensus_queue.cc:260] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.070739 24775 tablet_bootstrap.cc:492] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:54.072072 24778 tablet_bootstrap.cc:492] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:54.072602 24778 ts_tablet_manager.cc:1403] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.003s
I20260709 13:06:54.072846 24777 ts_tablet_manager.cc:1434] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:54.073853 24777 tablet_bootstrap.cc:492] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:54.077678 24775 tablet_bootstrap.cc:654] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.081997 24911 consensus_queue.cc:1048] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:54.089231 24778 raft_consensus.cc:359] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.090373 24778 raft_consensus.cc:385] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.090749 24778 raft_consensus.cc:740] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.091856 24778 consensus_queue.cc:260] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.094805 24778 ts_tablet_manager.cc:1434] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:06:54.095768 24778 tablet_bootstrap.cc:492] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:54.096874 24775 tablet_bootstrap.cc:492] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:54.097379 24775 ts_tablet_manager.cc:1403] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.010s
I20260709 13:06:54.100574 24775 raft_consensus.cc:359] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.101276 24775 raft_consensus.cc:385] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.101548 24775 raft_consensus.cc:740] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.102335 24775 consensus_queue.cc:260] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.104202 24775 ts_tablet_manager.cc:1434] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:06:54.106853 24911 raft_consensus.cc:493] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.110133 25000 raft_consensus.cc:493] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.113409 24911 raft_consensus.cc:515] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.114254 25000 raft_consensus.cc:515] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.116439 25000 leader_election.cc:290] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:54.115821 24911 leader_election.cc:290] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:54.118515 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:54.119206 24654 raft_consensus.cc:2468] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:54.109061 24775 tablet_bootstrap.cc:492] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:54.121701 24777 tablet_bootstrap.cc:654] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.115780 24776 tablet_bootstrap.cc:492] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:54.122696 24776 ts_tablet_manager.cc:1403] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.003s
I20260709 13:06:54.123428 24879 consensus_queue.cc:1048] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:54.125172 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:54.123430 24471 leader_election.cc:304] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:54.125912 24730 raft_consensus.cc:2468] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:54.127198 24775 tablet_bootstrap.cc:654] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.129180 25000 raft_consensus.cc:2804] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.129704 25000 raft_consensus.cc:493] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.130124 25000 raft_consensus.cc:3060] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.113448 24778 tablet_bootstrap.cc:654] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.130764 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b2b2b10c2a8445da974e94ac66be680" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:54.138612 24728 raft_consensus.cc:2468] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:54.125756 24776 raft_consensus.cc:359] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.139680 24776 raft_consensus.cc:385] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.140043 24776 raft_consensus.cc:740] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.140779 24776 consensus_queue.cc:260] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.143491 24776 ts_tablet_manager.cc:1434] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.005s
I20260709 13:06:54.144987 24776 tablet_bootstrap.cc:492] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:54.145505 24778 tablet_bootstrap.cc:492] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:54.146020 24778 ts_tablet_manager.cc:1403] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.000s
I20260709 13:06:54.148288 24619 leader_election.cc:304] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:06:54.150993 24840 raft_consensus.cc:493] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.151937 24777 tablet_bootstrap.cc:492] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:54.151767 24840 raft_consensus.cc:515] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.152472 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b2b2b10c2a8445da974e94ac66be680" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:54.153158 24505 raft_consensus.cc:2468] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:54.152499 24777 ts_tablet_manager.cc:1403] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.006s
I20260709 13:06:54.151024 24815 raft_consensus.cc:2804] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.155064 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:54.156589 24815 raft_consensus.cc:493] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.157058 24815 raft_consensus.cc:3060] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.157450 24728 raft_consensus.cc:2468] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:54.158841 24470 leader_election.cc:304] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:54.159775 24946 raft_consensus.cc:2804] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.159884 24777 raft_consensus.cc:359] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.160248 24946 raft_consensus.cc:493] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.160684 24777 raft_consensus.cc:385] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.160800 24946 raft_consensus.cc:3060] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.161039 24777 raft_consensus.cc:740] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.155756 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:54.162810 24777 consensus_queue.cc:260] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.164390 24857 consensus_queue.cc:1048] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:54.165197 24777 ts_tablet_manager.cc:1434] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:54.166265 24777 tablet_bootstrap.cc:492] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:54.148957 24778 raft_consensus.cc:359] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.167210 24778 raft_consensus.cc:385] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.167506 24778 raft_consensus.cc:740] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.168183 24778 consensus_queue.cc:260] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.172338 24777 tablet_bootstrap.cc:654] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.172744 24776 tablet_bootstrap.cc:654] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.154150 24840 leader_election.cc:290] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:54.184540 24775 tablet_bootstrap.cc:492] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:54.185182 24775 ts_tablet_manager.cc:1403] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.009s
W20260709 13:06:54.187911 24473 leader_election.cc:343] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.188803 24775 raft_consensus.cc:359] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.189626 24775 raft_consensus.cc:385] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.189962 24775 raft_consensus.cc:740] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.190783 24775 consensus_queue.cc:260] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.193746 24892 raft_consensus.cc:493] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.194268 24892 raft_consensus.cc:515] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.196576 24892 leader_election.cc:290] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:54.197261 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b05be5fc3d34aa0ae910d5a99463f49" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:54.198832 24696 leader_election.cc:343] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.203573 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b05be5fc3d34aa0ae910d5a99463f49" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:54.204327 24654 raft_consensus.cc:2468] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 0.
I20260709 13:06:54.205776 24694 leader_election.cc:304] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:54.207018 24815 raft_consensus.cc:515] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.207923 24808 raft_consensus.cc:2804] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.208385 24808 raft_consensus.cc:493] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.208721 24808 raft_consensus.cc:3060] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.211704 24778 ts_tablet_manager.cc:1434] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.001s
I20260709 13:06:54.212921 24778 tablet_bootstrap.cc:492] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:54.175482 25000 raft_consensus.cc:515] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.217659 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:54.218362 24654 raft_consensus.cc:3060] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.229538 25000 leader_election.cc:290] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:54.230494 24879 raft_consensus.cc:493] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.230679 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b2b2b10c2a8445da974e94ac66be680" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:54.231674 24729 raft_consensus.cc:3060] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.231366 24879 raft_consensus.cc:515] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.234880 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:54.238099 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:54.238629 24728 raft_consensus.cc:3060] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.239292 24582 raft_consensus.cc:2468] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:54.241725 24622 leader_election.cc:304] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:54.246214 24778 tablet_bootstrap.cc:654] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.248023 24857 consensus_queue.cc:1048] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:54.249325 25000 raft_consensus.cc:493] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.249998 25000 raft_consensus.cc:515] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.235608 24879 leader_election.cc:290] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:54.251168 24911 raft_consensus.cc:493] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.255692 24911 raft_consensus.cc:515] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.252233 24775 ts_tablet_manager.cc:1434] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.003s
I20260709 13:06:54.254940 24879 raft_consensus.cc:2804] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.225917 24808 raft_consensus.cc:515] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.286288 24775 tablet_bootstrap.cc:492] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:54.261880 24879 raft_consensus.cc:493] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.265630 24911 leader_election.cc:290] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:54.294670 24879 raft_consensus.cc:3060] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.289526 24654 raft_consensus.cc:2468] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:54.295459 24843 raft_consensus.cc:493] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.309638 24808 leader_election.cc:290] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:54.312064 24778 tablet_bootstrap.cc:492] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:54.312623 24778 ts_tablet_manager.cc:1403] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.100s	user 0.019s	sys 0.015s
I20260709 13:06:54.312429 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b05be5fc3d34aa0ae910d5a99463f49" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:54.312916 24777 tablet_bootstrap.cc:492] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:54.313464 24777 ts_tablet_manager.cc:1403] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.147s	user 0.028s	sys 0.049s
W20260709 13:06:54.314122 24696 leader_election.cc:343] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.300629 24815 leader_election.cc:290] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:54.315173 25000 leader_election.cc:290] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:54.293092 24729 raft_consensus.cc:2468] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:54.316787 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1b47e2ca4046dabceebdf5efd6ae27" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:54.317515 24730 raft_consensus.cc:2468] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:54.320169 24776 tablet_bootstrap.cc:492] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:54.320719 24776 ts_tablet_manager.cc:1403] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.176s	user 0.005s	sys 0.028s
W20260709 13:06:54.293924 24622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 52331.1us
I20260709 13:06:54.322868 24843 raft_consensus.cc:515] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.324504 24471 leader_election.cc:304] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:54.324853 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1b47e2ca4046dabceebdf5efd6ae27" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:54.325199 24843 leader_election.cc:290] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:54.325632 24580 raft_consensus.cc:2468] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:54.285928 24946 raft_consensus.cc:515] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.336623 24776 raft_consensus.cc:359] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.342872 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:54.343236 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b2b2b10c2a8445da974e94ac66be680" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:54.343663 24506 raft_consensus.cc:2468] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:54.343883 24505 raft_consensus.cc:3060] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.345541 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:54.346591 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:54.342425 24776 raft_consensus.cc:385] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.347827 24776 raft_consensus.cc:740] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.348434 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:54.348459 24619 leader_election.cc:304] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:06:54.349082 24730 raft_consensus.cc:3060] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.349261 24728 raft_consensus.cc:2468] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:54.349638 24619 leader_election.cc:304] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:06:54.338415 24778 raft_consensus.cc:359] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.339715 24946 leader_election.cc:290] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:54.354846 24778 raft_consensus.cc:385] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.355206 24778 raft_consensus.cc:740] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.355875 24778 consensus_queue.cc:260] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.347289 24777 raft_consensus.cc:359] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.357785 24777 raft_consensus.cc:385] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.358073 24777 raft_consensus.cc:740] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.348526 24776 consensus_queue.cc:260] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.348552 24941 raft_consensus.cc:2804] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:54.360246 24777 consensus_queue.cc:260] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.356181 24815 raft_consensus.cc:2804] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:54.371395 24892 raft_consensus.cc:493] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.372036 24892 raft_consensus.cc:515] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.373618 24505 raft_consensus.cc:2468] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:54.362012 25024 raft_consensus.cc:2804] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.374605 25024 raft_consensus.cc:493] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.374936 25024 raft_consensus.cc:3060] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.375946 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401126e2c8324c69961e005862f0b23f" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:54.378818 24696 leader_election.cc:343] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.379421 24815 raft_consensus.cc:697] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:54.380321 24730 raft_consensus.cc:2468] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:54.380409 24815 consensus_queue.cc:237] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.348453 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:54.381924 24470 leader_election.cc:304] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:54.382306 24778 ts_tablet_manager.cc:1434] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.011s
I20260709 13:06:54.382714 24580 raft_consensus.cc:2468] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:54.383514 24778 tablet_bootstrap.cc:492] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:54.383724 25000 raft_consensus.cc:2804] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:54.383800 24941 raft_consensus.cc:697] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:54.384409 25000 raft_consensus.cc:697] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:54.384884 24941 consensus_queue.cc:237] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.385324 25000 consensus_queue.cc:237] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.388204 24892 leader_election.cc:290] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:54.391901 24776 ts_tablet_manager.cc:1434] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.005s
I20260709 13:06:54.396703 24775 tablet_bootstrap.cc:654] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.406673 24778 tablet_bootstrap.cc:654] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:54.409981 25026 log.cc:927] Time spent T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:06:54.420893 24777 ts_tablet_manager.cc:1434] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.107s	user 0.013s	sys 0.004s
I20260709 13:06:54.424666 24776 tablet_bootstrap.cc:492] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
W20260709 13:06:54.410286 24473 leader_election.cc:343] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.431043 24857 raft_consensus.cc:493] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.431295 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b05be5fc3d34aa0ae910d5a99463f49" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:54.431967 24654 raft_consensus.cc:3060] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.431676 24857 raft_consensus.cc:515] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
W20260709 13:06:54.416996 24693 leader_election.cc:343] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.440619 24777 tablet_bootstrap.cc:492] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:54.466566 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59192aeb6ab34cdb81981c7024b885c1" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:54.467442 24728 raft_consensus.cc:2468] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:54.466653 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:54.468762 24545 leader_election.cc:304] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:54.491849 25028 raft_consensus.cc:2804] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.489810 24857 leader_election.cc:290] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:54.462601 24473 leader_election.cc:304] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:54.499017 24808 raft_consensus.cc:493] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.508128 24777 tablet_bootstrap.cc:654] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.498760 25028 raft_consensus.cc:493] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.498680 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401126e2c8324c69961e005862f0b23f" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:54.521710 24775 tablet_bootstrap.cc:492] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:54.493119 24879 raft_consensus.cc:515] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.522207 24775 ts_tablet_manager.cc:1403] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.258s	user 0.012s	sys 0.033s
I20260709 13:06:54.516484 24654 raft_consensus.cc:2468] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:06:54.518462 25000 raft_consensus.cc:2804] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.532001 25000 raft_consensus.cc:493] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.532138 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:54.532450 25000 raft_consensus.cc:3060] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.508569 25024 raft_consensus.cc:515] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.519701 25028 raft_consensus.cc:3060] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.537678 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1b47e2ca4046dabceebdf5efd6ae27" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
W20260709 13:06:54.515667 24473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 58997us
I20260709 13:06:54.508973 24808 raft_consensus.cc:515] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.548215 24776 tablet_bootstrap.cc:654] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.538458 25024 leader_election.cc:290] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
W20260709 13:06:54.552748 25034 log.cc:927] Time spent T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:06:54.555665 24775 raft_consensus.cc:359] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.544476 24729 raft_consensus.cc:3060] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.556460 24775 raft_consensus.cc:385] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.558188 24775 raft_consensus.cc:740] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.543329 24978 consensus_queue.cc:1048] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
W20260709 13:06:54.563476 24471 leader_election.cc:343] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.559213 24775 consensus_queue.cc:260] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.566352 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1b47e2ca4046dabceebdf5efd6ae27" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:54.543993 24941 consensus_queue.cc:1048] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:06:54.572715 24775 ts_tablet_manager.cc:1434] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.049s	user 0.002s	sys 0.005s
I20260709 13:06:54.571888 24402 catalog_manager.cc:5697] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.575861 24402 catalog_manager.cc:5697] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.571348 24404 catalog_manager.cc:5697] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.579694 24775 tablet_bootstrap.cc:492] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
W20260709 13:06:54.570873 24694 leader_election.cc:343] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.573537 24582 raft_consensus.cc:3060] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.574769 24946 raft_consensus.cc:493] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.583595 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59192aeb6ab34cdb81981c7024b885c1" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:54.602914 24946 raft_consensus.cc:515] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.604868 24505 raft_consensus.cc:2468] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:54.584257 24879 leader_election.cc:290] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:54.609233 25000 raft_consensus.cc:515] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.575448 24978 consensus_queue.cc:1048] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:06:54.610103 24924 consensus_queue.cc:1048] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:54.611023 25037 consensus_queue.cc:1048] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:54.611649 24879 raft_consensus.cc:493] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.609272 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:54.616133 24581 raft_consensus.cc:3060] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.605182 24946 leader_election.cc:290] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:54.616941 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:54.617642 24507 raft_consensus.cc:3060] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.614429 24694 leader_election.cc:304] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
W20260709 13:06:54.621232 24694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 51777.3us
I20260709 13:06:54.612190 24879 raft_consensus.cc:515] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.621639 25027 raft_consensus.cc:2749] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:54.623411 24879 leader_election.cc:290] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:54.623878 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:54.624928 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59192aeb6ab34cdb81981c7024b885c1" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:54.626932 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae7b1c100f1488cbbaafece940169fa" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:54.576514 25032 consensus_queue.cc:1048] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 13:06:54.632875 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae7b1c100f1488cbbaafece940169fa" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:54.638852 24724 raft_consensus.cc:2468] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
W20260709 13:06:54.640161 24622 leader_election.cc:343] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:54.628569 24694 leader_election.cc:343] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.669210 25028 raft_consensus.cc:515] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.633322 24729 raft_consensus.cc:2468] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:54.666205 24808 leader_election.cc:290] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
W20260709 13:06:54.681062 24693 leader_election.cc:343] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.690521 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59192aeb6ab34cdb81981c7024b885c1" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:54.691319 24730 raft_consensus.cc:2468] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:54.692643 24507 raft_consensus.cc:2468] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:54.688261 24579 raft_consensus.cc:2393] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e0390f5bd00484985fa5469e25be18d in current term 1: Already voted for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in this term.
I20260709 13:06:54.696224 24582 raft_consensus.cc:2468] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:54.701730 24581 raft_consensus.cc:2468] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:54.710765 24622 leader_election.cc:304] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:54.743876 24879 raft_consensus.cc:2804] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:54.744414 24879 raft_consensus.cc:697] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
W20260709 13:06:54.728132 24453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:54.745253 24879 consensus_queue.cc:237] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.749665 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59192aeb6ab34cdb81981c7024b885c1" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:54.749969 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:54.750344 24728 raft_consensus.cc:3060] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.668031 24694 leader_election.cc:304] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:54.751283 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:54.751542 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
W20260709 13:06:54.751772 24694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 123252us
I20260709 13:06:54.736971 24776 tablet_bootstrap.cc:492] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
W20260709 13:06:54.752650 24471 leader_election.cc:343] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.753083 24776 ts_tablet_manager.cc:1403] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.339s	user 0.027s	sys 0.034s
I20260709 13:06:54.732761 25028 leader_election.cc:290] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:54.742190 24778 tablet_bootstrap.cc:492] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:54.752211 24582 raft_consensus.cc:3060] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.754503 24778 ts_tablet_manager.cc:1403] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.371s	user 0.009s	sys 0.026s
I20260709 13:06:54.740805 24775 tablet_bootstrap.cc:654] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.737241 25000 leader_election.cc:290] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:54.745488 24777 tablet_bootstrap.cc:492] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:54.761310 24777 ts_tablet_manager.cc:1403] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.332s	user 0.021s	sys 0.013s
W20260709 13:06:54.762481 24696 leader_election.cc:343] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.763005 24696 leader_election.cc:304] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:54.764492 24843 raft_consensus.cc:2749] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:54.747241 24619 leader_election.cc:304] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:54.752681 24808 raft_consensus.cc:2749] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:54.766992 25033 raft_consensus.cc:2804] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:54.768049 25033 raft_consensus.cc:697] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:54.769028 25033 consensus_queue.cc:237] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.778028 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59192aeb6ab34cdb81981c7024b885c1" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:54.780390 24777 raft_consensus.cc:359] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.784499 24777 raft_consensus.cc:385] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.785094 24777 raft_consensus.cc:740] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.785909 24777 consensus_queue.cc:260] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.785924 24776 raft_consensus.cc:359] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.788710 24776 raft_consensus.cc:385] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.789175 24776 raft_consensus.cc:740] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.792546 24777 ts_tablet_manager.cc:1434] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 13:06:54.790174 24776 consensus_queue.cc:260] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.782846 24507 raft_consensus.cc:3060] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.796510 24777 tablet_bootstrap.cc:492] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:54.798763 24582 raft_consensus.cc:2468] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:54.800683 24808 raft_consensus.cc:493] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.803540 24778 raft_consensus.cc:359] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.791715 24728 raft_consensus.cc:2468] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:54.808678 24778 raft_consensus.cc:385] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.809043 24778 raft_consensus.cc:740] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.809664 24778 consensus_queue.cc:260] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.813294 24776 ts_tablet_manager.cc:1434] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:06:54.817520 24778 ts_tablet_manager.cc:1434] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.001s
I20260709 13:06:54.815186 24694 leader_election.cc:304] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:54.824334 24776 tablet_bootstrap.cc:492] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:54.824347 24778 tablet_bootstrap.cc:492] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:54.811993 24808 raft_consensus.cc:515] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.829133 24473 leader_election.cc:304] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:54.830343 24545 leader_election.cc:304] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:54.839093 24978 raft_consensus.cc:2804] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:54.839653 24978 raft_consensus.cc:697] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:54.840476 24978 consensus_queue.cc:237] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:54.842988 24619 leader_election.cc:304] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:54.843962 24843 raft_consensus.cc:2804] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:54.844533 24843 raft_consensus.cc:697] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:06:54.845399 24843 consensus_queue.cc:237] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.847051 24470 leader_election.cc:304] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:54.847936 25024 raft_consensus.cc:2804] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:54.848388 25024 raft_consensus.cc:493] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:54.848721 25024 raft_consensus.cc:3060] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.849520 25032 raft_consensus.cc:2804] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:54.850029 25032 raft_consensus.cc:697] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:54.856730 25032 consensus_queue.cc:237] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:54.861074 24777 tablet_bootstrap.cc:654] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.880389 24507 raft_consensus.cc:2468] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:54.881177 24941 raft_consensus.cc:2764] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 13:06:54.872993 24473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 43951.9us
I20260709 13:06:54.884879 25024 raft_consensus.cc:515] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.891378 24778 tablet_bootstrap.cc:654] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:54.893101 24775 tablet_bootstrap.cc:492] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:54.893687 24775 ts_tablet_manager.cc:1403] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.314s	user 0.025s	sys 0.020s
I20260709 13:06:54.893800 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae7b1c100f1488cbbaafece940169fa" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
W20260709 13:06:54.895373 24622 leader_election.cc:343] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:54.885900 24941 consensus_queue.cc:1048] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:06:54.896900 24775 raft_consensus.cc:359] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.897460 24582 raft_consensus.cc:3060] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.897665 24775 raft_consensus.cc:385] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:54.898058 24775 raft_consensus.cc:740] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:54.905583 24775 consensus_queue.cc:260] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.919057 24775 ts_tablet_manager.cc:1434] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:06:54.881112 25028 raft_consensus.cc:493] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.900087 25024 leader_election.cc:290] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:54.933145 24775 tablet_bootstrap.cc:492] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:54.910460 24808 leader_election.cc:290] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:54.951051 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae7b1c100f1488cbbaafece940169fa" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:54.951697 24729 raft_consensus.cc:3060] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:54.942408 24840 raft_consensus.cc:493] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.934729 25028 raft_consensus.cc:515] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:54.938591 25033 consensus_queue.cc:1048] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:06:54.969928 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:54.966812 24840 raft_consensus.cc:515] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:54.983492 24941 consensus_queue.cc:1048] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:54.992022 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b05be5fc3d34aa0ae910d5a99463f49" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:54.993325 24654 raft_consensus.cc:2393] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in current term 1: Already voted for candidate 3eeda3010ca44374a5bbf85e7980ba1c in this term.
W20260709 13:06:54.997277 24696 leader_election.cc:343] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:54.998381 24545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 51711.2us
I20260709 13:06:54.987534 25028 leader_election.cc:290] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:55.009423 24503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:55.005098 24729 raft_consensus.cc:2468] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
W20260709 13:06:55.018626 24693 leader_election.cc:343] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.022321 24775 tablet_bootstrap.cc:654] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.036082 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b05be5fc3d34aa0ae910d5a99463f49" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:55.029316 24693 leader_election.cc:304] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:55.040591 24843 raft_consensus.cc:2749] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.040014 24404 catalog_manager.cc:5697] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 1 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.041751 24545 leader_election.cc:304] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:55.053037 24776 tablet_bootstrap.cc:654] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.060449 24402 catalog_manager.cc:5697] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.062141 24778 tablet_bootstrap.cc:492] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:55.062706 24778 ts_tablet_manager.cc:1403] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.239s	user 0.013s	sys 0.018s
I20260709 13:06:55.058703 25028 raft_consensus.cc:3060] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:55.082181 24470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 106448us
I20260709 13:06:55.085218 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:55.087807 24778 raft_consensus.cc:359] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.088680 24778 raft_consensus.cc:385] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.088987 24778 raft_consensus.cc:740] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.090255 24778 consensus_queue.cc:260] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.092957 24778 ts_tablet_manager.cc:1434] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:06:55.094064 24778 tablet_bootstrap.cc:492] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
W20260709 13:06:55.096832 24471 leader_election.cc:343] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.097625 24946 consensus_queue.cc:1048] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.081439 24840 leader_election.cc:290] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:55.100190 24778 tablet_bootstrap.cc:654] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.118548 25024 consensus_queue.cc:1048] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:55.128348 24775 tablet_bootstrap.cc:492] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:55.121570 24405 catalog_manager.cc:5697] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.128970 24775 ts_tablet_manager.cc:1403] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.204s	user 0.017s	sys 0.004s
I20260709 13:06:55.135190 24775 raft_consensus.cc:359] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.135924 24775 raft_consensus.cc:385] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.125443 24401 catalog_manager.cc:5697] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.142338 24405 catalog_manager.cc:5697] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.136220 24775 raft_consensus.cc:740] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.149060 24777 tablet_bootstrap.cc:492] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:55.149623 24777 ts_tablet_manager.cc:1403] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.353s	user 0.052s	sys 0.054s
I20260709 13:06:55.150796 24775 consensus_queue.cc:260] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.154076 24775 ts_tablet_manager.cc:1434] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:06:55.154448 24777 raft_consensus.cc:359] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.155272 24777 raft_consensus.cc:385] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.155622 24777 raft_consensus.cc:740] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.156472 24777 consensus_queue.cc:260] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.160233 24777 ts_tablet_manager.cc:1434] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:06:55.165694 24777 tablet_bootstrap.cc:492] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:55.152778 25028 raft_consensus.cc:2749] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.179104 24775 tablet_bootstrap.cc:492] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:55.193660 24911 raft_consensus.cc:493] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.197386 24911 raft_consensus.cc:515] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.198498 25033 consensus_queue.cc:1048] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.196437 24778 tablet_bootstrap.cc:492] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:55.199851 24778 ts_tablet_manager.cc:1403] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.024s
W20260709 13:06:55.167874 24694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 87617.7us
I20260709 13:06:55.202332 25065 raft_consensus.cc:493] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.203760 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:55.204504 24730 raft_consensus.cc:2468] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:55.202868 25065 raft_consensus.cc:515] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.204496 24619 leader_election.cc:304] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:55.206883 24777 tablet_bootstrap.cc:654] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.210080 25065 leader_election.cc:290] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:55.218901 24778 raft_consensus.cc:359] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:55.219734 24778 raft_consensus.cc:385] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.220000 24778 raft_consensus.cc:740] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.220686 24778 consensus_queue.cc:260] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:55.223662 24911 leader_election.cc:290] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:55.226903 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06805e79e8c04d6cbbf3fb892cad56cd" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:55.227196 24778 ts_tablet_manager.cc:1434] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
W20260709 13:06:55.228760 24473 leader_election.cc:343] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.231017 25073 raft_consensus.cc:2804] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:55.232321 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:55.235874 24776 tablet_bootstrap.cc:492] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:55.236443 24776 ts_tablet_manager.cc:1403] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.412s	user 0.013s	sys 0.010s
I20260709 13:06:55.238925 25027 raft_consensus.cc:493] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.239526 25027 raft_consensus.cc:515] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.228536 24778 tablet_bootstrap.cc:492] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:55.252626 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06805e79e8c04d6cbbf3fb892cad56cd" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:55.254144 24941 consensus_queue.cc:1048] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:55.254622 25027 leader_election.cc:290] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:55.255064 24470 leader_election.cc:304] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:55.255529 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:55.256384 24582 raft_consensus.cc:2393] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 7e0390f5bd00484985fa5469e25be18d in this term.
I20260709 13:06:55.256557 24946 raft_consensus.cc:2804] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.256928 24946 raft_consensus.cc:493] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.257294 24946 raft_consensus.cc:3060] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.261503 25073 raft_consensus.cc:697] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:55.280821 24776 raft_consensus.cc:359] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.281673 24776 raft_consensus.cc:385] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.281952 24776 raft_consensus.cc:740] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.282801 24776 consensus_queue.cc:260] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.286582 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:55.287576 24776 ts_tablet_manager.cc:1434] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.001s
I20260709 13:06:55.287633 24778 tablet_bootstrap.cc:654] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:55.294844 24693 leader_election.cc:343] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.327567 25073 consensus_queue.cc:237] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.337627 24776 tablet_bootstrap.cc:492] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:55.350503 24775 tablet_bootstrap.cc:654] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.368105 24892 raft_consensus.cc:493] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.370118 24892 raft_consensus.cc:515] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.375767 25027 consensus_queue.cc:1048] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.377354 24892 leader_election.cc:290] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
W20260709 13:06:55.387056 24471 leader_election.cc:343] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.387633 24471 leader_election.cc:304] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:55.388706 24840 raft_consensus.cc:2749] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.384166 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652a4c910b344866bc517d7c4e994536" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:55.356208 24946 raft_consensus.cc:515] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:06:55.394857 24696 leader_election.cc:343] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.397950 24778 tablet_bootstrap.cc:492] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:55.398553 24778 ts_tablet_manager.cc:1403] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.010s
I20260709 13:06:55.411062 24778 raft_consensus.cc:359] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.411787 24778 raft_consensus.cc:385] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.412086 24778 raft_consensus.cc:740] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.413054 24778 consensus_queue.cc:260] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.414613 24946 leader_election.cc:290] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:55.416858 24911 consensus_queue.cc:1048] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.413245 24924 consensus_queue.cc:1048] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:55.420681 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:55.421377 24729 raft_consensus.cc:3060] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.418442 24778 ts_tablet_manager.cc:1434] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:06:55.429426 24778 tablet_bootstrap.cc:492] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:55.426043 24776 tablet_bootstrap.cc:654] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.434365 24729 raft_consensus.cc:2468] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:55.449267 24470 leader_election.cc:304] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:55.452489 24946 raft_consensus.cc:2804] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:55.453027 24946 raft_consensus.cc:697] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:55.453922 24946 consensus_queue.cc:237] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.455571 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:55.457974 25024 consensus_queue.cc:1048] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.457183 24622 leader_election.cc:304] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:55.465514 24777 tablet_bootstrap.cc:492] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:55.466087 24777 ts_tablet_manager.cc:1403] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.301s	user 0.020s	sys 0.011s
I20260709 13:06:55.467123 25024 raft_consensus.cc:3060] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.469573 24777 raft_consensus.cc:359] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.474164 24840 consensus_queue.cc:1048] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:55.478361 25078 raft_consensus.cc:493] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.478906 25078 raft_consensus.cc:515] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.481216 25078 leader_election.cc:290] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:55.477799 24777 raft_consensus.cc:385] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.484434 24777 raft_consensus.cc:740] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.485181 24777 consensus_queue.cc:260] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.474903 25024 raft_consensus.cc:2749] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.476963 24778 tablet_bootstrap.cc:654] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.489106 24857 consensus_queue.cc:1048] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:06:55.499714 24777 ts_tablet_manager.cc:1434] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:06:55.485304 25078 consensus_queue.cc:1048] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:06:55.507193 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:55.510892 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933347c92a6c4612a65f9a7c365bc170" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
W20260709 13:06:55.513324 24619 leader_election.cc:343] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.521176 24777 tablet_bootstrap.cc:492] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:55.525645 24775 tablet_bootstrap.cc:492] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:55.526638 24775 ts_tablet_manager.cc:1403] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.359s	user 0.022s	sys 0.006s
I20260709 13:06:55.534677 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652a4c910b344866bc517d7c4e994536" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:55.536370 24694 leader_election.cc:343] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.536916 24694 leader_election.cc:304] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
W20260709 13:06:55.537155 24471 leader_election.cc:343] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.537604 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933347c92a6c4612a65f9a7c365bc170" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:55.538501 24694 leader_election.cc:343] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.538962 24694 leader_election.cc:304] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:55.541463 24843 raft_consensus.cc:2749] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.550525 24892 raft_consensus.cc:2749] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.545171 25065 consensus_queue.cc:1048] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 13:06:55.545322 24622 leader_election.cc:343] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.556155 24622 leader_election.cc:304] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:55.562692 25024 raft_consensus.cc:2749] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.563514 24843 consensus_queue.cc:1048] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.570629 25065 raft_consensus.cc:493] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.571197 25065 raft_consensus.cc:515] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:55.573521 25065 leader_election.cc:290] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:55.581230 24777 tablet_bootstrap.cc:654] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.579793 24404 catalog_manager.cc:5697] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:55.571755 24401 catalog_manager.cc:5697] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:55.589591 24775 raft_consensus.cc:359] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.590183 24775 raft_consensus.cc:385] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.590510 24775 raft_consensus.cc:740] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.592911 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f942ac0144fc6b272c4a71b5bc224" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:55.594636 24775 consensus_queue.cc:260] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:06:55.602205 25085 log.cc:927] Time spent T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:06:55.602681 24775 ts_tablet_manager.cc:1434] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.000s
I20260709 13:06:55.603924 24775 tablet_bootstrap.cc:492] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:55.615085 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f942ac0144fc6b272c4a71b5bc224" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:55.615839 24729 raft_consensus.cc:2468] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:55.618173 24857 raft_consensus.cc:493] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.626348 24857 raft_consensus.cc:515] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.626698 24470 leader_election.cc:304] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:55.628084 24946 raft_consensus.cc:2804] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.628563 24946 raft_consensus.cc:493] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.629014 24946 raft_consensus.cc:3060] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.632910 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae7b1c100f1488cbbaafece940169fa" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:55.638128 24857 leader_election.cc:290] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:55.638468 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae7b1c100f1488cbbaafece940169fa" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:55.639343 24729 raft_consensus.cc:2393] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in current term 1: Already voted for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in this term.
I20260709 13:06:55.643464 24546 leader_election.cc:304] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:55.647367 25028 raft_consensus.cc:3060] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.632956 24776 tablet_bootstrap.cc:492] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:55.654434 24776 ts_tablet_manager.cc:1403] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.317s	user 0.016s	sys 0.005s
I20260709 13:06:55.658144 24776 raft_consensus.cc:359] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.658952 24776 raft_consensus.cc:385] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.659260 24776 raft_consensus.cc:740] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.660130 24776 consensus_queue.cc:260] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.662364 24776 ts_tablet_manager.cc:1434] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:06:55.663481 24776 tablet_bootstrap.cc:492] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:55.672245 24946 raft_consensus.cc:515] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:55.675256 24778 tablet_bootstrap.cc:492] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:55.675830 24778 ts_tablet_manager.cc:1403] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.247s	user 0.022s	sys 0.006s
I20260709 13:06:55.675875 24776 tablet_bootstrap.cc:654] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.678865 24778 raft_consensus.cc:359] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:55.680722 24778 raft_consensus.cc:385] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.681118 24778 raft_consensus.cc:740] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.682165 24778 consensus_queue.cc:260] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:55.684665 24778 ts_tablet_manager.cc:1434] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:06:55.685973 24778 tablet_bootstrap.cc:492] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:55.672248 25028 raft_consensus.cc:2749] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.692371 24778 tablet_bootstrap.cc:654] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:55.693709 24473 leader_election.cc:343] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.695480 24775 tablet_bootstrap.cc:654] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.702889 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f942ac0144fc6b272c4a71b5bc224" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:55.703948 24728 raft_consensus.cc:3060] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.702823 24946 leader_election.cc:290] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:55.722141 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f942ac0144fc6b272c4a71b5bc224" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:55.744951 24777 tablet_bootstrap.cc:492] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:55.745572 24777 ts_tablet_manager.cc:1403] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.243s	user 0.016s	sys 0.028s
I20260709 13:06:55.746845 25024 consensus_queue.cc:1048] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.748380 24777 raft_consensus.cc:359] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.749138 24777 raft_consensus.cc:385] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.749403 24777 raft_consensus.cc:740] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.750101 24777 consensus_queue.cc:260] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.753744 24777 ts_tablet_manager.cc:1434] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:06:55.754892 24777 tablet_bootstrap.cc:492] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:55.775563 25028 raft_consensus.cc:493] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.776201 25028 raft_consensus.cc:515] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.779393 25028 leader_election.cc:290] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:55.780699 24775 tablet_bootstrap.cc:492] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:55.781505 24775 ts_tablet_manager.cc:1403] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.178s	user 0.008s	sys 0.008s
I20260709 13:06:55.784363 24775 raft_consensus.cc:359] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.780535 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06805e79e8c04d6cbbf3fb892cad56cd" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:55.790516 25024 raft_consensus.cc:493] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.791172 24652 raft_consensus.cc:2468] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:55.792619 24546 leader_election.cc:304] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:55.791226 25024 raft_consensus.cc:515] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.793730 24775 raft_consensus.cc:385] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.794440 24775 raft_consensus.cc:740] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.787599 24503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06805e79e8c04d6cbbf3fb892cad56cd" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:55.799249 24503 raft_consensus.cc:2468] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:55.789642 24776 tablet_bootstrap.cc:492] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:55.790481 24778 tablet_bootstrap.cc:492] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:55.796559 25024 leader_election.cc:290] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:55.785508 24777 tablet_bootstrap.cc:654] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.797376 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:55.800684 24778 ts_tablet_manager.cc:1403] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.115s	user 0.028s	sys 0.033s
I20260709 13:06:55.800974 24724 raft_consensus.cc:2393] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 7e0390f5bd00484985fa5469e25be18d in this term.
I20260709 13:06:55.801442 25028 raft_consensus.cc:2804] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.801904 25028 raft_consensus.cc:493] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.802284 25028 raft_consensus.cc:3060] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.803912 24778 raft_consensus.cc:359] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:55.805207 24778 raft_consensus.cc:385] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.805569 24778 raft_consensus.cc:740] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.806362 24778 consensus_queue.cc:260] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:55.809106 24778 ts_tablet_manager.cc:1434] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:06:55.810199 24778 tablet_bootstrap.cc:492] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:55.804879 24776 ts_tablet_manager.cc:1403] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.142s	user 0.034s	sys 0.018s
I20260709 13:06:55.811257 25024 consensus_queue.cc:1048] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.813482 24776 raft_consensus.cc:359] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.814328 24776 raft_consensus.cc:385] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.814673 24776 raft_consensus.cc:740] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.815476 24776 consensus_queue.cc:260] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.807468 24775 consensus_queue.cc:260] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.822192 24775 ts_tablet_manager.cc:1434] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:06:55.823318 24775 tablet_bootstrap.cc:492] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:55.823350 24503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:55.825511 24777 tablet_bootstrap.cc:492] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:55.826045 24777 ts_tablet_manager.cc:1403] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.006s
I20260709 13:06:55.828740 24777 raft_consensus.cc:359] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.829428 24777 raft_consensus.cc:385] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.829710 24777 raft_consensus.cc:740] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.830354 24777 consensus_queue.cc:260] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.832727 24777 ts_tablet_manager.cc:1434] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:06:55.833787 24777 tablet_bootstrap.cc:492] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:55.834103 24776 ts_tablet_manager.cc:1434] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
W20260709 13:06:55.841131 24473 leader_election.cc:343] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.839571 24777 tablet_bootstrap.cc:654] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.843271 24728 raft_consensus.cc:2468] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:55.844172 24776 tablet_bootstrap.cc:492] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:55.844827 24470 leader_election.cc:304] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:55.846417 25065 raft_consensus.cc:2804] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:55.847142 25065 raft_consensus.cc:697] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:55.848021 25065 consensus_queue.cc:237] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:55.851728 24778 tablet_bootstrap.cc:654] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.856540 24775 tablet_bootstrap.cc:654] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.866961 24619 leader_election.cc:304] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:55.868944 25032 raft_consensus.cc:493] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.869697 25032 raft_consensus.cc:515] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.870182 25024 raft_consensus.cc:3060] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.875104 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:55.876528 25032 leader_election.cc:290] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
W20260709 13:06:55.878072 24471 leader_election.cc:343] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.891633 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:55.892715 24728 raft_consensus.cc:2468] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:55.894556 24470 leader_election.cc:304] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:55.896879 25032 raft_consensus.cc:2804] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.897305 25032 raft_consensus.cc:493] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.897694 25032 raft_consensus.cc:3060] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.906613 25024 raft_consensus.cc:2749] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.907845 24776 tablet_bootstrap.cc:654] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.912154 25028 raft_consensus.cc:515] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.914170 25032 raft_consensus.cc:515] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.914444 24857 raft_consensus.cc:493] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.933511 25032 leader_election.cc:290] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:55.915135 24946 raft_consensus.cc:493] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.934634 24946 raft_consensus.cc:515] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:55.937559 24946 leader_election.cc:290] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:55.917764 25028 leader_election.cc:290] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:55.915915 24503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06805e79e8c04d6cbbf3fb892cad56cd" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:55.921617 24843 raft_consensus.cc:493] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.939363 24503 raft_consensus.cc:3060] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.939772 24843 raft_consensus.cc:515] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.942289 24843 leader_election.cc:290] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:55.917680 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06805e79e8c04d6cbbf3fb892cad56cd" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:55.943641 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:55.944021 24652 raft_consensus.cc:3060] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.944922 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:55.945427 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
W20260709 13:06:55.955008 24471 leader_election.cc:343] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.946074 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:55.947362 24775 tablet_bootstrap.cc:492] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
W20260709 13:06:55.948483 24694 leader_election.cc:343] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:55.956547 24453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:06:55.956823 24693 leader_election.cc:343] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:55.956918 24473 leader_election.cc:343] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.930924 24777 tablet_bootstrap.cc:492] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:55.958491 24693 leader_election.cc:304] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:55.959095 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:55.959794 24724 raft_consensus.cc:2468] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:55.960088 24843 raft_consensus.cc:2749] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:55.959873 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:55.961267 24729 raft_consensus.cc:3060] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.963172 24775 ts_tablet_manager.cc:1403] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.140s	user 0.007s	sys 0.006s
I20260709 13:06:55.949752 24776 tablet_bootstrap.cc:492] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:55.933059 24857 raft_consensus.cc:515] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.959085 24777 ts_tablet_manager.cc:1403] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.126s	user 0.037s	sys 0.018s
I20260709 13:06:55.966964 24776 ts_tablet_manager.cc:1403] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.123s	user 0.013s	sys 0.006s
I20260709 13:06:55.968822 24729 raft_consensus.cc:2468] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:55.971506 24778 tablet_bootstrap.cc:492] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:55.971495 24775 raft_consensus.cc:359] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.972091 24778 ts_tablet_manager.cc:1403] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.162s	user 0.017s	sys 0.019s
I20260709 13:06:55.972434 24775 raft_consensus.cc:385] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.972762 24775 raft_consensus.cc:740] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.972241 24857 leader_election.cc:290] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:55.975656 24775 consensus_queue.cc:260] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:55.977123 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933347c92a6c4612a65f9a7c365bc170" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:55.978025 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933347c92a6c4612a65f9a7c365bc170" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:55.978722 24653 raft_consensus.cc:2468] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:55.979350 24775 ts_tablet_manager.cc:1434] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
W20260709 13:06:55.978943 24545 leader_election.cc:343] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.980422 24775 tablet_bootstrap.cc:492] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:55.980911 24778 raft_consensus.cc:359] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.981556 24778 raft_consensus.cc:385] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.981792 24778 raft_consensus.cc:740] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.973678 24470 leader_election.cc:304] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:55.983630 25065 raft_consensus.cc:2804] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.983951 25032 consensus_queue.cc:1048] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:55.984150 25065 raft_consensus.cc:493] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.985785 24546 leader_election.cc:304] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:55.987408 24857 raft_consensus.cc:2804] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:55.987928 24857 raft_consensus.cc:493] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:55.990483 24775 tablet_bootstrap.cc:654] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:55.989130 24857 raft_consensus.cc:3060] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:55.984105 24470 leader_election.cc:304] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:55.995822 24777 raft_consensus.cc:359] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:55.996636 24777 raft_consensus.cc:385] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:55.996938 24777 raft_consensus.cc:740] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:55.997413 25032 raft_consensus.cc:2804] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:55.998018 25032 raft_consensus.cc:697] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:55.998507 24778 consensus_queue.cc:260] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:55.998916 25032 consensus_queue.cc:237] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.001008 24843 raft_consensus.cc:493] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.002092 24843 raft_consensus.cc:515] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.005295 24843 leader_election.cc:290] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:56.006186 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:56.007797 24696 leader_election.cc:343] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:55.997633 24777 consensus_queue.cc:260] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.015381 24778 ts_tablet_manager.cc:1434] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 13:06:56.000275 25065 raft_consensus.cc:3060] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.020375 24777 ts_tablet_manager.cc:1434] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:06:56.029618 24778 tablet_bootstrap.cc:492] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:56.030396 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:56.054948 24652 raft_consensus.cc:2468] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
W20260709 13:06:56.056247 24694 leader_election.cc:343] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.056787 24694 leader_election.cc:304] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.031283 24776 raft_consensus.cc:359] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.057516 24776 raft_consensus.cc:385] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.057916 24776 raft_consensus.cc:740] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.059207 24776 consensus_queue.cc:260] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.063584 24777 tablet_bootstrap.cc:492] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:56.067855 24892 raft_consensus.cc:2749] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.070413 24404 catalog_manager.cc:5697] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.080084 24776 ts_tablet_manager.cc:1434] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 13:06:56.061910 24857 raft_consensus.cc:515] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.073318 24941 consensus_queue.cc:1048] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:06:56.085429 24775 tablet_bootstrap.cc:492] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:56.086186 24775 ts_tablet_manager.cc:1403] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.106s	user 0.013s	sys 0.019s
I20260709 13:06:56.088809 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933347c92a6c4612a65f9a7c365bc170" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
W20260709 13:06:56.090389 24545 leader_election.cc:343] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.092036 24776 tablet_bootstrap.cc:492] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:56.083124 24857 leader_election.cc:290] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:56.073817 24546 leader_election.cc:304] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:56.097307 25033 raft_consensus.cc:493] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.103364 24503 raft_consensus.cc:2468] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:56.115800 25065 raft_consensus.cc:515] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
W20260709 13:06:56.113770 24546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 47781.9us
I20260709 13:06:56.121315 25065 leader_election.cc:290] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:56.121459 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933347c92a6c4612a65f9a7c365bc170" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:56.122270 24655 raft_consensus.cc:3060] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.125972 24775 raft_consensus.cc:359] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.126739 24775 raft_consensus.cc:385] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.127015 24775 raft_consensus.cc:740] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.131323 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:56.127683 24775 consensus_queue.cc:260] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:06:56.133363 24473 leader_election.cc:343] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.117257 24857 raft_consensus.cc:2804] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.112493 25033 raft_consensus.cc:515] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.142069 24775 ts_tablet_manager.cc:1434] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 13:06:56.145519 25033 leader_election.cc:290] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:56.147598 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401126e2c8324c69961e005862f0b23f" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:56.149425 24775 tablet_bootstrap.cc:492] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
W20260709 13:06:56.149777 24622 leader_election.cc:343] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.155268 24776 tablet_bootstrap.cc:654] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.161846 24775 tablet_bootstrap.cc:654] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.142853 24857 raft_consensus.cc:697] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:56.211220 24778 tablet_bootstrap.cc:654] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.194828 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:56.225584 24729 raft_consensus.cc:3060] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.198799 24946 raft_consensus.cc:493] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.227054 24946 raft_consensus.cc:515] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.191293 24892 raft_consensus.cc:493] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.172649 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401126e2c8324c69961e005862f0b23f" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:56.241461 24725 raft_consensus.cc:2468] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:56.242197 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:56.242740 24892 raft_consensus.cc:515] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.245666 24619 leader_election.cc:304] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.247555 25024 raft_consensus.cc:2804] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:56.248091 25024 raft_consensus.cc:493] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.248538 25024 raft_consensus.cc:3060] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.240211 24946 leader_election.cc:290] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:56.245990 24892 leader_election.cc:290] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:56.256815 24777 tablet_bootstrap.cc:654] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.189640 24857 consensus_queue.cc:237] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.261204 25073 raft_consensus.cc:493] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.261963 25073 raft_consensus.cc:515] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.264752 25073 leader_election.cc:290] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:56.243207 24582 raft_consensus.cc:2468] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:56.268337 24473 leader_election.cc:304] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:56.270799 25065 raft_consensus.cc:2804] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:56.271330 25065 raft_consensus.cc:493] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.271761 25065 raft_consensus.cc:3060] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.217026 24655 raft_consensus.cc:2468] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:56.281843 24546 leader_election.cc:304] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:56.282925 24978 raft_consensus.cc:2804] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.283460 24978 raft_consensus.cc:697] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:56.284705 24978 consensus_queue.cc:237] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.291232 24503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:56.167094 24404 catalog_manager.cc:5697] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.303633 24729 raft_consensus.cc:2468] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:56.334192 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f37afc8b3624bd09784565977fef62c" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:56.348665 24694 leader_election.cc:343] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.349308 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:56.355803 24725 raft_consensus.cc:2393] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 7e0390f5bd00484985fa5469e25be18d in this term.
I20260709 13:06:56.358454 25024 raft_consensus.cc:515] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.365037 25024 leader_election.cc:290] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:56.368326 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401126e2c8324c69961e005862f0b23f" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
W20260709 13:06:56.313175 24696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 117732us
I20260709 13:06:56.371486 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f37afc8b3624bd09784565977fef62c" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:56.376544 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
W20260709 13:06:56.376771 24696 leader_election.cc:343] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.377496 24725 raft_consensus.cc:2468] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:56.378300 24696 leader_election.cc:304] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.379324 25114 raft_consensus.cc:2749] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.383637 24619 leader_election.cc:304] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:56.385671 25073 raft_consensus.cc:3060] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.389845 24775 tablet_bootstrap.cc:492] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:56.390655 24775 ts_tablet_manager.cc:1403] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.241s	user 0.028s	sys 0.043s
W20260709 13:06:56.394731 24622 leader_election.cc:343] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.405462 24402 catalog_manager.cc:5697] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.417287 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401126e2c8324c69961e005862f0b23f" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:56.418296 24725 raft_consensus.cc:3060] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:56.420156 24470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 53161.6us
I20260709 13:06:56.422039 24470 leader_election.cc:304] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.427134 24775 raft_consensus.cc:359] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.428153 24775 raft_consensus.cc:385] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.428407 24775 raft_consensus.cc:740] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.432432 24775 consensus_queue.cc:260] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.426818 25032 raft_consensus.cc:2804] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.401887 25065 raft_consensus.cc:515] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.446441 24775 ts_tablet_manager.cc:1434] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.055s	user 0.001s	sys 0.008s
I20260709 13:06:56.447624 24775 tablet_bootstrap.cc:492] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:56.458722 24725 raft_consensus.cc:2468] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:56.462338 25065 leader_election.cc:290] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:56.464102 24775 tablet_bootstrap.cc:654] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.465960 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:56.466589 24946 raft_consensus.cc:493] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.466688 24724 raft_consensus.cc:3060] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.444553 25032 raft_consensus.cc:697] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:56.467926 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:56.467238 24946 raft_consensus.cc:515] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.468549 24578 raft_consensus.cc:3060] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.468500 25032 consensus_queue.cc:237] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.472522 24776 tablet_bootstrap.cc:492] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:56.473147 24776 ts_tablet_manager.cc:1403] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.381s	user 0.040s	sys 0.060s
I20260709 13:06:56.473214 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af12d98819104c6ba6cbc1353f5d5970" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:56.472362 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af12d98819104c6ba6cbc1353f5d5970" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:56.475474 24471 leader_election.cc:343] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.475593 24724 raft_consensus.cc:2468] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:56.475947 24777 tablet_bootstrap.cc:492] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:56.476452 24777 ts_tablet_manager.cc:1403] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.448s	user 0.010s	sys 0.004s
W20260709 13:06:56.476718 24473 leader_election.cc:343] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.477205 24473 leader_election.cc:304] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.478600 25115 raft_consensus.cc:2749] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.479084 24578 raft_consensus.cc:2468] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:56.479301 24946 leader_election.cc:290] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:56.480773 24473 leader_election.cc:304] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:56.481601 25115 raft_consensus.cc:2804] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.487799 24941 consensus_queue.cc:1048] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:56.494866 25115 raft_consensus.cc:697] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:56.495796 25115 consensus_queue.cc:237] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.496811 24777 raft_consensus.cc:359] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.497541 24777 raft_consensus.cc:385] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.497845 24777 raft_consensus.cc:740] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.491422 25073 raft_consensus.cc:2749] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.481443 24776 raft_consensus.cc:359] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.500523 24776 raft_consensus.cc:385] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.500840 24776 raft_consensus.cc:740] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.501543 24776 consensus_queue.cc:260] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.502097 24404 catalog_manager.cc:5697] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.503930 24776 ts_tablet_manager.cc:1434] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:06:56.504940 24776 tablet_bootstrap.cc:492] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:56.506700 24777 consensus_queue.cc:260] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.510928 24777 ts_tablet_manager.cc:1434] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:06:56.516008 24777 tablet_bootstrap.cc:492] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:56.523213 24778 tablet_bootstrap.cc:492] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:56.523757 24778 ts_tablet_manager.cc:1403] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.499s	user 0.008s	sys 0.007s
I20260709 13:06:56.523896 24776 tablet_bootstrap.cc:654] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.528707 24777 tablet_bootstrap.cc:654] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.531136 24941 consensus_queue.cc:1048] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:56.535612 24778 raft_consensus.cc:359] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.536545 24778 raft_consensus.cc:385] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.536883 24778 raft_consensus.cc:740] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.537725 24778 consensus_queue.cc:260] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.541960 24778 ts_tablet_manager.cc:1434] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:06:56.546643 24778 tablet_bootstrap.cc:492] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:56.552399 24775 tablet_bootstrap.cc:492] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:56.553431 24775 ts_tablet_manager.cc:1403] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.007s
I20260709 13:06:56.550732 24619 leader_election.cc:304] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.557214 24775 raft_consensus.cc:359] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.563601 24775 raft_consensus.cc:385] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.564043 24775 raft_consensus.cc:740] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.564851 24775 consensus_queue.cc:260] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
W20260709 13:06:56.567024 24473 consensus_peers.cc:597] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:56.568969 25073 raft_consensus.cc:2804] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.569694 25073 raft_consensus.cc:697] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:56.571638 25073 consensus_queue.cc:237] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.578711 24404 catalog_manager.cc:5697] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.580332 24941 consensus_queue.cc:1048] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:56.591097 25024 raft_consensus.cc:493] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.591681 25024 raft_consensus.cc:515] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.593307 24778 tablet_bootstrap.cc:654] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.597225 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652a4c910b344866bc517d7c4e994536" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:56.599258 24622 leader_election.cc:343] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.593886 25024 leader_election.cc:290] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:56.620119 24404 catalog_manager.cc:5697] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.620909 24775 ts_tablet_manager.cc:1434] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.002s
I20260709 13:06:56.621832 25069 raft_consensus.cc:493] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.622419 25069 raft_consensus.cc:515] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.629482 25069 leader_election.cc:290] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:56.630389 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:56.631829 24694 leader_election.cc:343] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.631695 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652a4c910b344866bc517d7c4e994536" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:56.633801 24724 raft_consensus.cc:2468] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:56.635532 24775 tablet_bootstrap.cc:492] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:56.639503 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
W20260709 13:06:56.642100 24693 leader_election.cc:343] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.643080 24693 leader_election.cc:304] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:56.643877 25069 raft_consensus.cc:2749] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.644659 24619 leader_election.cc:304] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.645792 25024 raft_consensus.cc:2804] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:56.646184 25024 raft_consensus.cc:493] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.646559 25024 raft_consensus.cc:3060] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.650368 25069 raft_consensus.cc:493] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.651010 25069 raft_consensus.cc:515] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.654933 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:56.655812 24776 tablet_bootstrap.cc:492] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
W20260709 13:06:56.656203 24696 leader_election.cc:343] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.656476 24776 ts_tablet_manager.cc:1403] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.152s	user 0.032s	sys 0.012s
I20260709 13:06:56.658387 25069 leader_election.cc:290] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:56.658926 24777 tablet_bootstrap.cc:492] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:56.659490 24777 ts_tablet_manager.cc:1403] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.029s
I20260709 13:06:56.659947 24778 tablet_bootstrap.cc:492] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:56.659687 24776 raft_consensus.cc:359] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.660467 24776 raft_consensus.cc:385] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.660584 24778 ts_tablet_manager.cc:1403] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.118s	user 0.006s	sys 0.024s
I20260709 13:06:56.660822 24776 raft_consensus.cc:740] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.661945 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:56.661752 24776 consensus_queue.cc:260] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
W20260709 13:06:56.663586 24693 leader_election.cc:343] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.664047 24693 leader_election.cc:304] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.664012 24778 raft_consensus.cc:359] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.664875 24778 raft_consensus.cc:385] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.665143 24778 raft_consensus.cc:740] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.665671 25069 raft_consensus.cc:2749] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.665834 24778 consensus_queue.cc:260] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.668577 24776 ts_tablet_manager.cc:1434] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:56.668233 24777 raft_consensus.cc:359] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.669112 24777 raft_consensus.cc:385] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.669487 24777 raft_consensus.cc:740] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.669685 24776 tablet_bootstrap.cc:492] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:56.670384 24777 consensus_queue.cc:260] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.672609 24778 ts_tablet_manager.cc:1434] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:06:56.673700 24778 tablet_bootstrap.cc:492] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:56.680040 24778 tablet_bootstrap.cc:654] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.687718 24777 ts_tablet_manager.cc:1434] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.003s
I20260709 13:06:56.689265 24777 tablet_bootstrap.cc:492] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:56.692288 24776 tablet_bootstrap.cc:654] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.698485 24857 consensus_queue.cc:1048] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:56.710692 24504 raft_consensus.cc:3060] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.731329 25024 raft_consensus.cc:515] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.735613 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652a4c910b344866bc517d7c4e994536" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:56.735983 24978 consensus_queue.cc:1048] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:56.737710 24622 leader_election.cc:343] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.749943 24775 tablet_bootstrap.cc:654] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.759018 25024 leader_election.cc:290] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:56.759902 24777 tablet_bootstrap.cc:654] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.765447 25028 raft_consensus.cc:493] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.774102 25069 raft_consensus.cc:493] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.774706 25069 raft_consensus.cc:515] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.776942 25032 raft_consensus.cc:493] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.777534 25032 raft_consensus.cc:515] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.778182 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:56.779071 25116 raft_consensus.cc:493] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.766054 25028 raft_consensus.cc:515] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.779606 25116 raft_consensus.cc:515] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:06:56.781350 24696 leader_election.cc:343] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.783202 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401126e2c8324c69961e005862f0b23f" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:56.784363 24724 raft_consensus.cc:2393] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in current term 1: Already voted for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in this term.
I20260709 13:06:56.785585 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:56.786512 24725 raft_consensus.cc:2468] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:56.788883 25028 leader_election.cc:290] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:56.786839 25116 leader_election.cc:290] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:56.812582 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933347c92a6c4612a65f9a7c365bc170" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:56.819796 24776 tablet_bootstrap.cc:492] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:56.820099 24778 tablet_bootstrap.cc:492] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:56.820432 24776 ts_tablet_manager.cc:1403] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.151s	user 0.038s	sys 0.050s
I20260709 13:06:56.820446 24775 tablet_bootstrap.cc:492] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:56.822204 24775 ts_tablet_manager.cc:1403] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.187s	user 0.014s	sys 0.001s
I20260709 13:06:56.822677 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:56.825199 24775 raft_consensus.cc:359] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.825969 24775 raft_consensus.cc:385] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.788926 24470 leader_election.cc:304] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
W20260709 13:06:56.832389 24470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 43617.9us
I20260709 13:06:56.832619 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652a4c910b344866bc517d7c4e994536" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:56.800343 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401126e2c8324c69961e005862f0b23f" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:56.833355 24725 raft_consensus.cc:3060] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.777009 25069 leader_election.cc:290] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:56.820701 24778 ts_tablet_manager.cc:1403] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.147s	user 0.038s	sys 0.069s
I20260709 13:06:56.835107 24775 raft_consensus.cc:740] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.835955 24775 consensus_queue.cc:260] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.836741 24946 raft_consensus.cc:2804] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:56.837205 24946 raft_consensus.cc:493] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:56.837525 24946 raft_consensus.cc:3060] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.838622 24775 ts_tablet_manager.cc:1434] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:06:56.827219 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:56.828002 25032 leader_election.cc:290] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:56.789691 25028 consensus_queue.cc:1048] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:56.829432 24693 leader_election.cc:343] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.842985 24693 leader_election.cc:304] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.844429 24775 tablet_bootstrap.cc:492] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:56.831351 24776 raft_consensus.cc:359] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.844347 25069 raft_consensus.cc:2749] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.859014 24776 raft_consensus.cc:385] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.859400 24776 raft_consensus.cc:740] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.849687 24778 raft_consensus.cc:359] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.860481 24778 raft_consensus.cc:385] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.860141 24776 consensus_queue.cc:260] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.862504 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933347c92a6c4612a65f9a7c365bc170" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:56.832629 24777 tablet_bootstrap.cc:492] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:56.864125 24777 ts_tablet_manager.cc:1403] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.008s
W20260709 13:06:56.845532 24471 leader_election.cc:343] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.860827 24778 raft_consensus.cc:740] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.867123 24777 raft_consensus.cc:359] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.867864 24777 raft_consensus.cc:385] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.867641 24778 consensus_queue.cc:260] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.868196 24777 raft_consensus.cc:740] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.868979 24777 consensus_queue.cc:260] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.869791 24778 ts_tablet_manager.cc:1434] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.000s
I20260709 13:06:56.871047 24778 tablet_bootstrap.cc:492] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:56.862466 24776 ts_tablet_manager.cc:1434] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 13:06:56.872601 24776 tablet_bootstrap.cc:492] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:56.876761 24778 tablet_bootstrap.cc:654] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.830390 24402 catalog_manager.cc:5697] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.856948 24546 leader_election.cc:304] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:56.885325 25144 raft_consensus.cc:3060] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.846201 24725 raft_consensus.cc:2468] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:56.854086 24946 raft_consensus.cc:515] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.888398 24946 leader_election.cc:290] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:56.889978 24619 leader_election.cc:304] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.896165 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:56.896498 25024 raft_consensus.cc:2804] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:56.897059 25024 raft_consensus.cc:697] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:56.897451 24946 consensus_queue.cc:1048] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:56.896862 24725 raft_consensus.cc:3060] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:56.897994 25024 consensus_queue.cc:237] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:56.903463 24775 tablet_bootstrap.cc:654] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.906996 24473 leader_election.cc:304] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:56.909211 24776 tablet_bootstrap.cc:654] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.890041 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:56.894093 24777 ts_tablet_manager.cc:1434] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
W20260709 13:06:56.913632 24471 leader_election.cc:343] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:56.914194 24777 tablet_bootstrap.cc:492] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:56.919241 24946 raft_consensus.cc:2749] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:56.927333 24777 tablet_bootstrap.cc:654] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.939391 24725 raft_consensus.cc:2468] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:56.942929 24470 leader_election.cc:304] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:56.944314 24941 raft_consensus.cc:2804] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:56.944872 24473 consensus_peers.cc:597] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:56.944998 24941 raft_consensus.cc:697] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:56.945894 24776 tablet_bootstrap.cc:492] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:56.946544 24776 ts_tablet_manager.cc:1403] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.003s
I20260709 13:06:56.946285 24941 consensus_queue.cc:237] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.948841 24778 tablet_bootstrap.cc:492] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:56.949368 24778 ts_tablet_manager.cc:1403] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.079s	user 0.022s	sys 0.026s
I20260709 13:06:56.949672 24775 tablet_bootstrap.cc:492] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:56.950606 24775 ts_tablet_manager.cc:1403] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.000s
I20260709 13:06:56.960011 24778 raft_consensus.cc:359] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.960784 24778 raft_consensus.cc:385] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.963824 24778 raft_consensus.cc:740] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.964650 24778 consensus_queue.cc:260] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:56.966809 24778 ts_tablet_manager.cc:1434] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:06:56.968070 24778 tablet_bootstrap.cc:492] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:56.954582 24775 raft_consensus.cc:359] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.974916 24775 raft_consensus.cc:385] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.975265 24775 raft_consensus.cc:740] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.975410 24778 tablet_bootstrap.cc:654] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:56.969825 24402 catalog_manager.cc:5697] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:56.978933 24775 consensus_queue.cc:260] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:56.983696 24775 ts_tablet_manager.cc:1434] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:06:56.986388 24924 consensus_queue.cc:1048] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:56.987718 24776 raft_consensus.cc:359] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:56.988483 24776 raft_consensus.cc:385] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:56.988751 24776 raft_consensus.cc:740] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:56.989382 24776 consensus_queue.cc:260] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
W20260709 13:06:56.990478 24546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 79519.5us
I20260709 13:06:56.993005 24775 tablet_bootstrap.cc:492] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:56.994266 25144 raft_consensus.cc:2749] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:56.995689 24776 ts_tablet_manager.cc:1434] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 13:06:56.996739 24776 tablet_bootstrap.cc:492] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:57.002635 24946 raft_consensus.cc:493] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.002878 24777 tablet_bootstrap.cc:492] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:57.003247 24946 raft_consensus.cc:515] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.003544 24777 ts_tablet_manager.cc:1403] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.000s
I20260709 13:06:57.005674 25069 raft_consensus.cc:493] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.006266 25069 raft_consensus.cc:515] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.007109 24777 raft_consensus.cc:359] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.008456 24777 raft_consensus.cc:385] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.008594 25069 leader_election.cc:290] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:57.008810 24777 raft_consensus.cc:740] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.011503 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:57.013058 24777 consensus_queue.cc:260] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:06:57.013855 24694 leader_election.cc:343] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.015702 24777 ts_tablet_manager.cc:1434] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:06:57.016348 24503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
W20260709 13:06:57.018373 24693 leader_election.cc:343] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.018837 24693 leader_election.cc:304] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:57.019200 24946 leader_election.cc:290] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:57.023983 25069 raft_consensus.cc:2749] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.012961 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:57.028996 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:57.029942 24653 raft_consensus.cc:2468] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:57.031119 24471 leader_election.cc:304] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:57.031777 24777 tablet_bootstrap.cc:492] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:57.035859 25065 raft_consensus.cc:2804] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.036404 25065 raft_consensus.cc:493] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.036800 25065 raft_consensus.cc:3060] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.038780 25024 consensus_queue.cc:1048] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:57.043486 24473 leader_election.cc:343] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.044236 25115 consensus_queue.cc:1048] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:57.048339 24776 tablet_bootstrap.cc:654] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.059219 25024 consensus_queue.cc:1048] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.070317 24777 tablet_bootstrap.cc:654] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.072716 25144 raft_consensus.cc:493] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.061568 25065 raft_consensus.cc:515] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.073355 25144 raft_consensus.cc:515] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.089298 24404 catalog_manager.cc:5697] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.100785 25144 leader_election.cc:290] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:57.102043 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af12d98819104c6ba6cbc1353f5d5970" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:57.094193 25122 raft_consensus.cc:493] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.106750 25122 raft_consensus.cc:515] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.108187 24655 raft_consensus.cc:2468] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:57.109503 25122 leader_election.cc:290] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:57.111569 24546 leader_election.cc:304] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:57.112615 25140 raft_consensus.cc:2804] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.096393 24946 consensus_queue.cc:1048] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:06:57.113085 25140 raft_consensus.cc:493] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.113559 25140 raft_consensus.cc:3060] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.115540 25144 raft_consensus.cc:493] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.116221 25144 raft_consensus.cc:515] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.117465 24775 tablet_bootstrap.cc:654] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.112903 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af12d98819104c6ba6cbc1353f5d5970" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:57.118676 24504 raft_consensus.cc:2468] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:57.119433 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652a4c910b344866bc517d7c4e994536" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:57.121613 24453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:57.122180 24619 leader_election.cc:304] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:57.125285 25033 raft_consensus.cc:2804] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.125759 25033 raft_consensus.cc:493] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.126114 25033 raft_consensus.cc:3060] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.122910 25140 raft_consensus.cc:515] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.128989 24503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af12d98819104c6ba6cbc1353f5d5970" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:57.129768 24503 raft_consensus.cc:2468] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:57.130234 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af12d98819104c6ba6cbc1353f5d5970" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:57.132381 24504 raft_consensus.cc:3060] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.142067 25024 raft_consensus.cc:493] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.142452 25033 raft_consensus.cc:515] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.142769 25024 raft_consensus.cc:515] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.145018 25024 leader_election.cc:290] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:57.151150 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:57.132246 25144 leader_election.cc:290] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:57.169740 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:57.182909 24778 tablet_bootstrap.cc:492] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:57.183458 24778 ts_tablet_manager.cc:1403] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.216s	user 0.024s	sys 0.034s
I20260709 13:06:57.192286 24504 raft_consensus.cc:2468] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:57.193670 24545 leader_election.cc:304] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:57.195118 25143 raft_consensus.cc:2804] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.196863 25143 raft_consensus.cc:697] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:57.162190 25069 raft_consensus.cc:493] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.194195 24503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af12d98819104c6ba6cbc1353f5d5970" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:57.197785 25069 raft_consensus.cc:515] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.198563 24503 raft_consensus.cc:2393] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in this term.
I20260709 13:06:57.199993 25069 leader_election.cc:290] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:57.187273 25140 leader_election.cc:290] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:57.200568 25143 consensus_queue.cc:237] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.204296 24728 raft_consensus.cc:2393] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 7e0390f5bd00484985fa5469e25be18d in this term.
I20260709 13:06:57.206952 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:06:57.208176 25154 log.cc:927] Time spent T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:57.212038 24619 leader_election.cc:304] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:57.215137 24911 raft_consensus.cc:3060] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.217532 25115 raft_consensus.cc:493] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.218117 25115 raft_consensus.cc:515] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:06:57.220142 24694 leader_election.cc:343] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.220542 25115 leader_election.cc:290] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:57.162982 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652a4c910b344866bc517d7c4e994536" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:57.232285 24724 raft_consensus.cc:2393] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in current term 1: Already voted for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in this term.
I20260709 13:06:57.236709 24578 raft_consensus.cc:3060] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.238271 24545 leader_election.cc:304] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:57.242561 24924 raft_consensus.cc:3060] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.250484 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af12d98819104c6ba6cbc1353f5d5970" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:57.266360 25065 leader_election.cc:290] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:57.266796 24655 raft_consensus.cc:2393] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in current term 1: Already voted for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in this term.
I20260709 13:06:57.267112 24911 raft_consensus.cc:2749] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.267999 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:57.253170 25033 leader_election.cc:290] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:57.278556 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:57.279209 24655 raft_consensus.cc:3060] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.281605 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:57.287082 24696 leader_election.cc:343] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.287663 24696 leader_election.cc:304] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:57.290531 24777 tablet_bootstrap.cc:492] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:57.290731 25069 raft_consensus.cc:2749] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.291078 24777 ts_tablet_manager.cc:1403] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.260s	user 0.024s	sys 0.042s
I20260709 13:06:57.292207 24924 raft_consensus.cc:2749] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.287410 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af12d98819104c6ba6cbc1353f5d5970" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
W20260709 13:06:57.287101 24471 leader_election.cc:343] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.300045 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af12d98819104c6ba6cbc1353f5d5970" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:57.301106 24655 raft_consensus.cc:2468] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:57.302201 24622 leader_election.cc:304] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:57.302603 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:57.304032 25122 raft_consensus.cc:2749] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.306149 24775 tablet_bootstrap.cc:492] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:57.306756 24775 ts_tablet_manager.cc:1403] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.314s	user 0.009s	sys 0.023s
W20260709 13:06:57.310384 24473 leader_election.cc:343] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.312572 24471 leader_election.cc:304] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:57.313585 24946 raft_consensus.cc:2804] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.314113 24946 raft_consensus.cc:697] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:57.315572 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:57.315025 24946 consensus_queue.cc:237] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.316238 24729 raft_consensus.cc:2468] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:57.321605 24777 raft_consensus.cc:359] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.322460 24777 raft_consensus.cc:385] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.322770 24777 raft_consensus.cc:740] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.324707 24778 raft_consensus.cc:359] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.325532 24778 raft_consensus.cc:385] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.325806 24778 raft_consensus.cc:740] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.327268 24777 consensus_queue.cc:260] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.331138 24776 tablet_bootstrap.cc:492] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:57.331717 24776 ts_tablet_manager.cc:1403] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.335s	user 0.024s	sys 0.008s
I20260709 13:06:57.330709 24778 consensus_queue.cc:260] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.329896 24911 consensus_queue.cc:1048] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:06:57.346261 24402 catalog_manager.cc:5697] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.347949 24777 ts_tablet_manager.cc:1434] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:06:57.349131 24777 tablet_bootstrap.cc:492] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:57.365567 24778 ts_tablet_manager.cc:1434] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.182s	user 0.002s	sys 0.006s
I20260709 13:06:57.370839 24778 tablet_bootstrap.cc:492] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:57.378696 24470 leader_election.cc:304] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:06:57.379838 25116 raft_consensus.cc:2804] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.380332 25116 raft_consensus.cc:493] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.380738 25116 raft_consensus.cc:3060] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.387647 24776 raft_consensus.cc:359] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.388312 24776 raft_consensus.cc:385] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.388514 24776 raft_consensus.cc:740] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.389217 24776 consensus_queue.cc:260] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.391130 24778 tablet_bootstrap.cc:654] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.391240 24776 ts_tablet_manager.cc:1434] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:06:57.414892 24776 tablet_bootstrap.cc:492] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:57.424100 24775 raft_consensus.cc:359] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.424921 24775 raft_consensus.cc:385] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.425297 24775 raft_consensus.cc:740] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.426239 24775 consensus_queue.cc:260] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.432884 24776 tablet_bootstrap.cc:654] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.436573 24775 ts_tablet_manager.cc:1434] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.130s	user 0.004s	sys 0.006s
W20260709 13:06:57.437040 24622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 111312us
I20260709 13:06:57.445163 24775 tablet_bootstrap.cc:492] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c: Bootstrap starting.
I20260709 13:06:57.469834 24911 raft_consensus.cc:493] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:57.489377 25167 log.cc:927] Time spent T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Append to log took a long time: real 0.102s	user 0.000s	sys 0.003s
I20260709 13:06:57.486982 24404 catalog_manager.cc:5697] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:57.485816 24911 raft_consensus.cc:515] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.506523 25033 consensus_queue.cc:1048] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:06:57.511994 25165 log.cc:927] Time spent T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
I20260709 13:06:57.512512 24778 tablet_bootstrap.cc:492] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:57.513062 24778 ts_tablet_manager.cc:1403] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.142s	user 0.021s	sys 0.032s
I20260709 13:06:57.530829 24778 raft_consensus.cc:359] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.531546 24778 raft_consensus.cc:385] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.531839 24778 raft_consensus.cc:740] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.532531 24778 consensus_queue.cc:260] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.535640 24911 leader_election.cc:290] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:57.535935 24941 consensus_queue.cc:1048] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:57.537990 24777 tablet_bootstrap.cc:654] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.544502 24778 ts_tablet_manager.cc:1434] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:06:57.547451 24778 tablet_bootstrap.cc:492] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:57.554848 24776 tablet_bootstrap.cc:492] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:57.555428 24776 ts_tablet_manager.cc:1403] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.145s	user 0.019s	sys 0.000s
I20260709 13:06:57.559904 25065 consensus_queue.cc:1048] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:57.560333 24776 raft_consensus.cc:359] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.561024 24776 raft_consensus.cc:385] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.561299 24776 raft_consensus.cc:740] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.540697 25116 raft_consensus.cc:515] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.575814 24778 tablet_bootstrap.cc:654] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.542204 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:57.576615 24724 raft_consensus.cc:2468] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:57.578583 24619 leader_election.cc:304] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:06:57.579914 24911 raft_consensus.cc:2804] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.580525 24911 raft_consensus.cc:493] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.581112 24911 raft_consensus.cc:3060] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.582330 24776 consensus_queue.cc:260] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.586512 24776 ts_tablet_manager.cc:1434] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:06:57.587939 24776 tablet_bootstrap.cc:492] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
W20260709 13:06:57.589048 24473 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 102738us
I20260709 13:06:57.590747 25116 leader_election.cc:290] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:57.591446 24775 tablet_bootstrap.cc:654] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.593966 24776 tablet_bootstrap.cc:654] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.596189 25115 raft_consensus.cc:493] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.596956 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:57.601507 24504 raft_consensus.cc:2393] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 7e0390f5bd00484985fa5469e25be18d in this term.
I20260709 13:06:57.597802 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:57.602512 24729 raft_consensus.cc:3060] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.604732 24777 tablet_bootstrap.cc:492] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:57.605283 24777 ts_tablet_manager.cc:1403] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.256s	user 0.015s	sys 0.000s
I20260709 13:06:57.609467 24729 raft_consensus.cc:2468] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:57.610085 25115 raft_consensus.cc:515] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.612793 25115 leader_election.cc:290] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:57.615221 25144 raft_consensus.cc:493] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.615784 25144 raft_consensus.cc:515] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.618172 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:57.619057 25144 leader_election.cc:290] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:57.620169 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:57.620924 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:57.625491 24778 tablet_bootstrap.cc:492] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:57.626048 24778 ts_tablet_manager.cc:1403] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.000s
I20260709 13:06:57.619153 24729 raft_consensus.cc:2468] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:57.631105 24776 tablet_bootstrap.cc:492] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:57.631721 24776 ts_tablet_manager.cc:1403] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.006s
I20260709 13:06:57.633201 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:57.607898 24777 raft_consensus.cc:359] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.634573 24776 raft_consensus.cc:359] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.635124 24777 raft_consensus.cc:385] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.635329 24776 raft_consensus.cc:385] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.635464 24777 raft_consensus.cc:740] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.635737 24776 raft_consensus.cc:740] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.636302 24777 consensus_queue.cc:260] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.637514 24778 raft_consensus.cc:359] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.638219 24778 raft_consensus.cc:385] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.638466 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:57.638490 24778 raft_consensus.cc:740] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.639711 24911 raft_consensus.cc:515] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.641103 24545 leader_election.cc:304] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:57.642026 25139 raft_consensus.cc:2749] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.641979 24775 tablet_bootstrap.cc:492] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c: No bootstrap required, opened a new log
I20260709 13:06:57.642823 24911 leader_election.cc:290] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:57.643229 24775 ts_tablet_manager.cc:1403] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent bootstrapping tablet: real 0.206s	user 0.009s	sys 0.005s
I20260709 13:06:57.643700 24777 ts_tablet_manager.cc:1434] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
W20260709 13:06:57.644426 24473 leader_election.cc:343] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.645576 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:57.646373 24777 tablet_bootstrap.cc:492] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:57.646482 24507 raft_consensus.cc:2393] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 7e0390f5bd00484985fa5469e25be18d in this term.
I20260709 13:06:57.646072 24775 raft_consensus.cc:359] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.646906 24775 raft_consensus.cc:385] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.647213 24775 raft_consensus.cc:740] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.648100 24653 raft_consensus.cc:2393] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7e0390f5bd00484985fa5469e25be18d in current term 1: Already voted for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in this term.
I20260709 13:06:57.639907 24778 consensus_queue.cc:260] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.650570 24778 ts_tablet_manager.cc:1434] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:06:57.651592 24778 tablet_bootstrap.cc:492] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:57.652619 24777 tablet_bootstrap.cc:654] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.652736 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:57.654119 24729 raft_consensus.cc:2393] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 7e0390f5bd00484985fa5469e25be18d in this term.
I20260709 13:06:57.636538 24776 consensus_queue.cc:260] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.647894 24775 consensus_queue.cc:260] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.658951 24619 leader_election.cc:304] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:57.659439 24776 ts_tablet_manager.cc:1434] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:06:57.663882 24470 leader_election.cc:304] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:57.670900 24470 leader_election.cc:304] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:57.674437 25032 raft_consensus.cc:2804] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.674921 25032 raft_consensus.cc:493] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.674479 25170 raft_consensus.cc:2804] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.675874 25170 raft_consensus.cc:697] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:57.676472 24843 raft_consensus.cc:493] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.676960 24775 ts_tablet_manager.cc:1434] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 13:06:57.676836 25170 consensus_queue.cc:237] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.677028 24843 raft_consensus.cc:515] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.677862 24778 tablet_bootstrap.cc:654] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.678910 24776 tablet_bootstrap.cc:492] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:57.679574 24843 leader_election.cc:290] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:57.681293 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fde674ca95f4161a7f741a822bfe6df" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
W20260709 13:06:57.682729 24693 leader_election.cc:343] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.665571 25073 raft_consensus.cc:2749] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.682883 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fde674ca95f4161a7f741a822bfe6df" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:57.686342 24696 leader_election.cc:343] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.686873 24696 leader_election.cc:304] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:57.688135 24843 raft_consensus.cc:2749] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.675298 25032 raft_consensus.cc:3060] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.697109 24777 tablet_bootstrap.cc:492] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:57.705734 24777 ts_tablet_manager.cc:1403] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.007s
I20260709 13:06:57.698361 25143 consensus_queue.cc:1048] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.709514 24777 raft_consensus.cc:359] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.711488 24776 tablet_bootstrap.cc:654] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.718432 24777 raft_consensus.cc:385] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.718892 24777 raft_consensus.cc:740] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.719700 24777 consensus_queue.cc:260] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.720252 25032 raft_consensus.cc:515] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.732402 24777 ts_tablet_manager.cc:1434] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:06:57.733530 24777 tablet_bootstrap.cc:492] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:57.727206 25115 raft_consensus.cc:493] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.735194 25115 raft_consensus.cc:515] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.740243 25115 leader_election.cc:290] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:57.741343 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb6450ef5924cec9eacb07c5c4a79ed" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:57.742944 25032 leader_election.cc:290] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
W20260709 13:06:57.743104 24471 leader_election.cc:343] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.743155 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:57.741334 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb6450ef5924cec9eacb07c5c4a79ed" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:57.745697 24473 leader_election.cc:343] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:57.746506 24473 leader_election.cc:343] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.746953 24473 leader_election.cc:304] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:57.749727 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:57.751209 24724 raft_consensus.cc:3060] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.754968 25032 raft_consensus.cc:2749] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.751153 24777 tablet_bootstrap.cc:654] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.762991 25032 consensus_queue.cc:1048] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.771118 25144 raft_consensus.cc:493] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.771801 25144 raft_consensus.cc:515] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.789160 24778 tablet_bootstrap.cc:492] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:57.789824 24778 ts_tablet_manager.cc:1403] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.005s
I20260709 13:06:57.791769 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:57.792263 24776 tablet_bootstrap.cc:492] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:57.793931 25144 leader_election.cc:290] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:57.793977 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:57.795195 24776 ts_tablet_manager.cc:1403] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.116s	user 0.010s	sys 0.014s
I20260709 13:06:57.797722 24776 raft_consensus.cc:359] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.798242 24776 raft_consensus.cc:385] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.798564 24776 raft_consensus.cc:740] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.799237 24776 consensus_queue.cc:260] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.799600 24546 leader_election.cc:304] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:57.801362 24776 ts_tablet_manager.cc:1434] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:06:57.801599 25139 raft_consensus.cc:2749] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.802408 24776 tablet_bootstrap.cc:492] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:57.802251 24778 raft_consensus.cc:359] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.803089 24778 raft_consensus.cc:385] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.803499 24778 raft_consensus.cc:740] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.804298 24778 consensus_queue.cc:260] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.806123 24778 ts_tablet_manager.cc:1434] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:06:57.809993 24776 tablet_bootstrap.cc:654] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.812489 25140 raft_consensus.cc:493] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.813230 25140 raft_consensus.cc:515] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.816996 25139 consensus_queue.cc:1048] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:57.824839 24778 tablet_bootstrap.cc:492] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:57.829397 24403 catalog_manager.cc:5697] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:57.836426 24778 tablet_bootstrap.cc:654] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:57.841333 25160 raft_consensus.cc:493] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.841921 25160 raft_consensus.cc:515] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:57.845366 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:57.846575 25160 leader_election.cc:290] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
W20260709 13:06:57.847301 24693 leader_election.cc:343] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.839949 24776 tablet_bootstrap.cc:492] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:57.851596 24776 ts_tablet_manager.cc:1403] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 13:06:57.856787 24578 raft_consensus.cc:3060] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.850072 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f37afc8b3624bd09784565977fef62c" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:57.858462 24652 raft_consensus.cc:2468] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:57.873222 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f37afc8b3624bd09784565977fef62c" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:57.877417 24729 raft_consensus.cc:2468] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:57.864774 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:57.860004 24546 leader_election.cc:304] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:57.888432 25166 raft_consensus.cc:493] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.888841 25144 raft_consensus.cc:2804] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:57.889338 25144 raft_consensus.cc:493] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.889051 25166 raft_consensus.cc:515] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.889724 25144 raft_consensus.cc:3060] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.889422 25140 leader_election.cc:290] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
W20260709 13:06:57.904579 24694 leader_election.cc:343] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:57.905299 24694 leader_election.cc:304] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:57.923264 25170 raft_consensus.cc:493] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.923899 25170 raft_consensus.cc:515] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.920235 24843 raft_consensus.cc:2749] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:57.926095 25170 leader_election.cc:290] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:57.930743 24776 raft_consensus.cc:359] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.931538 24776 raft_consensus.cc:385] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.931830 24776 raft_consensus.cc:740] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.932512 24776 consensus_queue.cc:260] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.935387 25166 leader_election.cc:290] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:57.935865 24777 tablet_bootstrap.cc:492] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:57.935599 24724 raft_consensus.cc:2468] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:57.936534 24777 ts_tablet_manager.cc:1403] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.203s	user 0.055s	sys 0.050s
I20260709 13:06:57.939486 24777 raft_consensus.cc:359] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.940183 24777 raft_consensus.cc:385] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.940613 24777 raft_consensus.cc:740] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.941329 24777 consensus_queue.cc:260] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.940016 24470 leader_election.cc:304] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:57.943526 24777 ts_tablet_manager.cc:1434] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:06:57.943957 25032 raft_consensus.cc:2804] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:57.944599 24777 tablet_bootstrap.cc:492] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:57.944550 25032 raft_consensus.cc:697] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:57.945746 25032 consensus_queue.cc:237] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:57.947608 24776 ts_tablet_manager.cc:1434] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.000s
I20260709 13:06:57.958029 24776 tablet_bootstrap.cc:492] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:57.956770 25166 raft_consensus.cc:493] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.967546 25166 raft_consensus.cc:515] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.968977 24778 tablet_bootstrap.cc:492] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:57.969060 25144 raft_consensus.cc:515] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:57.969681 25166 leader_election.cc:290] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:57.969779 24778 ts_tablet_manager.cc:1403] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.145s	user 0.024s	sys 0.033s
I20260709 13:06:57.973280 24778 raft_consensus.cc:359] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.977432 24778 raft_consensus.cc:385] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:57.977672 24778 raft_consensus.cc:740] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:57.978335 24778 consensus_queue.cc:260] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:57.983788 24778 ts_tablet_manager.cc:1434] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:06:57.985037 24778 tablet_bootstrap.cc:492] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:57.989084 25171 consensus_queue.cc:1048] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:57.993618 25144 leader_election.cc:290] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:57.994351 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f37afc8b3624bd09784565977fef62c" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:57.995071 24653 raft_consensus.cc:3060] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:57.995245 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:57.995921 24581 raft_consensus.cc:2468] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:57.996161 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb6450ef5924cec9eacb07c5c4a79ed" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:57.998926 24577 raft_consensus.cc:3060] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.003062 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:58.003298 25116 raft_consensus.cc:493] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.961925 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:58.018983 24726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f37afc8b3624bd09784565977fef62c" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:58.019964 25116 raft_consensus.cc:515] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:58.023465 24726 raft_consensus.cc:3060] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.031006 24724 raft_consensus.cc:2468] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:58.051509 24777 tablet_bootstrap.cc:654] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:58.054498 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:58.055560 24729 raft_consensus.cc:2468] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:58.055788 25116 leader_election.cc:290] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:58.056275 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb6450ef5924cec9eacb07c5c4a79ed" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:58.056943 24507 raft_consensus.cc:2468] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:58.057327 24778 tablet_bootstrap.cc:654] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:58.060607 24473 leader_election.cc:343] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:58.068962 24622 leader_election.cc:304] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:58.070029 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4161a18cbe354021af90307a3789b890" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:06:58.072969 25191 raft_consensus.cc:2804] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:58.073411 25191 raft_consensus.cc:493] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.073781 25191 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:58.078351 24473 leader_election.cc:343] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:58.080582 24726 raft_consensus.cc:2468] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
W20260709 13:06:58.081215 24622 leader_election.cc:343] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:58.082024 24545 leader_election.cc:304] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:58.083151 24924 raft_consensus.cc:2804] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:58.083648 24924 raft_consensus.cc:697] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:58.084481 24924 consensus_queue.cc:237] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:58.094798 24777 tablet_bootstrap.cc:492] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:58.099499 24777 ts_tablet_manager.cc:1403] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.155s	user 0.016s	sys 0.000s
I20260709 13:06:58.101759 24470 leader_election.cc:304] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:58.102843 24776 tablet_bootstrap.cc:654] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:58.104061 25116 raft_consensus.cc:2804] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:58.104514 25116 raft_consensus.cc:493] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.104852 25116 raft_consensus.cc:3060] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.111907 25191 raft_consensus.cc:515] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:58.119256 24777 raft_consensus.cc:359] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:58.120368 24777 raft_consensus.cc:385] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:58.120756 24777 raft_consensus.cc:740] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:58.121626 24777 consensus_queue.cc:260] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:58.123924 24777 ts_tablet_manager.cc:1434] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:06:58.124827 24777 tablet_bootstrap.cc:492] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:58.134276 24941 consensus_queue.cc:1048] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:58.134377 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4161a18cbe354021af90307a3789b890" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:58.143158 24619 leader_election.cc:304] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
W20260709 13:06:58.144544 24471 leader_election.cc:343] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:58.145138 24471 leader_election.cc:304] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:58.146394 24946 raft_consensus.cc:2749] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:58.151628 25116 raft_consensus.cc:515] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.061676 24653 raft_consensus.cc:2468] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:58.155957 25166 raft_consensus.cc:2804] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:58.156385 25166 raft_consensus.cc:493] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.156739 25166 raft_consensus.cc:3060] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.162779 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:58.165509 24777 tablet_bootstrap.cc:654] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:58.166775 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:58.168855 24577 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.171751 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:58.172467 24730 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.152057 24404 catalog_manager.cc:5697] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.167147 25191 leader_election.cc:290] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:58.191300 24778 tablet_bootstrap.cc:492] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:58.192034 24778 ts_tablet_manager.cc:1403] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.207s	user 0.033s	sys 0.032s
I20260709 13:06:58.192297 25166 raft_consensus.cc:515] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:58.192471 24403 catalog_manager.cc:5697] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.197002 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb6450ef5924cec9eacb07c5c4a79ed" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:58.197602 24507 raft_consensus.cc:3060] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.198408 25116 leader_election.cc:290] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:58.223172 25116 raft_consensus.cc:493] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.223555 24577 raft_consensus.cc:2468] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:58.223824 25116 raft_consensus.cc:515] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:58.226125 25116 leader_election.cc:290] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:58.227114 25166 leader_election.cc:290] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:58.228288 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
W20260709 13:06:58.217530 24473 leader_election.cc:343] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:58.228993 24729 raft_consensus.cc:2468] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:58.231278 24470 leader_election.cc:304] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:58.236083 24778 raft_consensus.cc:359] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.237162 24778 raft_consensus.cc:385] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:58.237540 24778 raft_consensus.cc:740] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:58.209262 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:58.248443 24507 raft_consensus.cc:2468] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:58.250309 24619 leader_election.cc:304] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:58.245831 25171 raft_consensus.cc:2804] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:58.250439 24724 raft_consensus.cc:3060] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:58.259158 24453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:58.268164 24778 consensus_queue.cc:260] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.265081 24730 raft_consensus.cc:2468] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:58.271474 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb6450ef5924cec9eacb07c5c4a79ed" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:58.273022 24622 leader_election.cc:304] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:58.253392 25191 raft_consensus.cc:2804] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:58.282321 24776 tablet_bootstrap.cc:492] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:58.252600 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:58.293622 24777 tablet_bootstrap.cc:492] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:58.294014 25191 raft_consensus.cc:697] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:58.294222 24777 ts_tablet_manager.cc:1403] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.170s	user 0.024s	sys 0.054s
I20260709 13:06:58.295035 25191 consensus_queue.cc:237] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:58.289301 24776 ts_tablet_manager.cc:1403] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.332s	user 0.028s	sys 0.034s
I20260709 13:06:58.297544 24777 raft_consensus.cc:359] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:58.298359 24777 raft_consensus.cc:385] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:58.298615 24777 raft_consensus.cc:740] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:58.257419 25171 raft_consensus.cc:493] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.304915 24778 ts_tablet_manager.cc:1434] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.113s	user 0.012s	sys 0.000s
I20260709 13:06:58.306782 24778 tablet_bootstrap.cc:492] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:06:58.299227 24777 consensus_queue.cc:260] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:58.291281 25122 raft_consensus.cc:2804] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:06:58.313200 24622 leader_election.cc:343] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:58.314559 24777 ts_tablet_manager.cc:1434] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:06:58.306782 25171 raft_consensus.cc:3060] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.316241 24777 tablet_bootstrap.cc:492] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:58.316784 24946 raft_consensus.cc:493] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.312564 24653 raft_consensus.cc:2468] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:58.317550 25122 raft_consensus.cc:697] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:58.339136 25122 consensus_queue.cc:237] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:58.349789 24776 raft_consensus.cc:359] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:58.350677 24776 raft_consensus.cc:385] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:58.350970 24776 raft_consensus.cc:740] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:58.352239 24776 consensus_queue.cc:260] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:58.330305 24946 raft_consensus.cc:515] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.361635 24776 ts_tablet_manager.cc:1434] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:06:58.366286 24776 tablet_bootstrap.cc:492] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:58.369925 25171 raft_consensus.cc:515] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:58.376922 24946 leader_election.cc:290] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:58.377941 24776 tablet_bootstrap.cc:654] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:58.381757 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fde674ca95f4161a7f741a822bfe6df" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:58.385509 24473 leader_election.cc:343] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:58.388809 24946 consensus_queue.cc:1048] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.390440 24582 raft_consensus.cc:3060] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.398070 25171 leader_election.cc:290] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
W20260709 13:06:58.386755 25200 log.cc:927] Time spent T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:06:58.399798 24724 raft_consensus.cc:2468] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:58.404320 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:58.405287 24653 raft_consensus.cc:3060] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.453075 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:58.453814 24728 raft_consensus.cc:3060] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.454707 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fde674ca95f4161a7f741a822bfe6df" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:58.455443 24725 raft_consensus.cc:2468] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:58.461500 24728 raft_consensus.cc:2468] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:58.466753 24470 leader_election.cc:304] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:58.469017 24946 raft_consensus.cc:2804] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:58.448238 25024 raft_consensus.cc:493] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.434614 25171 consensus_queue.cc:1048] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 13:06:58.486195 25024 raft_consensus.cc:515] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:58.492836 25171 consensus_queue.cc:1048] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:58.496235 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:06:58.498050 24622 leader_election.cc:343] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:58.493984 25024 leader_election.cc:290] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:58.506848 24776 tablet_bootstrap.cc:492] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:58.507419 24776 ts_tablet_manager.cc:1403] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.142s	user 0.014s	sys 0.027s
I20260709 13:06:58.488827 25144 raft_consensus.cc:493] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.518400 24470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 49949us
I20260709 13:06:58.519361 24470 leader_election.cc:304] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:58.519779 24946 raft_consensus.cc:697] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:58.520756 24946 consensus_queue.cc:237] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.519366 24653 raft_consensus.cc:2468] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:58.526863 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:58.527616 24730 raft_consensus.cc:2468] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 0.
I20260709 13:06:58.528458 24776 raft_consensus.cc:359] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.529199 24776 raft_consensus.cc:385] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:58.528693 24619 leader_election.cc:304] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:58.529471 24776 raft_consensus.cc:740] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:58.521860 24470 leader_election.cc:304] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:58.535663 25170 raft_consensus.cc:2804] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:58.533298 25116 raft_consensus.cc:2804] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:58.541180 25116 raft_consensus.cc:493] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.541641 25116 raft_consensus.cc:3060] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.536055 25024 raft_consensus.cc:2804] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:58.542637 25024 raft_consensus.cc:493] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.542984 25024 raft_consensus.cc:3060] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.540488 24404 catalog_manager.cc:5697] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:58.546299 24924 raft_consensus.cc:493] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.546888 24924 raft_consensus.cc:515] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:58.548106 24777 tablet_bootstrap.cc:654] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:58.548286 24778 tablet_bootstrap.cc:654] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:58.549028 24924 leader_election.cc:290] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:58.566210 25024 raft_consensus.cc:515] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:58.523520 25144 raft_consensus.cc:515] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.578552 24507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb6450ef5924cec9eacb07c5c4a79ed" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:58.579430 24507 raft_consensus.cc:2393] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in current term 1: Already voted for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in this term.
I20260709 13:06:58.582762 25144 leader_election.cc:290] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:58.583361 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edb6450ef5924cec9eacb07c5c4a79ed" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:58.586840 24776 consensus_queue.cc:260] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.587386 24924 consensus_queue.cc:1048] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.589274 24776 ts_tablet_manager.cc:1434] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 13:06:58.589701 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:58.590456 24728 raft_consensus.cc:2468] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:58.596997 24776 tablet_bootstrap.cc:492] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:58.599608 24545 leader_election.cc:304] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:58.568440 25170 raft_consensus.cc:697] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:58.629426 25024 leader_election.cc:290] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:58.622035 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:58.623919 25140 raft_consensus.cc:2804] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:06:58.627108 24471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 49452us
I20260709 13:06:58.640667 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:58.641714 24727 raft_consensus.cc:3060] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.627393 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:58.622833 25116 raft_consensus.cc:515] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.650578 25170 consensus_queue.cc:237] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:58.652551 25116 leader_election.cc:290] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:06:58.664393 24777 tablet_bootstrap.cc:492] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:58.665293 24777 ts_tablet_manager.cc:1403] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.349s	user 0.015s	sys 0.000s
I20260709 13:06:58.674340 25139 consensus_queue.cc:1048] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:06:58.674561 24622 leader_election.cc:343] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:58.684000 24470 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 71948.1us
I20260709 13:06:58.691869 24776 tablet_bootstrap.cc:654] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:58.685063 25202 log.cc:927] Time spent T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:06:58.697782 24778 tablet_bootstrap.cc:492] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: No bootstrap required, opened a new log
I20260709 13:06:58.698411 24778 ts_tablet_manager.cc:1403] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.392s	user 0.024s	sys 0.030s
I20260709 13:06:58.702039 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fde674ca95f4161a7f741a822bfe6df" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:58.702840 24724 raft_consensus.cc:3060] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:06:58.706662 25209 log.cc:927] Time spent T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:06:58.696808 24546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 74523.8us
I20260709 13:06:58.739305 24778 raft_consensus.cc:359] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:58.750516 24778 raft_consensus.cc:385] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:58.750919 24778 raft_consensus.cc:740] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:06:58.753517 24778 consensus_queue.cc:260] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:58.759894 24724 raft_consensus.cc:2468] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:58.762356 24470 leader_election.cc:304] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:58.763499 24946 raft_consensus.cc:2804] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:58.763968 24946 raft_consensus.cc:697] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:58.764045 24778 ts_tablet_manager.cc:1434] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 13:06:58.772707 24545 leader_election.cc:304] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:58.782560 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fde674ca95f4161a7f741a822bfe6df" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:06:58.740236 25140 raft_consensus.cc:493] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:06:58.764822 24946 consensus_queue.cc:237] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
W20260709 13:06:58.805346 24473 leader_election.cc:343] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:58.792079 25139 raft_consensus.cc:3060] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.794377 25140 raft_consensus.cc:3060] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:58.851822 24777 raft_consensus.cc:359] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:58.852628 24777 raft_consensus.cc:385] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:58.852891 24777 raft_consensus.cc:740] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:58.854076 24777 consensus_queue.cc:260] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:58.857743 24777 ts_tablet_manager.cc:1434] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.192s	user 0.007s	sys 0.000s
I20260709 13:06:58.859614 24777 tablet_bootstrap.cc:492] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4: Bootstrap starting.
I20260709 13:06:58.867019 25166 consensus_queue.cc:1048] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:58.877413 25170 raft_consensus.cc:493] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.878067 25170 raft_consensus.cc:515] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:58.880537 25170 leader_election.cc:290] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:58.884109 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:58.888202 24724 raft_consensus.cc:2468] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 0.
I20260709 13:06:58.911010 24470 leader_election.cc:304] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:58.912540 25032 raft_consensus.cc:2804] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:58.912963 25032 raft_consensus.cc:493] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.913314 25032 raft_consensus.cc:3060] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:58.921729 24776 tablet_bootstrap.cc:492] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:58.922405 24776 ts_tablet_manager.cc:1403] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.332s	user 0.012s	sys 0.003s
I20260709 13:06:58.924064 25024 consensus_queue.cc:1048] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:58.924485 25139 raft_consensus.cc:2749] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:58.931354 24776 raft_consensus.cc:359] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:58.932384 24776 raft_consensus.cc:385] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:58.932696 24776 raft_consensus.cc:740] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:58.941876 24776 consensus_queue.cc:260] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:58.945304 24776 ts_tablet_manager.cc:1434] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:06:58.910090 25140 raft_consensus.cc:515] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.946626 24776 tablet_bootstrap.cc:492] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:58.949138 24580 raft_consensus.cc:1240] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Rejecting Update request from peer 7e0390f5bd00484985fa5469e25be18d for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:58.949865 24727 raft_consensus.cc:2468] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:06:58.957779 25140 leader_election.cc:290] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:58.972378 25217 raft_consensus.cc:493] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.997287 25217 raft_consensus.cc:515] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:58.999994 25217 leader_election.cc:290] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:59.003093 24776 tablet_bootstrap.cc:654] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:59.008831 24619 leader_election.cc:304] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:06:59.009882 25122 raft_consensus.cc:2804] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:59.010468 25122 raft_consensus.cc:697] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:06:58.965349 24404 catalog_manager.cc:5697] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:59.011355 25122 consensus_queue.cc:237] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:59.017634 24776 tablet_bootstrap.cc:492] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:59.018253 24776 ts_tablet_manager.cc:1403] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.009s
I20260709 13:06:59.020262 24777 tablet_bootstrap.cc:700] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent opening tablet: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:06:59.021306 24777 tablet_bootstrap.cc:654] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4: Neither blocks nor log segments found. Creating new log.
W20260709 13:06:59.021500 24471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 159184us
I20260709 13:06:59.021306 24776 raft_consensus.cc:359] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:59.022279 24776 raft_consensus.cc:385] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:59.022603 24776 raft_consensus.cc:740] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:59.023448 24776 consensus_queue.cc:260] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:59.025820 24776 ts_tablet_manager.cc:1434] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:06:59.027002 24776 tablet_bootstrap.cc:492] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Bootstrap starting.
I20260709 13:06:59.039935 24941 consensus_queue.cc:1059] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:59.041009 24946 raft_consensus.cc:3055] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:59.041411 24946 raft_consensus.cc:740] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:59.042855 25166 raft_consensus.cc:493] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.054425 24946 consensus_queue.cc:260] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:59.060014 24946 raft_consensus.cc:3060] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:59.063721 25032 raft_consensus.cc:515] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:59.065855 25032 leader_election.cc:290] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:59.066643 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:59.043813 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:59.044639 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:59.051304 24505 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:59.041739 25208 consensus_queue.cc:1048] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:06:59.103266 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:59.104048 24730 raft_consensus.cc:3060] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:59.072789 25166 raft_consensus.cc:515] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:59.111243 25166 leader_election.cc:290] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:06:59.112938 24655 raft_consensus.cc:3060] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:59.117565 24506 raft_consensus.cc:2468] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 2.
I20260709 13:06:59.125496 24655 raft_consensus.cc:2468] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:59.127951 24776 tablet_bootstrap.cc:654] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Neither blocks nor log segments found. Creating new log.
I20260709 13:06:59.131145 25231 consensus_queue.cc:1048] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:59.140710 24579 raft_consensus.cc:3060] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:59.142817 24730 raft_consensus.cc:2468] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 1.
I20260709 13:06:59.149410 24470 leader_election.cc:304] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:06:59.150576 25213 raft_consensus.cc:2804] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:59.151134 25213 raft_consensus.cc:697] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:06:59.151976 25213 consensus_queue.cc:237] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:06:59.162485 25223 consensus_queue.cc:1048] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:59.164366 24777 tablet_bootstrap.cc:492] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4: No bootstrap required, opened a new log
I20260709 13:06:59.165150 24777 ts_tablet_manager.cc:1403] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent bootstrapping tablet: real 0.306s	user 0.017s	sys 0.000s
W20260709 13:06:59.167057 24619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 80988.4us
I20260709 13:06:59.169708 25239 consensus_queue.cc:1048] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:59.171957 24777 raft_consensus.cc:359] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:59.172741 24777 raft_consensus.cc:385] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:59.173032 24777 raft_consensus.cc:740] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Initialized, Role: FOLLOWER
I20260709 13:06:59.179585 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:59.180581 24728 raft_consensus.cc:2393] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 1: Already voted for candidate 7e0390f5bd00484985fa5469e25be18d in this term.
W20260709 13:06:59.181424 24693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 396745us
I20260709 13:06:59.185045 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:59.185441 25032 consensus_queue.cc:1048] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:06:59.189504 25032 consensus_queue.cc:1048] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:59.173705 24777 consensus_queue.cc:260] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:59.195196 24777 ts_tablet_manager.cc:1434] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:06:59.195870 24776 tablet_bootstrap.cc:492] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63: No bootstrap required, opened a new log
I20260709 13:06:59.196499 24776 ts_tablet_manager.cc:1403] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.002s
I20260709 13:06:59.199963 24776 raft_consensus.cc:359] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:59.200701 24776 raft_consensus.cc:385] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:06:59.200978 24776 raft_consensus.cc:740] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Initialized, Role: FOLLOWER
I20260709 13:06:59.201663 24776 consensus_queue.cc:260] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:59.207842 24776 ts_tablet_manager.cc:1434] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:06:59.219499 24723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:06:59.220608 24545 leader_election.cc:304] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:59.221077 24619 leader_election.cc:304] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:59.221839 24723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:59.222498 25024 raft_consensus.cc:2749] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:59.222143 25140 raft_consensus.cc:2804] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:59.226464 25140 raft_consensus.cc:697] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:59.227336 25140 consensus_queue.cc:237] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:06:59.258373 25223 consensus_queue.cc:1048] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:06:59.280779 24401 catalog_manager.cc:5697] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } }
I20260709 13:06:59.293154 24545 leader_election.cc:304] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:06:59.320269 25217 raft_consensus.cc:493] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.321262 25217 raft_consensus.cc:515] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:06:59.324545 25143 raft_consensus.cc:2749] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:06:59.334460 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:59.342496 25217 leader_election.cc:290] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:06:59.340410 24579 raft_consensus.cc:3060] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:59.348387 24402 catalog_manager.cc:5697] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.352736 24402 catalog_manager.cc:5697] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:59.356600 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:06:59.357497 24724 raft_consensus.cc:2393] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in current term 1: Already voted for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in this term.
I20260709 13:06:59.353972 24402 catalog_manager.cc:5697] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 1 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.365345 24545 leader_election.cc:304] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:06:59.367383 25217 raft_consensus.cc:3060] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:59.372431 25231 consensus_queue.cc:1048] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:59.374758 25217 raft_consensus.cc:2749] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:06:59.378939 24453 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:06:59.393744 24401 catalog_manager.cc:5697] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:59.416822 24404 catalog_manager.cc:5697] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:59.444379 25242 consensus_queue.cc:1048] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:59.455416 25122 consensus_queue.cc:1048] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:59.484383 25143 raft_consensus.cc:493] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.487013 25143 raft_consensus.cc:515] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:59.491129 24506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4161a18cbe354021af90307a3789b890" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d" is_pre_election: true
I20260709 13:06:59.491700 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4161a18cbe354021af90307a3789b890" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:06:59.491950 24506 raft_consensus.cc:2468] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:59.492326 25143 leader_election.cc:290] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:59.492432 24655 raft_consensus.cc:2468] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 0.
I20260709 13:06:59.493626 24545 leader_election.cc:304] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:59.496093 25143 raft_consensus.cc:2804] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:06:59.496537 25143 raft_consensus.cc:493] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.497305 25143 raft_consensus.cc:3060] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:59.516098 25143 raft_consensus.cc:515] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:59.570784 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4161a18cbe354021af90307a3789b890" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:06:59.571442 24504 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4161a18cbe354021af90307a3789b890" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
I20260709 13:06:59.571856 25143 leader_election.cc:290] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:06:59.572242 24504 raft_consensus.cc:3060] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:59.571439 24655 raft_consensus.cc:3060] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:06:59.588145 24504 raft_consensus.cc:2468] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:59.589311 24655 raft_consensus.cc:2468] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:06:59.590688 24546 leader_election.cc:304] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:06:59.591702 25143 raft_consensus.cc:2804] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:06:59.592259 25143 raft_consensus.cc:697] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:06:59.593170 25143 consensus_queue.cc:237] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:06:59.608256 24402 catalog_manager.cc:5697] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:59.617193 24504 raft_consensus.cc:1275] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Refusing update from remote peer 9fbc9c105f2a47f6a6a1d298a1b7dc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:59.618844 25143 consensus_queue.cc:1048] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:59.635871 24724 raft_consensus.cc:3060] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:59.648527 24724 raft_consensus.cc:1275] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 9fbc9c105f2a47f6a6a1d298a1b7dc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:59.655685 25223 consensus_queue.cc:1048] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:06:59.655957 25143 consensus_queue.cc:1048] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:59.682387 25223 consensus_queue.cc:1048] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:00.029572 25140 consensus_queue.cc:1048] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:00.043268 25143 consensus_queue.cc:1048] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:00.863153 14139 tablet_server.cc:179] TabletServer@127.13.206.193:0 shutting down...
W20260709 13:07:00.884061 24693 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:07:00.891561 24545 consensus_peers.cc:597] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:00.894074 24545 consensus_peers.cc:597] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:00.893280 24693 consensus_peers.cc:597] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:00.902117 24619 consensus_peers.cc:597] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:00.922050 24619 consensus_peers.cc:597] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:00.943189 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:00.946615 14139 tablet_replica.cc:333] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:00.950377 14139 raft_consensus.cc:2243] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:00.952700 14139 raft_consensus.cc:2272] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:00.954167 24545 consensus_peers.cc:597] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:00.962659 14139 tablet_replica.cc:333] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
W20260709 13:07:00.964782 24693 consensus_peers.cc:597] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:00.965162 14139 raft_consensus.cc:2243] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:00.967739 14139 raft_consensus.cc:2272] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:00.973186 14139 tablet_replica.cc:333] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:00.975308 14139 raft_consensus.cc:2243] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:00.976547 14139 raft_consensus.cc:2272] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:00.982535 14139 tablet_replica.cc:333] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:00.984910 14139 raft_consensus.cc:2243] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:00.986903 14139 raft_consensus.cc:2272] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:00.991797 14139 tablet_replica.cc:333] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:00.993353 14139 raft_consensus.cc:2243] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:00.995487 14139 raft_consensus.cc:2272] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:00.999917 14139 tablet_replica.cc:333] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.002633 14139 raft_consensus.cc:2243] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.005355 14139 raft_consensus.cc:2272] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.006109 24619 consensus_peers.cc:597] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.006322 24545 consensus_peers.cc:597] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.010218 14139 tablet_replica.cc:333] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
W20260709 13:07:01.010341 24545 consensus_peers.cc:597] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.011602 14139 raft_consensus.cc:2243] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.013036 14139 raft_consensus.cc:2272] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.016156 14139 tablet_replica.cc:333] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.017169 14139 raft_consensus.cc:2243] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.018580 14139 raft_consensus.cc:2272] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.022084 14139 tablet_replica.cc:333] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.022928 14139 raft_consensus.cc:2243] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.024869 14139 raft_consensus.cc:2272] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.025269 24545 consensus_peers.cc:597] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.029395 14139 tablet_replica.cc:333] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.030503 14139 raft_consensus.cc:2243] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.031076 14139 raft_consensus.cc:2272] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.033818 14139 tablet_replica.cc:333] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.035055 14139 raft_consensus.cc:2243] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.035804 14139 raft_consensus.cc:2272] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.039548 14139 tablet_replica.cc:333] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.040436 14139 raft_consensus.cc:2243] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.041580 14139 raft_consensus.cc:2272] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.045401 14139 tablet_replica.cc:333] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.046754 14139 raft_consensus.cc:2243] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.047461 14139 raft_consensus.cc:2272] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.050688 24545 consensus_peers.cc:597] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.051348 14139 tablet_replica.cc:333] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.052608 14139 raft_consensus.cc:2243] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.054085 14139 raft_consensus.cc:2272] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.057687 14139 tablet_replica.cc:333] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.058665 14139 raft_consensus.cc:2243] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.060025 14139 raft_consensus.cc:2272] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.062042 24619 consensus_peers.cc:597] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.063345 14139 tablet_replica.cc:333] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.064584 14139 raft_consensus.cc:2243] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.065477 14139 raft_consensus.cc:2272] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.069072 14139 tablet_replica.cc:333] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.069774 14139 raft_consensus.cc:2243] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.070439 14139 raft_consensus.cc:2272] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.073468 14139 tablet_replica.cc:333] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.074550 14139 raft_consensus.cc:2243] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.075301 14139 raft_consensus.cc:2272] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.076604 24545 consensus_peers.cc:597] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.078369 14139 tablet_replica.cc:333] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.079418 14139 raft_consensus.cc:2243] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.079998 14139 raft_consensus.cc:2272] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.082579 14139 tablet_replica.cc:333] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.083244 14139 raft_consensus.cc:2243] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.083787 14139 raft_consensus.cc:2272] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.086958 14139 tablet_replica.cc:333] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.087951 14139 raft_consensus.cc:2243] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.089162 14139 raft_consensus.cc:2272] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.089460 24545 consensus_peers.cc:597] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.091693 14139 tablet_replica.cc:333] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.092335 14139 raft_consensus.cc:2243] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.093415 14139 raft_consensus.cc:2272] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.095865 14139 tablet_replica.cc:333] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.096449 14139 raft_consensus.cc:2243] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.096901 14139 raft_consensus.cc:2272] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.099273 14139 tablet_replica.cc:333] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.099996 14139 raft_consensus.cc:2243] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.100731 14139 raft_consensus.cc:2272] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.103951 14139 tablet_replica.cc:333] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.104903 14139 raft_consensus.cc:2243] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.105728 14139 raft_consensus.cc:2272] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.110798 14139 tablet_replica.cc:333] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.111546 14139 raft_consensus.cc:2243] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.112092 14139 raft_consensus.cc:2272] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.115077 14139 tablet_replica.cc:333] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.115747 14139 raft_consensus.cc:2243] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.117038 14139 raft_consensus.cc:2272] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.118148 24545 consensus_peers.cc:597] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.118856 24693 consensus_peers.cc:597] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.120340 14139 tablet_replica.cc:333] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.121136 14139 raft_consensus.cc:2243] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.122309 14139 raft_consensus.cc:2272] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.124969 14139 tablet_replica.cc:333] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.125728 14139 raft_consensus.cc:2243] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.126390 14139 raft_consensus.cc:2272] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.129630 14139 tablet_replica.cc:333] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.130597 14139 raft_consensus.cc:2243] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.131505 14139 raft_consensus.cc:2272] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.135689 14139 tablet_replica.cc:333] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.136627 14139 raft_consensus.cc:2243] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.138535 14139 raft_consensus.cc:2272] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.141559 14139 tablet_replica.cc:333] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.142319 14139 raft_consensus.cc:2243] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.142864 14139 raft_consensus.cc:2272] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.145480 14139 tablet_replica.cc:333] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.146418 14139 raft_consensus.cc:2243] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.147182 14139 raft_consensus.cc:2272] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.150799 14139 tablet_replica.cc:333] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.151731 14139 raft_consensus.cc:2243] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.153445 14139 raft_consensus.cc:2272] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.156033 24619 consensus_peers.cc:597] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.157505 14139 tablet_replica.cc:333] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.158490 14139 raft_consensus.cc:2243] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.159363 14139 raft_consensus.cc:2272] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.161700 14139 tablet_replica.cc:333] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.162403 14139 raft_consensus.cc:2243] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.162927 14139 raft_consensus.cc:2272] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.165401 14139 tablet_replica.cc:333] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.166045 14139 raft_consensus.cc:2243] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.166989 14139 raft_consensus.cc:2272] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.169284 14139 tablet_replica.cc:333] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.169914 14139 raft_consensus.cc:2243] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.170518 14139 raft_consensus.cc:2272] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.174437 14139 tablet_replica.cc:333] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.175264 14139 raft_consensus.cc:2243] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.176054 14139 raft_consensus.cc:2272] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.178944 14139 tablet_replica.cc:333] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.179673 14139 raft_consensus.cc:2243] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.180349 14139 raft_consensus.cc:2272] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.182785 14139 tablet_replica.cc:333] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.183432 14139 raft_consensus.cc:2243] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.184038 14139 raft_consensus.cc:2272] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.186465 14139 tablet_replica.cc:333] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.187184 14139 raft_consensus.cc:2243] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.187726 14139 raft_consensus.cc:2272] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.190002 14139 tablet_replica.cc:333] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.190595 14139 raft_consensus.cc:2243] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.191102 14139 raft_consensus.cc:2272] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.193946 14139 tablet_replica.cc:333] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
I20260709 13:07:01.194643 14139 raft_consensus.cc:2243] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.195981 14139 raft_consensus.cc:2272] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.199258 14139 tablet_replica.cc:333] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: stopping tablet replica
W20260709 13:07:01.199301 24619 consensus_peers.cc:597] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.199965 24545 consensus_peers.cc:597] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.200106 14139 raft_consensus.cc:2243] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.200835 14139 raft_consensus.cc:2272] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.215673 24693 consensus_peers.cc:597] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.225337 24545 consensus_peers.cc:597] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.232250 24545 consensus_peers.cc:597] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.252882 24619 consensus_peers.cc:597] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.254644 24693 consensus_peers.cc:597] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.288479 24545 connection.cc:573] client connection to 127.13.206.193:40253 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:07:01.297636 14139 tablet_server.cc:196] TabletServer@127.13.206.193:0 shutdown complete.
I20260709 13:07:01.393793 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:01.401680 25272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:01.405983 25275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:01.406136 25273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:01.408453 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:01.414636 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:01.414983 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:01.415236 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602421415215 us; error 0 us; skew 500 ppm
I20260709 13:07:01.415820 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:01.418533 14139 webserver.cc:533] Webserver started at http://127.13.206.193:35079/ using document root <none> and password file <none>
I20260709 13:07:01.419036 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:01.419190 14139 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:07:01.423444 14139 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:07:01.450829 25284 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:01.452209 14139 fs_manager.cc:730] Time spent opening block manager: real 0.019s	user 0.011s	sys 0.008s
I20260709 13:07:01.452749 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-0-root
uuid: "7e0390f5bd00484985fa5469e25be18d"
format_stamp: "Formatted at 2026-07-09 13:06:48 on dist-test-slave-ml7r"
I20260709 13:07:01.457909 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602098938719-14139-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:01.503027 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:01.504760 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:01.506500 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:01.512451 25291 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:07:01.841195 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:07:01.841521 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.330s	user 0.010s	sys 0.000s
I20260709 13:07:01.841831 14139 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:07:01.847693 25291 tablet_bootstrap.cc:492] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:01.862851 25291 tablet_bootstrap.cc:492] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.863850 25291 tablet_bootstrap.cc:492] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:01.864552 25291 ts_tablet_manager.cc:1403] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:07:01.867405 25291 raft_consensus.cc:359] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:01.868315 25291 raft_consensus.cc:740] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:01.869071 25291 consensus_queue.cc:260] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:01.872059 25291 ts_tablet_manager.cc:1434] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:07:01.872947 25291 tablet_bootstrap.cc:492] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:01.888022 25291 tablet_bootstrap.cc:492] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.889029 25291 tablet_bootstrap.cc:492] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:01.889735 25291 ts_tablet_manager.cc:1403] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:07:01.892186 25291 raft_consensus.cc:359] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:01.892865 25291 raft_consensus.cc:740] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:01.893451 25291 consensus_queue.cc:260] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:01.895459 25291 ts_tablet_manager.cc:1434] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:07:01.896270 25291 tablet_bootstrap.cc:492] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:01.909832 25291 tablet_bootstrap.cc:492] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.910778 25291 tablet_bootstrap.cc:492] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:01.911338 25291 ts_tablet_manager.cc:1403] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:07:01.913324 25291 raft_consensus.cc:359] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:01.913895 25291 raft_consensus.cc:740] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:01.914522 25291 consensus_queue.cc:260] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:01.915984 25291 ts_tablet_manager.cc:1434] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:07:01.916662 25291 tablet_bootstrap.cc:492] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:01.928731 25291 tablet_bootstrap.cc:492] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.929535 25291 tablet_bootstrap.cc:492] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:01.930102 25291 ts_tablet_manager.cc:1403] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:07:01.932022 25291 raft_consensus.cc:359] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:01.932556 25291 raft_consensus.cc:740] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:01.933202 25291 consensus_queue.cc:260] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:01.934913 25291 ts_tablet_manager.cc:1434] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:01.935562 25291 tablet_bootstrap.cc:492] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:01.947878 25291 tablet_bootstrap.cc:492] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.948771 25291 tablet_bootstrap.cc:492] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:01.949334 25291 ts_tablet_manager.cc:1403] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:07:01.951354 25291 raft_consensus.cc:359] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:01.951933 25291 raft_consensus.cc:740] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:01.952591 25291 consensus_queue.cc:260] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:01.954041 25291 ts_tablet_manager.cc:1434] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:07:01.954746 25291 tablet_bootstrap.cc:492] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:01.970506 25291 tablet_bootstrap.cc:492] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.971410 25291 tablet_bootstrap.cc:492] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:01.972090 25291 ts_tablet_manager.cc:1403] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 13:07:01.974663 25291 raft_consensus.cc:359] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:01.975379 25291 raft_consensus.cc:740] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:01.975978 25291 consensus_queue.cc:260] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:01.977730 25291 ts_tablet_manager.cc:1434] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:01.978588 25291 tablet_bootstrap.cc:492] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:01.991659 25291 tablet_bootstrap.cc:492] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:01.992650 25291 tablet_bootstrap.cc:492] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:01.993302 25291 ts_tablet_manager.cc:1403] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:07:01.995813 25291 raft_consensus.cc:359] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:01.996527 25291 raft_consensus.cc:740] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:01.997216 25291 consensus_queue.cc:260] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:01.998943 25291 ts_tablet_manager.cc:1434] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:07:01.999620 25291 tablet_bootstrap.cc:492] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:02.012363 25291 tablet_bootstrap.cc:492] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:02.013113 25291 tablet_bootstrap.cc:492] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:02.013715 25291 ts_tablet_manager.cc:1403] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:07:02.016177 25291 raft_consensus.cc:359] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.016846 25291 raft_consensus.cc:740] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:02.017480 25291 consensus_queue.cc:260] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.019371 25291 ts_tablet_manager.cc:1434] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 13:07:02.020140 25291 tablet_bootstrap.cc:492] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:02.042752 25291 tablet_bootstrap.cc:492] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:02.043654 25291 tablet_bootstrap.cc:492] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:02.044291 25291 ts_tablet_manager.cc:1403] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:07:02.046578 25291 raft_consensus.cc:359] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.047173 25291 raft_consensus.cc:740] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:02.047940 25291 consensus_queue.cc:260] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.049927 25291 ts_tablet_manager.cc:1434] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:07:02.050153 25264 raft_consensus.cc:493] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.050812 25291 tablet_bootstrap.cc:492] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:02.050776 25264 raft_consensus.cc:515] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.053202 25264 leader_election.cc:290] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.055114 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:07:02.061250 24619 leader_election.cc:336] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.061832 24619 leader_election.cc:304] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:02.062696 25143 raft_consensus.cc:493] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.062879 25264 raft_consensus.cc:2749] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.063318 25143 raft_consensus.cc:515] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.065729 25143 leader_election.cc:290] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.067399 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
W20260709 13:07:02.074612 24545 leader_election.cc:336] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.078218 24545 leader_election.cc:304] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.081509 25217 raft_consensus.cc:2749] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.086083 25291 tablet_bootstrap.cc:492] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:02.087244 25291 tablet_bootstrap.cc:492] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:02.087913 25291 ts_tablet_manager.cc:1403] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.021s
I20260709 13:07:02.090692 25291 raft_consensus.cc:359] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.091820 25291 raft_consensus.cc:740] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:02.092667 25291 consensus_queue.cc:260] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.095052 25263 raft_consensus.cc:493] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.095064 25291 ts_tablet_manager.cc:1434] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:02.095778 25263 raft_consensus.cc:515] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.097318 25291 tablet_bootstrap.cc:492] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:02.098080 25263 leader_election.cc:290] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.101336 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.102927 25280 raft_consensus.cc:493] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.103539 25280 raft_consensus.cc:515] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.105217 14139 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:07:02.105585 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.264s	user 0.231s	sys 0.008s
W20260709 13:07:02.105698 24619 leader_election.cc:336] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.111225 24693 leader_election.cc:336] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.111521 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.118182 24694 leader_election.cc:304] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.119675 25281 raft_consensus.cc:2749] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.121003 25280 leader_election.cc:290] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.126830 25280 raft_consensus.cc:493] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.127656 25280 raft_consensus.cc:515] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.130218 24619 leader_election.cc:304] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.131917 25239 raft_consensus.cc:2749] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.142923 25291 tablet_bootstrap.cc:492] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:02.143987 25291 tablet_bootstrap.cc:492] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:02.144723 25291 ts_tablet_manager.cc:1403] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.048s	user 0.027s	sys 0.016s
I20260709 13:07:02.148001 25264 raft_consensus.cc:493] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.147713 25291 raft_consensus.cc:359] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.148635 25291 raft_consensus.cc:740] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:02.149585 25291 consensus_queue.cc:260] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.148650 25264 raft_consensus.cc:515] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.152572 25291 ts_tablet_manager.cc:1434] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
W20260709 13:07:02.152894 24693 leader_election.cc:336] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.153517 25291 tablet_bootstrap.cc:492] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:02.156358 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.156185 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f942ac0144fc6b272c4a71b5bc224" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:02.151959 25281 raft_consensus.cc:493] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.154105 25264 leader_election.cc:290] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.157109 25280 leader_election.cc:290] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.159642 24696 leader_election.cc:304] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:02.166890 25160 raft_consensus.cc:493] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.159695 25281 raft_consensus.cc:515] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.171826 25160 raft_consensus.cc:515] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:07:02.165936 24619 leader_election.cc:336] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.174429 24724 raft_consensus.cc:2468] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:07:02.170476 25280 raft_consensus.cc:2749] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.178120 25160 leader_election.cc:290] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.183204 25291 tablet_bootstrap.cc:492] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:02.184381 25291 tablet_bootstrap.cc:492] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:02.185282 25291 ts_tablet_manager.cc:1403] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.007s
I20260709 13:07:02.188167 25291 raft_consensus.cc:359] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.188937 25291 raft_consensus.cc:740] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:02.189507 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.189826 25291 consensus_queue.cc:260] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.190393 25270 raft_consensus.cc:493] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.190505 24654 raft_consensus.cc:2468] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:07:02.190971 25270 raft_consensus.cc:515] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.192526 25291 ts_tablet_manager.cc:1434] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:02.192621 24694 leader_election.cc:304] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:02.193312 25270 leader_election.cc:290] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.193666 25291 tablet_bootstrap.cc:492] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:02.194605 25160 raft_consensus.cc:2804] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.195297 25160 raft_consensus.cc:493] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.195849 25160 raft_consensus.cc:3060] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.194608 25217 raft_consensus.cc:493] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.189882 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.200472 24652 raft_consensus.cc:2468] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:07:02.200244 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.202705 24694 leader_election.cc:304] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:02.203961 25280 raft_consensus.cc:2804] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.204505 25280 raft_consensus.cc:493] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.205031 25280 raft_consensus.cc:3060] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.207005 24619 leader_election.cc:304] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.202720 25143 raft_consensus.cc:493] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.207471 25281 leader_election.cc:290] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.208137 25143 raft_consensus.cc:515] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.208796 25264 raft_consensus.cc:2804] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.209440 25264 raft_consensus.cc:493] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.209935 25264 raft_consensus.cc:3060] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.210537 25143 leader_election.cc:290] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.205964 25217 raft_consensus.cc:515] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.213801 25281 raft_consensus.cc:493] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.217518 25217 leader_election.cc:290] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.217659 25281 raft_consensus.cc:515] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.223196 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:02.223803 24578 raft_consensus.cc:2468] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:07:02.226922 25217 raft_consensus.cc:493] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.228407 25217 raft_consensus.cc:515] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.228968 24696 leader_election.cc:304] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:02.228866 25280 raft_consensus.cc:515] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.221187 25281 leader_election.cc:290] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
W20260709 13:07:02.234608 24545 leader_election.cc:336] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.236840 24545 leader_election.cc:304] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.238600 25217 leader_election.cc:290] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.247813 25280 leader_election.cc:290] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.248947 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:02.249645 24652 raft_consensus.cc:3060] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.253826 25311 raft_consensus.cc:2749] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:02.264482 24693 leader_election.cc:336] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.265328 25281 raft_consensus.cc:2804] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:02.267817 24693 leader_election.cc:336] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.265954 25281 raft_consensus.cc:493] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.264624 25264 raft_consensus.cc:515] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.273150 25281 raft_consensus.cc:3060] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.273240 25313 raft_consensus.cc:493] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.276640 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fde674ca95f4161a7f741a822bfe6df" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.264933 24652 raft_consensus.cc:2468] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
W20260709 13:07:02.277698 24545 leader_election.cc:336] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.278190 24545 leader_election.cc:336] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.273710 25160 raft_consensus.cc:515] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.280447 25313 raft_consensus.cc:515] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.281339 25264 leader_election.cc:290] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.282666 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:02.283463 24654 raft_consensus.cc:2393] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3eeda3010ca44374a5bbf85e7980ba1c in current term 2: Already voted for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in this term.
I20260709 13:07:02.284627 25313 leader_election.cc:290] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
W20260709 13:07:02.292361 24545 leader_election.cc:336] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.293499 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.286530 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:02.294764 24727 raft_consensus.cc:2393] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 2: Already voted for candidate 3eeda3010ca44374a5bbf85e7980ba1c in this term.
I20260709 13:07:02.281399 25160 leader_election.cc:290] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.288116 24694 leader_election.cc:304] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
W20260709 13:07:02.288718 24619 leader_election.cc:336] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.295223 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f942ac0144fc6b272c4a71b5bc224" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.296854 24728 raft_consensus.cc:2468] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:07:02.298306 24619 leader_election.cc:304] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.301920 25281 raft_consensus.cc:515] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.302452 25143 raft_consensus.cc:493] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.303040 25143 raft_consensus.cc:515] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.304176 25281 leader_election.cc:290] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.305166 25143 leader_election.cc:290] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:02.301983 25239 raft_consensus.cc:2749] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.306658 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.307507 25316 raft_consensus.cc:2804] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:02.307868 24693 leader_election.cc:336] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.308121 25316 raft_consensus.cc:697] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:02.308209 25280 raft_consensus.cc:493] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
W20260709 13:07:02.308665 24693 leader_election.cc:336] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.308830 25280 raft_consensus.cc:515] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.309298 25239 raft_consensus.cc:493] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.309146 25316 consensus_queue.cc:237] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.309587 25281 raft_consensus.cc:493] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.309881 25239 raft_consensus.cc:515] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.310717 25281 raft_consensus.cc:515] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.311256 25280 leader_election.cc:290] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.312198 25239 leader_election.cc:290] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.312906 25281 leader_election.cc:290] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.314729 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.315261 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.315550 24728 raft_consensus.cc:2468] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
W20260709 13:07:02.272473 24696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 43611.3us
I20260709 13:07:02.316803 25263 raft_consensus.cc:493] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.317538 25263 raft_consensus.cc:515] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:07:02.319752 24693 leader_election.cc:336] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.315537 24545 leader_election.cc:304] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.320212 24693 leader_election.cc:304] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.319509 24619 leader_election.cc:304] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
W20260709 13:07:02.321197 24693 leader_election.cc:336] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.322613 25311 raft_consensus.cc:2749] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.322829 25315 raft_consensus.cc:2749] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.322986 25313 raft_consensus.cc:493] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.323630 25313 raft_consensus.cc:515] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.324913 25263 leader_election.cc:290] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.325452 25239 raft_consensus.cc:2804] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.325703 25313 leader_election.cc:290] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.325918 25239 raft_consensus.cc:493] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.326195 25291 tablet_bootstrap.cc:492] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:02.326352 25239 raft_consensus.cc:3060] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.319980 25280 raft_consensus.cc:493] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.327339 25291 tablet_bootstrap.cc:492] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:02.327399 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b10f5f3b44ddd821edcf5236589ed" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.327273 25280 raft_consensus.cc:515] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.362725 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:02.378381 25160 raft_consensus.cc:493] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.329452 25264 raft_consensus.cc:493] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.374450 25315 raft_consensus.cc:493] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.383824 25315 raft_consensus.cc:515] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.383323 25264 raft_consensus.cc:515] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.351604 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:02.383244 25160 raft_consensus.cc:515] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.389274 24578 raft_consensus.cc:2468] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:07:02.339877 25313 raft_consensus.cc:493] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.390820 25263 raft_consensus.cc:493] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.392117 24579 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 3.
I20260709 13:07:02.391687 25263 raft_consensus.cc:515] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.363246 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:02.391168 25313 raft_consensus.cc:515] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.394136 24696 leader_election.cc:304] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.328392 25291 ts_tablet_manager.cc:1403] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.010s
I20260709 13:07:02.393146 25314 raft_consensus.cc:493] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.398813 25315 leader_election.cc:290] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.396729 24580 raft_consensus.cc:3060] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.399072 25314 raft_consensus.cc:515] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.400841 25313 leader_election.cc:290] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.401355 25314 leader_election.cc:290] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.396729 25160 leader_election.cc:290] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.403826 25264 leader_election.cc:290] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.405090 25315 raft_consensus.cc:493] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.405283 25314 raft_consensus.cc:2804] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.405764 25314 raft_consensus.cc:493] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.405681 25315 raft_consensus.cc:515] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.403383 25291 raft_consensus.cc:359] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.406559 25314 raft_consensus.cc:3060] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.406775 25291 raft_consensus.cc:740] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
W20260709 13:07:02.407703 24693 leader_election.cc:336] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.408598 24693 leader_election.cc:336] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.328238 24545 leader_election.cc:304] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.409564 24693 leader_election.cc:304] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.410368 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:02.410915 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adface6ea0a7412bab90d65a3ed77df8" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:02.411599 24582 raft_consensus.cc:2468] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:07:02.412779 25281 raft_consensus.cc:2749] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.407696 25291 consensus_queue.cc:260] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.413352 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.414057 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:02.410962 25263 leader_election.cc:290] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.417760 25280 leader_election.cc:290] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.417716 24578 raft_consensus.cc:2468] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:07:02.419404 24696 leader_election.cc:304] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
W20260709 13:07:02.422593 24693 leader_election.cc:336] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.423731 25160 raft_consensus.cc:493] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.424378 25160 raft_consensus.cc:515] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.425834 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fde674ca95f4161a7f741a822bfe6df" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:02.426750 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.427086 25160 leader_election.cc:290] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.427465 24654 raft_consensus.cc:2468] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:07:02.423743 25281 raft_consensus.cc:2804] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:02.427987 25281 raft_consensus.cc:493] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.428184 24696 leader_election.cc:304] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:02.415311 25311 raft_consensus.cc:493] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.430971 25311 raft_consensus.cc:515] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
W20260709 13:07:02.431612 24693 leader_election.cc:336] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.431777 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.432148 24693 leader_election.cc:304] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.432371 25314 raft_consensus.cc:515] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.415869 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.433391 25313 raft_consensus.cc:2749] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.433524 24652 raft_consensus.cc:2468] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:07:02.428360 25281 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.429220 24694 leader_election.cc:304] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:02.434863 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.435693 24654 raft_consensus.cc:2468] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:07:02.435901 25313 raft_consensus.cc:2804] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.436913 25313 raft_consensus.cc:493] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.437309 25313 raft_consensus.cc:3060] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.436144 25311 leader_election.cc:290] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:02.437357 25315 leader_election.cc:290] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.437419 24546 leader_election.cc:304] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:02.438763 25143 raft_consensus.cc:2804] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.438901 24694 leader_election.cc:304] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:02.439261 25143 raft_consensus.cc:493] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.439718 24580 raft_consensus.cc:2468] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:02.439878 25143 raft_consensus.cc:3060] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.440135 25280 raft_consensus.cc:2804] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.440615 25280 raft_consensus.cc:493] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.434487 25314 leader_election.cc:290] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.441010 25280 raft_consensus.cc:3060] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.428373 24578 raft_consensus.cc:2468] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 1.
I20260709 13:07:02.442709 25217 raft_consensus.cc:2749] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:02.443563 24545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 115406us
W20260709 13:07:02.442675 24693 leader_election.cc:336] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.448597 25314 raft_consensus.cc:2804] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.449052 25314 raft_consensus.cc:493] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.449442 25314 raft_consensus.cc:3060] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.451617 25313 raft_consensus.cc:515] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:07:02.454025 24693 leader_election.cc:336] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.444628 24545 leader_election.cc:304] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
W20260709 13:07:02.454896 24693 leader_election.cc:336] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.455385 24696 leader_election.cc:304] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
W20260709 13:07:02.455657 24693 leader_election.cc:336] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.414832 25291 ts_tablet_manager.cc:1434] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:07:02.456117 24693 leader_election.cc:304] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.456854 25291 tablet_bootstrap.cc:492] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:02.457573 24696 leader_election.cc:304] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.454969 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:02.451083 25143 raft_consensus.cc:515] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.459435 24654 raft_consensus.cc:3060] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.459105 25270 raft_consensus.cc:2804] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.453847 25313 leader_election.cc:290] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.462399 25316 raft_consensus.cc:2804] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:02.460852 25270 raft_consensus.cc:493] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.463011 25316 raft_consensus.cc:697] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:02.463274 25270 raft_consensus.cc:3060] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.464031 25316 consensus_queue.cc:237] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.464494 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:02.458793 25239 raft_consensus.cc:515] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.462252 25160 raft_consensus.cc:2749] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.465143 24652 raft_consensus.cc:3060] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.462173 25315 raft_consensus.cc:2804] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:02.460740 24619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 141304us
I20260709 13:07:02.467875 25315 raft_consensus.cc:493] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.469823 25315 raft_consensus.cc:3060] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.469624 25280 raft_consensus.cc:515] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.474874 24653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:02.475590 24653 raft_consensus.cc:3060] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.476265 25314 raft_consensus.cc:515] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.477257 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.483677 24727 raft_consensus.cc:2393] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 2: Already voted for candidate 3eeda3010ca44374a5bbf85e7980ba1c in this term.
I20260709 13:07:02.483525 25323 raft_consensus.cc:493] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.483897 25314 leader_election.cc:290] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.477859 25160 raft_consensus.cc:493] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.479709 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "074fffdc7884498f9ef3ed6915f8dbc0" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.485256 24724 raft_consensus.cc:2393] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0e0c30b65a5d485e89552b4cb36da6b4 in current term 2: Already voted for candidate 3eeda3010ca44374a5bbf85e7980ba1c in this term.
I20260709 13:07:02.485105 25160 raft_consensus.cc:515] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.484301 25323 raft_consensus.cc:515] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.487533 25323 leader_election.cc:290] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.488073 25217 raft_consensus.cc:493] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.488570 25281 raft_consensus.cc:515] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.488713 25217 raft_consensus.cc:515] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.467434 25143 leader_election.cc:290] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
W20260709 13:07:02.491938 24693 leader_election.cc:336] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.493834 24693 leader_election.cc:336] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.497357 24693 leader_election.cc:304] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.499104 24652 raft_consensus.cc:2468] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 2.
I20260709 13:07:02.500641 24546 leader_election.cc:304] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:02.500741 25280 leader_election.cc:290] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.500926 24653 raft_consensus.cc:2468] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
W20260709 13:07:02.505618 24696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 48146.3us
I20260709 13:07:02.507639 25280 raft_consensus.cc:2749] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.509155 24696 leader_election.cc:304] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.487562 25160 leader_election.cc:290] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.508394 25311 raft_consensus.cc:2804] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:02.523605 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c6dec4aa0e24123bf8fb5a0cd30dd77" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:02.524513 24578 raft_consensus.cc:3060] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.523970 25311 raft_consensus.cc:697] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:07:02.523270 25217 leader_election.cc:290] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:02.497545 25270 raft_consensus.cc:515] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.529704 24694 leader_election.cc:304] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:02.532650 25328 raft_consensus.cc:493] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.533455 25328 raft_consensus.cc:515] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.536347 25328 leader_election.cc:290] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.522363 25160 raft_consensus.cc:2804] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.545215 25313 raft_consensus.cc:2804] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:02.556887 24693 leader_election.cc:336] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.558806 24693 leader_election.cc:336] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.548486 25281 leader_election.cc:290] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.550411 25160 raft_consensus.cc:493] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.572067 25160 raft_consensus.cc:3060] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.574383 25313 raft_consensus.cc:697] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:02.555683 25239 leader_election.cc:290] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.575500 25313 consensus_queue.cc:237] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.559091 25217 raft_consensus.cc:493] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.579465 25217 raft_consensus.cc:515] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.581821 25217 leader_election.cc:290] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.569694 25270 leader_election.cc:290] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.573450 24404 catalog_manager.cc:5697] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.570317 25311 consensus_queue.cc:237] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.597365 24654 raft_consensus.cc:2468] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:02.597455 24578 raft_consensus.cc:2468] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:02.603101 24694 leader_election.cc:304] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:02.605865 25281 raft_consensus.cc:2804] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:02.606566 25281 raft_consensus.cc:697] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:02.610127 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:02.611053 24654 raft_consensus.cc:2468] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:07:02.579496 25315 raft_consensus.cc:515] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.619313 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f942ac0144fc6b272c4a71b5bc224" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:02.620011 24728 raft_consensus.cc:3060] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.617092 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.620736 24724 raft_consensus.cc:2468] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 1.
I20260709 13:07:02.622397 24545 leader_election.cc:304] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:02.612285 25281 consensus_queue.cc:237] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.629240 25143 raft_consensus.cc:2804] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.629801 25143 raft_consensus.cc:493] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.630261 25143 raft_consensus.cc:3060] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.635741 24546 leader_election.cc:304] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:02.644961 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:02.638880 25239 raft_consensus.cc:493] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.649849 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adface6ea0a7412bab90d65a3ed77df8" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:02.660849 24580 raft_consensus.cc:3060] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.664570 24696 leader_election.cc:304] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
W20260709 13:07:02.667168 24619 leader_election.cc:336] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.669951 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.670840 24724 raft_consensus.cc:2468] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:07:02.674948 25327 raft_consensus.cc:2804] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:02.675310 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:02.676254 24581 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:02.664721 25331 raft_consensus.cc:493] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.664695 25239 raft_consensus.cc:515] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:07:02.679721 24545 leader_election.cc:336] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.681241 24545 leader_election.cc:304] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.681627 25239 leader_election.cc:290] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.682140 25217 raft_consensus.cc:2749] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:02.682286 25334 raft_consensus.cc:2804] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.682427 25335 raft_consensus.cc:493] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.682776 25334 raft_consensus.cc:493] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.683225 25334 raft_consensus.cc:3060] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:02.684357 24545 leader_election.cc:336] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.687440 25315 leader_election.cc:290] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
W20260709 13:07:02.689162 24545 leader_election.cc:336] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.675549 25327 raft_consensus.cc:697] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
W20260709 13:07:02.690394 24545 leader_election.cc:336] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.689909 24693 leader_election.cc:336] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.693009 24693 leader_election.cc:336] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.693480 24693 leader_election.cc:336] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.693907 24693 leader_election.cc:336] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.694546 24693 leader_election.cc:336] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.694917 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.695870 24730 raft_consensus.cc:2468] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:07:02.696250 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:02.696897 24578 raft_consensus.cc:3060] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.674113 25143 raft_consensus.cc:515] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.700698 24582 raft_consensus.cc:2393] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3eeda3010ca44374a5bbf85e7980ba1c in current term 2: Already voted for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in this term.
I20260709 13:07:02.702932 24581 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 4.
I20260709 13:07:02.703702 24696 leader_election.cc:304] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:02.704927 25315 raft_consensus.cc:3060] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.705418 24696 leader_election.cc:304] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.706422 25314 raft_consensus.cc:2804] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:02.706914 25314 raft_consensus.cc:697] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:02.708267 25143 leader_election.cc:290] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.722083 24619 leader_election.cc:304] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:02.724426 24578 raft_consensus.cc:2468] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:02.729569 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:02.730554 24730 raft_consensus.cc:2468] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:07:02.730948 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:02.729588 24696 leader_election.cc:304] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:02.736768 24580 raft_consensus.cc:2468] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:02.733976 24619 leader_election.cc:304] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
W20260709 13:07:02.742069 24546 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 106429us
I20260709 13:07:02.728790 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:02.683087 25335 raft_consensus.cc:515] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.744391 24727 raft_consensus.cc:3060] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.744191 25327 consensus_queue.cc:237] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.744961 25264 raft_consensus.cc:2804] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.745397 25264 raft_consensus.cc:493] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.745790 25264 raft_consensus.cc:3060] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.746146 25335 leader_election.cc:290] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.679239 25331 raft_consensus.cc:515] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:02.758872 25314 consensus_queue.cc:237] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.743046 25316 raft_consensus.cc:2804] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:02.764739 25316 raft_consensus.cc:697] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:02.765744 25316 consensus_queue.cc:237] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.770846 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:02.772006 24581 raft_consensus.cc:2468] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
W20260709 13:07:02.778644 24545 leader_election.cc:336] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:02.779744 24545 leader_election.cc:336] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.752215 24619 leader_election.cc:304] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:02.825533 24728 raft_consensus.cc:2468] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 2.
I20260709 13:07:02.743218 25323 raft_consensus.cc:2804] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.832088 24696 leader_election.cc:304] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
W20260709 13:07:02.837034 24694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 80608.7us
I20260709 13:07:02.765815 25331 leader_election.cc:290] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:02.846722 25291 tablet_bootstrap.cc:492] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:02.848559 24545 leader_election.cc:304] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.839535 25281 raft_consensus.cc:2804] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:02.851912 25281 raft_consensus.cc:697] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:02.852255 24727 raft_consensus.cc:2468] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 2.
I20260709 13:07:02.852596 25160 raft_consensus.cc:515] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.853864 25281 consensus_queue.cc:237] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.833642 25323 raft_consensus.cc:493] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.857638 24403 catalog_manager.cc:5697] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.858673 25328 raft_consensus.cc:2804] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.882905 25291 tablet_bootstrap.cc:492] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:02.884584 25291 ts_tablet_manager.cc:1403] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.428s	user 0.021s	sys 0.009s
I20260709 13:07:02.867823 25323 raft_consensus.cc:3060] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.891111 25291 raft_consensus.cc:359] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.891945 25291 raft_consensus.cc:740] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:02.892802 25291 consensus_queue.cc:260] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
W20260709 13:07:02.893373 24622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 53501.5us
I20260709 13:07:02.894784 24622 leader_election.cc:304] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:02.885876 25328 raft_consensus.cc:493] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.897795 25328 raft_consensus.cc:3060] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.893518 25315 raft_consensus.cc:2749] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:02.898645 24545 leader_election.cc:336] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.907568 25291 ts_tablet_manager.cc:1434] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:07:02.880558 25270 raft_consensus.cc:2804] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:02.908929 25291 tablet_bootstrap.cc:492] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
W20260709 13:07:02.905164 24693 leader_election.cc:336] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.934559 25160 leader_election.cc:290] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:02.939456 25270 raft_consensus.cc:697] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:07:02.940157 25334 raft_consensus.cc:515] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:02.940574 25270 consensus_queue.cc:237] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:02.941164 25323 raft_consensus.cc:515] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:07:02.951503 24619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 199328us
I20260709 13:07:02.951009 24652 raft_consensus.cc:1275] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:02.975997 24619 leader_election.cc:336] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:02.976573 24619 leader_election.cc:304] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:02.983515 24725 raft_consensus.cc:2468] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 2.
I20260709 13:07:02.986984 25353 raft_consensus.cc:2804] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:02.987535 25353 raft_consensus.cc:493] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:02.987931 25353 raft_consensus.cc:3060] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:02.990399 25356 consensus_queue.cc:1048] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:07:02.993160 25334 leader_election.cc:290] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:03.000659 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fde674ca95f4161a7f741a822bfe6df" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:03.001303 24580 raft_consensus.cc:3060] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.003557 24578 raft_consensus.cc:1275] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.005770 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:03.006419 24654 raft_consensus.cc:3060] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.009089 25314 consensus_queue.cc:1048] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:03.011912 25323 leader_election.cc:290] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
W20260709 13:07:03.014917 24693 leader_election.cc:336] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:03.015579 24693 consensus_peers.cc:597] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.971505 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b10f5f3b44ddd821edcf5236589ed" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
W20260709 13:07:03.018534 24693 consensus_peers.cc:597] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.023799 24580 raft_consensus.cc:2468] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:03.024266 24654 raft_consensus.cc:2468] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in term 2.
I20260709 13:07:03.025946 24696 leader_election.cc:304] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
W20260709 13:07:03.020501 24619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 44527us
W20260709 13:07:03.026814 24619 leader_election.cc:336] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:03.027978 25281 raft_consensus.cc:2804] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.028570 25281 raft_consensus.cc:697] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:03.029502 25281 consensus_queue.cc:237] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:03.027210 24619 leader_election.cc:304] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:03.033293 24546 leader_election.cc:304] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:03.031817 24545 leader_election.cc:304] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
W20260709 13:07:03.035009 24619 leader_election.cc:336] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:03.035605 24619 leader_election.cc:304] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:03.038417 25323 raft_consensus.cc:2749] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:03.039278 25333 raft_consensus.cc:2749] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:03.025405 24727 raft_consensus.cc:2468] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 1.
I20260709 13:07:03.025828 25331 raft_consensus.cc:2749] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:03.043490 25337 raft_consensus.cc:2804] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.044123 25362 raft_consensus.cc:2804] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.044008 25264 raft_consensus.cc:515] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.055714 25353 raft_consensus.cc:515] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:03.057082 25337 raft_consensus.cc:697] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:07:03.058406 25362 raft_consensus.cc:697] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Becoming Leader. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:07:03.058178 25337 consensus_queue.cc:237] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:03.059475 24654 raft_consensus.cc:1275] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc9c105f2a47f6a6a1d298a1b7dc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.059378 25362 consensus_queue.cc:237] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:03.066066 25217 consensus_queue.cc:1048] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:03.069298 25264 leader_election.cc:290] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:03.072115 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:03.073000 24580 raft_consensus.cc:3060] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.066613 24619 leader_election.cc:304] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:03.083155 24619 leader_election.cc:304] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:03.084824 25339 raft_consensus.cc:2804] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.086071 25331 raft_consensus.cc:2804] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:03.058166 25353 leader_election.cc:290] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Requested vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
W20260709 13:07:03.089939 24545 leader_election.cc:336] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:03.089568 24653 raft_consensus.cc:1275] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.086673 25331 raft_consensus.cc:493] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:03.094492 25331 raft_consensus.cc:3060] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.088040 25339 raft_consensus.cc:697] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:03.099519 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:03.100643 24727 raft_consensus.cc:3060] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.100756 24723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:03.101541 24723 raft_consensus.cc:3060] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.099473 25339 consensus_queue.cc:237] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:07:03.111907 24619 leader_election.cc:336] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:03.113015 24619 leader_election.cc:336] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:03.067101 25328 raft_consensus.cc:515] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:07:03.117724 24619 leader_election.cc:336] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:03.119239 24619 leader_election.cc:336] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:03.120345 24619 leader_election.cc:336] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:03.121544 24619 leader_election.cc:336] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:03.133260 25314 consensus_queue.cc:1048] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:03.157105 24619 leader_election.cc:336] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:03.159030 24619 leader_election.cc:336] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:03.159682 24619 leader_election.cc:336] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:03.171922 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:03.172851 24728 raft_consensus.cc:3060] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.142354 25328 leader_election.cc:290] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:03.150106 24723 raft_consensus.cc:2468] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 2.
W20260709 13:07:03.202864 24545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 111212us
I20260709 13:07:03.213195 24727 raft_consensus.cc:2468] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 2.
I20260709 13:07:03.219698 24728 raft_consensus.cc:2468] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 2.
I20260709 13:07:03.221232 24580 raft_consensus.cc:2468] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 2.
W20260709 13:07:03.235646 24545 consensus_peers.cc:597] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.247164 24622 leader_election.cc:304] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:03.271544 24619 leader_election.cc:304] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:03.273386 24619 leader_election.cc:304] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:03.274710 25291 tablet_bootstrap.cc:492] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:03.280958 25323 raft_consensus.cc:2804] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.281715 24579 raft_consensus.cc:1275] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.289415 25323 raft_consensus.cc:697] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:03.290520 25263 raft_consensus.cc:2804] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.272951 25353 raft_consensus.cc:2804] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.302268 25323 consensus_queue.cc:237] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.302296 24580 raft_consensus.cc:1275] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 4 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:07:03.354331 24696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 66887.1us
W20260709 13:07:03.361630 24622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 73708.3us
W20260709 13:07:03.364035 24693 consensus_peers.cc:597] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.366721 25291 tablet_bootstrap.cc:492] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:03.367545 25291 ts_tablet_manager.cc:1403] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.459s	user 0.031s	sys 0.004s
W20260709 13:07:03.369093 25374 log.cc:927] Time spent T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:07:03.371788 25293 raft_consensus.cc:493] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.372574 24728 raft_consensus.cc:1275] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 9fbc9c105f2a47f6a6a1d298a1b7dc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.372402 25293 raft_consensus.cc:515] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
W20260709 13:07:03.376899 24693 consensus_peers.cc:597] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:03.377698 24693 consensus_peers.cc:597] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:03.378935 24619 leader_election.cc:336] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:03.361014 25263 raft_consensus.cc:697] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:03.390318 25291 raft_consensus.cc:359] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.392264 25291 raft_consensus.cc:740] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.393011 25291 consensus_queue.cc:260] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.376962 25353 raft_consensus.cc:697] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:03.402441 24619 leader_election.cc:304] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:03.364239 25327 consensus_queue.cc:1048] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:07:03.381731 25293 leader_election.cc:290] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:03.410009 25335 raft_consensus.cc:2804] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.404444 25337 consensus_queue.cc:1048] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:07:03.384684 25356 consensus_queue.cc:1048] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 13:07:03.479385 24693 consensus_peers.cc:597] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:03.479907 24693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 101690us
W20260709 13:07:03.480423 24693 consensus_peers.cc:597] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:03.475958 25342 log.cc:927] Time spent T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:03.476347 25335 raft_consensus.cc:697] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:03.473541 25331 raft_consensus.cc:515] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.521035 25331 leader_election.cc:290] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:03.528669 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf0b10f5f3b44ddd821edcf5236589ed" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:03.529433 24725 raft_consensus.cc:3060] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:03.552311 24655 raft_consensus.cc:1275] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.498872 25263 consensus_queue.cc:237] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
W20260709 13:07:03.566773 24693 consensus_peers.cc:597] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:03.509837 25353 consensus_queue.cc:237] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
W20260709 13:07:03.605930 24545 consensus_peers.cc:597] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.590752 25293 raft_consensus.cc:493] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.614675 24693 consensus_peers.cc:597] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:03.615307 24693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 47895.9us
I20260709 13:07:03.619403 24404 catalog_manager.cc:5697] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:03.611985 24545 consensus_peers.cc:597] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:03.586159 25281 consensus_queue.cc:1048] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:07:03.637109 24404 catalog_manager.cc:5697] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } }
I20260709 13:07:03.654371 25291 ts_tablet_manager.cc:1434] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.287s	user 0.021s	sys 0.033s
I20260709 13:07:03.655471 25291 tablet_bootstrap.cc:492] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:03.655611 24404 catalog_manager.cc:5697] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.566776 25335 consensus_queue.cc:237] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.663139 24404 catalog_manager.cc:5697] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.629671 25293 raft_consensus.cc:515] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:03.677932 24580 raft_consensus.cc:1275] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:03.689570 25394 log.cc:927] Time spent T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:03.685065 25397 raft_consensus.cc:493] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.713069 25397 raft_consensus.cc:515] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:03.716674 25293 leader_election.cc:290] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:03.688958 24402 catalog_manager.cc:5697] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.722136 24725 raft_consensus.cc:2468] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 2.
I20260709 13:07:03.693181 25402 raft_consensus.cc:493] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.723238 25402 raft_consensus.cc:515] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.717437 25293 raft_consensus.cc:493] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:03.750588 24619 consensus_peers.cc:597] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:03.751499 24619 leader_election.cc:336] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:03.756846 24694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 184130us
I20260709 13:07:03.759311 25391 consensus_queue.cc:1048] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:07:03.778865 24622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 186131us
I20260709 13:07:03.760751 25397 leader_election.cc:290] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:03.784480 25397 raft_consensus.cc:493] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.784824 24619 leader_election.cc:304] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:03.785059 25397 raft_consensus.cc:515] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:03.786656 25264 raft_consensus.cc:2804] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:03.787175 25264 raft_consensus.cc:697] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:03.787420 25397 leader_election.cc:290] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:03.787704 25402 leader_election.cc:290] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:03.788064 25264 consensus_queue.cc:237] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.754312 25293 raft_consensus.cc:515] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.793524 25293 leader_election.cc:290] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
W20260709 13:07:03.794206 24619 consensus_peers.cc:597] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:03.799280 24693 consensus_peers.cc:597] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:03.800063 24693 consensus_peers.cc:597] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.802273 24581 raft_consensus.cc:1275] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.803514 24728 raft_consensus.cc:1275] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:03.803501 24693 consensus_peers.cc:597] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:03.788074 25397 raft_consensus.cc:493] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.818082 25397 raft_consensus.cc:515] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:03.820107 25397 leader_election.cc:290] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:03.817072 25316 consensus_queue.cc:1048] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:07:03.829649 24581 raft_consensus.cc:1275] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.845156 25328 consensus_queue.cc:1048] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:03.849923 25315 consensus_queue.cc:1048] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:03.865715 24619 consensus_peers.cc:597] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:03.940830 25291 tablet_bootstrap.cc:492] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:03.944774 25410 raft_consensus.cc:493] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.945439 25410 raft_consensus.cc:515] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.947901 25410 leader_election.cc:290] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:03.945312 25291 tablet_bootstrap.cc:492] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:03.950580 25291 ts_tablet_manager.cc:1403] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.295s	user 0.021s	sys 0.017s
I20260709 13:07:03.973102 24581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1987f47fa594dbbac6f13e3ffaac7ba" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:03.973495 25414 raft_consensus.cc:493] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.973640 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933347c92a6c4612a65f9a7c365bc170" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:03.974378 25414 raft_consensus.cc:515] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:03.978091 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "933347c92a6c4612a65f9a7c365bc170" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:03.980301 24654 raft_consensus.cc:1275] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 9fbc9c105f2a47f6a6a1d298a1b7dc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:03.978574 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:03.960502 25410 raft_consensus.cc:493] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.988269 25410 raft_consensus.cc:515] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:03.991915 24651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1987f47fa594dbbac6f13e3ffaac7ba" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:03.993957 25409 raft_consensus.cc:493] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.994783 25409 raft_consensus.cc:515] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:03.997735 25409 leader_election.cc:290] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:03.998620 24577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:03.981578 25316 raft_consensus.cc:493] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.000185 25316 raft_consensus.cc:515] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:04.000459 24575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcff4066e9b4592a94b0522794d5365" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:04.005872 25397 raft_consensus.cc:493] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.006543 25397 raft_consensus.cc:515] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:04.009060 25397 leader_election.cc:290] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:04.011366 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66a54bd402a430e8012e83b9926ed3c" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:03.998695 25344 consensus_queue.cc:1048] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:07:04.013161 25414 leader_election.cc:290] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:04.013417 24728 raft_consensus.cc:1275] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.018301 24654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:04.019081 24654 raft_consensus.cc:2468] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:04.021528 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:04.023963 25410 leader_election.cc:290] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:04.000833 25286 leader_election.cc:304] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:04.024533 24576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:07:04.024732 24545 consensus_peers.cc:597] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.026625 24651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:04.026656 25410 raft_consensus.cc:2749] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:04.029044 24619 consensus_peers.cc:597] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:04.030146 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:04.031755 24575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419e360ee50f470b8f48831ac5316b40" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:04.032725 25384 consensus_queue.cc:1048] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:04.034121 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "419e360ee50f470b8f48831ac5316b40" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:04.034632 25316 leader_election.cc:290] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:04.035585 25409 raft_consensus.cc:493] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.036094 25409 raft_consensus.cc:515] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:04.038561 25409 leader_election.cc:290] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:04.039117 25409 raft_consensus.cc:493] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.039613 25409 raft_consensus.cc:515] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:04.041898 25409 leader_election.cc:290] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:04.044732 24575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:07:04.052687 24619 consensus_peers.cc:597] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:04.051106 25291 raft_consensus.cc:359] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:04.054656 25291 raft_consensus.cc:740] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
W20260709 13:07:04.055935 24545 consensus_peers.cc:597] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.055897 25291 consensus_queue.cc:260] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:04.058701 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffa83e4678e4efcbe8b21ee2c2a48ad" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:04.060310 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
I20260709 13:07:04.060638 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a078959f5dc84592b3f57c5e621ceb3d" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" is_pre_election: true
W20260709 13:07:04.063457 24619 consensus_peers.cc:597] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.065550 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "612adbf2e5c7415abb570cbce1f934dd" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:04.065966 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bffa83e4678e4efcbe8b21ee2c2a48ad" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:04.067723 24656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a078959f5dc84592b3f57c5e621ceb3d" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
W20260709 13:07:04.071383 24545 consensus_peers.cc:597] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.071907 25286 leader_election.cc:304] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:04.074430 24694 leader_election.cc:304] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:04.076371 25291 ts_tablet_manager.cc:1434] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.125s	user 0.007s	sys 0.000s
I20260709 13:07:04.078799 25315 raft_consensus.cc:2804] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:04.079300 25315 raft_consensus.cc:493] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.079677 25315 raft_consensus.cc:3060] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:04.077345 25410 raft_consensus.cc:2749] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:04.082926 24545 consensus_peers.cc:597] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:04.094769 24545 consensus_peers.cc:597] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.097740 24545 consensus_peers.cc:597] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.100309 24545 consensus_peers.cc:597] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.102464 25286 leader_election.cc:304] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:04.103893 25286 leader_election.cc:304] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:04.104696 25410 raft_consensus.cc:2749] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:04.105322 24545 consensus_peers.cc:597] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.108773 24545 consensus_peers.cc:597] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.106560 24619 consensus_peers.cc:597] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.112548 24619 consensus_peers.cc:597] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.117237 24545 consensus_peers.cc:597] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:04.118002 24545 consensus_peers.cc:597] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.106820 25286 leader_election.cc:304] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:04.105436 25410 raft_consensus.cc:2749] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.109422 25291 tablet_bootstrap.cc:492] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:04.128088 25410 raft_consensus.cc:2749] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.129655 25286 leader_election.cc:304] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:04.154083 24728 raft_consensus.cc:1275] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 9fbc9c105f2a47f6a6a1d298a1b7dc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.155221 25410 raft_consensus.cc:2749] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.155567 25286 leader_election.cc:304] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:04.166493 25410 raft_consensus.cc:2749] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:04.171515 24619 consensus_peers.cc:597] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.174417 24728 raft_consensus.cc:1275] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.181723 25384 consensus_queue.cc:1048] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:04.178293 24693 consensus_peers.cc:597] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.198107 25315 raft_consensus.cc:515] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:04.200517 25270 consensus_queue.cc:1048] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:04.211072 25315 leader_election.cc:290] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:04.213577 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cfd4cea52324105ba39f2e3d7e4c330" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:04.214421 24652 raft_consensus.cc:3060] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:07:04.220088 24693 leader_election.cc:336] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:04.236038 24728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:04.237874 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fcff4066e9b4592a94b0522794d5365" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:04.241334 24723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df168e3caa0d42c896ca63b19c3438d7" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:04.241788 24726 raft_consensus.cc:1275] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.243371 24728 raft_consensus.cc:2393] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e0390f5bd00484985fa5469e25be18d in current term 2: Already voted for candidate 9fbc9c105f2a47f6a6a1d298a1b7dc63 in this term.
I20260709 13:07:04.245461 24652 raft_consensus.cc:2468] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 3.
I20260709 13:07:04.229838 24403 catalog_manager.cc:5697] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.248962 24403 catalog_manager.cc:5697] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 3 to 4, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 4 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.247515 24694 leader_election.cc:304] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 
I20260709 13:07:04.254958 24403 catalog_manager.cc:5697] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:04.258857 24693 consensus_peers.cc:597] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.260155 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baca274246424542b0d38cdab6cb25a5" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:04.263160 24722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66a54bd402a430e8012e83b9926ed3c" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:04.246474 25353 consensus_queue.cc:1048] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:07:04.266546 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df176e388c3e486e851d2450693d34ae" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:04.269073 24729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
W20260709 13:07:04.271404 24619 consensus_peers.cc:597] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.254024 25280 raft_consensus.cc:2804] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:04.273239 25280 raft_consensus.cc:697] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:04.274456 25280 consensus_queue.cc:237] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:04.258071 24403 catalog_manager.cc:5697] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.280721 24403 catalog_manager.cc:5697] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.285000 24403 catalog_manager.cc:5697] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.286639 24403 catalog_manager.cc:5697] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.295884 25285 leader_election.cc:304] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:07:04.297484 25285 leader_election.cc:304] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:04.298378 25409 raft_consensus.cc:2749] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.298399 25293 raft_consensus.cc:3060] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.308663 24582 raft_consensus.cc:1275] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.299398 25285 leader_election.cc:304] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:04.318753 25353 consensus_queue.cc:1048] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:07:04.336107 25409 raft_consensus.cc:2749] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.348268 25285 leader_election.cc:304] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
W20260709 13:07:04.355270 24693 leader_election.cc:336] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:04.361666 25409 raft_consensus.cc:2749] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:04.363052 24619 consensus_peers.cc:597] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:04.363780 24619 consensus_peers.cc:597] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:04.366457 24724 raft_consensus.cc:1275] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.361724 25285 leader_election.cc:304] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:07:04.371822 25285 leader_election.cc:304] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:04.372681 25410 raft_consensus.cc:2749] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.373342 25410 raft_consensus.cc:2749] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.373236 25285 leader_election.cc:304] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:07:04.375051 25410 raft_consensus.cc:2749] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.375952 25358 consensus_queue.cc:1048] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 13:07:04.402323 24619 consensus_peers.cc:597] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:04.403294 25438 log.cc:927] Time spent T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:04.409962 25293 raft_consensus.cc:2749] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:04.424057 24403 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45190 (request call id 107) took 1139 ms. Trace:
W20260709 13:07:04.430862 25444 log.cc:927] Time spent T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:04.435657 25291 tablet_bootstrap.cc:492] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:04.428843 24403 rpcz_store.cc:276] 0709 13:07:03.282355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.282515 (+   160us) service_pool.cc:224] Handling call
0709 13:07:04.421168 (+1138653us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:04.344514 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:04.372985 (+ 28471us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:04.373038 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:07:04.373056 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:04.374075 (+  1019us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:04.374155 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:04.374189 (+    34us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:07:04.374932 (+   743us) tablet.cc:701] Row locks acquired
0709 13:07:04.374949 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:07:04.375127 (+   178us) write_op.cc:270] Start()
0709 13:07:04.379068 (+  3941us) write_op.cc:276] Timestamp: P: 1783602424375066 usec, L: 0
0709 13:07:04.379117 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 13:07:04.402638 (+ 23521us) log.cc:844] Serialized 2890 byte log entry
0709 13:07:04.405454 (+  2816us) op_driver.cc:464] REPLICATION: finished
0709 13:07:04.406248 (+   794us) write_op.cc:301] APPLY: starting
0709 13:07:04.406333 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:04.406515 (+   182us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:04.406635 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:04.407426 (+   791us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:04.407638 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:07:04.407694 (+    56us) write_op.cc:312] APPLY: finished
0709 13:07:04.407961 (+   267us) log.cc:844] Serialized 58 byte log entry
0709 13:07:04.408121 (+   160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:04.408236 (+   115us) write_op.cc:454] Released schema lock
0709 13:07:04.408278 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:04.408685 (+   407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:04.408712 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3801,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":439,"apply.run_cpu_time_us":2415,"apply.run_wall_time_us":2415,"num_ops":7,"prepare.queue_time_us":284,"prepare.run_cpu_time_us":4676,"prepare.run_wall_time_us":61374,"replication_time_us":25370}]]}
I20260709 13:07:04.469076 25291 tablet_bootstrap.cc:492] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:04.468732 24402 catalog_manager.cc:5697] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.469913 25291 ts_tablet_manager.cc:1403] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.361s	user 0.022s	sys 0.006s
I20260709 13:07:04.470992 24402 catalog_manager.cc:5697] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.472645 24402 catalog_manager.cc:5697] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:04.486913 24545 consensus_peers.cc:597] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.474992 24402 catalog_manager.cc:5697] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:04.492399 24545 consensus_peers.cc:597] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.498714 24402 catalog_manager.cc:5697] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 1 to 2, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:04.505445 24545 consensus_peers.cc:597] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.514120 25291 raft_consensus.cc:359] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:04.515116 25291 raft_consensus.cc:740] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:04.516479 25291 consensus_queue.cc:260] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:04.522042 25291 ts_tablet_manager.cc:1434] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:07:04.522923 25291 tablet_bootstrap.cc:492] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:04.695622 25291 tablet_bootstrap.cc:492] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:04.699828 25291 tablet_bootstrap.cc:492] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:04.700587 25291 ts_tablet_manager.cc:1403] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.003s
I20260709 13:07:04.703574 25291 raft_consensus.cc:359] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:04.704319 25291 raft_consensus.cc:740] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:04.705030 25291 consensus_queue.cc:260] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:04.707348 25291 ts_tablet_manager.cc:1434] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:04.708231 25291 tablet_bootstrap.cc:492] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:04.708396 24402 catalog_manager.cc:5697] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 3, leader changed from 7e0390f5bd00484985fa5469e25be18d (127.13.206.193) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 3 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:04.732244 24619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 48590.8us
I20260709 13:07:04.740926 25291 tablet_bootstrap.cc:492] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:04.742034 25291 tablet_bootstrap.cc:492] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:04.747478 25291 ts_tablet_manager.cc:1403] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.005s
I20260709 13:07:04.750842 25291 raft_consensus.cc:359] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:04.751642 25291 raft_consensus.cc:740] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:04.752542 25291 consensus_queue.cc:260] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:04.761142 25291 ts_tablet_manager.cc:1434] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:07:04.762044 25291 tablet_bootstrap.cc:492] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
W20260709 13:07:04.884724 24693 consensus_peers.cc:597] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:04.899742 24651 raft_consensus.cc:1275] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:04.901436 25316 consensus_queue.cc:1048] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:04.902496 25291 tablet_bootstrap.cc:492] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:04.903941 25291 tablet_bootstrap.cc:492] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:04.909300 25291 ts_tablet_manager.cc:1403] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.147s	user 0.031s	sys 0.050s
I20260709 13:07:04.913872 25291 raft_consensus.cc:359] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:04.914911 25291 raft_consensus.cc:740] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:04.916070 25291 consensus_queue.cc:260] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:04.920089 25291 ts_tablet_manager.cc:1434] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:07:04.921191 25291 tablet_bootstrap.cc:492] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:04.951550 25293 raft_consensus.cc:493] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.952185 25293 raft_consensus.cc:515] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:04.967825 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f9a01ed3924f7e8f9e3b4e2cd343d0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" is_pre_election: true
I20260709 13:07:04.969563 25479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.193:40253 every 8 connection(s)
I20260709 13:07:04.970479 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.193:40253
I20260709 13:07:04.971786 25293 leader_election.cc:290] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:04.974007 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58f9a01ed3924f7e8f9e3b4e2cd343d0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" is_pre_election: true
I20260709 13:07:04.976485 25285 leader_election.cc:304] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:07:04.989135 25293 raft_consensus.cc:2749] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:05.003391 25291 tablet_bootstrap.cc:492] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.004568 25291 tablet_bootstrap.cc:492] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.005352 25291 ts_tablet_manager.cc:1403] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.084s	user 0.039s	sys 0.013s
I20260709 13:07:05.009267 25291 raft_consensus.cc:359] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.010218 25291 raft_consensus.cc:740] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.011175 25291 consensus_queue.cc:260] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.014021 25291 ts_tablet_manager.cc:1434] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:07:05.015198 25291 tablet_bootstrap.cc:492] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.018497 25481 heartbeater.cc:344] Connected to a master server at 127.13.206.254:42253
I20260709 13:07:05.019145 25481 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:05.020287 25481 heartbeater.cc:507] Master 127.13.206.254:42253 requested a full tablet report, sending...
I20260709 13:07:05.042073 25440 raft_consensus.cc:3060] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.057878 25291 tablet_bootstrap.cc:492] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.059118 25291 tablet_bootstrap.cc:492] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.061739 25439 raft_consensus.cc:3060] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.064597 25291 ts_tablet_manager.cc:1403] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.004s
I20260709 13:07:05.068010 25291 raft_consensus.cc:359] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.070567 25291 raft_consensus.cc:740] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.071331 25291 consensus_queue.cc:260] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.074064 25291 ts_tablet_manager.cc:1434] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:07:05.075031 25291 tablet_bootstrap.cc:492] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.099409 25424 raft_consensus.cc:3060] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.100165 25291 tablet_bootstrap.cc:492] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.101585 25291 tablet_bootstrap.cc:492] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.102672 25291 ts_tablet_manager.cc:1403] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.009s
I20260709 13:07:05.106395 25291 raft_consensus.cc:359] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.107252 25291 raft_consensus.cc:740] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.108122 25291 consensus_queue.cc:260] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.111832 25291 ts_tablet_manager.cc:1434] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:05.112854 25291 tablet_bootstrap.cc:492] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.156337 24402 ts_manager.cc:194] Re-registered known tserver with Master: 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
I20260709 13:07:05.159029 25424 raft_consensus.cc:3060] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.176927 25291 tablet_bootstrap.cc:492] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.178481 25291 tablet_bootstrap.cc:492] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.179414 25291 ts_tablet_manager.cc:1403] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.067s	user 0.022s	sys 0.001s
I20260709 13:07:05.183075 25291 raft_consensus.cc:359] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.184039 25291 raft_consensus.cc:740] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.185034 25291 consensus_queue.cc:260] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.187369 25291 ts_tablet_manager.cc:1434] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:05.188207 25291 tablet_bootstrap.cc:492] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.201526 25430 raft_consensus.cc:3060] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.203094 25435 raft_consensus.cc:3060] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.232685 25440 raft_consensus.cc:3060] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.235556 25291 tablet_bootstrap.cc:492] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.236649 25291 tablet_bootstrap.cc:492] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.237360 25291 ts_tablet_manager.cc:1403] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.049s	user 0.027s	sys 0.016s
I20260709 13:07:05.242578 25291 raft_consensus.cc:359] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.243297 25291 raft_consensus.cc:740] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.243989 25291 consensus_queue.cc:260] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.246126 25291 ts_tablet_manager.cc:1434] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:05.247473 25291 tablet_bootstrap.cc:492] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.264257 25291 tablet_bootstrap.cc:492] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.265239 25291 tablet_bootstrap.cc:492] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.266748 25291 ts_tablet_manager.cc:1403] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:07:05.268877 25291 raft_consensus.cc:359] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.269491 25291 raft_consensus.cc:740] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.270155 25291 consensus_queue.cc:260] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.271956 25291 ts_tablet_manager.cc:1434] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:05.272782 25291 tablet_bootstrap.cc:492] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.286402 24402 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38332
I20260709 13:07:05.288924 25291 tablet_bootstrap.cc:492] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.289881 25291 tablet_bootstrap.cc:492] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.290577 25291 ts_tablet_manager.cc:1403] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:07:05.291339 25481 heartbeater.cc:499] Master 127.13.206.254:42253 was elected leader, sending a full tablet report...
I20260709 13:07:05.293032 25291 raft_consensus.cc:359] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.293864 25291 raft_consensus.cc:740] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.294554 25291 consensus_queue.cc:260] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.296444 25291 ts_tablet_manager.cc:1434] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:05.297161 25291 tablet_bootstrap.cc:492] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.309657 25291 tablet_bootstrap.cc:492] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.310671 25291 tablet_bootstrap.cc:492] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.311491 25291 ts_tablet_manager.cc:1403] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:07:05.314198 25291 raft_consensus.cc:359] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.314924 25291 raft_consensus.cc:740] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.315654 25291 consensus_queue.cc:260] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.317267 25291 ts_tablet_manager.cc:1434] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.003s
I20260709 13:07:05.318076 25291 tablet_bootstrap.cc:492] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.360376 25291 tablet_bootstrap.cc:492] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.361444 25291 tablet_bootstrap.cc:492] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.362131 25291 ts_tablet_manager.cc:1403] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.044s	user 0.024s	sys 0.016s
I20260709 13:07:05.364851 25291 raft_consensus.cc:359] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.365573 25291 raft_consensus.cc:740] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.366405 25291 consensus_queue.cc:260] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.367605 25424 raft_consensus.cc:3060] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.368548 25291 ts_tablet_manager.cc:1434] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:05.369451 25291 tablet_bootstrap.cc:492] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.369693 25440 raft_consensus.cc:3060] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.371800 25439 raft_consensus.cc:3060] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.377911 25435 raft_consensus.cc:3060] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.382071 25430 raft_consensus.cc:3060] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.399724 25419 raft_consensus.cc:3060] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.445907 25291 tablet_bootstrap.cc:492] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.447032 25291 tablet_bootstrap.cc:492] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.447734 25291 ts_tablet_manager.cc:1403] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.078s	user 0.030s	sys 0.032s
I20260709 13:07:05.452926 25291 raft_consensus.cc:359] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.453689 25291 raft_consensus.cc:740] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.454593 25291 consensus_queue.cc:260] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.457078 25291 ts_tablet_manager.cc:1434] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:05.457906 25291 tablet_bootstrap.cc:492] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.491093 25291 tablet_bootstrap.cc:492] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.492108 25291 tablet_bootstrap.cc:492] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.492787 25291 ts_tablet_manager.cc:1403] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.013s
I20260709 13:07:05.495476 25291 raft_consensus.cc:359] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.496206 25291 raft_consensus.cc:740] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.496925 25291 consensus_queue.cc:260] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.499418 25291 ts_tablet_manager.cc:1434] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:05.500257 25291 tablet_bootstrap.cc:492] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
W20260709 13:07:05.549012 24693 consensus_peers.cc:597] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:05.556740 25291 tablet_bootstrap.cc:492] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.559197 25291 tablet_bootstrap.cc:492] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.560981 25291 ts_tablet_manager.cc:1403] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.061s	user 0.030s	sys 0.015s
I20260709 13:07:05.564596 25291 raft_consensus.cc:359] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.565410 25291 raft_consensus.cc:740] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.566268 25291 consensus_queue.cc:260] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.568509 25291 ts_tablet_manager.cc:1434] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:05.569401 25291 tablet_bootstrap.cc:492] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.589352 25291 tablet_bootstrap.cc:492] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.590394 25291 tablet_bootstrap.cc:492] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.591137 25291 ts_tablet_manager.cc:1403] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:07:05.594004 25291 raft_consensus.cc:359] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.594724 25291 raft_consensus.cc:740] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.595430 25291 consensus_queue.cc:260] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.597539 25291 ts_tablet_manager.cc:1434] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:05.598410 25291 tablet_bootstrap.cc:492] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.617317 25291 tablet_bootstrap.cc:492] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.618297 25291 tablet_bootstrap.cc:492] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.618878 25291 ts_tablet_manager.cc:1403] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 13:07:05.621187 25291 raft_consensus.cc:359] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.621909 25291 raft_consensus.cc:740] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.622654 25291 consensus_queue.cc:260] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.624747 25291 ts_tablet_manager.cc:1434] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:05.625550 25291 tablet_bootstrap.cc:492] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.640192 25291 tablet_bootstrap.cc:492] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.641038 25291 tablet_bootstrap.cc:492] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.641636 25291 ts_tablet_manager.cc:1403] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 13:07:05.644217 25291 raft_consensus.cc:359] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.644774 25291 raft_consensus.cc:740] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.645448 25291 consensus_queue.cc:260] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.647519 25291 ts_tablet_manager.cc:1434] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:05.648411 25291 tablet_bootstrap.cc:492] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.667451 25291 tablet_bootstrap.cc:492] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.668480 25291 tablet_bootstrap.cc:492] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.669163 25291 ts_tablet_manager.cc:1403] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.006s
I20260709 13:07:05.671736 25291 raft_consensus.cc:359] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.672447 25291 raft_consensus.cc:740] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.674255 25291 consensus_queue.cc:260] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.676501 25291 ts_tablet_manager.cc:1434] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:07:05.677649 25291 tablet_bootstrap.cc:492] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.701977 25291 tablet_bootstrap.cc:492] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.703052 25291 tablet_bootstrap.cc:492] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.703773 25291 ts_tablet_manager.cc:1403] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 13:07:05.706368 25291 raft_consensus.cc:359] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.707098 25291 raft_consensus.cc:740] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.707854 25291 consensus_queue.cc:260] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.709662 25291 ts_tablet_manager.cc:1434] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:05.710595 25291 tablet_bootstrap.cc:492] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.715353 25430 raft_consensus.cc:3060] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.725929 25291 tablet_bootstrap.cc:492] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.727911 25291 tablet_bootstrap.cc:492] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.728713 25291 ts_tablet_manager.cc:1403] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 13:07:05.731415 25291 raft_consensus.cc:359] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.732203 25291 raft_consensus.cc:740] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.732882 25291 consensus_queue.cc:260] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:05.734946 25291 ts_tablet_manager.cc:1434] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:05.735865 25291 tablet_bootstrap.cc:492] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.753906 25291 tablet_bootstrap.cc:492] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.754931 25291 tablet_bootstrap.cc:492] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.755549 25291 ts_tablet_manager.cc:1403] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:07:05.758239 25291 raft_consensus.cc:359] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.759006 25291 raft_consensus.cc:740] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.759796 25291 consensus_queue.cc:260] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.762123 25291 ts_tablet_manager.cc:1434] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:05.763610 25291 tablet_bootstrap.cc:492] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.765327 25419 raft_consensus.cc:3060] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:05.827239 25291 tablet_bootstrap.cc:492] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.828316 25291 tablet_bootstrap.cc:492] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.829113 25291 ts_tablet_manager.cc:1403] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.066s	user 0.032s	sys 0.031s
I20260709 13:07:05.831820 25291 raft_consensus.cc:359] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.832665 25291 raft_consensus.cc:740] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.833438 25291 consensus_queue.cc:260] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.835803 25291 ts_tablet_manager.cc:1434] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:05.839233 25291 tablet_bootstrap.cc:492] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.855444 25291 tablet_bootstrap.cc:492] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.856299 25291 tablet_bootstrap.cc:492] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.856915 25291 ts_tablet_manager.cc:1403] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:07:05.858942 25291 raft_consensus.cc:359] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.859460 25291 raft_consensus.cc:740] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.860030 25291 consensus_queue.cc:260] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:05.861644 25291 ts_tablet_manager.cc:1434] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:05.863130 25291 tablet_bootstrap.cc:492] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.897430 25291 tablet_bootstrap.cc:492] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.898509 25291 tablet_bootstrap.cc:492] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.899202 25291 ts_tablet_manager.cc:1403] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.009s
I20260709 13:07:05.901626 25291 raft_consensus.cc:359] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.902287 25291 raft_consensus.cc:740] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.902990 25291 consensus_queue.cc:260] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.904999 25291 ts_tablet_manager.cc:1434] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:07:05.907660 25291 tablet_bootstrap.cc:492] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.921188 25291 tablet_bootstrap.cc:492] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.922171 25291 tablet_bootstrap.cc:492] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.923000 25291 ts_tablet_manager.cc:1403] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 13:07:05.925663 25291 raft_consensus.cc:359] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.926424 25291 raft_consensus.cc:740] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.927117 25291 consensus_queue.cc:260] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.928674 25291 ts_tablet_manager.cc:1434] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:05.929417 25291 tablet_bootstrap.cc:492] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:05.946961 25291 tablet_bootstrap.cc:492] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:05.947911 25291 tablet_bootstrap.cc:492] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:05.948655 25291 ts_tablet_manager.cc:1403] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 13:07:05.951148 25291 raft_consensus.cc:359] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.951975 25291 raft_consensus.cc:740] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:05.952670 25291 consensus_queue.cc:260] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:05.954707 25291 ts_tablet_manager.cc:1434] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:05.954770 25430 raft_consensus.cc:3060] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:05.955478 25291 tablet_bootstrap.cc:492] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: Bootstrap starting.
I20260709 13:07:06.000283 25291 tablet_bootstrap.cc:492] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:06.001298 25291 tablet_bootstrap.cc:492] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: Bootstrap complete.
I20260709 13:07:06.001969 25291 ts_tablet_manager.cc:1403] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.020s
I20260709 13:07:06.004618 25291 raft_consensus.cc:359] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:06.005306 25291 raft_consensus.cc:740] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Initialized, Role: FOLLOWER
I20260709 13:07:06.006134 25291 consensus_queue.cc:260] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:06.008275 25291 ts_tablet_manager.cc:1434] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:06.024961 25430 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:06.085644 25430 raft_consensus.cc:3060] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:06.204734 25430 raft_consensus.cc:3060] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:08.084061 24603 debug-util.cc:398] Leaking SignalData structure 0x7b0800270000 after lost signal to thread 14142
W20260709 13:07:08.085181 24603 debug-util.cc:398] Leaking SignalData structure 0x7b08002834e0 after lost signal to thread 24439
W20260709 13:07:08.086615 24603 debug-util.cc:398] Leaking SignalData structure 0x7b080029a920 after lost signal to thread 24606
W20260709 13:07:08.087898 24603 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6be0 after lost signal to thread 24680
W20260709 13:07:08.089154 24603 debug-util.cc:398] Leaking SignalData structure 0x7b080014ec80 after lost signal to thread 24754
W20260709 13:07:08.090574 24603 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed6c0 after lost signal to thread 25479
W20260709 13:07:11.019424 24619 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 63292.7us
I20260709 13:07:15.089571 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:15.163141 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:44280
I20260709 13:07:15.163862 24652 raft_consensus.cc:606] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:15.176502 24730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:55756
I20260709 13:07:15.177098 24730 raft_consensus.cc:606] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:15.179697 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6357dd272feb4d93ab11f73b1e3bead5"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
mode: GRACEFUL
new_leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
 from {username='slave'} at 127.0.0.1:44280
I20260709 13:07:15.180248 24652 raft_consensus.cc:606] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Received request to transfer leadership to TS 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:07:15.182646 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
mode: GRACEFUL
new_leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
 from {username='slave'} at 127.0.0.1:44280
I20260709 13:07:15.183125 24652 raft_consensus.cc:606] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Received request to transfer leadership to TS 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:07:15.197734 24580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e"
dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:56082
I20260709 13:07:15.198218 24580 raft_consensus.cc:606] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:15.200423 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:44280
I20260709 13:07:15.200845 24652 raft_consensus.cc:606] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:15.203118 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:44280
I20260709 13:07:15.203686 24652 raft_consensus.cc:606] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:15.204838 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:07:15.206403 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:15.308228 25563 raft_consensus.cc:993] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4: : Instructing follower 3eeda3010ca44374a5bbf85e7980ba1c to start an election
I20260709 13:07:15.308925 25572 raft_consensus.cc:1081] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Signalling peer 3eeda3010ca44374a5bbf85e7980ba1c to start an election
I20260709 13:07:15.310657 24730 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6357dd272feb4d93ab11f73b1e3bead5"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
 from {username='slave'} at 127.0.0.1:48440
I20260709 13:07:15.311223 24730 raft_consensus.cc:493] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.311637 24730 raft_consensus.cc:3060] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.320429 24730 raft_consensus.cc:515] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:15.322896 24730 leader_election.cc:290] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:15.323674 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6357dd272feb4d93ab11f73b1e3bead5" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:15.323923 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6357dd272feb4d93ab11f73b1e3bead5" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:15.325416 24580 raft_consensus.cc:3060] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.325520 24652 raft_consensus.cc:3055] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.326465 24652 raft_consensus.cc:740] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:15.327296 24652 consensus_queue.cc:260] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:15.328406 24652 raft_consensus.cc:3060] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.333341 24580 raft_consensus.cc:2468] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:15.335119 24696 leader_election.cc:304] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:15.336093 25557 raft_consensus.cc:2804] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.336329 24652 raft_consensus.cc:2468] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:15.345108 25557 raft_consensus.cc:697] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:15.346318 25557 consensus_queue.cc:237] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:15.362053 24403 catalog_manager.cc:5697] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.416033 25572 raft_consensus.cc:993] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4: : Instructing follower 3eeda3010ca44374a5bbf85e7980ba1c to start an election
I20260709 13:07:15.416656 25563 raft_consensus.cc:1081] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Signalling peer 3eeda3010ca44374a5bbf85e7980ba1c to start an election
I20260709 13:07:15.419518 25572 raft_consensus.cc:993] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:15.420017 25572 raft_consensus.cc:1081] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:15.420166 24724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
 from {username='slave'} at 127.0.0.1:48440
I20260709 13:07:15.420739 24724 raft_consensus.cc:493] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.421104 24724 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.422130 25439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47284
I20260709 13:07:15.422765 25439 raft_consensus.cc:493] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.423092 25439 raft_consensus.cc:3060] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.427402 24724 raft_consensus.cc:515] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:15.430287 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:15.430914 24580 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.430954 24724 leader_election.cc:290] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:15.432207 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:15.432904 24652 raft_consensus.cc:3055] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.433210 24652 raft_consensus.cc:740] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:15.433990 24652 consensus_queue.cc:260] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:15.435089 24652 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.434755 25439 raft_consensus.cc:515] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:15.438371 24580 raft_consensus.cc:2468] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:15.440279 24696 leader_election.cc:304] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:15.440755 25439 leader_election.cc:290] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:15.441242 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:15.441886 24578 raft_consensus.cc:3060] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.442091 25557 raft_consensus.cc:2804] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.442603 25557 raft_consensus.cc:697] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:15.443588 25557 consensus_queue.cc:237] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:15.447327 24651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f17522023e1e45c5bb9bae9be809cb3b" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:15.447968 24651 raft_consensus.cc:3055] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.448247 24651 raft_consensus.cc:740] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:15.449077 24651 consensus_queue.cc:260] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:15.449915 24578 raft_consensus.cc:2468] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 2.
I20260709 13:07:15.450327 24651 raft_consensus.cc:3060] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.451334 25288 leader_election.cc:304] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:15.458616 24651 raft_consensus.cc:2468] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 2.
I20260709 13:07:15.460330 25585 raft_consensus.cc:2804] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.460968 24652 raft_consensus.cc:2468] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:15.463267 25585 raft_consensus.cc:697] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 2 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:15.464298 25585 consensus_queue.cc:237] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:15.468007 24403 catalog_manager.cc:5697] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.476719 24402 catalog_manager.cc:5697] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 1 to 2, leader changed from 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 2 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.492580 25565 raft_consensus.cc:993] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:15.493698 25563 raft_consensus.cc:1081] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:15.494755 25588 raft_consensus.cc:993] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:15.495393 25563 raft_consensus.cc:1081] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:15.495611 25419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47284
I20260709 13:07:15.496290 25419 raft_consensus.cc:493] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.496670 25419 raft_consensus.cc:3060] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.497502 25439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47284
I20260709 13:07:15.498082 25439 raft_consensus.cc:493] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.498481 25439 raft_consensus.cc:3060] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.505975 25439 raft_consensus.cc:515] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:15.508152 25439 leader_election.cc:290] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:15.509583 24724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:15.510334 24724 raft_consensus.cc:3060] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.510042 25419 raft_consensus.cc:515] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:15.512526 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b8dffdf450843a0a7cf0e91c3bd3861" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:15.513124 24652 raft_consensus.cc:3055] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.513340 24652 raft_consensus.cc:740] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:15.514041 24652 consensus_queue.cc:260] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:15.514629 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:15.515137 24652 raft_consensus.cc:3060] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.515285 24730 raft_consensus.cc:3060] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.517760 24724 raft_consensus.cc:2468] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 2.
I20260709 13:07:15.519598 25285 leader_election.cc:304] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:07:15.520638 25585 raft_consensus.cc:2804] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.521111 25585 raft_consensus.cc:697] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 2 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:15.522022 25585 consensus_queue.cc:237] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:15.512581 25419 leader_election.cc:290] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:15.526108 24651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f04e8125d3094e3fbdf35b449e5afd2e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:15.527045 24651 raft_consensus.cc:3055] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:15.527382 24651 raft_consensus.cc:740] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:15.528309 24651 consensus_queue.cc:260] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:15.529681 24651 raft_consensus.cc:3060] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.522188 24652 raft_consensus.cc:2468] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 2.
I20260709 13:07:15.538272 24651 raft_consensus.cc:2468] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:15.539474 25286 leader_election.cc:304] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:07:15.540534 25585 raft_consensus.cc:2804] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:15.541093 25585 raft_consensus.cc:697] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:15.542100 25585 consensus_queue.cc:237] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:15.544936 24402 catalog_manager.cc:5697] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 1 to 2, leader changed from 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 2 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.548017 24730 raft_consensus.cc:2468] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:15.548363 25568 raft_consensus.cc:993] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:15.549028 25568 raft_consensus.cc:1081] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:15.550710 25439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47278
I20260709 13:07:15.551204 25439 raft_consensus.cc:493] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.551548 25439 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.559373 25439 raft_consensus.cc:515] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:15.561416 25439 leader_election.cc:290] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 5 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:15.562397 24578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:15.563059 24578 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.563694 24730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6061c3782cb742d0895cd3cb6892588e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:15.564327 24730 raft_consensus.cc:3055] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:15.564639 24730 raft_consensus.cc:740] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:15.565456 24730 consensus_queue.cc:260] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:15.566743 24730 raft_consensus.cc:3060] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:15.569814 24578 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 5.
I20260709 13:07:15.570425 24402 catalog_manager.cc:5697] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 2 to 3, leader changed from 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 3 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.571000 25288 leader_election.cc:304] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:15.572022 25585 raft_consensus.cc:2804] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:15.572440 24730 raft_consensus.cc:2468] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 5.
I20260709 13:07:15.572536 25585 raft_consensus.cc:697] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 5 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:15.573696 25585 consensus_queue.cc:237] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:15.587172 24402 catalog_manager.cc:5697] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 4 to 5, leader changed from 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 5 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.621697 25570 raft_consensus.cc:993] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:15.622361 25578 raft_consensus.cc:1081] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:15.624233 25435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47288
I20260709 13:07:15.624744 25435 raft_consensus.cc:493] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.625056 25435 raft_consensus.cc:3060] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.633069 25435 raft_consensus.cc:515] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:15.635244 25435 leader_election.cc:290] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:15.635850 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:15.636479 24651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d25a32222ca44ec493cfc78f7a31824e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:15.637102 24651 raft_consensus.cc:3060] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.636489 24580 raft_consensus.cc:3055] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:15.638067 24580 raft_consensus.cc:740] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:07:15.638926 24580 consensus_queue.cc:260] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:15.643992 24580 raft_consensus.cc:3060] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:15.653172 24580 raft_consensus.cc:2468] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:15.653172 24651 raft_consensus.cc:2468] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:15.654505 25288 leader_election.cc:304] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:15.655450 25585 raft_consensus.cc:2804] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:15.655984 25585 raft_consensus.cc:697] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:15.656917 25585 consensus_queue.cc:237] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:15.675284 24402 catalog_manager.cc:5697] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 2 to 3, leader changed from 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 3 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.901201 24580 raft_consensus.cc:1275] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.902719 25577 consensus_queue.cc:1048] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.911162 24651 raft_consensus.cc:1275] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.913390 25585 consensus_queue.cc:1048] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.917927 24652 raft_consensus.cc:1275] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.924068 25557 consensus_queue.cc:1048] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.935621 24730 raft_consensus.cc:1275] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.939661 25585 consensus_queue.cc:1048] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.953846 24580 raft_consensus.cc:1275] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.965255 24724 raft_consensus.cc:1275] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:15.966847 25585 consensus_queue.cc:1048] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.967291 25586 consensus_queue.cc:1048] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:15.984787 24655 raft_consensus.cc:1275] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:16.098197 25557 consensus_queue.cc:1048] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:16.103528 24651 raft_consensus.cc:1275] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:16.106101 24578 raft_consensus.cc:1275] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 5 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:16.108947 25586 consensus_queue.cc:1048] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:16.100534 24694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:41635, user_credentials={real_user=slave}} blocked reactor thread for 111372us
I20260709 13:07:16.123729 25600 consensus_queue.cc:1048] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:16.129508 24656 raft_consensus.cc:1275] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:16.140465 24578 raft_consensus.cc:1275] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:16.141486 25607 consensus_queue.cc:1048] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:16.143585 25577 consensus_queue.cc:1048] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.143936 24724 raft_consensus.cc:1275] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 5 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:16.150696 25607 consensus_queue.cc:1048] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:16.187297 25288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:46385, user_credentials={real_user=slave}} blocked reactor thread for 79750.8us
I20260709 13:07:16.198989 24578 raft_consensus.cc:1275] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:16.210583 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:16.228797 24545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.196:34879, user_credentials={real_user=slave}} blocked reactor thread for 240661us
I20260709 13:07:16.230520 25608 consensus_queue.cc:1048] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:07:16.325318 24545 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 49260.5us
W20260709 13:07:16.328333 24693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:40253, user_credentials={real_user=slave}} blocked reactor thread for 77408.8us
I20260709 13:07:16.368018 24655 raft_consensus.cc:1275] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:16.492594 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:16.519289 25608 consensus_queue.cc:1048] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:16.645429 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3106acd049af4538a29a53f816570f50"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:44280
I20260709 13:07:16.646031 24652 raft_consensus.cc:606] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:16.649536 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:44280
I20260709 13:07:16.650125 24652 raft_consensus.cc:606] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:16.653462 24725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
mode: GRACEFUL
new_leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
 from {username='slave'} at 127.0.0.1:55756
I20260709 13:07:16.654199 24725 raft_consensus.cc:606] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Received request to transfer leadership to TS 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:07:16.657271 24579 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61"
dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:56082
I20260709 13:07:16.657877 24579 raft_consensus.cc:606] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:16.660732 24725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:55756
I20260709 13:07:16.661363 24725 raft_consensus.cc:606] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:16.662120 25629 raft_consensus.cc:993] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:16.662856 25610 raft_consensus.cc:1081] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:16.664125 24725 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee94f042219e46ecb9ac23aebbf326b9"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
mode: GRACEFUL
new_leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
 from {username='slave'} at 127.0.0.1:55756
I20260709 13:07:16.664703 25430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3106acd049af4538a29a53f816570f50"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47284
I20260709 13:07:16.664741 24725 raft_consensus.cc:606] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Received request to transfer leadership to TS 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:07:16.665458 25430 raft_consensus.cc:493] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.665830 25430 raft_consensus.cc:3060] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.666601 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:16.668509 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:16.674150 25430 raft_consensus.cc:515] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:16.675928 25430 leader_election.cc:290] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:16.676774 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:16.676789 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3106acd049af4538a29a53f816570f50" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:16.677659 24579 raft_consensus.cc:3060] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.677737 24652 raft_consensus.cc:3055] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:16.678201 24652 raft_consensus.cc:740] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:16.679034 24652 consensus_queue.cc:260] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:16.679941 24652 raft_consensus.cc:3060] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.686412 24652 raft_consensus.cc:2468] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:16.688242 25286 leader_election.cc:304] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:07:16.689561 25607 raft_consensus.cc:2804] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:16.690090 25607 raft_consensus.cc:697] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:16.691111 25607 consensus_queue.cc:237] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:16.691226 24579 raft_consensus.cc:2468] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:16.708251 24401 catalog_manager.cc:5697] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 2 to 3, leader changed from 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 3 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.717998 25619 raft_consensus.cc:993] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c: : Instructing follower 0e0c30b65a5d485e89552b4cb36da6b4 to start an election
I20260709 13:07:16.718822 25619 raft_consensus.cc:1081] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Signalling peer 0e0c30b65a5d485e89552b4cb36da6b4 to start an election
I20260709 13:07:16.721079 24652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee94f042219e46ecb9ac23aebbf326b9"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
 from {username='slave'} at 127.0.0.1:54222
I20260709 13:07:16.721762 24652 raft_consensus.cc:493] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.722173 24652 raft_consensus.cc:3060] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.730304 24652 raft_consensus.cc:515] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:16.733800 24652 leader_election.cc:290] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:16.733932 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f042219e46ecb9ac23aebbf326b9" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:16.734364 24725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee94f042219e46ecb9ac23aebbf326b9" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:16.734731 24579 raft_consensus.cc:3060] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.734982 24725 raft_consensus.cc:3055] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:16.735323 24725 raft_consensus.cc:740] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:16.736181 24725 consensus_queue.cc:260] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:16.737555 24725 raft_consensus.cc:3060] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:16.742882 24579 raft_consensus.cc:2468] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 2.
I20260709 13:07:16.745985 24622 leader_election.cc:304] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:16.746881 25629 raft_consensus.cc:2804] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:16.747385 25629 raft_consensus.cc:697] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:16.748296 25629 consensus_queue.cc:237] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:16.756983 24725 raft_consensus.cc:2468] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 2.
I20260709 13:07:16.790218 24401 catalog_manager.cc:5697] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 1 to 2, leader changed from 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196) to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.948544 25610 raft_consensus.cc:993] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:16.949083 25623 raft_consensus.cc:1081] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:16.950755 25430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47284
I20260709 13:07:16.951241 25430 raft_consensus.cc:493] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.951529 25430 raft_consensus.cc:3060] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.957676 25430 raft_consensus.cc:515] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:16.959273 25430 leader_election.cc:290] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:16.960151 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:16.960505 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d88b79763a4db4a24e470a3d02f478" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:16.960753 24652 raft_consensus.cc:3055] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:16.961129 24727 raft_consensus.cc:3060] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.961163 24652 raft_consensus.cc:740] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:16.962265 24652 consensus_queue.cc:260] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:16.963500 24652 raft_consensus.cc:3060] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.971422 24652 raft_consensus.cc:2468] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:16.971864 24727 raft_consensus.cc:2468] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:16.972456 25286 leader_election.cc:304] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:07:16.973294 25600 raft_consensus.cc:2804] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:16.973811 25600 raft_consensus.cc:697] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:16.974606 25600 consensus_queue.cc:237] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:16.985442 24401 catalog_manager.cc:5697] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 2 to 3, leader changed from 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 3 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.988185 25628 raft_consensus.cc:993] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:16.988796 25628 raft_consensus.cc:1081] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:16.990712 25430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47288
I20260709 13:07:16.991259 25430 raft_consensus.cc:493] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.991566 25430 raft_consensus.cc:3060] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:16.998520 25430 raft_consensus.cc:515] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.000237 25430 leader_election.cc:290] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:17.001405 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:17.002104 24580 raft_consensus.cc:3055] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.002445 24580 raft_consensus.cc:740] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:07:17.003237 24580 consensus_queue.cc:260] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.004356 24580 raft_consensus.cc:3060] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.004604 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8100c9df824b0383fbb5f05b846b61" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:17.005380 24727 raft_consensus.cc:3060] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.006112 25625 raft_consensus.cc:993] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:17.006753 25625 raft_consensus.cc:1081] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:17.012494 25440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47278
I20260709 13:07:17.013164 25440 raft_consensus.cc:493] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:17.013649 25440 raft_consensus.cc:3060] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.017855 24727 raft_consensus.cc:2468] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:17.019153 25285 leader_election.cc:304] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:07:17.020115 25600 raft_consensus.cc:2804] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:17.020651 25600 raft_consensus.cc:697] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:17.021533 25600 consensus_queue.cc:237] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.022544 25440 raft_consensus.cc:515] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.024392 24580 raft_consensus.cc:2468] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:17.024892 25440 leader_election.cc:290] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:17.025631 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:17.026304 24727 raft_consensus.cc:3055] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.026187 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccd41fd6be624ea6bc27b249b0619443" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:17.026793 24727 raft_consensus.cc:740] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:17.027019 24580 raft_consensus.cc:3060] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.029616 24727 consensus_queue.cc:260] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.031016 24727 raft_consensus.cc:3060] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.034611 24580 raft_consensus.cc:2468] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:17.034320 24401 catalog_manager.cc:5697] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 2 to 3, leader changed from 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 3 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.036059 25288 leader_election.cc:304] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:17.040606 24727 raft_consensus.cc:2468] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:17.043005 25600 raft_consensus.cc:2804] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:17.043581 25600 raft_consensus.cc:697] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:17.044428 25600 consensus_queue.cc:237] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.055464 24401 catalog_manager.cc:5697] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 2 to 3, leader changed from 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 3 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.204970 25577 raft_consensus.cc:993] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c: : Instructing follower 0e0c30b65a5d485e89552b4cb36da6b4 to start an election
I20260709 13:07:17.205497 25638 raft_consensus.cc:1081] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Signalling peer 0e0c30b65a5d485e89552b4cb36da6b4 to start an election
I20260709 13:07:17.205583 24580 raft_consensus.cc:1275] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.207259 24652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
 from {username='slave'} at 127.0.0.1:54222
I20260709 13:07:17.207412 25600 consensus_queue.cc:1048] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:17.207857 24652 raft_consensus.cc:493] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:17.208312 24652 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.215222 24652 raft_consensus.cc:515] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:17.218214 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:17.218984 24579 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.231401 24652 leader_election.cc:290] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 3 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:17.231858 24655 raft_consensus.cc:1275] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.233516 25600 consensus_queue.cc:1048] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.237720 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:17.238430 24727 raft_consensus.cc:3055] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.238641 24724 raft_consensus.cc:1275] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.238741 24727 raft_consensus.cc:740] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:17.239718 24727 consensus_queue.cc:260] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:17.241030 24727 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.242709 24579 raft_consensus.cc:2468] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 3.
I20260709 13:07:17.243956 24622 leader_election.cc:304] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:17.245151 25623 raft_consensus.cc:2804] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:17.245151 25610 consensus_queue.cc:1048] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:07:17.248968 25623 raft_consensus.cc:697] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:17.249985 25623 consensus_queue.cc:237] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:17.251994 24727 raft_consensus.cc:2468] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 3.
I20260709 13:07:17.283823 24580 raft_consensus.cc:1275] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:17.285801 25623 consensus_queue.cc:1048] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:17.291107 24404 catalog_manager.cc:5697] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 2 to 3, leader changed from 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196) to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.408450 24724 raft_consensus.cc:1275] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.410059 25600 consensus_queue.cc:1048] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.430965 24655 raft_consensus.cc:1275] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.432803 25607 consensus_queue.cc:1048] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.457763 24579 raft_consensus.cc:1275] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.460351 25608 consensus_queue.cc:1048] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.475979 24724 raft_consensus.cc:1275] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.479488 25600 consensus_queue.cc:1048] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.549284 24727 raft_consensus.cc:1275] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.550886 25607 consensus_queue.cc:1048] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.560796 24580 raft_consensus.cc:1275] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.564091 25600 consensus_queue.cc:1048] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.669394 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:17.729188 24727 raft_consensus.cc:1275] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.731202 25629 consensus_queue.cc:1048] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.732353 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:17.741580 24580 raft_consensus.cc:1275] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:17.744236 25610 consensus_queue.cc:1048] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:17.791651 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "652a4c910b344866bc517d7c4e994536"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
mode: GRACEFUL
new_leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
 from {username='slave'} at 127.0.0.1:44280
I20260709 13:07:17.792351 24652 raft_consensus.cc:606] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Received request to transfer leadership to TS 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:07:17.795513 24580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209"
dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:56082
I20260709 13:07:17.796032 24580 raft_consensus.cc:606] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:17.798805 24580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0"
dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:56082
I20260709 13:07:17.799309 24580 raft_consensus.cc:606] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:17.801887 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
mode: GRACEFUL
new_leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
 from {username='slave'} at 127.0.0.1:44280
I20260709 13:07:17.802559 24652 raft_consensus.cc:606] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 LEADER]: Received request to transfer leadership to TS 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:07:17.805598 24580 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e775c3cec51d4d2ab3dfc17e2109ef87"
dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:56082
I20260709 13:07:17.806269 24580 raft_consensus.cc:606] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:17.807356 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:17.808887 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:17.829259 25570 raft_consensus.cc:993] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:17.829931 25628 raft_consensus.cc:1081] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:17.831884 25440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e775c3cec51d4d2ab3dfc17e2109ef87"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47288
I20260709 13:07:17.832516 25440 raft_consensus.cc:493] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:17.832938 25440 raft_consensus.cc:3060] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.840055 25440 raft_consensus.cc:515] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.843410 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e775c3cec51d4d2ab3dfc17e2109ef87" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:17.844003 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e775c3cec51d4d2ab3dfc17e2109ef87" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:17.846570 24727 raft_consensus.cc:3060] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.846752 24580 raft_consensus.cc:3055] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.847121 24580 raft_consensus.cc:740] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:07:17.844439 25440 leader_election.cc:290] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:17.848778 24580 consensus_queue.cc:260] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.849874 24580 raft_consensus.cc:3060] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.864486 24580 raft_consensus.cc:2468] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 2.
I20260709 13:07:17.866703 24727 raft_consensus.cc:2468] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 2.
I20260709 13:07:17.868144 25288 leader_election.cc:304] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:17.869110 25600 raft_consensus.cc:2804] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.869658 25600 raft_consensus.cc:697] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 2 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:17.870649 25600 consensus_queue.cc:237] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.889154 24404 catalog_manager.cc:5697] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 1 to 2, leader changed from 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 2 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.937490 25621 raft_consensus.cc:993] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:17.937958 25570 raft_consensus.cc:1081] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:17.939455 25440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47288
I20260709 13:07:17.940079 25440 raft_consensus.cc:493] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:17.940454 25440 raft_consensus.cc:3060] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.947835 25440 raft_consensus.cc:515] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:17.950640 25440 leader_election.cc:290] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:17.951850 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:17.952245 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90e8fa226feb408abe09d6269eafb209" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:17.952505 24652 raft_consensus.cc:3060] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.951843 25621 raft_consensus.cc:993] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:17.953383 25621 raft_consensus.cc:1081] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:17.954103 24580 raft_consensus.cc:3055] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:17.954622 24580 raft_consensus.cc:740] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:07:17.955391 24580 consensus_queue.cc:260] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:17.956269 25440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47288
I20260709 13:07:17.956668 24580 raft_consensus.cc:3060] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:17.956939 25440 raft_consensus.cc:493] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:17.957347 25440 raft_consensus.cc:3060] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.964052 24580 raft_consensus.cc:2468] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 2.
I20260709 13:07:17.965377 25288 leader_election.cc:304] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:17.966262 25600 raft_consensus.cc:2804] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:17.966965 25600 raft_consensus.cc:697] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 2 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:17.968034 25600 consensus_queue.cc:237] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } }
I20260709 13:07:17.970204 25440 raft_consensus.cc:515] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.972215 24652 raft_consensus.cc:2468] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 2.
I20260709 13:07:17.972607 25440 leader_election.cc:290] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Requested vote from peers 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:17.973356 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:17.974040 24727 raft_consensus.cc:3060] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.974539 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ae22b5647eb41b083a1184bcc60bca0" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:17.975172 24580 raft_consensus.cc:3055] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:17.975507 24580 raft_consensus.cc:740] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9fbc9c105f2a47f6a6a1d298a1b7dc63, State: Running, Role: LEADER
I20260709 13:07:17.976370 24580 consensus_queue.cc:260] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.977767 24580 raft_consensus.cc:3060] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:17.986395 24580 raft_consensus.cc:2468] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:17.987576 25288 leader_election.cc:304] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:17.987735 24404 catalog_manager.cc:5697] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 1 to 2, leader changed from 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 2 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.988595 25600 raft_consensus.cc:2804] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:17.989434 25600 raft_consensus.cc:697] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:17.990401 25600 consensus_queue.cc:237] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:17.998539 24727 raft_consensus.cc:2468] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:18.023855 24404 catalog_manager.cc:5697] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 2 to 3, leader changed from 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 3 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:18.168279 25623 raft_consensus.cc:993] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4: : Instructing follower 3eeda3010ca44374a5bbf85e7980ba1c to start an election
I20260709 13:07:18.168812 25629 raft_consensus.cc:1081] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 LEADER]: Signalling peer 3eeda3010ca44374a5bbf85e7980ba1c to start an election
I20260709 13:07:18.170588 24724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
 from {username='slave'} at 127.0.0.1:48440
I20260709 13:07:18.171096 24724 raft_consensus.cc:493] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.171496 24724 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.177279 24724 raft_consensus.cc:515] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:18.180485 24580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:18.181468 24580 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.181934 24724 leader_election.cc:290] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:18.188699 24580 raft_consensus.cc:2468] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 4.
I20260709 13:07:18.190006 24696 leader_election.cc:304] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:18.190032 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c43fdc79e19f4cf69e4689b91e9df7e1" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:18.190775 24652 raft_consensus.cc:3055] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:18.190886 25638 raft_consensus.cc:2804] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:18.191154 24652 raft_consensus.cc:740] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:18.191525 25638 raft_consensus.cc:697] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:18.192039 24652 consensus_queue.cc:260] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:18.192409 25638 consensus_queue.cc:237] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:18.193399 24652 raft_consensus.cc:3060] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:18.198813 24652 raft_consensus.cc:2468] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 4.
I20260709 13:07:18.201277 24404 catalog_manager.cc:5697] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 3 to 4, leader changed from 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 4 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.356917 25629 raft_consensus.cc:993] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4: : Instructing follower 3eeda3010ca44374a5bbf85e7980ba1c to start an election
I20260709 13:07:18.357523 25659 raft_consensus.cc:1081] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Signalling peer 3eeda3010ca44374a5bbf85e7980ba1c to start an election
I20260709 13:07:18.359196 24727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "652a4c910b344866bc517d7c4e994536"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
 from {username='slave'} at 127.0.0.1:48440
I20260709 13:07:18.359771 24727 raft_consensus.cc:493] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.360180 24727 raft_consensus.cc:3060] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.366595 24727 raft_consensus.cc:515] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:18.369272 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652a4c910b344866bc517d7c4e994536" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:18.369364 24727 leader_election.cc:290] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:18.369485 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652a4c910b344866bc517d7c4e994536" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:18.369877 24582 raft_consensus.cc:3060] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.370182 24655 raft_consensus.cc:3055] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:18.370520 24655 raft_consensus.cc:740] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:18.371340 24655 consensus_queue.cc:260] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:18.372687 24655 raft_consensus.cc:3060] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.377657 24582 raft_consensus.cc:2468] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:18.378996 24696 leader_election.cc:304] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:18.379793 25577 raft_consensus.cc:2804] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:18.379832 24655 raft_consensus.cc:2468] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:18.380399 25577 raft_consensus.cc:697] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:18.381268 25577 consensus_queue.cc:237] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:18.391876 24404 catalog_manager.cc:5697] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.412098 24582 raft_consensus.cc:1275] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.413421 25656 consensus_queue.cc:1048] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.423862 24727 raft_consensus.cc:1275] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.425518 25656 consensus_queue.cc:1048] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.492107 24582 raft_consensus.cc:1275] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:18.493314 25656 consensus_queue.cc:1048] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:18.499866 24582 raft_consensus.cc:1275] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.501744 24655 raft_consensus.cc:1275] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.501672 25608 consensus_queue.cc:1048] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.503280 25600 consensus_queue.cc:1048] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.504205 24724 raft_consensus.cc:1275] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:18.509476 25656 consensus_queue.cc:1048] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:18.625492 24652 raft_consensus.cc:1275] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 4 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:18.626705 25638 consensus_queue.cc:1048] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:18.634199 24582 raft_consensus.cc:1275] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 4 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:18.635929 25577 consensus_queue.cc:1048] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:18.809849 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:18.851595 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:18.852972 24582 raft_consensus.cc:1275] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.854373 25577 consensus_queue.cc:1048] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.874747 24652 raft_consensus.cc:1275] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:18.876694 25638 consensus_queue.cc:1048] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:18.905808 24727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b05be5fc3d34aa0ae910d5a99463f49"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
mode: GRACEFUL
new_leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
 from {username='slave'} at 127.0.0.1:55756
I20260709 13:07:18.906442 24727 raft_consensus.cc:606] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Received request to transfer leadership to TS 0e0c30b65a5d485e89552b4cb36da6b4
I20260709 13:07:18.909313 24727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:55756
I20260709 13:07:18.909825 24727 raft_consensus.cc:606] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:18.910943 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:18.912837 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:18.923038 25577 raft_consensus.cc:993] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:18.923583 25638 raft_consensus.cc:1081] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:18.925025 25419 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47278
I20260709 13:07:18.925487 25419 raft_consensus.cc:493] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.925731 25419 raft_consensus.cc:3060] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.931272 25419 raft_consensus.cc:515] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:18.934733 24655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:18.935364 24655 raft_consensus.cc:3060] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.941731 25419 leader_election.cc:290] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:18.942777 24655 raft_consensus.cc:2468] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:18.942919 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5945ceca673541d8a363891cbb6ac97e" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:18.943601 24727 raft_consensus.cc:3055] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:18.943905 24727 raft_consensus.cc:740] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:18.944020 25286 leader_election.cc:304] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:07:18.944656 24727 consensus_queue.cc:260] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:18.944909 25608 raft_consensus.cc:2804] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:18.945700 25608 raft_consensus.cc:697] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:18.945895 24727 raft_consensus.cc:3060] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.946630 25608 consensus_queue.cc:237] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:18.954349 24727 raft_consensus.cc:2468] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:18.958060 25577 raft_consensus.cc:993] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c: : Instructing follower 0e0c30b65a5d485e89552b4cb36da6b4 to start an election
I20260709 13:07:18.958598 25638 raft_consensus.cc:1081] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Signalling peer 0e0c30b65a5d485e89552b4cb36da6b4 to start an election
I20260709 13:07:18.959450 24401 catalog_manager.cc:5697] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 2 to 3, leader changed from 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 3 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.960194 24655 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b05be5fc3d34aa0ae910d5a99463f49"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
 from {username='slave'} at 127.0.0.1:54222
I20260709 13:07:18.960820 24655 raft_consensus.cc:493] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.961198 24655 raft_consensus.cc:3060] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.968390 24655 raft_consensus.cc:515] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:18.971328 24655 leader_election.cc:290] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:18.971649 24582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b05be5fc3d34aa0ae910d5a99463f49" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:18.972651 24582 raft_consensus.cc:3060] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.973320 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b05be5fc3d34aa0ae910d5a99463f49" candidate_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:18.973951 24727 raft_consensus.cc:3055] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:18.974294 24727 raft_consensus.cc:740] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:18.975049 24727 consensus_queue.cc:260] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:18.982061 24727 raft_consensus.cc:3060] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:18.987641 24582 raft_consensus.cc:2468] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 2.
I20260709 13:07:18.988919 24622 leader_election.cc:304] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:18.989784 25659 raft_consensus.cc:2804] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:18.990284 25659 raft_consensus.cc:697] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Becoming Leader. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:18.990485 24727 raft_consensus.cc:2468] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0c30b65a5d485e89552b4cb36da6b4 in term 2.
I20260709 13:07:18.991122 25659 consensus_queue.cc:237] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:19.011382 24404 catalog_manager.cc:5697] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 reported cstate change: term changed from 1 to 2, leader changed from 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196) to 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.377909 24727 raft_consensus.cc:1275] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:19.379252 25659 consensus_queue.cc:1048] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:19.395392 24582 raft_consensus.cc:1275] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 0e0c30b65a5d485e89552b4cb36da6b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:19.396987 25629 consensus_queue.cc:1048] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:19.412634 24655 raft_consensus.cc:1275] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:19.414857 25600 consensus_queue.cc:1048] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:19.434046 24727 raft_consensus.cc:1275] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:19.435527 25607 consensus_queue.cc:1048] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:19.913830 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:19.959733 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:20.003902 24652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27"
dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
mode: GRACEFUL
new_leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
 from {username='slave'} at 127.0.0.1:44280
I20260709 13:07:20.004613 24652 raft_consensus.cc:606] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Received request to transfer leadership to TS 3eeda3010ca44374a5bbf85e7980ba1c
I20260709 13:07:20.005928 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:07:20.007155 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:20.118059 25659 raft_consensus.cc:993] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4: : Instructing follower 3eeda3010ca44374a5bbf85e7980ba1c to start an election
I20260709 13:07:20.118719 25688 raft_consensus.cc:1081] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Signalling peer 3eeda3010ca44374a5bbf85e7980ba1c to start an election
I20260709 13:07:20.120119 24727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
 from {username='slave'} at 127.0.0.1:48440
I20260709 13:07:20.120548 24727 raft_consensus.cc:493] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:20.120905 24727 raft_consensus.cc:3060] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:20.125669 24727 raft_consensus.cc:515] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:20.127161 24727 leader_election.cc:290] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Requested vote from peers 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385), 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635)
I20260709 13:07:20.127960 24579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63"
I20260709 13:07:20.128309 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5007dd79f86a4afcb717368e91865e27" candidate_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:20.128623 24579 raft_consensus.cc:3060] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:20.128858 24652 raft_consensus.cc:3055] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:20.129168 24652 raft_consensus.cc:740] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e0c30b65a5d485e89552b4cb36da6b4, State: Running, Role: LEADER
I20260709 13:07:20.129894 24652 consensus_queue.cc:260] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:20.131171 24652 raft_consensus.cc:3060] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:20.136545 24579 raft_consensus.cc:2468] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:20.137913 24696 leader_election.cc:304] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c, 9fbc9c105f2a47f6a6a1d298a1b7dc63; no voters: 
I20260709 13:07:20.138209 24652 raft_consensus.cc:2468] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3eeda3010ca44374a5bbf85e7980ba1c in term 2.
I20260709 13:07:20.138876 25678 raft_consensus.cc:2804] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:20.139967 25678 raft_consensus.cc:697] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Leader. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:20.140697 25678 consensus_queue.cc:237] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } }
I20260709 13:07:20.159121 24404 catalog_manager.cc:5697] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c reported cstate change: term changed from 1 to 2, leader changed from 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195) to 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196). New cstate: current_term: 2 leader_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:20.705027 24655 raft_consensus.cc:1275] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.706280 25678 consensus_queue.cc:1048] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:20.717348 24579 raft_consensus.cc:1275] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Refusing update from remote peer 3eeda3010ca44374a5bbf85e7980ba1c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.719098 25577 consensus_queue.cc:1048] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:21.008913 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:21.115586 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:21.179136 24727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce"
dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
mode: GRACEFUL
new_leader_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:55756
I20260709 13:07:21.179888 24727 raft_consensus.cc:606] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Received request to transfer leadership to TS 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:21.181537 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:07:21.183435 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:21.355439 25715 raft_consensus.cc:993] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c: : Instructing follower 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:21.356189 25577 raft_consensus.cc:1081] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Signalling peer 7e0390f5bd00484985fa5469e25be18d to start an election
I20260709 13:07:21.358186 25430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce"
dest_uuid: "7e0390f5bd00484985fa5469e25be18d"
 from {username='slave'} at 127.0.0.1:47278
I20260709 13:07:21.358827 25430 raft_consensus.cc:493] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:21.359193 25430 raft_consensus.cc:3060] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.371258 25430 raft_consensus.cc:515] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:21.374502 24652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0e0c30b65a5d485e89552b4cb36da6b4"
I20260709 13:07:21.374974 24727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fefa199c339342a7a12607fe3298ffce" candidate_uuid: "7e0390f5bd00484985fa5469e25be18d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3eeda3010ca44374a5bbf85e7980ba1c"
I20260709 13:07:21.375511 24652 raft_consensus.cc:3060] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.375640 24727 raft_consensus.cc:3055] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:21.376104 24727 raft_consensus.cc:740] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3eeda3010ca44374a5bbf85e7980ba1c, State: Running, Role: LEADER
I20260709 13:07:21.373986 25430 leader_election.cc:290] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Requested vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196:34879)
I20260709 13:07:21.377097 24727 consensus_queue.cc:260] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:21.378465 24727 raft_consensus.cc:3060] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:21.383255 24652 raft_consensus.cc:2468] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:21.384596 25286 leader_election.cc:304] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d; no voters: 
I20260709 13:07:21.385234 24727 raft_consensus.cc:2468] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e0390f5bd00484985fa5469e25be18d in term 3.
I20260709 13:07:21.385416 25696 raft_consensus.cc:2804] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:21.386006 25696 raft_consensus.cc:697] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Becoming Leader. State: Replica: 7e0390f5bd00484985fa5469e25be18d, State: Running, Role: LEADER
I20260709 13:07:21.387255 25696 consensus_queue.cc:237] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:21.397706 24404 catalog_manager.cc:5697] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d reported cstate change: term changed from 2 to 3, leader changed from 3eeda3010ca44374a5bbf85e7980ba1c (127.13.206.196) to 7e0390f5bd00484985fa5469e25be18d (127.13.206.193). New cstate: current_term: 3 leader_uuid: "7e0390f5bd00484985fa5469e25be18d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:21.793918 24655 raft_consensus.cc:1275] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:21.795071 25696 consensus_queue.cc:1048] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:21.806339 24727 raft_consensus.cc:1275] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Refusing update from remote peer 7e0390f5bd00484985fa5469e25be18d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:21.809028 25696 consensus_queue.cc:1048] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:22.184580 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:22.225776 14139 tablet_server.cc:179] TabletServer@127.13.206.193:40253 shutting down...
W20260709 13:07:22.230616 24545 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 307 similar messages]
W20260709 13:07:22.240989 24545 consensus_peers.cc:597] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.246764 24619 consensus_peers.cc:597] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.269203 24693 consensus_peers.cc:597] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.275903 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:07:22.277105 24693 consensus_peers.cc:597] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.277293 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.279116 14139 raft_consensus.cc:2243] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.280426 14139 raft_consensus.cc:2272] T 90e8fa226feb408abe09d6269eafb209 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.283623 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.284307 14139 raft_consensus.cc:2243] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.284723 14139 raft_consensus.cc:2272] T 56de0c37502d4e8d80b19f4427f256b0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.287060 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.287778 14139 raft_consensus.cc:2243] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.288679 14139 raft_consensus.cc:2272] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.290938 24693 consensus_peers.cc:597] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.292081 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.293102 14139 raft_consensus.cc:2243] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.293702 14139 raft_consensus.cc:2272] T 59192aeb6ab34cdb81981c7024b885c1 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.294099 24545 consensus_peers.cc:597] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.297031 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.297948 14139 raft_consensus.cc:2243] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.298836 14139 raft_consensus.cc:2272] T 5945ceca673541d8a363891cbb6ac97e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.302032 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.302758 14139 raft_consensus.cc:2243] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.303565 14139 raft_consensus.cc:2272] T 6061c3782cb742d0895cd3cb6892588e P 7e0390f5bd00484985fa5469e25be18d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.306785 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.307708 14139 raft_consensus.cc:2243] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.308326 14139 raft_consensus.cc:2272] T 6b2b2b10c2a8445da974e94ac66be680 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.313541 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.314414 14139 raft_consensus.cc:2243] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.315101 14139 raft_consensus.cc:2272] T 8fde674ca95f4161a7f741a822bfe6df P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.318884 14139 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:22.318923 24545 consensus_peers.cc:597] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.319763 14139 raft_consensus.cc:2243] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.320684 14139 raft_consensus.cc:2272] T e775c3cec51d4d2ab3dfc17e2109ef87 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.323676 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.324353 14139 raft_consensus.cc:2243] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.324874 14139 raft_consensus.cc:2272] T 7cfd4cea52324105ba39f2e3d7e4c330 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.324945 24693 consensus_peers.cc:597] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.327487 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.328121 14139 raft_consensus.cc:2243] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.328572 14139 raft_consensus.cc:2272] T 827bf9c0d4a14d209cbef1837ddb425d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.331969 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.332758 14139 raft_consensus.cc:2243] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.333803 14139 raft_consensus.cc:2272] T 3106acd049af4538a29a53f816570f50 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.336768 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.337572 14139 raft_consensus.cc:2243] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.338083 14139 raft_consensus.cc:2272] T 508d2533e8754d53924aecd87664e4fa P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.339987 24693 consensus_peers.cc:597] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.340672 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.341370 14139 raft_consensus.cc:2243] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.342206 14139 raft_consensus.cc:2272] T 90d88b79763a4db4a24e470a3d02f478 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.344581 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.345378 14139 raft_consensus.cc:2243] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.345978 14139 raft_consensus.cc:2272] T 709f942ac0144fc6b272c4a71b5bc224 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.348796 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.349426 14139 raft_consensus.cc:2243] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.350284 14139 raft_consensus.cc:2272] T f04e8125d3094e3fbdf35b449e5afd2e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.352454 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.353065 14139 raft_consensus.cc:2243] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.353904 14139 raft_consensus.cc:2272] T ccd41fd6be624ea6bc27b249b0619443 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.356124 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.356768 14139 raft_consensus.cc:2243] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.357342 14139 raft_consensus.cc:2272] T df176e388c3e486e851d2450693d34ae P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.360074 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.360721 14139 raft_consensus.cc:2243] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.361521 14139 raft_consensus.cc:2272] T cb8100c9df824b0383fbb5f05b846b61 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.364233 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.364822 14139 raft_consensus.cc:2243] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.365325 14139 raft_consensus.cc:2272] T 563bd2fd6aae48ba994effc0e9e35427 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.368145 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.369032 14139 raft_consensus.cc:2243] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.369549 14139 raft_consensus.cc:2272] T bffa83e4678e4efcbe8b21ee2c2a48ad P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.371052 24545 consensus_peers.cc:597] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.372396 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.373502 14139 raft_consensus.cc:2243] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.374034 14139 raft_consensus.cc:2272] T 4161a18cbe354021af90307a3789b890 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.376166 24619 consensus_peers.cc:597] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.378903 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.379837 14139 raft_consensus.cc:2243] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.380513 14139 raft_consensus.cc:2272] T adface6ea0a7412bab90d65a3ed77df8 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.383812 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.384609 14139 raft_consensus.cc:2243] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.385221 14139 raft_consensus.cc:2272] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.388579 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.389434 14139 raft_consensus.cc:2243] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.389952 14139 raft_consensus.cc:2272] T a078959f5dc84592b3f57c5e621ceb3d P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.392750 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.393321 14139 raft_consensus.cc:2243] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.394114 14139 raft_consensus.cc:2272] T d25a32222ca44ec493cfc78f7a31824e P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.396307 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.396858 14139 raft_consensus.cc:2243] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.397271 14139 raft_consensus.cc:2272] T 074fffdc7884498f9ef3ed6915f8dbc0 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.399605 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.400143 14139 raft_consensus.cc:2243] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.400512 14139 raft_consensus.cc:2272] T 8fcff4066e9b4592a94b0522794d5365 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.402750 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.403435 14139 raft_consensus.cc:2243] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.404439 14139 raft_consensus.cc:2272] T fefa199c339342a7a12607fe3298ffce P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.408033 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.408915 14139 raft_consensus.cc:2243] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.409507 14139 raft_consensus.cc:2272] T df4698536ba648bb9b505f77a4cef71b P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.412627 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.413465 14139 raft_consensus.cc:2243] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:22.413854 24619 consensus_peers.cc:597] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.414091 14139 raft_consensus.cc:2272] T bf0b10f5f3b44ddd821edcf5236589ed P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.417479 14139 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:22.417526 24693 consensus_peers.cc:597] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.417521 24619 consensus_peers.cc:597] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.418459 14139 raft_consensus.cc:2243] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.419016 14139 raft_consensus.cc:2272] T 419e360ee50f470b8f48831ac5316b40 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.421792 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.422631 14139 raft_consensus.cc:2243] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.423205 14139 raft_consensus.cc:2272] T edb6450ef5924cec9eacb07c5c4a79ed P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.426532 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.427281 14139 raft_consensus.cc:2243] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:07:22.427739 24693 consensus_peers.cc:597] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.428296 14139 raft_consensus.cc:2272] T f17522023e1e45c5bb9bae9be809cb3b P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.430780 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.431402 14139 raft_consensus.cc:2243] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.431847 14139 raft_consensus.cc:2272] T af12d98819104c6ba6cbc1353f5d5970 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.434027 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.434659 14139 raft_consensus.cc:2243] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.435168 14139 raft_consensus.cc:2272] T 612adbf2e5c7415abb570cbce1f934dd P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.437788 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.438529 14139 raft_consensus.cc:2243] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.439535 14139 raft_consensus.cc:2272] T 9ae22b5647eb41b083a1184bcc60bca0 P 7e0390f5bd00484985fa5469e25be18d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.442174 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.442777 14139 raft_consensus.cc:2243] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.443269 14139 raft_consensus.cc:2272] T 933347c92a6c4612a65f9a7c365bc170 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.444057 24545 consensus_peers.cc:597] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.446506 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.447278 14139 raft_consensus.cc:2243] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.447749 14139 raft_consensus.cc:2272] T baca274246424542b0d38cdab6cb25a5 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.450309 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.450845 14139 raft_consensus.cc:2243] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.451224 14139 raft_consensus.cc:2272] T 06805e79e8c04d6cbbf3fb892cad56cd P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.453420 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.453918 14139 raft_consensus.cc:2243] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.454322 14139 raft_consensus.cc:2272] T 44c7563825eb4e418fa6c9e6a8488191 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.456429 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.457052 14139 raft_consensus.cc:2243] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.457497 14139 raft_consensus.cc:2272] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.460192 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.460777 14139 raft_consensus.cc:2243] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.461218 14139 raft_consensus.cc:2272] T b66a54bd402a430e8012e83b9926ed3c P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.463852 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.464617 14139 raft_consensus.cc:2243] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.465128 14139 raft_consensus.cc:2272] T df168e3caa0d42c896ca63b19c3438d7 P 7e0390f5bd00484985fa5469e25be18d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.467573 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:22.468057 14139 raft_consensus.cc:2243] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.468466 14139 raft_consensus.cc:2272] T d1987f47fa594dbbac6f13e3ffaac7ba P 7e0390f5bd00484985fa5469e25be18d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.471966 24693 consensus_peers.cc:597] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.480580 24693 consensus_peers.cc:597] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.554030 24545 consensus_peers.cc:597] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.554680 24545 consensus_peers.cc:597] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.560690 14139 tablet_server.cc:196] TabletServer@127.13.206.193:40253 shutdown complete.
W20260709 13:07:22.561012 24545 consensus_peers.cc:597] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.576006 24545 consensus_peers.cc:597] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.576440 24545 consensus_peers.cc:597] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.590431 24693 consensus_peers.cc:597] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.592759 24693 consensus_peers.cc:597] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.608969 24619 consensus_peers.cc:597] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.621691 24545 consensus_peers.cc:597] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.660221 14139 tablet_server.cc:179] TabletServer@127.13.206.194:0 shutting down...
W20260709 13:07:22.671898 24696 consensus_peers.cc:597] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.691756 24619 consensus_peers.cc:597] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.714969 24619 consensus_peers.cc:597] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.715462 24619 consensus_peers.cc:597] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.723697 24622 consensus_peers.cc:597] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.740082 24696 consensus_peers.cc:597] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.740126 24545 consensus_peers.cc:597] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 -> Peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Couldn't send request to peer 7e0390f5bd00484985fa5469e25be18d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.745887 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:22.747110 14139 tablet_replica.cc:333] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.747949 14139 raft_consensus.cc:2243] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.748646 14139 raft_consensus.cc:2272] T 5007dd79f86a4afcb717368e91865e27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.751299 14139 tablet_replica.cc:333] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.752159 14139 raft_consensus.cc:2243] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.752823 14139 raft_consensus.cc:2272] T df176e388c3e486e851d2450693d34ae P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.755964 14139 tablet_replica.cc:333] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.756572 14139 raft_consensus.cc:2243] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.757076 14139 raft_consensus.cc:2272] T cb8100c9df824b0383fbb5f05b846b61 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.759413 14139 tablet_replica.cc:333] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.759955 14139 raft_consensus.cc:2243] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.760377 14139 raft_consensus.cc:2272] T c43fdc79e19f4cf69e4689b91e9df7e1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.762432 14139 tablet_replica.cc:333] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.763036 14139 raft_consensus.cc:2243] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.763906 14139 raft_consensus.cc:2272] T 2f37afc8b3624bd09784565977fef62c P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.765988 14139 tablet_replica.cc:333] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.766636 14139 raft_consensus.cc:2243] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.767835 14139 raft_consensus.cc:2272] T 709f942ac0144fc6b272c4a71b5bc224 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.771222 14139 tablet_replica.cc:333] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.772192 14139 raft_consensus.cc:2243] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.772794 14139 raft_consensus.cc:2272] T ccd41fd6be624ea6bc27b249b0619443 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.775102 14139 tablet_replica.cc:333] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.775826 14139 raft_consensus.cc:2243] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.776904 14139 raft_consensus.cc:2272] T 933347c92a6c4612a65f9a7c365bc170 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.779163 14139 tablet_replica.cc:333] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.779846 14139 raft_consensus.cc:2243] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.780872 14139 raft_consensus.cc:2272] T 06805e79e8c04d6cbbf3fb892cad56cd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.784121 14139 tablet_replica.cc:333] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.785040 14139 raft_consensus.cc:2243] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.785650 14139 raft_consensus.cc:2272] T 652a4c910b344866bc517d7c4e994536 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.788409 14139 tablet_replica.cc:333] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.789041 14139 raft_consensus.cc:2243] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.789635 14139 raft_consensus.cc:2272] T 9ae22b5647eb41b083a1184bcc60bca0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.792346 14139 tablet_replica.cc:333] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.793118 14139 raft_consensus.cc:2243] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.794333 14139 raft_consensus.cc:2272] T 59192aeb6ab34cdb81981c7024b885c1 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.797160 14139 tablet_replica.cc:333] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.797933 14139 raft_consensus.cc:2243] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.798506 14139 raft_consensus.cc:2272] T edb6450ef5924cec9eacb07c5c4a79ed P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.800858 14139 tablet_replica.cc:333] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.801658 14139 raft_consensus.cc:2243] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.802155 14139 raft_consensus.cc:2272] T f17522023e1e45c5bb9bae9be809cb3b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.804286 14139 tablet_replica.cc:333] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.804862 14139 raft_consensus.cc:2243] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.805334 14139 raft_consensus.cc:2272] T d25a32222ca44ec493cfc78f7a31824e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.807466 14139 tablet_replica.cc:333] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.808055 14139 raft_consensus.cc:2243] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.808523 14139 raft_consensus.cc:2272] T 8fcff4066e9b4592a94b0522794d5365 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.810731 14139 tablet_replica.cc:333] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.811393 14139 raft_consensus.cc:2243] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.812505 14139 raft_consensus.cc:2272] T a078959f5dc84592b3f57c5e621ceb3d P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.815428 14139 tablet_replica.cc:333] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
W20260709 13:07:22.815800 24622 consensus_peers.cc:597] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.816283 14139 raft_consensus.cc:2243] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.816830 14139 raft_consensus.cc:2272] T 6357dd272feb4d93ab11f73b1e3bead5 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.819408 14139 tablet_replica.cc:333] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.820329 14139 raft_consensus.cc:2243] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.821389 14139 raft_consensus.cc:2272] T 563bd2fd6aae48ba994effc0e9e35427 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.823560 14139 tablet_replica.cc:333] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.824087 14139 raft_consensus.cc:2243] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.824896 14139 raft_consensus.cc:2272] T bffa83e4678e4efcbe8b21ee2c2a48ad P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.827569 14139 tablet_replica.cc:333] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.828351 14139 raft_consensus.cc:2243] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.829020 14139 raft_consensus.cc:2272] T ee94f042219e46ecb9ac23aebbf326b9 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.832046 14139 tablet_replica.cc:333] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.832962 14139 raft_consensus.cc:2243] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.833590 14139 raft_consensus.cc:2272] T 8fde674ca95f4161a7f741a822bfe6df P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.834272 24696 consensus_peers.cc:597] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.835084 24696 consensus_peers.cc:597] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.836521 14139 tablet_replica.cc:333] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.837203 14139 raft_consensus.cc:2243] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.837723 14139 raft_consensus.cc:2272] T e775c3cec51d4d2ab3dfc17e2109ef87 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.840054 14139 tablet_replica.cc:333] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.840636 14139 raft_consensus.cc:2243] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.841060 14139 raft_consensus.cc:2272] T 419e360ee50f470b8f48831ac5316b40 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.843968 14139 tablet_replica.cc:333] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.844722 14139 raft_consensus.cc:2243] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.845229 14139 raft_consensus.cc:2272] T 401126e2c8324c69961e005862f0b23f P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.848543 14139 tablet_replica.cc:333] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.849179 14139 raft_consensus.cc:2243] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.850101 14139 raft_consensus.cc:2272] T 8aba850266fd46739f0f92ff3ac0de00 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.852756 14139 tablet_replica.cc:333] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.853361 14139 raft_consensus.cc:2243] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.853827 14139 raft_consensus.cc:2272] T d1987f47fa594dbbac6f13e3ffaac7ba P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.856127 14139 tablet_replica.cc:333] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.856736 14139 raft_consensus.cc:2243] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.857194 14139 raft_consensus.cc:2272] T 1b05be5fc3d34aa0ae910d5a99463f49 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.859612 14139 tablet_replica.cc:333] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.860351 14139 raft_consensus.cc:2243] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.860893 14139 raft_consensus.cc:2272] T c2adce7a2cbc4be09cbebfdcb64b4438 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.863835 14139 tablet_replica.cc:333] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.864704 14139 raft_consensus.cc:2243] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.865281 14139 raft_consensus.cc:2272] T 29f50121b46a470a88a2ca466f285339 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.867457 14139 tablet_replica.cc:333] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.867974 14139 raft_consensus.cc:2243] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.868378 14139 raft_consensus.cc:2272] T fae7b1c100f1488cbbaafece940169fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.870396 14139 tablet_replica.cc:333] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.870914 14139 raft_consensus.cc:2243] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.871920 14139 raft_consensus.cc:2272] T df4698536ba648bb9b505f77a4cef71b P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.873943 14139 tablet_replica.cc:333] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.874595 14139 raft_consensus.cc:2243] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.875461 14139 raft_consensus.cc:2272] T 56de0c37502d4e8d80b19f4427f256b0 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.877486 14139 tablet_replica.cc:333] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.878121 14139 raft_consensus.cc:2243] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.878729 14139 raft_consensus.cc:2272] T 508d2533e8754d53924aecd87664e4fa P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.881816 14139 tablet_replica.cc:333] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.882579 14139 raft_consensus.cc:2243] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.883296 14139 raft_consensus.cc:2272] T 6061c3782cb742d0895cd3cb6892588e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.886019 14139 tablet_replica.cc:333] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.886930 14139 raft_consensus.cc:2243] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.888267 14139 raft_consensus.cc:2272] T af12d98819104c6ba6cbc1353f5d5970 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.892016 14139 tablet_replica.cc:333] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.893013 14139 raft_consensus.cc:2243] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:07:22.893953 24696 consensus_peers.cc:597] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.894189 14139 raft_consensus.cc:2272] T 612adbf2e5c7415abb570cbce1f934dd P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.897396 14139 tablet_replica.cc:333] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.898183 14139 raft_consensus.cc:2243] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.899353 14139 raft_consensus.cc:2272] T 5c7db6e3ae894339b05d8598c9df859e P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.902086 24622 consensus_peers.cc:597] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.902577 14139 tablet_replica.cc:333] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.903232 14139 raft_consensus.cc:2243] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.903719 14139 raft_consensus.cc:2272] T 3106acd049af4538a29a53f816570f50 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.905846 14139 tablet_replica.cc:333] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.906448 14139 raft_consensus.cc:2243] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.906903 14139 raft_consensus.cc:2272] T 90e8fa226feb408abe09d6269eafb209 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.908996 14139 tablet_replica.cc:333] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.909530 14139 raft_consensus.cc:2243] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.910017 14139 raft_consensus.cc:2272] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.912379 14139 tablet_replica.cc:333] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.912927 14139 raft_consensus.cc:2243] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:22.913906 14139 raft_consensus.cc:2272] T 4161a18cbe354021af90307a3789b890 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.916730 14139 tablet_replica.cc:333] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
I20260709 13:07:22.917457 14139 raft_consensus.cc:2243] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.918099 14139 raft_consensus.cc:2272] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:22.921041 14139 tablet_replica.cc:333] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63: stopping tablet replica
W20260709 13:07:22.921589 24622 consensus_peers.cc:597] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:22.921722 14139 raft_consensus.cc:2243] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:22.922564 14139 raft_consensus.cc:2272] T adface6ea0a7412bab90d65a3ed77df8 P 9fbc9c105f2a47f6a6a1d298a1b7dc63 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:22.941313 24622 consensus_peers.cc:597] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.958671 24622 consensus_peers.cc:597] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:22.988941 24622 consensus_peers.cc:597] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.033515 14139 tablet_server.cc:196] TabletServer@127.13.206.194:0 shutdown complete.
W20260709 13:07:23.034719 24622 consensus_peers.cc:597] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.066401 24696 consensus_peers.cc:597] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.106169 24622 consensus_peers.cc:597] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.116888 24696 consensus_peers.cc:597] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.135428 14139 tablet_server.cc:179] TabletServer@127.13.206.195:0 shutting down...
W20260709 13:07:23.140765 24696 consensus_peers.cc:597] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.145704 24696 consensus_peers.cc:597] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.158958 24696 consensus_peers.cc:597] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.183275 24694 consensus_peers.cc:597] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Couldn't send request to peer 0e0c30b65a5d485e89552b4cb36da6b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.191865 24622 consensus_peers.cc:597] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 -> Peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Couldn't send request to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.194296 24694 consensus_peers.cc:597] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Couldn't send request to peer 0e0c30b65a5d485e89552b4cb36da6b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.201890 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:23.202934 14139 tablet_replica.cc:333] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.203928 14139 raft_consensus.cc:2243] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.204633 14139 raft_consensus.cc:2272] T 4161a18cbe354021af90307a3789b890 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.207118 14139 tablet_replica.cc:333] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.207638 14139 raft_consensus.cc:2243] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.208057 14139 raft_consensus.cc:2272] T f04e8125d3094e3fbdf35b449e5afd2e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.210095 14139 tablet_replica.cc:333] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.210678 14139 raft_consensus.cc:2243] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.211102 14139 raft_consensus.cc:2272] T 5007dd79f86a4afcb717368e91865e27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.213104 14139 tablet_replica.cc:333] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.213657 14139 raft_consensus.cc:2243] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.214058 14139 raft_consensus.cc:2272] T c43fdc79e19f4cf69e4689b91e9df7e1 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.216109 14139 tablet_replica.cc:333] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.216625 14139 raft_consensus.cc:2243] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.217065 14139 raft_consensus.cc:2272] T 2f37afc8b3624bd09784565977fef62c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.219090 14139 tablet_replica.cc:333] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.219614 14139 raft_consensus.cc:2243] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.219990 14139 raft_consensus.cc:2272] T 074fffdc7884498f9ef3ed6915f8dbc0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.222358 14139 tablet_replica.cc:333] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.223067 14139 raft_consensus.cc:2243] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.223608 14139 raft_consensus.cc:2272] T d25a32222ca44ec493cfc78f7a31824e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.226254 14139 tablet_replica.cc:333] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.226922 14139 raft_consensus.cc:2243] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.227367 14139 raft_consensus.cc:2272] T 652a4c910b344866bc517d7c4e994536 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.229328 14139 tablet_replica.cc:333] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.230058 14139 raft_consensus.cc:2243] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.230695 14139 raft_consensus.cc:2272] T 5945ceca673541d8a363891cbb6ac97e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.233481 14139 tablet_replica.cc:333] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.234455 14139 raft_consensus.cc:2243] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.234992 14139 raft_consensus.cc:2272] T 7cfd4cea52324105ba39f2e3d7e4c330 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.237408 14139 tablet_replica.cc:333] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.238265 14139 raft_consensus.cc:2243] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.238827 14139 raft_consensus.cc:2272] T af12d98819104c6ba6cbc1353f5d5970 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.241622 14139 tablet_replica.cc:333] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.242453 14139 raft_consensus.cc:2243] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.243027 14139 raft_consensus.cc:2272] T 612adbf2e5c7415abb570cbce1f934dd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.245700 14139 tablet_replica.cc:333] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.246466 14139 raft_consensus.cc:2243] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.247465 14139 raft_consensus.cc:2272] T edb6450ef5924cec9eacb07c5c4a79ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.249863 14139 tablet_replica.cc:333] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.250545 14139 raft_consensus.cc:2243] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.251016 14139 raft_consensus.cc:2272] T f17522023e1e45c5bb9bae9be809cb3b P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.253087 14139 tablet_replica.cc:333] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.253636 14139 raft_consensus.cc:2243] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.254061 14139 raft_consensus.cc:2272] T 933347c92a6c4612a65f9a7c365bc170 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.256001 14139 tablet_replica.cc:333] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.256520 14139 raft_consensus.cc:2243] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.257279 14139 raft_consensus.cc:2272] T baca274246424542b0d38cdab6cb25a5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.259600 14139 tablet_replica.cc:333] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.260115 14139 raft_consensus.cc:2243] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.261001 14139 raft_consensus.cc:2272] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.263458 14139 tablet_replica.cc:333] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.264238 14139 raft_consensus.cc:2243] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.265312 14139 raft_consensus.cc:2272] T c2adce7a2cbc4be09cbebfdcb64b4438 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.268010 14139 tablet_replica.cc:333] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.268810 14139 raft_consensus.cc:2243] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.269912 14139 raft_consensus.cc:2272] T 1b05be5fc3d34aa0ae910d5a99463f49 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.272747 14139 tablet_replica.cc:333] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.273524 14139 raft_consensus.cc:2243] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.274083 14139 raft_consensus.cc:2272] T a078959f5dc84592b3f57c5e621ceb3d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.276693 14139 tablet_replica.cc:333] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.277418 14139 raft_consensus.cc:2243] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.278218 14139 raft_consensus.cc:2272] T 29f50121b46a470a88a2ca466f285339 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.280336 14139 tablet_replica.cc:333] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.280841 14139 raft_consensus.cc:2243] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.281574 14139 raft_consensus.cc:2272] T df168e3caa0d42c896ca63b19c3438d7 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.283464 14139 tablet_replica.cc:333] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.283923 14139 raft_consensus.cc:2243] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.284317 14139 raft_consensus.cc:2272] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.286140 14139 tablet_replica.cc:333] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.286692 14139 raft_consensus.cc:2243] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.287079 14139 raft_consensus.cc:2272] T 6357dd272feb4d93ab11f73b1e3bead5 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.289111 14139 tablet_replica.cc:333] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.289680 14139 raft_consensus.cc:2243] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.290714 14139 raft_consensus.cc:2272] T ee94f042219e46ecb9ac23aebbf326b9 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.292112 25577 raft_consensus.cc:493] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:23.292672 25577 raft_consensus.cc:515] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:23.293550 14139 tablet_replica.cc:333] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.294477 14139 raft_consensus.cc:2243] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.294757 25577 leader_election.cc:290] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:23.295034 14139 raft_consensus.cc:2272] T bffa83e4678e4efcbe8b21ee2c2a48ad P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.298067 14139 tablet_replica.cc:333] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.298966 14139 raft_consensus.cc:2243] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:23.299525 24693 leader_election.cc:336] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:23.299582 14139 raft_consensus.cc:2272] T 90d88b79763a4db4a24e470a3d02f478 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:23.300643 24696 leader_election.cc:336] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111)
I20260709 13:07:23.301131 24696 leader_election.cc:304] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:23.301867 25577 raft_consensus.cc:2749] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:23.302870 14139 tablet_replica.cc:333] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.303722 14139 raft_consensus.cc:2243] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.304723 14139 raft_consensus.cc:2272] T 401126e2c8324c69961e005862f0b23f P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.306836 14139 tablet_replica.cc:333] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.307406 14139 raft_consensus.cc:2243] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.307830 14139 raft_consensus.cc:2272] T 8aba850266fd46739f0f92ff3ac0de00 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.309780 14139 tablet_replica.cc:333] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.310410 14139 raft_consensus.cc:2243] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.311213 14139 raft_consensus.cc:2272] T 6b2b2b10c2a8445da974e94ac66be680 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.313413 14139 tablet_replica.cc:333] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.313977 14139 raft_consensus.cc:2243] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.314491 14139 raft_consensus.cc:2272] T 827bf9c0d4a14d209cbef1837ddb425d P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.316562 14139 tablet_replica.cc:333] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.317092 14139 raft_consensus.cc:2243] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.317533 14139 raft_consensus.cc:2272] T 56de0c37502d4e8d80b19f4427f256b0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.319670 14139 tablet_replica.cc:333] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.320245 14139 raft_consensus.cc:2243] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.320992 14139 raft_consensus.cc:2272] T fae7b1c100f1488cbbaafece940169fa P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.323067 14139 tablet_replica.cc:333] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.323616 14139 raft_consensus.cc:2243] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.324410 14139 raft_consensus.cc:2272] T bf0b10f5f3b44ddd821edcf5236589ed P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.326578 14139 tablet_replica.cc:333] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.327101 14139 raft_consensus.cc:2243] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.327876 14139 raft_consensus.cc:2272] T 419e360ee50f470b8f48831ac5316b40 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.329787 14139 tablet_replica.cc:333] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.330435 14139 raft_consensus.cc:2243] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.330893 14139 raft_consensus.cc:2272] T 3106acd049af4538a29a53f816570f50 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.332898 14139 tablet_replica.cc:333] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.333420 14139 raft_consensus.cc:2243] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.333873 14139 raft_consensus.cc:2272] T fefa199c339342a7a12607fe3298ffce P 0e0c30b65a5d485e89552b4cb36da6b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.335748 14139 tablet_replica.cc:333] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.336232 14139 raft_consensus.cc:2243] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.336634 14139 raft_consensus.cc:2272] T 5c7db6e3ae894339b05d8598c9df859e P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.338680 14139 tablet_replica.cc:333] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.339180 14139 raft_consensus.cc:2243] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.339592 14139 raft_consensus.cc:2272] T 06805e79e8c04d6cbbf3fb892cad56cd P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.341478 14139 tablet_replica.cc:333] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.341967 14139 raft_consensus.cc:2243] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.342412 14139 raft_consensus.cc:2272] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.344777 14139 tablet_replica.cc:333] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.345312 14139 raft_consensus.cc:2243] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.345796 14139 raft_consensus.cc:2272] T 44c7563825eb4e418fa6c9e6a8488191 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.348136 14139 tablet_replica.cc:333] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.348762 14139 raft_consensus.cc:2243] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.349628 14139 raft_consensus.cc:2272] T b66a54bd402a430e8012e83b9926ed3c P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.351833 14139 tablet_replica.cc:333] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.352358 14139 raft_consensus.cc:2243] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.352823 14139 raft_consensus.cc:2272] T 90e8fa226feb408abe09d6269eafb209 P 0e0c30b65a5d485e89552b4cb36da6b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.355054 14139 tablet_replica.cc:333] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4: stopping tablet replica
I20260709 13:07:23.355719 14139 raft_consensus.cc:2243] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.356621 14139 raft_consensus.cc:2272] T d1987f47fa594dbbac6f13e3ffaac7ba P 0e0c30b65a5d485e89552b4cb36da6b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.361052 25577 raft_consensus.cc:493] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:23.361613 25577 raft_consensus.cc:515] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0c30b65a5d485e89552b4cb36da6b4" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41635 } } peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } }
I20260709 13:07:23.363739 25577 leader_election.cc:290] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635), 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253)
W20260709 13:07:23.366640 24694 leader_election.cc:336] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:07:23.368237 24693 leader_election.cc:336] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:23.368665 24693 leader_election.cc:304] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 0e0c30b65a5d485e89552b4cb36da6b4, 7e0390f5bd00484985fa5469e25be18d
I20260709 13:07:23.369386 25577 raft_consensus.cc:2749] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:23.411535 24694 consensus_peers.cc:597] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Couldn't send request to peer 0e0c30b65a5d485e89552b4cb36da6b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.434849 14139 tablet_server.cc:196] TabletServer@127.13.206.195:0 shutdown complete.
I20260709 13:07:23.454046 25577 raft_consensus.cc:493] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:23.454732 25577 raft_consensus.cc:515] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:23.456445 25577 leader_election.cc:290] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
I20260709 13:07:23.459364 25705 raft_consensus.cc:493] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:23.459926 25705 raft_consensus.cc:515] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:23.462440 25705 leader_election.cc:290] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
W20260709 13:07:23.463702 24693 leader_election.cc:336] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:23.469573 24693 leader_election.cc:336] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
W20260709 13:07:23.471730 24696 leader_election.cc:336] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111)
I20260709 13:07:23.472342 24696 leader_election.cc:304] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
W20260709 13:07:23.473114 24694 consensus_peers.cc:597] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Couldn't send request to peer 0e0c30b65a5d485e89552b4cb36da6b4. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.195:41635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.473165 25705 raft_consensus.cc:2749] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:07:23.476691 24694 consensus_peers.cc:597] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Couldn't send request to peer 0e0c30b65a5d485e89552b4cb36da6b4. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.195:41635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.476902 24696 leader_election.cc:336] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111)
I20260709 13:07:23.477494 24696 leader_election.cc:304] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:23.478211 25705 raft_consensus.cc:2749] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:23.485121 25705 raft_consensus.cc:493] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7e0390f5bd00484985fa5469e25be18d)
I20260709 13:07:23.485774 25705 raft_consensus.cc:515] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3eeda3010ca44374a5bbf85e7980ba1c" member_type: VOTER last_known_addr { host: "127.13.206.196" port: 34879 } } peers { permanent_uuid: "7e0390f5bd00484985fa5469e25be18d" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40253 } } peers { permanent_uuid: "9fbc9c105f2a47f6a6a1d298a1b7dc63" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 46385 } }
I20260709 13:07:23.488242 25705 leader_election.cc:290] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253), 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385)
W20260709 13:07:23.498633 24696 leader_election.cc:336] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9fbc9c105f2a47f6a6a1d298a1b7dc63 (127.13.206.194:46385): Network error: Client connection negotiation failed: client connection to 127.13.206.194:46385: connect: Connection refused (error 111)
W20260709 13:07:23.500411 24693 leader_election.cc:336] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7e0390f5bd00484985fa5469e25be18d (127.13.206.193:40253): Network error: Client connection negotiation failed: client connection to 127.13.206.193:40253: connect: Connection refused (error 111)
I20260709 13:07:23.500942 24693 leader_election.cc:304] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3eeda3010ca44374a5bbf85e7980ba1c; no voters: 7e0390f5bd00484985fa5469e25be18d, 9fbc9c105f2a47f6a6a1d298a1b7dc63
I20260709 13:07:23.501821 25741 raft_consensus.cc:2749] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:07:23.505767 24694 consensus_peers.cc:597] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Couldn't send request to peer 0e0c30b65a5d485e89552b4cb36da6b4. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.195:41635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.522065 14139 tablet_server.cc:179] TabletServer@127.13.206.196:0 shutting down...
W20260709 13:07:23.538475 24694 consensus_peers.cc:597] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Couldn't send request to peer 0e0c30b65a5d485e89552b4cb36da6b4. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.195:41635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.564241 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:23.565263 14139 tablet_replica.cc:333] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.566354 14139 raft_consensus.cc:2243] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.567313 14139 raft_consensus.cc:2272] T 5007dd79f86a4afcb717368e91865e27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.569350 14139 tablet_replica.cc:333] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.569895 14139 raft_consensus.cc:2243] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.570652 14139 raft_consensus.cc:2272] T df176e388c3e486e851d2450693d34ae P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.572672 14139 tablet_replica.cc:333] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.573210 14139 raft_consensus.cc:2243] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.573606 14139 raft_consensus.cc:2272] T cb8100c9df824b0383fbb5f05b846b61 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.575552 14139 tablet_replica.cc:333] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.576077 14139 raft_consensus.cc:2243] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.576455 14139 raft_consensus.cc:2272] T 2f37afc8b3624bd09784565977fef62c P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.578452 14139 tablet_replica.cc:333] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.578951 14139 raft_consensus.cc:2243] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.579701 14139 raft_consensus.cc:2272] T c43fdc79e19f4cf69e4689b91e9df7e1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.581614 14139 tablet_replica.cc:333] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.582106 14139 raft_consensus.cc:2243] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.582559 14139 raft_consensus.cc:2272] T 5945ceca673541d8a363891cbb6ac97e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.584542 14139 tablet_replica.cc:333] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.585080 14139 raft_consensus.cc:2243] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.585850 14139 raft_consensus.cc:2272] T 7cfd4cea52324105ba39f2e3d7e4c330 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.587913 14139 tablet_replica.cc:333] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.588454 14139 raft_consensus.cc:2243] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.588943 14139 raft_consensus.cc:2272] T f04e8125d3094e3fbdf35b449e5afd2e P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.590937 14139 tablet_replica.cc:333] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.591496 14139 raft_consensus.cc:2243] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.591943 14139 raft_consensus.cc:2272] T ccd41fd6be624ea6bc27b249b0619443 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.593977 14139 tablet_replica.cc:333] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.594565 14139 raft_consensus.cc:2243] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.595023 14139 raft_consensus.cc:2272] T 709f942ac0144fc6b272c4a71b5bc224 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.597730 14139 tablet_replica.cc:333] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.598399 14139 raft_consensus.cc:2243] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.598948 14139 raft_consensus.cc:2272] T 59192aeb6ab34cdb81981c7024b885c1 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:23.599745 24694 consensus_peers.cc:597] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Couldn't send request to peer 0e0c30b65a5d485e89552b4cb36da6b4. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.195:41635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.601313 14139 tablet_replica.cc:333] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.601956 14139 raft_consensus.cc:2243] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.602487 14139 raft_consensus.cc:2272] T baca274246424542b0d38cdab6cb25a5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.604542 14139 tablet_replica.cc:333] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.605098 14139 raft_consensus.cc:2243] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.605533 14139 raft_consensus.cc:2272] T fae7b1c100f1488cbbaafece940169fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.607807 14139 tablet_replica.cc:333] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.608412 14139 raft_consensus.cc:2243] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.608887 14139 raft_consensus.cc:2272] T df4698536ba648bb9b505f77a4cef71b P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.611442 14139 tablet_replica.cc:333] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.612380 14139 raft_consensus.cc:2243] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.612948 14139 raft_consensus.cc:2272] T bf0b10f5f3b44ddd821edcf5236589ed P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.615571 14139 tablet_replica.cc:333] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.616303 14139 raft_consensus.cc:2243] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.617333 14139 raft_consensus.cc:2272] T 8fde674ca95f4161a7f741a822bfe6df P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.620115 14139 tablet_replica.cc:333] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.620805 14139 raft_consensus.cc:2243] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.621259 14139 raft_consensus.cc:2272] T 6b2b2b10c2a8445da974e94ac66be680 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.623273 14139 tablet_replica.cc:333] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.623874 14139 raft_consensus.cc:2243] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.624387 14139 raft_consensus.cc:2272] T e775c3cec51d4d2ab3dfc17e2109ef87 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.626466 14139 tablet_replica.cc:333] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.627038 14139 raft_consensus.cc:2243] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.627843 14139 raft_consensus.cc:2272] T 074fffdc7884498f9ef3ed6915f8dbc0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.629880 14139 tablet_replica.cc:333] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.630519 14139 raft_consensus.cc:2243] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.631349 14139 raft_consensus.cc:2272] T 8fcff4066e9b4592a94b0522794d5365 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.633754 14139 tablet_replica.cc:333] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.634387 14139 raft_consensus.cc:2243] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.635195 14139 raft_consensus.cc:2272] T 6357dd272feb4d93ab11f73b1e3bead5 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.637346 14139 tablet_replica.cc:333] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
W20260709 13:07:23.637374 24694 consensus_peers.cc:597] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c -> Peer 0e0c30b65a5d485e89552b4cb36da6b4 (127.13.206.195:41635): Couldn't send request to peer 0e0c30b65a5d485e89552b4cb36da6b4. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.195:41635: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.638013 14139 raft_consensus.cc:2243] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.638540 14139 raft_consensus.cc:2272] T ee94f042219e46ecb9ac23aebbf326b9 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.640631 14139 tablet_replica.cc:333] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.641211 14139 raft_consensus.cc:2243] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.641650 14139 raft_consensus.cc:2272] T 563bd2fd6aae48ba994effc0e9e35427 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.643800 14139 tablet_replica.cc:333] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.644380 14139 raft_consensus.cc:2243] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.644809 14139 raft_consensus.cc:2272] T 2b8dffdf450843a0a7cf0e91c3bd3861 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.646824 14139 tablet_replica.cc:333] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.647393 14139 raft_consensus.cc:2243] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.648259 14139 raft_consensus.cc:2272] T 827bf9c0d4a14d209cbef1837ddb425d P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.650401 14139 tablet_replica.cc:333] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.650976 14139 raft_consensus.cc:2243] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.651441 14139 raft_consensus.cc:2272] T 90d88b79763a4db4a24e470a3d02f478 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.653518 14139 tablet_replica.cc:333] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.654096 14139 raft_consensus.cc:2243] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.654598 14139 raft_consensus.cc:2272] T 401126e2c8324c69961e005862f0b23f P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.656461 14139 tablet_replica.cc:333] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.657023 14139 raft_consensus.cc:2243] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.657428 14139 raft_consensus.cc:2272] T 8aba850266fd46739f0f92ff3ac0de00 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.659741 14139 tablet_replica.cc:333] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.660291 14139 raft_consensus.cc:2243] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.660746 14139 raft_consensus.cc:2272] T 29f50121b46a470a88a2ca466f285339 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.662739 14139 tablet_replica.cc:333] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.663280 14139 raft_consensus.cc:2243] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.663745 14139 raft_consensus.cc:2272] T df168e3caa0d42c896ca63b19c3438d7 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.665752 14139 tablet_replica.cc:333] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.666404 14139 raft_consensus.cc:2243] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.667198 14139 raft_consensus.cc:2272] T 508d2533e8754d53924aecd87664e4fa P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.669170 14139 tablet_replica.cc:333] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.669751 14139 raft_consensus.cc:2243] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.670176 14139 raft_consensus.cc:2272] T fefa199c339342a7a12607fe3298ffce P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.672150 14139 tablet_replica.cc:333] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.672712 14139 raft_consensus.cc:2243] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.673178 14139 raft_consensus.cc:2272] T 5c7db6e3ae894339b05d8598c9df859e P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.675197 14139 tablet_replica.cc:333] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.675750 14139 raft_consensus.cc:2243] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.676548 14139 raft_consensus.cc:2272] T 652a4c910b344866bc517d7c4e994536 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.678591 14139 tablet_replica.cc:333] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.679149 14139 raft_consensus.cc:2243] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.679620 14139 raft_consensus.cc:2272] T 9ae22b5647eb41b083a1184bcc60bca0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.681439 14139 tablet_replica.cc:333] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.681993 14139 raft_consensus.cc:2243] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.682474 14139 raft_consensus.cc:2272] T 4e1b47e2ca4046dabceebdf5efd6ae27 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.684458 14139 tablet_replica.cc:333] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.684983 14139 raft_consensus.cc:2243] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.685712 14139 raft_consensus.cc:2272] T 6c6dec4aa0e24123bf8fb5a0cd30dd77 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.687670 14139 tablet_replica.cc:333] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.688215 14139 raft_consensus.cc:2243] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.688978 14139 raft_consensus.cc:2272] T adface6ea0a7412bab90d65a3ed77df8 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.691033 14139 tablet_replica.cc:333] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.691579 14139 raft_consensus.cc:2243] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.692031 14139 raft_consensus.cc:2272] T 6061c3782cb742d0895cd3cb6892588e P 3eeda3010ca44374a5bbf85e7980ba1c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.694072 14139 tablet_replica.cc:333] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.694691 14139 raft_consensus.cc:2243] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.695123 14139 raft_consensus.cc:2272] T b66a54bd402a430e8012e83b9926ed3c P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.697188 14139 tablet_replica.cc:333] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.697708 14139 raft_consensus.cc:2243] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.698490 14139 raft_consensus.cc:2272] T 44c7563825eb4e418fa6c9e6a8488191 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.700486 14139 tablet_replica.cc:333] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.701020 14139 raft_consensus.cc:2243] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.701751 14139 raft_consensus.cc:2272] T 58f9a01ed3924f7e8f9e3b4e2cd343d0 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.703768 14139 tablet_replica.cc:333] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.704259 14139 raft_consensus.cc:2243] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.704715 14139 raft_consensus.cc:2272] T 1b05be5fc3d34aa0ae910d5a99463f49 P 3eeda3010ca44374a5bbf85e7980ba1c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.706650 14139 tablet_replica.cc:333] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c: stopping tablet replica
I20260709 13:07:23.707125 14139 raft_consensus.cc:2243] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.707543 14139 raft_consensus.cc:2272] T c2adce7a2cbc4be09cbebfdcb64b4438 P 3eeda3010ca44374a5bbf85e7980ba1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.774395 14139 tablet_server.cc:196] TabletServer@127.13.206.196:0 shutdown complete.
I20260709 13:07:23.838402 14139 master.cc:562] Master@127.13.206.254:42253 shutting down...
I20260709 13:07:23.865108 14139 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.865754 14139 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.866110 14139 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8363ad02838347f2863b396b0be1ea69: stopping tablet replica
I20260709 13:07:23.888460 14139 master.cc:584] Master@127.13.206.254:42253 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36164 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:07:23.979668 14139 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.206.254:35753
I20260709 13:07:23.980975 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:23.986979 25743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.987100 25742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:23.988926 25746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:23.988948 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:23.990577 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:23.990779 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:23.990971 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602443990939 us; error 0 us; skew 500 ppm
I20260709 13:07:23.991533 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:23.993973 14139 webserver.cc:533] Webserver started at http://127.13.206.254:40589/ using document root <none> and password file <none>
I20260709 13:07:23.994769 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:23.994975 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:23.995270 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:23.996438 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/master-0-root/instance:
uuid: "f177caa1e82649d2915770eac08f69c0"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-ml7r"
I20260709 13:07:24.000960 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:07:24.004611 25750 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.005396 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:07:24.005707 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/master-0-root
uuid: "f177caa1e82649d2915770eac08f69c0"
format_stamp: "Formatted at 2026-07-09 13:07:23 on dist-test-slave-ml7r"
I20260709 13:07:24.006008 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:24.017743 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:24.019151 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:24.057806 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.254:35753
I20260709 13:07:24.057914 25801 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.254:35753 every 8 connection(s)
I20260709 13:07:24.061851 25802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.072866 25802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0: Bootstrap starting.
I20260709 13:07:24.077689 25802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.082115 25802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0: No bootstrap required, opened a new log
I20260709 13:07:24.084383 25802 raft_consensus.cc:359] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f177caa1e82649d2915770eac08f69c0" member_type: VOTER }
I20260709 13:07:24.084833 25802 raft_consensus.cc:385] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.085110 25802 raft_consensus.cc:740] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f177caa1e82649d2915770eac08f69c0, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.085759 25802 consensus_queue.cc:260] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f177caa1e82649d2915770eac08f69c0" member_type: VOTER }
I20260709 13:07:24.086294 25802 raft_consensus.cc:399] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:24.086537 25802 raft_consensus.cc:493] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:24.086825 25802 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.091640 25802 raft_consensus.cc:515] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f177caa1e82649d2915770eac08f69c0" member_type: VOTER }
I20260709 13:07:24.092257 25802 leader_election.cc:304] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f177caa1e82649d2915770eac08f69c0; no voters: 
I20260709 13:07:24.093411 25802 leader_election.cc:290] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:24.093864 25805 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.095301 25805 raft_consensus.cc:697] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 1 LEADER]: Becoming Leader. State: Replica: f177caa1e82649d2915770eac08f69c0, State: Running, Role: LEADER
I20260709 13:07:24.096024 25805 consensus_queue.cc:237] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f177caa1e82649d2915770eac08f69c0" member_type: VOTER }
I20260709 13:07:24.096568 25802 sys_catalog.cc:565] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:24.101176 25807 sys_catalog.cc:455] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f177caa1e82649d2915770eac08f69c0. Latest consensus state: current_term: 1 leader_uuid: "f177caa1e82649d2915770eac08f69c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f177caa1e82649d2915770eac08f69c0" member_type: VOTER } }
I20260709 13:07:24.101141 25806 sys_catalog.cc:455] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f177caa1e82649d2915770eac08f69c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f177caa1e82649d2915770eac08f69c0" member_type: VOTER } }
I20260709 13:07:24.101994 25807 sys_catalog.cc:458] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:24.102116 25806 sys_catalog.cc:458] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:24.104414 25812 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:24.109835 25812 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:24.115203 14139 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:24.119232 25812 catalog_manager.cc:1383] Generated new cluster ID: 0a54e83135aa4a6eaf78f01e8dc7f58c
I20260709 13:07:24.119555 25812 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:24.140147 25812 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:24.141466 25812 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:24.154309 25812 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0: Generated new TSK 0
I20260709 13:07:24.154978 25812 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:24.188381 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:24.194648 25823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.195734 25824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.197728 25826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:24.198113 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:24.199182 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:24.199393 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:24.199579 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602444199554 us; error 0 us; skew 500 ppm
I20260709 13:07:24.200127 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:24.202512 14139 webserver.cc:533] Webserver started at http://127.13.206.193:35659/ using document root <none> and password file <none>
I20260709 13:07:24.203011 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:24.203212 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:24.203485 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:24.204568 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-0-root/instance:
uuid: "acac180e41d14920bd0350315f8b75c9"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-ml7r"
I20260709 13:07:24.209260 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:07:24.212698 25831 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.213487 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:24.213812 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-0-root
uuid: "acac180e41d14920bd0350315f8b75c9"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-ml7r"
I20260709 13:07:24.214113 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:24.225294 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:24.226699 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:24.228193 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:24.230764 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:24.230955 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.231244 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:24.231416 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.271780 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.193:37129
I20260709 13:07:24.271893 25893 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.193:37129 every 8 connection(s)
I20260709 13:07:24.277433 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:24.285372 25898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.286011 25899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.288923 25901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:24.289119 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:24.290207 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:24.290534 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:24.290709 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602444290689 us; error 0 us; skew 500 ppm
I20260709 13:07:24.291253 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:24.293874 14139 webserver.cc:533] Webserver started at http://127.13.206.194:46387/ using document root <none> and password file <none>
I20260709 13:07:24.294445 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:24.294665 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:24.294940 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:24.296113 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-1-root/instance:
uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-ml7r"
I20260709 13:07:24.296675 25894 heartbeater.cc:344] Connected to a master server at 127.13.206.254:35753
I20260709 13:07:24.297098 25894 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:24.297837 25894 heartbeater.cc:507] Master 127.13.206.254:35753 requested a full tablet report, sending...
I20260709 13:07:24.299999 25767 ts_manager.cc:194] Registered new tserver with Master: acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129)
I20260709 13:07:24.301503 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:07:24.302124 25767 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48122
I20260709 13:07:24.305434 25906 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.306334 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:24.306636 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-1-root
uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-ml7r"
I20260709 13:07:24.306929 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:24.328783 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:24.330070 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:24.331574 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:24.333998 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:24.334270 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.334517 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:24.334689 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.374753 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.194:42183
I20260709 13:07:24.374872 25968 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.194:42183 every 8 connection(s)
I20260709 13:07:24.379813 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:24.388440 25972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.389303 25973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.392598 25975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:24.392782 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:24.393980 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:24.394265 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:24.394449 25969 heartbeater.cc:344] Connected to a master server at 127.13.206.254:35753
I20260709 13:07:24.394474 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602444394456 us; error 0 us; skew 500 ppm
I20260709 13:07:24.395048 25969 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:24.395536 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:24.395982 25969 heartbeater.cc:507] Master 127.13.206.254:35753 requested a full tablet report, sending...
I20260709 13:07:24.398423 25767 ts_manager.cc:194] Registered new tserver with Master: 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:24.398439 14139 webserver.cc:533] Webserver started at http://127.13.206.195:43509/ using document root <none> and password file <none>
I20260709 13:07:24.399123 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:24.399338 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:24.399619 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:24.400179 25767 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48138
I20260709 13:07:24.401250 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-2-root/instance:
uuid: "5270e1a3c44b4438aa7478aac0f2db10"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-ml7r"
I20260709 13:07:24.406334 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:24.409868 25980 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.410737 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:07:24.411080 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-2-root
uuid: "5270e1a3c44b4438aa7478aac0f2db10"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-ml7r"
I20260709 13:07:24.411368 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:24.423013 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:24.424276 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:24.425781 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:24.428210 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:24.428450 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.428699 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:24.428886 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.469898 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.195:34521
I20260709 13:07:24.470000 26042 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.195:34521 every 8 connection(s)
I20260709 13:07:24.484287 26043 heartbeater.cc:344] Connected to a master server at 127.13.206.254:35753
I20260709 13:07:24.484714 26043 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:24.485497 26043 heartbeater.cc:507] Master 127.13.206.254:35753 requested a full tablet report, sending...
I20260709 13:07:24.487648 25767 ts_manager.cc:194] Registered new tserver with Master: 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:24.488181 14139 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014893781s
I20260709 13:07:24.489519 25767 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48140
I20260709 13:07:24.516750 25767 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48144:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:24.519821 25767 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:24.593838 25934 tablet_service.cc:1511] Processing CreateTablet for tablet 8525767dd89448c4a173a8f24f61adba (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:24.595968 25934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8525767dd89448c4a173a8f24f61adba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.598483 25933 tablet_service.cc:1511] Processing CreateTablet for tablet 4a590fc2359d40c29b7385f46f63da54 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:24.600056 25933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a590fc2359d40c29b7385f46f63da54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.601779 25932 tablet_service.cc:1511] Processing CreateTablet for tablet f0e8f9b8bc3c4576976f05cf414220a5 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:24.603399 25932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8f9b8bc3c4576976f05cf414220a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.620373 25931 tablet_service.cc:1511] Processing CreateTablet for tablet e3c9bb914bf048339a39c9af42c0c0a0 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:24.621886 25931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c9bb914bf048339a39c9af42c0c0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.623541 25859 tablet_service.cc:1511] Processing CreateTablet for tablet 8525767dd89448c4a173a8f24f61adba (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:24.625710 25859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8525767dd89448c4a173a8f24f61adba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.627427 26058 tablet_bootstrap.cc:492] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15: Bootstrap starting.
I20260709 13:07:24.629176 25930 tablet_service.cc:1511] Processing CreateTablet for tablet 261eea069e2945fbaea718a92d9920b0 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:24.630688 25930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261eea069e2945fbaea718a92d9920b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.634133 25858 tablet_service.cc:1511] Processing CreateTablet for tablet 4a590fc2359d40c29b7385f46f63da54 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:24.635195 26058 tablet_bootstrap.cc:654] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.635864 25858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a590fc2359d40c29b7385f46f63da54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.637713 25933 tablet_service.cc:1511] Processing CreateTablet for tablet 22c9f0b306484add9940e5947cb3c63c (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:24.639245 25933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c9f0b306484add9940e5947cb3c63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.645119 25929 tablet_service.cc:1511] Processing CreateTablet for tablet d733e5a2389b47b79587469926b7bd1c (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:24.646785 25929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d733e5a2389b47b79587469926b7bd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.649374 26008 tablet_service.cc:1511] Processing CreateTablet for tablet 8525767dd89448c4a173a8f24f61adba (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:24.650985 26008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8525767dd89448c4a173a8f24f61adba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.653206 25928 tablet_service.cc:1511] Processing CreateTablet for tablet 1cccdbedba1f4f808712f240d624ad92 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:24.655398 25927 tablet_service.cc:1511] Processing CreateTablet for tablet 09615d2827524bb88374b9124e1b3a67 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:24.656148 25926 tablet_service.cc:1511] Processing CreateTablet for tablet 86180566196d48cfa37affa4b8cb25ec (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:24.662822 25928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cccdbedba1f4f808712f240d624ad92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.663555 26058 tablet_bootstrap.cc:492] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15: No bootstrap required, opened a new log
I20260709 13:07:24.664191 26058 ts_tablet_manager.cc:1403] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.004s
I20260709 13:07:24.665344 25926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86180566196d48cfa37affa4b8cb25ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.667510 26058 raft_consensus.cc:359] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:24.668308 26058 raft_consensus.cc:385] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.668599 26058 raft_consensus.cc:740] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.670053 25927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09615d2827524bb88374b9124e1b3a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.675693 26058 consensus_queue.cc:260] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:24.680495 26007 tablet_service.cc:1511] Processing CreateTablet for tablet 4a590fc2359d40c29b7385f46f63da54 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:24.682623 26007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a590fc2359d40c29b7385f46f63da54. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.685324 26058 ts_tablet_manager.cc:1434] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent starting tablet: real 0.021s	user 0.012s	sys 0.000s
I20260709 13:07:24.686296 25969 heartbeater.cc:499] Master 127.13.206.254:35753 was elected leader, sending a full tablet report...
I20260709 13:07:24.688004 26006 tablet_service.cc:1511] Processing CreateTablet for tablet f0e8f9b8bc3c4576976f05cf414220a5 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:24.689507 26006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8f9b8bc3c4576976f05cf414220a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.694934 26058 tablet_bootstrap.cc:492] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15: Bootstrap starting.
I20260709 13:07:24.703605 26058 tablet_bootstrap.cc:654] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.714578 25857 tablet_service.cc:1511] Processing CreateTablet for tablet f0e8f9b8bc3c4576976f05cf414220a5 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:24.716328 25857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8f9b8bc3c4576976f05cf414220a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.716727 25854 tablet_service.cc:1511] Processing CreateTablet for tablet 22c9f0b306484add9940e5947cb3c63c (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:24.718163 25854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c9f0b306484add9940e5947cb3c63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.719673 25856 tablet_service.cc:1511] Processing CreateTablet for tablet e3c9bb914bf048339a39c9af42c0c0a0 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:24.721634 25856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c9bb914bf048339a39c9af42c0c0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.723524 25855 tablet_service.cc:1511] Processing CreateTablet for tablet 261eea069e2945fbaea718a92d9920b0 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:24.725032 25855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261eea069e2945fbaea718a92d9920b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.725278 26005 tablet_service.cc:1511] Processing CreateTablet for tablet e3c9bb914bf048339a39c9af42c0c0a0 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:24.726768 26005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c9bb914bf048339a39c9af42c0c0a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.736179 25853 tablet_service.cc:1511] Processing CreateTablet for tablet d733e5a2389b47b79587469926b7bd1c (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:24.737703 25853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d733e5a2389b47b79587469926b7bd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.739501 25852 tablet_service.cc:1511] Processing CreateTablet for tablet 1cccdbedba1f4f808712f240d624ad92 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:24.741047 25852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cccdbedba1f4f808712f240d624ad92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.741354 26003 tablet_service.cc:1511] Processing CreateTablet for tablet 22c9f0b306484add9940e5947cb3c63c (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:24.742794 26003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22c9f0b306484add9940e5947cb3c63c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.743528 25851 tablet_service.cc:1511] Processing CreateTablet for tablet 09615d2827524bb88374b9124e1b3a67 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:24.744911 25851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09615d2827524bb88374b9124e1b3a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.747462 25850 tablet_service.cc:1511] Processing CreateTablet for tablet 86180566196d48cfa37affa4b8cb25ec (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:24.748868 25850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86180566196d48cfa37affa4b8cb25ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.739501 26004 tablet_service.cc:1511] Processing CreateTablet for tablet 261eea069e2945fbaea718a92d9920b0 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:24.751863 26004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261eea069e2945fbaea718a92d9920b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.751893 26002 tablet_service.cc:1511] Processing CreateTablet for tablet d733e5a2389b47b79587469926b7bd1c (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:24.753345 26002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d733e5a2389b47b79587469926b7bd1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.774356 26001 tablet_service.cc:1511] Processing CreateTablet for tablet 1cccdbedba1f4f808712f240d624ad92 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:24.775946 26001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cccdbedba1f4f808712f240d624ad92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.788084 26000 tablet_service.cc:1511] Processing CreateTablet for tablet 09615d2827524bb88374b9124e1b3a67 (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:24.789644 26000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09615d2827524bb88374b9124e1b3a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.847368 26006 tablet_service.cc:1511] Processing CreateTablet for tablet 86180566196d48cfa37affa4b8cb25ec (DEFAULT_TABLE table=test-workload [id=6cf441ce0974406d8831d2e74367ebbb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:24.855832 26006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86180566196d48cfa37affa4b8cb25ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:24.879117 25970 tablet.cc:2406] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:24.936285 26060 raft_consensus.cc:493] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.937124 26060 raft_consensus.cc:515] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:24.975003 26062 tablet_bootstrap.cc:492] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10: Bootstrap starting.
I20260709 13:07:24.978169 26060 leader_election.cc:290] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:24.994884 26058 tablet_bootstrap.cc:492] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15: No bootstrap required, opened a new log
I20260709 13:07:24.995651 26058 ts_tablet_manager.cc:1403] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent bootstrapping tablet: real 0.301s	user 0.087s	sys 0.148s
I20260709 13:07:24.999368 26058 raft_consensus.cc:359] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.000538 26058 raft_consensus.cc:385] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.000964 26058 raft_consensus.cc:740] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.004129 26058 consensus_queue.cc:260] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.016551 26058 ts_tablet_manager.cc:1434] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:07:25.017944 26058 tablet_bootstrap.cc:492] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15: Bootstrap starting.
I20260709 13:07:25.023581 26063 tablet_bootstrap.cc:492] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:25.027263 26058 tablet_bootstrap.cc:654] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.031473 26062 tablet_bootstrap.cc:654] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.050777 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.051644 26063 tablet_bootstrap.cc:654] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.050889 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
W20260709 13:07:25.055152 25908 leader_election.cc:343] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:25.056922 25909 leader_election.cc:343] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.057556 25909 leader_election.cc:304] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9
I20260709 13:07:25.058687 26060 raft_consensus.cc:2749] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:25.063153 26062 tablet_bootstrap.cc:492] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10: No bootstrap required, opened a new log
I20260709 13:07:25.063709 26058 tablet_bootstrap.cc:492] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15: No bootstrap required, opened a new log
I20260709 13:07:25.063792 26062 ts_tablet_manager.cc:1403] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.028s
I20260709 13:07:25.064307 26058 ts_tablet_manager.cc:1403] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.016s
I20260709 13:07:25.064838 26063 tablet_bootstrap.cc:492] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: No bootstrap required, opened a new log
I20260709 13:07:25.065412 26063 ts_tablet_manager.cc:1403] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.007s
I20260709 13:07:25.067440 26058 raft_consensus.cc:359] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.067361 26062 raft_consensus.cc:359] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.068377 26058 raft_consensus.cc:385] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.068499 26062 raft_consensus.cc:385] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.068763 26058 raft_consensus.cc:740] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.068934 26062 raft_consensus.cc:740] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.068624 26063 raft_consensus.cc:359] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:25.069598 26063 raft_consensus.cc:385] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.069994 26063 raft_consensus.cc:740] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.069926 26058 consensus_queue.cc:260] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.070163 26062 consensus_queue.cc:260] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.071213 26063 consensus_queue.cc:260] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:25.072819 26058 ts_tablet_manager.cc:1434] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:07:25.074054 26058 tablet_bootstrap.cc:492] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15: Bootstrap starting.
I20260709 13:07:25.079008 26043 heartbeater.cc:499] Master 127.13.206.254:35753 was elected leader, sending a full tablet report...
I20260709 13:07:25.080724 26062 ts_tablet_manager.cc:1434] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:07:25.082360 26062 tablet_bootstrap.cc:492] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10: Bootstrap starting.
I20260709 13:07:25.088578 26058 tablet_bootstrap.cc:654] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.090898 25894 heartbeater.cc:499] Master 127.13.206.254:35753 was elected leader, sending a full tablet report...
I20260709 13:07:25.091441 26063 ts_tablet_manager.cc:1434] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.026s	user 0.013s	sys 0.014s
I20260709 13:07:25.092159 26062 tablet_bootstrap.cc:654] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.092691 26063 tablet_bootstrap.cc:492] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:25.101284 26063 tablet_bootstrap.cc:654] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.102685 26058 tablet_bootstrap.cc:492] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15: No bootstrap required, opened a new log
I20260709 13:07:25.103322 26058 ts_tablet_manager.cc:1403] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.007s
I20260709 13:07:25.103951 26062 tablet_bootstrap.cc:492] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10: No bootstrap required, opened a new log
I20260709 13:07:25.104516 26062 ts_tablet_manager.cc:1403] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260709 13:07:25.106784 26058 raft_consensus.cc:359] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.107630 26058 raft_consensus.cc:385] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.108011 26058 raft_consensus.cc:740] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.107733 26062 raft_consensus.cc:359] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.108530 26062 raft_consensus.cc:385] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.108857 26062 raft_consensus.cc:740] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.109064 26058 consensus_queue.cc:260] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.109747 26062 consensus_queue.cc:260] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
W20260709 13:07:25.111008 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:25.111847 26062 ts_tablet_manager.cc:1434] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:25.111873 26058 ts_tablet_manager.cc:1434] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:25.113131 26062 tablet_bootstrap.cc:492] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10: Bootstrap starting.
I20260709 13:07:25.113385 26058 tablet_bootstrap.cc:492] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15: Bootstrap starting.
I20260709 13:07:25.120558 26062 tablet_bootstrap.cc:654] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.121096 26058 tablet_bootstrap.cc:654] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.125424 26063 tablet_bootstrap.cc:492] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: No bootstrap required, opened a new log
I20260709 13:07:25.126281 26063 ts_tablet_manager.cc:1403] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.016s
I20260709 13:07:25.130540 26063 raft_consensus.cc:359] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.131399 26063 raft_consensus.cc:385] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.131768 26063 raft_consensus.cc:740] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.132714 26063 consensus_queue.cc:260] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.133890 26069 raft_consensus.cc:493] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.135651 26069 raft_consensus.cc:515] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.137006 26063 ts_tablet_manager.cc:1434] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:07:25.138077 26063 tablet_bootstrap.cc:492] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:25.145202 26069 leader_election.cc:290] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:25.148279 26058 tablet_bootstrap.cc:492] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15: No bootstrap required, opened a new log
I20260709 13:07:25.148445 26070 raft_consensus.cc:493] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.148998 26058 ts_tablet_manager.cc:1403] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.006s
I20260709 13:07:25.149006 26070 raft_consensus.cc:515] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.152456 26058 raft_consensus.cc:359] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.153316 26058 raft_consensus.cc:385] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.153637 26058 raft_consensus.cc:740] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.146108 26063 tablet_bootstrap.cc:654] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.153900 26070 leader_election.cc:290] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.160336 26058 consensus_queue.cc:260] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.163584 26058 ts_tablet_manager.cc:1434] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:07:25.164942 26058 tablet_bootstrap.cc:492] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15: Bootstrap starting.
I20260709 13:07:25.155989 26062 tablet_bootstrap.cc:492] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10: No bootstrap required, opened a new log
I20260709 13:07:25.172859 26062 ts_tablet_manager.cc:1403] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.009s
I20260709 13:07:25.176599 26062 raft_consensus.cc:359] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.178825 26058 tablet_bootstrap.cc:654] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.178910 26062 raft_consensus.cc:385] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.179930 26062 raft_consensus.cc:740] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.181872 26062 consensus_queue.cc:260] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.187115 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.188093 25944 raft_consensus.cc:2468] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 0.
I20260709 13:07:25.188758 26062 ts_tablet_manager.cc:1434] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:07:25.189077 26069 raft_consensus.cc:493] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.189936 26062 tablet_bootstrap.cc:492] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10: Bootstrap starting.
I20260709 13:07:25.189656 26069 raft_consensus.cc:515] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.190366 26063 tablet_bootstrap.cc:492] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: No bootstrap required, opened a new log
I20260709 13:07:25.190923 26063 ts_tablet_manager.cc:1403] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.006s
I20260709 13:07:25.192196 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.187273 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
W20260709 13:07:25.194916 25833 leader_election.cc:343] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.195133 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.195940 25944 raft_consensus.cc:2468] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 0.
I20260709 13:07:25.195660 26063 raft_consensus.cc:359] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.196877 26063 raft_consensus.cc:385] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.196703 25982 leader_election.cc:304] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: 
I20260709 13:07:25.197481 26063 raft_consensus.cc:740] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.189234 26058 tablet_bootstrap.cc:492] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15: No bootstrap required, opened a new log
W20260709 13:07:25.198174 25983 leader_election.cc:343] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.198688 26058 ts_tablet_manager.cc:1403] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.003s
I20260709 13:07:25.198483 26063 consensus_queue.cc:260] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.199786 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.200884 26063 ts_tablet_manager.cc:1434] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:07:25.201220 26069 leader_election.cc:290] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:25.201874 26069 raft_consensus.cc:2804] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:25.202315 26069 raft_consensus.cc:493] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.202018 26063 tablet_bootstrap.cc:492] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:25.202746 26069 raft_consensus.cc:3060] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.201964 26058 raft_consensus.cc:359] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.210399 26058 raft_consensus.cc:385] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:25.210446 25983 leader_election.cc:343] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.211932 26058 raft_consensus.cc:740] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.211972 26069 raft_consensus.cc:515] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.213110 26058 consensus_queue.cc:260] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.215482 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:25.216408 25869 raft_consensus.cc:3060] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.216959 26063 tablet_bootstrap.cc:654] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.216442 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
W20260709 13:07:25.219790 25833 leader_election.cc:343] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.220268 25833 leader_election.cc:304] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acac180e41d14920bd0350315f8b75c9; no voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15
I20260709 13:07:25.221117 26070 raft_consensus.cc:2749] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:25.224635 26069 leader_election.cc:290] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:25.215788 26058 ts_tablet_manager.cc:1434] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 13:07:25.226320 26063 tablet_bootstrap.cc:492] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: No bootstrap required, opened a new log
I20260709 13:07:25.227005 26063 ts_tablet_manager.cc:1403] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.009s
I20260709 13:07:25.229178 25869 raft_consensus.cc:2468] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 1.
I20260709 13:07:25.230314 26063 raft_consensus.cc:359] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.230784 25983 leader_election.cc:304] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:25.231225 26063 raft_consensus.cc:385] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.231650 26063 raft_consensus.cc:740] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.231906 26069 raft_consensus.cc:2804] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.232131 26062 tablet_bootstrap.cc:654] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.232519 26069 raft_consensus.cc:697] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:25.232630 26063 consensus_queue.cc:260] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.233457 26069 consensus_queue.cc:237] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.229410 26058 tablet_bootstrap.cc:492] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15: Bootstrap starting.
I20260709 13:07:25.235309 26063 ts_tablet_manager.cc:1434] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:07:25.236441 26063 tablet_bootstrap.cc:492] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:25.236883 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:25.237521 25944 raft_consensus.cc:3060] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.242961 26063 tablet_bootstrap.cc:654] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.244669 26058 tablet_bootstrap.cc:654] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.246076 25944 raft_consensus.cc:2468] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 1.
I20260709 13:07:25.247682 25982 leader_election.cc:304] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: acac180e41d14920bd0350315f8b75c9
I20260709 13:07:25.252122 26084 raft_consensus.cc:2804] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:25.256481 26084 raft_consensus.cc:493] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.257045 26084 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.257900 26062 tablet_bootstrap.cc:492] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10: No bootstrap required, opened a new log
I20260709 13:07:25.258533 26062 ts_tablet_manager.cc:1403] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.007s
I20260709 13:07:25.257756 25765 catalog_manager.cc:5697] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.259016 26063 tablet_bootstrap.cc:492] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: No bootstrap required, opened a new log
I20260709 13:07:25.260260 26063 ts_tablet_manager.cc:1403] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.006s
I20260709 13:07:25.253762 26058 tablet_bootstrap.cc:492] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15: No bootstrap required, opened a new log
I20260709 13:07:25.261662 26062 raft_consensus.cc:359] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.262667 26062 raft_consensus.cc:385] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.263164 26062 raft_consensus.cc:740] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.262626 26058 ts_tablet_manager.cc:1403] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.007s
I20260709 13:07:25.263689 26063 raft_consensus.cc:359] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.264604 26063 raft_consensus.cc:385] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.265295 26063 raft_consensus.cc:740] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.264534 26062 consensus_queue.cc:260] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.266618 26063 consensus_queue.cc:260] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.267282 26058 raft_consensus.cc:359] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.267932 26062 ts_tablet_manager.cc:1434] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:25.268127 26058 raft_consensus.cc:385] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.268532 26058 raft_consensus.cc:740] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.269346 26063 ts_tablet_manager.cc:1434] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:07:25.269615 26058 consensus_queue.cc:260] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.270777 26063 tablet_bootstrap.cc:492] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:25.276050 26084 raft_consensus.cc:515] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.281489 26063 tablet_bootstrap.cc:654] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.282109 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:25.282519 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:25.283237 25944 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:25.283910 25983 leader_election.cc:343] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.272466 26058 ts_tablet_manager.cc:1434] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:25.269281 26062 tablet_bootstrap.cc:492] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10: Bootstrap starting.
I20260709 13:07:25.291862 26058 tablet_bootstrap.cc:492] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15: Bootstrap starting.
I20260709 13:07:25.293619 26084 leader_election.cc:290] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:25.298157 26063 tablet_bootstrap.cc:492] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: No bootstrap required, opened a new log
I20260709 13:07:25.298981 26063 ts_tablet_manager.cc:1403] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.011s
I20260709 13:07:25.300163 26058 tablet_bootstrap.cc:654] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.300752 25944 raft_consensus.cc:2468] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 1.
I20260709 13:07:25.302363 26063 raft_consensus.cc:359] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.303238 26063 raft_consensus.cc:385] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.303583 26063 raft_consensus.cc:740] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.303438 25982 leader_election.cc:304] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: acac180e41d14920bd0350315f8b75c9
I20260709 13:07:25.304891 26084 raft_consensus.cc:2804] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.304548 26063 consensus_queue.cc:260] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.305478 26084 raft_consensus.cc:697] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:25.306376 26084 consensus_queue.cc:237] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.307631 26063 ts_tablet_manager.cc:1434] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:25.308916 26063 tablet_bootstrap.cc:492] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:25.302371 26062 tablet_bootstrap.cc:654] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.321403 26063 tablet_bootstrap.cc:654] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.328253 26062 tablet_bootstrap.cc:492] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10: No bootstrap required, opened a new log
I20260709 13:07:25.328824 26062 ts_tablet_manager.cc:1403] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.004s
I20260709 13:07:25.328936 26058 tablet_bootstrap.cc:492] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15: No bootstrap required, opened a new log
I20260709 13:07:25.329525 26058 ts_tablet_manager.cc:1403] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.017s
I20260709 13:07:25.329668 26063 tablet_bootstrap.cc:492] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: No bootstrap required, opened a new log
I20260709 13:07:25.330370 26063 ts_tablet_manager.cc:1403] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.005s
I20260709 13:07:25.332130 26062 raft_consensus.cc:359] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.333065 26062 raft_consensus.cc:385] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.333438 26062 raft_consensus.cc:740] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.333731 26063 raft_consensus.cc:359] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.334630 26063 raft_consensus.cc:385] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.334321 26062 consensus_queue.cc:260] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.332291 26058 raft_consensus.cc:359] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.335412 26058 raft_consensus.cc:385] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.335733 26058 raft_consensus.cc:740] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.336335 26063 raft_consensus.cc:740] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.336521 26058 consensus_queue.cc:260] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.337271 26063 consensus_queue.cc:260] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.339784 26063 ts_tablet_manager.cc:1434] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:25.340332 26062 ts_tablet_manager.cc:1434] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:07:25.341074 26063 tablet_bootstrap.cc:492] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:25.341463 26062 tablet_bootstrap.cc:492] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10: Bootstrap starting.
I20260709 13:07:25.342051 25764 catalog_manager.cc:5697] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.348737 26063 tablet_bootstrap.cc:654] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.349021 26058 ts_tablet_manager.cc:1434] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:07:25.349473 26060 raft_consensus.cc:493] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.350159 26058 tablet_bootstrap.cc:492] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15: Bootstrap starting.
I20260709 13:07:25.350029 26060 raft_consensus.cc:515] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.352419 26060 leader_election.cc:290] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.355059 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.355618 26062 tablet_bootstrap.cc:654] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.355854 25869 raft_consensus.cc:2468] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 0.
I20260709 13:07:25.357025 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
I20260709 13:07:25.358338 26058 tablet_bootstrap.cc:654] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:25.358546 25908 leader_election.cc:343] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.359896 25909 leader_election.cc:304] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:25.361562 26063 tablet_bootstrap.cc:492] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: No bootstrap required, opened a new log
I20260709 13:07:25.362392 26063 ts_tablet_manager.cc:1403] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:07:25.366585 26063 raft_consensus.cc:359] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.367715 26063 raft_consensus.cc:385] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.368178 26063 raft_consensus.cc:740] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.369340 26063 consensus_queue.cc:260] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.372961 26063 ts_tablet_manager.cc:1434] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:25.375182 26063 tablet_bootstrap.cc:492] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:25.376362 26058 tablet_bootstrap.cc:492] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15: No bootstrap required, opened a new log
I20260709 13:07:25.376992 26058 ts_tablet_manager.cc:1403] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.016s
I20260709 13:07:25.378455 26070 raft_consensus.cc:493] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.379047 26070 raft_consensus.cc:515] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.380861 26063 tablet_bootstrap.cc:654] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.381253 26070 leader_election.cc:290] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.383544 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.384493 25944 raft_consensus.cc:2468] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acac180e41d14920bd0350315f8b75c9 in term 0.
I20260709 13:07:25.386437 25833 leader_election.cc:304] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:25.372725 26060 raft_consensus.cc:2804] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:25.388805 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
I20260709 13:07:25.389268 26060 raft_consensus.cc:493] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.390053 26060 raft_consensus.cc:3060] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:25.391258 25833 leader_election.cc:343] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.392825 26070 raft_consensus.cc:2804] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:25.393491 26070 raft_consensus.cc:493] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.394029 26070 raft_consensus.cc:3060] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.407594 26058 raft_consensus.cc:359] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.422966 26058 raft_consensus.cc:385] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.423712 26103 raft_consensus.cc:493] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.424212 26058 raft_consensus.cc:740] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.424584 26103 raft_consensus.cc:515] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:25.426991 26058 consensus_queue.cc:260] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.429561 26104 raft_consensus.cc:493] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.430790 26104 raft_consensus.cc:515] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.431514 26070 raft_consensus.cc:515] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.438782 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:25.439760 25944 raft_consensus.cc:3060] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.444384 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8525767dd89448c4a173a8f24f61adba" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
I20260709 13:07:25.442876 25943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8525767dd89448c4a173a8f24f61adba" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.446377 26104 leader_election.cc:290] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.447448 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86180566196d48cfa37affa4b8cb25ec" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
W20260709 13:07:25.448540 25833 leader_election.cc:343] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.436127 26103 leader_election.cc:290] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.448203 25869 raft_consensus.cc:2468] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 0.
I20260709 13:07:25.449550 26103 raft_consensus.cc:493] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.450019 26103 raft_consensus.cc:515] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.450739 25909 leader_election.cc:304] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
W20260709 13:07:25.451390 25833 leader_election.cc:343] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.451920 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86180566196d48cfa37affa4b8cb25ec" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
I20260709 13:07:25.448192 26060 raft_consensus.cc:515] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.452227 26103 leader_election.cc:290] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.455978 26070 leader_election.cc:290] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 election: Requested vote from peers 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
W20260709 13:07:25.458310 25908 leader_election.cc:343] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.452158 25833 leader_election.cc:304] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acac180e41d14920bd0350315f8b75c9; no voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15
I20260709 13:07:25.459954 26070 raft_consensus.cc:2749] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:25.461531 25943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.462039 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:25.462390 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
I20260709 13:07:25.464485 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:25.465135 25869 raft_consensus.cc:3060] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.466086 25943 raft_consensus.cc:2468] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acac180e41d14920bd0350315f8b75c9 in term 0.
I20260709 13:07:25.466385 25944 raft_consensus.cc:2468] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acac180e41d14920bd0350315f8b75c9 in term 1.
I20260709 13:07:25.469252 26058 ts_tablet_manager.cc:1434] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent starting tablet: real 0.092s	user 0.012s	sys 0.000s
I20260709 13:07:25.470374 26058 tablet_bootstrap.cc:492] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15: Bootstrap starting.
I20260709 13:07:25.470378 26062 tablet_bootstrap.cc:492] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10: No bootstrap required, opened a new log
I20260709 13:07:25.454725 26104 raft_consensus.cc:2804] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:25.471549 26104 raft_consensus.cc:493] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.472187 26104 raft_consensus.cc:3060] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.473963 26063 tablet_bootstrap.cc:492] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: No bootstrap required, opened a new log
I20260709 13:07:25.471539 25833 leader_election.cc:304] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:25.474535 26063 ts_tablet_manager.cc:1403] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.100s	user 0.052s	sys 0.041s
I20260709 13:07:25.474910 26070 raft_consensus.cc:2804] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:25.475137 25833 leader_election.cc:343] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.475395 26070 raft_consensus.cc:493] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.477150 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:25.477435 26063 raft_consensus.cc:359] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.478379 26063 raft_consensus.cc:385] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.478420 26070 raft_consensus.cc:3060] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.478788 26063 raft_consensus.cc:740] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.479532 26063 consensus_queue.cc:260] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
W20260709 13:07:25.479926 25908 leader_election.cc:343] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.480687 26060 leader_election.cc:290] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
W20260709 13:07:25.478693 25833 leader_election.cc:343] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.481630 26063 ts_tablet_manager.cc:1434] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:07:25.482491 25833 leader_election.cc:304] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:25.482932 26063 tablet_bootstrap.cc:492] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:25.483867 26103 raft_consensus.cc:2804] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.484457 26058 tablet_bootstrap.cc:654] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.484407 26103 raft_consensus.cc:697] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 1 LEADER]: Becoming Leader. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Running, Role: LEADER
I20260709 13:07:25.485513 26103 consensus_queue.cc:237] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.487695 26062 ts_tablet_manager.cc:1403] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10: Time spent bootstrapping tablet: real 0.146s	user 0.023s	sys 0.071s
I20260709 13:07:25.488716 26063 tablet_bootstrap.cc:654] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.488662 25869 raft_consensus.cc:2468] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 1.
I20260709 13:07:25.490397 25909 leader_election.cc:304] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:25.491451 26105 raft_consensus.cc:2804] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.492481 26105 raft_consensus.cc:697] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:25.491496 26062 raft_consensus.cc:359] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:25.493592 26062 raft_consensus.cc:385] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.493969 26062 raft_consensus.cc:740] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.495126 26062 consensus_queue.cc:260] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:25.498042 26062 ts_tablet_manager.cc:1434] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:07:25.493364 26105 consensus_queue.cc:237] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.499392 26062 tablet_bootstrap.cc:492] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10: Bootstrap starting.
I20260709 13:07:25.505532 26060 raft_consensus.cc:493] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.506523 26060 raft_consensus.cc:515] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.509945 26060 leader_election.cc:290] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.510785 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.511672 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
I20260709 13:07:25.511819 25869 raft_consensus.cc:2468] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 0.
I20260709 13:07:25.512578 26018 raft_consensus.cc:2468] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 0.
I20260709 13:07:25.514182 25908 leader_election.cc:304] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: 
I20260709 13:07:25.515944 26060 raft_consensus.cc:2804] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:25.516690 26060 raft_consensus.cc:493] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.517045 26060 raft_consensus.cc:3060] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.521865 26070 raft_consensus.cc:515] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.522835 26063 tablet_bootstrap.cc:492] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: No bootstrap required, opened a new log
I20260709 13:07:25.523387 26063 ts_tablet_manager.cc:1403] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.012s
I20260709 13:07:25.525082 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:25.525743 26070 leader_election.cc:290] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 election: Requested vote from peers 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.525786 25944 raft_consensus.cc:3060] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.527307 26063 raft_consensus.cc:359] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.527941 26063 raft_consensus.cc:385] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.528111 26063 raft_consensus.cc:740] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.528409 26060 raft_consensus.cc:515] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.528690 26063 consensus_queue.cc:260] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.530200 26063 ts_tablet_manager.cc:1434] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:25.531160 25764 catalog_manager.cc:5697] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.535686 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:25.535931 25944 raft_consensus.cc:2468] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acac180e41d14920bd0350315f8b75c9 in term 1.
W20260709 13:07:25.537242 25833 leader_election.cc:343] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.537494 26104 raft_consensus.cc:515] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.538081 25833 leader_election.cc:304] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:25.538417 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:25.539055 25869 raft_consensus.cc:3060] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.539650 26070 raft_consensus.cc:2804] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.539811 26104 leader_election.cc:290] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.540539 26070 raft_consensus.cc:697] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 1 LEADER]: Becoming Leader. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Running, Role: LEADER
I20260709 13:07:25.541144 26062 tablet_bootstrap.cc:654] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.545557 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:25.544116 25868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86180566196d48cfa37affa4b8cb25ec" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:25.547042 26017 raft_consensus.cc:3060] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.547137 25868 raft_consensus.cc:3060] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.547178 26070 consensus_queue.cc:237] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.544703 25765 catalog_manager.cc:5697] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to acac180e41d14920bd0350315f8b75c9 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "acac180e41d14920bd0350315f8b75c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.545765 26058 tablet_bootstrap.cc:492] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15: No bootstrap required, opened a new log
I20260709 13:07:25.554908 26058 ts_tablet_manager.cc:1403] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent bootstrapping tablet: real 0.085s	user 0.023s	sys 0.002s
I20260709 13:07:25.558391 26084 raft_consensus.cc:493] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.558892 26084 raft_consensus.cc:515] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.559926 26062 tablet_bootstrap.cc:492] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10: No bootstrap required, opened a new log
I20260709 13:07:25.560542 26062 ts_tablet_manager.cc:1403] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.006s
I20260709 13:07:25.560611 26017 raft_consensus.cc:2468] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 1.
I20260709 13:07:25.560971 26084 leader_election.cc:290] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:25.546132 26105 raft_consensus.cc:493] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.562041 25867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cccdbedba1f4f808712f240d624ad92" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.562170 26105 raft_consensus.cc:515] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.562963 25867 raft_consensus.cc:2468] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 0.
I20260709 13:07:25.563664 26062 raft_consensus.cc:359] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.544152 26060 leader_election.cc:290] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.564579 25869 raft_consensus.cc:2468] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 1.
I20260709 13:07:25.564528 25983 leader_election.cc:304] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:25.564545 26062 raft_consensus.cc:385] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.565755 26062 raft_consensus.cc:740] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.565757 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cccdbedba1f4f808712f240d624ad92" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.566044 25909 leader_election.cc:304] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:25.566823 25944 raft_consensus.cc:2468] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 0.
I20260709 13:07:25.565754 26084 raft_consensus.cc:2804] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:25.567513 26105 leader_election.cc:290] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.567055 26062 consensus_queue.cc:260] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.567746 26060 raft_consensus.cc:2804] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.568511 26060 raft_consensus.cc:697] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:25.569821 26062 ts_tablet_manager.cc:1434] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:07:25.569479 26060 consensus_queue.cc:237] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.567721 26084 raft_consensus.cc:493] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.570994 26062 tablet_bootstrap.cc:492] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10: Bootstrap starting.
I20260709 13:07:25.571115 26084 raft_consensus.cc:3060] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.579872 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d733e5a2389b47b79587469926b7bd1c" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
I20260709 13:07:25.580734 26062 tablet_bootstrap.cc:654] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.580664 26017 raft_consensus.cc:2468] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 0.
I20260709 13:07:25.557911 26058 raft_consensus.cc:359] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:25.581867 26058 raft_consensus.cc:385] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.582207 26058 raft_consensus.cc:740] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.582315 26084 raft_consensus.cc:515] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.583081 26058 consensus_queue.cc:260] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:25.585489 26058 ts_tablet_manager.cc:1434] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:07:25.585687 25867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cccdbedba1f4f808712f240d624ad92" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:25.586382 25867 raft_consensus.cc:3060] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.546325 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86180566196d48cfa37affa4b8cb25ec" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:25.588099 25908 leader_election.cc:304] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: 
I20260709 13:07:25.588959 26060 raft_consensus.cc:2804] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:25.589090 25908 leader_election.cc:343] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.589371 26060 raft_consensus.cc:493] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.589807 26060 raft_consensus.cc:3060] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.590123 25869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d733e5a2389b47b79587469926b7bd1c" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.589593 25767 catalog_manager.cc:5697] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.590858 25869 raft_consensus.cc:2468] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 0.
I20260709 13:07:25.594763 25867 raft_consensus.cc:2468] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 1.
I20260709 13:07:25.597093 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cccdbedba1f4f808712f240d624ad92" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:25.598351 25944 raft_consensus.cc:3060] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.601135 26060 raft_consensus.cc:515] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.602334 26062 tablet_bootstrap.cc:492] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10: No bootstrap required, opened a new log
I20260709 13:07:25.602936 26062 ts_tablet_manager.cc:1403] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.010s
I20260709 13:07:25.605108 25866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d733e5a2389b47b79587469926b7bd1c" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:25.605885 25866 raft_consensus.cc:3060] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.608737 25983 leader_election.cc:304] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:25.609964 26089 raft_consensus.cc:2804] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.610586 26089 raft_consensus.cc:697] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:25.611626 26089 consensus_queue.cc:237] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.612221 26062 raft_consensus.cc:359] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.612993 26062 raft_consensus.cc:385] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.613279 26062 raft_consensus.cc:740] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.614223 26062 consensus_queue.cc:260] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.597628 26084 leader_election.cc:290] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:25.615614 25866 raft_consensus.cc:2468] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 1.
I20260709 13:07:25.616729 26062 ts_tablet_manager.cc:1434] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:07:25.607519 25944 raft_consensus.cc:2468] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 1.
I20260709 13:07:25.616324 26060 leader_election.cc:290] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.617825 25909 leader_election.cc:304] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:25.618013 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d733e5a2389b47b79587469926b7bd1c" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:25.617849 26062 tablet_bootstrap.cc:492] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10: Bootstrap starting.
I20260709 13:07:25.618935 26018 raft_consensus.cc:3060] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.618960 26105 raft_consensus.cc:2804] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.622900 26105 raft_consensus.cc:697] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:25.624219 26062 tablet_bootstrap.cc:654] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.623900 26105 consensus_queue.cc:237] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.632807 25766 catalog_manager.cc:5697] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:25.638720 26062 tablet_bootstrap.cc:492] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10: No bootstrap required, opened a new log
I20260709 13:07:25.639243 26062 ts_tablet_manager.cc:1403] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 13:07:25.641310 25765 catalog_manager.cc:5697] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.642023 26062 raft_consensus.cc:359] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.642840 26062 raft_consensus.cc:385] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.643144 26062 raft_consensus.cc:740] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.643941 26062 consensus_queue.cc:260] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.645978 26062 ts_tablet_manager.cc:1434] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:25.647171 26062 tablet_bootstrap.cc:492] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10: Bootstrap starting.
I20260709 13:07:25.648648 26018 raft_consensus.cc:2468] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 1.
I20260709 13:07:25.634644 25764 catalog_manager.cc:5697] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to acac180e41d14920bd0350315f8b75c9 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "acac180e41d14920bd0350315f8b75c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.638532 25868 raft_consensus.cc:2468] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 1.
I20260709 13:07:25.652915 26062 tablet_bootstrap.cc:654] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.653244 25909 leader_election.cc:304] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:25.656576 26105 raft_consensus.cc:2804] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.657585 26105 raft_consensus.cc:697] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:25.658779 26105 consensus_queue.cc:237] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.666204 26062 tablet_bootstrap.cc:492] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10: No bootstrap required, opened a new log
I20260709 13:07:25.666889 26062 ts_tablet_manager.cc:1403] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 13:07:25.669219 26062 raft_consensus.cc:359] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.669708 26062 raft_consensus.cc:385] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.669943 26062 raft_consensus.cc:740] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.670215 25764 catalog_manager.cc:5697] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.670674 26062 consensus_queue.cc:260] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.672427 26062 ts_tablet_manager.cc:1434] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:25.679893 26089 raft_consensus.cc:493] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.680136 26084 consensus_queue.cc:1048] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:25.680469 26089 raft_consensus.cc:515] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.682346 26089 leader_election.cc:290] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:25.682950 25868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.683629 25868 raft_consensus.cc:2393] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5270e1a3c44b4438aa7478aac0f2db10 in current term 1: Already voted for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in this term.
I20260709 13:07:25.683439 25943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.688845 25983 leader_election.cc:304] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10; no voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9
I20260709 13:07:25.695361 26069 raft_consensus.cc:3060] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.701406 26089 raft_consensus.cc:493] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.702383 26089 raft_consensus.cc:515] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.704954 26089 leader_election.cc:290] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:25.705731 25868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86180566196d48cfa37affa4b8cb25ec" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.706557 25868 raft_consensus.cc:2393] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5270e1a3c44b4438aa7478aac0f2db10 in current term 1: Already voted for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in this term.
I20260709 13:07:25.707939 25943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86180566196d48cfa37affa4b8cb25ec" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.710345 25982 leader_election.cc:304] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10; no voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9
I20260709 13:07:25.711531 26089 raft_consensus.cc:3060] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.711555 26084 consensus_queue.cc:1048] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:25.707660 26069 raft_consensus.cc:2749] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:25.723026 26105 raft_consensus.cc:493] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.723722 26105 raft_consensus.cc:515] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:25.725507 26089 raft_consensus.cc:2749] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:25.726092 26105 leader_election.cc:290] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521), acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129)
I20260709 13:07:25.727722 25868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8525767dd89448c4a173a8f24f61adba" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.729451 25868 raft_consensus.cc:2468] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 0.
I20260709 13:07:25.728521 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8525767dd89448c4a173a8f24f61adba" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
I20260709 13:07:25.730459 26018 raft_consensus.cc:2468] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 0.
I20260709 13:07:25.730690 25909 leader_election.cc:304] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:25.731555 26105 raft_consensus.cc:2804] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:25.731937 26105 raft_consensus.cc:493] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.732285 26105 raft_consensus.cc:3060] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.739346 26105 raft_consensus.cc:515] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:25.741487 26105 leader_election.cc:290] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Requested vote from peers 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521), acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129)
I20260709 13:07:25.742410 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8525767dd89448c4a173a8f24f61adba" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:25.742835 25868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8525767dd89448c4a173a8f24f61adba" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:25.743151 26018 raft_consensus.cc:3060] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.743470 25868 raft_consensus.cc:3060] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.750660 26018 raft_consensus.cc:2468] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 1.
I20260709 13:07:25.750660 25868 raft_consensus.cc:2468] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 1.
I20260709 13:07:25.752393 25908 leader_election.cc:304] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: 
I20260709 13:07:25.753242 26105 raft_consensus.cc:2804] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:25.753685 26105 raft_consensus.cc:697] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:25.754532 26105 consensus_queue.cc:237] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:25.761773 25765 catalog_manager.cc:5697] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.765167 26070 raft_consensus.cc:493] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.765686 26070 raft_consensus.cc:515] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.767396 26070 leader_election.cc:290] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:25.768318 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.768667 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "acac180e41d14920bd0350315f8b75c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
I20260709 13:07:25.769140 25944 raft_consensus.cc:2393] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate acac180e41d14920bd0350315f8b75c9 in current term 1: Already voted for candidate 5270e1a3c44b4438aa7478aac0f2db10 in this term.
I20260709 13:07:25.770804 25833 leader_election.cc:304] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: acac180e41d14920bd0350315f8b75c9; no voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15
I20260709 13:07:25.771504 26070 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.776643 26070 raft_consensus.cc:2749] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:25.845441 26089 consensus_queue.cc:1048] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.856211 26084 consensus_queue.cc:1048] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.858662 26084 raft_consensus.cc:493] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.860634 26084 raft_consensus.cc:515] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.863925 26084 leader_election.cc:290] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:25.864540 25868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.865993 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.866856 25944 raft_consensus.cc:2393] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5270e1a3c44b4438aa7478aac0f2db10 in current term 1: Already voted for candidate acac180e41d14920bd0350315f8b75c9 in this term.
I20260709 13:07:25.867741 25982 leader_election.cc:304] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10; no voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9
I20260709 13:07:25.868458 26084 raft_consensus.cc:3060] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.875573 26084 raft_consensus.cc:2749] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:25.918848 26084 raft_consensus.cc:493] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.919358 26084 raft_consensus.cc:515] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:25.921265 26084 leader_election.cc:290] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:25.922024 25868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acac180e41d14920bd0350315f8b75c9" is_pre_election: true
I20260709 13:07:25.922358 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:25.923151 25944 raft_consensus.cc:2393] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5270e1a3c44b4438aa7478aac0f2db10 in current term 1: Already voted for candidate acac180e41d14920bd0350315f8b75c9 in this term.
I20260709 13:07:25.924121 25982 leader_election.cc:304] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10; no voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9
I20260709 13:07:25.924762 26084 raft_consensus.cc:3060] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:25.930217 26084 raft_consensus.cc:2749] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:25.935544 26105 consensus_queue.cc:1048] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.946632 26105 consensus_queue.cc:1048] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.967768 26070 consensus_queue.cc:1048] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:25.980746 26106 consensus_queue.cc:1048] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:25.986666 14139 ts_manager.cc:295] Set tserver state for acac180e41d14920bd0350315f8b75c9 to MAINTENANCE_MODE
I20260709 13:07:25.987646 14139 tablet_server.cc:179] TabletServer@127.13.206.193:0 shutting down...
I20260709 13:07:26.010833 26103 consensus_queue.cc:1048] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:26.032590 26070 consensus_queue.cc:1048] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:26.036230 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:26.037205 14139 tablet_replica.cc:333] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: stopping tablet replica
I20260709 13:07:26.038156 14139 raft_consensus.cc:2243] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:26.038753 14139 raft_consensus.cc:2272] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.041061 14139 tablet_replica.cc:333] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: stopping tablet replica
I20260709 13:07:26.041719 14139 raft_consensus.cc:2243] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:26.042264 14139 raft_consensus.cc:2272] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.044723 14139 tablet_replica.cc:333] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: stopping tablet replica
I20260709 13:07:26.045332 14139 raft_consensus.cc:2243] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:26.046391 14139 raft_consensus.cc:2272] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.048830 14139 tablet_replica.cc:333] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: stopping tablet replica
I20260709 13:07:26.049419 14139 raft_consensus.cc:2243] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:26.049818 14139 raft_consensus.cc:2272] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.051651 14139 tablet_replica.cc:333] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: stopping tablet replica
I20260709 13:07:26.052471 14139 raft_consensus.cc:2243] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:26.053272 14139 raft_consensus.cc:2272] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.055650 14139 tablet_replica.cc:333] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: stopping tablet replica
I20260709 13:07:26.056178 14139 raft_consensus.cc:2243] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:26.056514 14139 raft_consensus.cc:2272] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.058174 14139 tablet_replica.cc:333] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: stopping tablet replica
I20260709 13:07:26.058936 14139 raft_consensus.cc:2243] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:26.059311 14139 raft_consensus.cc:2272] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.061012 14139 tablet_replica.cc:333] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: stopping tablet replica
I20260709 13:07:26.061487 14139 raft_consensus.cc:2243] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:26.061852 14139 raft_consensus.cc:2272] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.064019 14139 tablet_replica.cc:333] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: stopping tablet replica
I20260709 13:07:26.064623 14139 raft_consensus.cc:2243] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:26.065032 14139 raft_consensus.cc:2272] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.067528 14139 tablet_replica.cc:333] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: stopping tablet replica
I20260709 13:07:26.067986 14139 raft_consensus.cc:2243] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:26.068336 14139 raft_consensus.cc:2272] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:26.096217 14139 tablet_server.cc:196] TabletServer@127.13.206.193:0 shutdown complete.
W20260709 13:07:26.103475 25909 consensus_peers.cc:597] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:26.112282 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:26.113992 25983 consensus_peers.cc:597] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:26.117726 26105 consensus_queue.cc:1048] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:26.127693 26060 consensus_queue.cc:1048] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:26.133383 25909 consensus_peers.cc:597] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:26.143767 25983 consensus_peers.cc:597] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:26.199106 26084 consensus_queue.cc:1048] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:26.205428 25909 consensus_peers.cc:597] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:26.218922 25909 consensus_peers.cc:597] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:26.219204 26060 consensus_queue.cc:1048] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:26.288674 26130 consensus_queue.cc:1048] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:26.447798 25909 consensus_peers.cc:597] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:26.480062 25983 consensus_peers.cc:597] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:27.113469 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:27.316493 25909 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111) [suppressed 131 similar messages]
I20260709 13:07:27.479713 26130 raft_consensus.cc:493] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acac180e41d14920bd0350315f8b75c9)
I20260709 13:07:27.480202 26130 raft_consensus.cc:515] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:27.481822 26130 leader_election.cc:290] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:27.483037 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
I20260709 13:07:27.484750 26084 raft_consensus.cc:493] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acac180e41d14920bd0350315f8b75c9)
I20260709 13:07:27.485215 26084 raft_consensus.cc:515] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
W20260709 13:07:27.485736 25909 leader_election.cc:336] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111)
I20260709 13:07:27.486203 25909 leader_election.cc:304] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9
I20260709 13:07:27.486910 26130 raft_consensus.cc:2749] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:27.487251 26084 leader_election.cc:290] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:27.488358 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:27.488952 25944 raft_consensus.cc:2468] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 1.
I20260709 13:07:27.490095 25982 leader_election.cc:304] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: 
I20260709 13:07:27.490841 26084 raft_consensus.cc:2804] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:27.490902 25983 leader_election.cc:336] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111)
I20260709 13:07:27.491320 26084 raft_consensus.cc:493] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting leader election (detected failure of leader acac180e41d14920bd0350315f8b75c9)
I20260709 13:07:27.491683 26084 raft_consensus.cc:3060] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.497614 26084 raft_consensus.cc:515] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:27.499742 26084 leader_election.cc:290] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:27.500923 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:27.501633 25944 raft_consensus.cc:3060] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:27.504730 25983 leader_election.cc:336] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111)
I20260709 13:07:27.509652 25944 raft_consensus.cc:2468] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:27.510915 25982 leader_election.cc:304] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: acac180e41d14920bd0350315f8b75c9
I20260709 13:07:27.511588 26084 raft_consensus.cc:2804] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:27.512429 26084 raft_consensus.cc:697] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:27.513175 26084 consensus_queue.cc:237] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:27.521417 25764 catalog_manager.cc:5697] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 1 to 2, leader changed from acac180e41d14920bd0350315f8b75c9 (127.13.206.193) to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.528854 26130 raft_consensus.cc:493] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acac180e41d14920bd0350315f8b75c9)
I20260709 13:07:27.529608 26130 raft_consensus.cc:515] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:27.531798 26130 leader_election.cc:290] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:27.532913 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10" is_pre_election: true
W20260709 13:07:27.536156 25909 leader_election.cc:336] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111)
I20260709 13:07:27.536576 25909 leader_election.cc:304] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9
I20260709 13:07:27.536870 26084 raft_consensus.cc:493] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acac180e41d14920bd0350315f8b75c9)
I20260709 13:07:27.537339 26130 raft_consensus.cc:2749] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:27.537441 26084 raft_consensus.cc:515] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:27.539466 26084 leader_election.cc:290] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:27.540635 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" is_pre_election: true
I20260709 13:07:27.541314 25944 raft_consensus.cc:2468] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 1.
I20260709 13:07:27.542392 25982 leader_election.cc:304] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: 
W20260709 13:07:27.543037 25983 leader_election.cc:336] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111)
I20260709 13:07:27.543090 26084 raft_consensus.cc:2804] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:27.543533 26084 raft_consensus.cc:493] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting leader election (detected failure of leader acac180e41d14920bd0350315f8b75c9)
I20260709 13:07:27.543823 26084 raft_consensus.cc:3060] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:27.549376 26084 raft_consensus.cc:515] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:27.551097 26084 leader_election.cc:290] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:27.552345 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:27.553022 25944 raft_consensus.cc:3060] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:27.554908 25983 leader_election.cc:336] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111)
I20260709 13:07:27.559999 25944 raft_consensus.cc:2468] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:27.561064 25982 leader_election.cc:304] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: acac180e41d14920bd0350315f8b75c9
I20260709 13:07:27.561736 26084 raft_consensus.cc:2804] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:27.562093 26084 raft_consensus.cc:697] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:27.562903 26084 consensus_queue.cc:237] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:27.570071 25764 catalog_manager.cc:5697] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 1 to 2, leader changed from acac180e41d14920bd0350315f8b75c9 (127.13.206.193) to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.958408 25944 raft_consensus.cc:1275] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:27.959764 26084 consensus_queue.cc:1048] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:27.973945 25983 consensus_peers.cc:597] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:27.977171 25944 raft_consensus.cc:1275] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:27.978816 26146 consensus_queue.cc:1048] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:27.987068 25983 consensus_peers.cc:597] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:28.114529 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:28.455356 25983 consensus_peers.cc:597] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:28.463900 25909 consensus_peers.cc:597] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:28.598148 25909 consensus_peers.cc:597] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:28.719933 25983 consensus_peers.cc:597] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:28.738000 25983 consensus_peers.cc:597] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:28.804231 25909 consensus_peers.cc:597] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:28.835373 25909 consensus_peers.cc:597] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:29.032733 25909 consensus_peers.cc:597] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:29.115484 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:30.116506 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:30.410676 25983 consensus_peers.cc:597] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:30.602767 25983 consensus_peers.cc:597] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:31.040570 25909 consensus_peers.cc:597] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:31.071774 25909 consensus_peers.cc:597] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:31.117810 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:31.120121 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:31.128746 25983 consensus_peers.cc:597] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:31.130059 26164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:31.130494 26165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:31.133414 26167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:31.136629 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:31.138525 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:31.138808 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:31.139009 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602451138992 us; error 0 us; skew 500 ppm
I20260709 13:07:31.139628 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:31.142503 14139 webserver.cc:533] Webserver started at http://127.13.206.193:35659/ using document root <none> and password file <none>
I20260709 13:07:31.143092 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:31.143318 14139 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:07:31.147516 14139 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:07:31.152192 26172 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:31.153105 14139 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:07:31.153468 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-0-root
uuid: "acac180e41d14920bd0350315f8b75c9"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-ml7r"
I20260709 13:07:31.154153 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602098938719-14139-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:07:31.155982 25909 consensus_peers.cc:597] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:31.164542 25983 consensus_peers.cc:597] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:31.188071 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:31.189709 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:31.191390 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:31.195417 26179 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:07:31.234671 25983 consensus_peers.cc:597] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:31.238860 25909 consensus_peers.cc:597] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:31.261708 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:07:31.262079 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.068s	user 0.002s	sys 0.000s
I20260709 13:07:31.262400 14139 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:07:31.268594 26179 tablet_bootstrap.cc:492] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:31.284965 26179 tablet_bootstrap.cc:492] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:31.285892 26179 tablet_bootstrap.cc:492] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: Bootstrap complete.
I20260709 13:07:31.286728 26179 ts_tablet_manager.cc:1403] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:07:31.289927 26179 raft_consensus.cc:359] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.291051 26179 raft_consensus.cc:740] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.291931 26179 consensus_queue.cc:260] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.295222 26179 ts_tablet_manager.cc:1434] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:07:31.296121 26179 tablet_bootstrap.cc:492] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:31.312786 26179 tablet_bootstrap.cc:492] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:31.313805 26179 tablet_bootstrap.cc:492] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: Bootstrap complete.
I20260709 13:07:31.314469 26179 ts_tablet_manager.cc:1403] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 13:07:31.316675 26179 raft_consensus.cc:359] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.317267 26179 raft_consensus.cc:740] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.317956 26179 consensus_queue.cc:260] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.319664 26179 ts_tablet_manager.cc:1434] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:31.320401 26179 tablet_bootstrap.cc:492] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:31.324963 14139 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:07:31.325341 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.063s	user 0.057s	sys 0.003s
I20260709 13:07:31.334331 26179 tablet_bootstrap.cc:492] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:31.335345 26179 tablet_bootstrap.cc:492] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: Bootstrap complete.
I20260709 13:07:31.336225 26179 ts_tablet_manager.cc:1403] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:07:31.338658 26179 raft_consensus.cc:359] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.339277 26179 raft_consensus.cc:740] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.340011 26179 consensus_queue.cc:260] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.341825 26179 ts_tablet_manager.cc:1434] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:31.342767 26179 tablet_bootstrap.cc:492] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:31.355546 26179 tablet_bootstrap.cc:492] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:31.356596 26179 tablet_bootstrap.cc:492] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: Bootstrap complete.
I20260709 13:07:31.357247 26179 ts_tablet_manager.cc:1403] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.003s
I20260709 13:07:31.359324 26179 raft_consensus.cc:359] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.359853 26179 raft_consensus.cc:740] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.360625 26179 consensus_queue.cc:260] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.362473 26179 ts_tablet_manager.cc:1434] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:07:31.363282 26179 tablet_bootstrap.cc:492] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:31.374590 26179 tablet_bootstrap.cc:492] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:31.375326 26179 tablet_bootstrap.cc:492] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: Bootstrap complete.
I20260709 13:07:31.375901 26179 ts_tablet_manager.cc:1403] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:07:31.378582 26179 raft_consensus.cc:359] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.379292 26179 raft_consensus.cc:740] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.380088 26179 consensus_queue.cc:260] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.381759 26179 ts_tablet_manager.cc:1434] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:31.382648 26179 tablet_bootstrap.cc:492] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:31.388590 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.193:37129
I20260709 13:07:31.388798 26241 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.193:37129 every 8 connection(s)
I20260709 13:07:31.394330 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:31.403502 26179 tablet_bootstrap.cc:492] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:31.404704 26179 tablet_bootstrap.cc:492] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: Bootstrap complete.
I20260709 13:07:31.405490 26179 ts_tablet_manager.cc:1403] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:07:31.408572 26179 raft_consensus.cc:359] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.409684 26179 raft_consensus.cc:740] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.410882 26179 consensus_queue.cc:260] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.414075 26179 ts_tablet_manager.cc:1434] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:07:31.415433 26179 tablet_bootstrap.cc:492] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:31.423839 26242 heartbeater.cc:344] Connected to a master server at 127.13.206.254:35753
I20260709 13:07:31.424379 26242 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:31.425416 26242 heartbeater.cc:507] Master 127.13.206.254:35753 requested a full tablet report, sending...
I20260709 13:07:31.430105 25944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
mode: GRACEFUL
new_leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:40802
I20260709 13:07:31.431052 25944 raft_consensus.cc:606] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Received request to transfer leadership to TS 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:31.431914 26179 tablet_bootstrap.cc:492] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:31.432938 26179 tablet_bootstrap.cc:492] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: Bootstrap complete.
I20260709 13:07:31.433588 25766 ts_manager.cc:194] Re-registered known tserver with Master: acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129)
I20260709 13:07:31.433768 26179 ts_tablet_manager.cc:1403] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:07:31.433998 25944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86180566196d48cfa37affa4b8cb25ec"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
mode: GRACEFUL
new_leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:40802
I20260709 13:07:31.434607 25944 raft_consensus.cc:606] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Received request to transfer leadership to TS 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:31.437144 26179 raft_consensus.cc:359] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:31.438305 26179 raft_consensus.cc:740] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.439278 26179 consensus_queue.cc:260] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:31.441438 26179 ts_tablet_manager.cc:1434] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 13:07:31.442327 26179 tablet_bootstrap.cc:492] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:31.449414 26018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
mode: GRACEFUL
new_leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:60134
I20260709 13:07:31.450052 26018 raft_consensus.cc:606] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Received request to transfer leadership to TS 66cca95e9f6d4dbabe5c9254d40cfb15
I20260709 13:07:31.451508 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:31.452049 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:31.452739 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:31.453548 25766 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48158
I20260709 13:07:31.457618 26242 heartbeater.cc:499] Master 127.13.206.254:35753 was elected leader, sending a full tablet report...
I20260709 13:07:31.459230 26179 tablet_bootstrap.cc:492] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:31.460255 26179 tablet_bootstrap.cc:492] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: Bootstrap complete.
I20260709 13:07:31.460906 26179 ts_tablet_manager.cc:1403] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:07:31.463478 26179 raft_consensus.cc:359] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.464231 26179 raft_consensus.cc:740] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.464711 26163 raft_consensus.cc:993] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10: : Instructing follower 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:31.465056 26179 consensus_queue.cc:260] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.465389 26084 raft_consensus.cc:1081] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Signalling peer 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:31.467005 26179 ts_tablet_manager.cc:1434] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:31.467494 25944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:40788
I20260709 13:07:31.467816 26179 tablet_bootstrap.cc:492] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:31.468245 25944 raft_consensus.cc:493] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.468711 25944 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.483069 25944 raft_consensus.cc:515] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.486147 25944 leader_election.cc:290] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 2 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:31.487068 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:31.487928 26018 raft_consensus.cc:3055] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:31.488296 26018 raft_consensus.cc:740] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:31.489427 26018 consensus_queue.cc:260] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.490903 26018 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.493266 26179 tablet_bootstrap.cc:492] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:31.494007 26179 tablet_bootstrap.cc:492] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: Bootstrap complete.
I20260709 13:07:31.494702 26179 ts_tablet_manager.cc:1403] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.011s
I20260709 13:07:31.497624 26179 raft_consensus.cc:359] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.498317 26179 raft_consensus.cc:740] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.499116 26179 consensus_queue.cc:260] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.500712 26179 ts_tablet_manager.cc:1434] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:31.501567 26179 tablet_bootstrap.cc:492] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: Bootstrap starting.
I20260709 13:07:31.513629 26018 raft_consensus.cc:2468] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 2.
I20260709 13:07:31.516243 26214 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:31.517036 26214 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.521617 25908 leader_election.cc:304] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, 66cca95e9f6d4dbabe5c9254d40cfb15; no voters: 
I20260709 13:07:31.522853 26162 raft_consensus.cc:2804] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:31.537322 26259 raft_consensus.cc:993] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15: : Instructing follower 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:31.538113 26259 raft_consensus.cc:1081] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Signalling peer 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:31.540915 26018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:60114
I20260709 13:07:31.541795 26018 raft_consensus.cc:493] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.542382 26018 raft_consensus.cc:3060] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.543455 26213 raft_consensus.cc:3060] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.550346 26179 tablet_bootstrap.cc:492] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:31.552117 26179 tablet_bootstrap.cc:492] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: Bootstrap complete.
I20260709 13:07:31.552927 26179 ts_tablet_manager.cc:1403] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: Time spent bootstrapping tablet: real 0.052s	user 0.030s	sys 0.009s
I20260709 13:07:31.550354 26162 raft_consensus.cc:697] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:31.555464 26214 raft_consensus.cc:2468] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 2.
I20260709 13:07:31.555510 26162 consensus_queue.cc:237] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.556988 26179 raft_consensus.cc:359] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.558362 26179 raft_consensus.cc:740] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: acac180e41d14920bd0350315f8b75c9, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.559917 26179 consensus_queue.cc:260] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.563515 26179 ts_tablet_manager.cc:1434] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:31.574542 26018 raft_consensus.cc:515] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.573129 25764 catalog_manager.cc:5697] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 1 to 2, leader changed from 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195) to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.579694 26216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:31.580346 26216 raft_consensus.cc:3060] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.583297 26018 leader_election.cc:290] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:31.584014 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:31.584784 25944 raft_consensus.cc:3055] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:31.585105 25944 raft_consensus.cc:740] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:31.586062 25944 consensus_queue.cc:260] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.587466 25944 raft_consensus.cc:3060] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.592934 26216 raft_consensus.cc:2468] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:31.594933 25983 leader_election.cc:304] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:31.596071 26163 raft_consensus.cc:2804] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:31.596690 26163 raft_consensus.cc:697] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:31.597971 26163 consensus_queue.cc:237] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.596611 25944 raft_consensus.cc:2468] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:31.616688 25764 catalog_manager.cc:5697] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 1 to 2, leader changed from 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194) to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.837931 26162 raft_consensus.cc:993] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15: : Instructing follower 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:31.838646 26258 raft_consensus.cc:1081] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Signalling peer 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:31.840327 26018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86180566196d48cfa37affa4b8cb25ec"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:60114
I20260709 13:07:31.840848 26018 raft_consensus.cc:493] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:31.841315 26018 raft_consensus.cc:3060] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.848305 26018 raft_consensus.cc:515] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.850462 26018 leader_election.cc:290] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:31.851217 26213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86180566196d48cfa37affa4b8cb25ec" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:31.851523 25944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86180566196d48cfa37affa4b8cb25ec" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:31.852193 25944 raft_consensus.cc:3055] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:31.852362 26213 raft_consensus.cc:3060] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.852505 25944 raft_consensus.cc:740] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:31.853626 25944 consensus_queue.cc:260] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.854699 25944 raft_consensus.cc:3060] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.857411 26216 raft_consensus.cc:3060] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:31.859685 26213 raft_consensus.cc:2468] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:31.860893 25983 leader_election.cc:304] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:31.861629 26084 raft_consensus.cc:2804] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:31.862128 26084 raft_consensus.cc:697] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:31.863052 26084 consensus_queue.cc:237] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:31.863670 25944 raft_consensus.cc:2468] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:31.871842 25764 catalog_manager.cc:5697] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 1 to 2, leader changed from 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194) to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.993489 26216 raft_consensus.cc:1275] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:31.994781 26258 consensus_queue.cc:1048] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.006719 26018 raft_consensus.cc:1275] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.008205 26258 consensus_queue.cc:1048] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:32.118767 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:32.134953 26216 raft_consensus.cc:1275] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.136320 26084 consensus_queue.cc:1048] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.145115 25944 raft_consensus.cc:1275] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.146888 26163 consensus_queue.cc:1048] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.339352 26216 raft_consensus.cc:1275] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.340721 26163 consensus_queue.cc:1048] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.348796 25944 raft_consensus.cc:1275] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:32.351039 26281 consensus_queue.cc:1048] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:32.463886 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:32.470928 26018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
mode: GRACEFUL
new_leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:60134
I20260709 13:07:32.471472 26018 raft_consensus.cc:606] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Received request to transfer leadership to TS 66cca95e9f6d4dbabe5c9254d40cfb15
I20260709 13:07:32.474121 26018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
mode: GRACEFUL
new_leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:60134
I20260709 13:07:32.474629 26018 raft_consensus.cc:606] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Received request to transfer leadership to TS 66cca95e9f6d4dbabe5c9254d40cfb15
I20260709 13:07:32.477069 25943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
mode: GRACEFUL
new_leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:40802
I20260709 13:07:32.477589 25943 raft_consensus.cc:606] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 LEADER]: Received request to transfer leadership to TS 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:32.478778 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:32.479295 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:32.479898 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:32.608378 26160 raft_consensus.cc:993] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15: : Instructing follower 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:32.608976 26258 raft_consensus.cc:1081] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 LEADER]: Signalling peer 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:32.610646 26018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:60114
I20260709 13:07:32.611194 26018 raft_consensus.cc:493] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.611536 26018 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.616452 26018 raft_consensus.cc:515] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:32.617982 26018 leader_election.cc:290] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 3 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:32.618984 26216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:32.619027 25943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:32.619884 26216 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.619982 25943 raft_consensus.cc:3055] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.620378 25943 raft_consensus.cc:740] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:32.621240 25943 consensus_queue.cc:260] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:32.622653 25943 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.628101 26216 raft_consensus.cc:2468] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 3.
I20260709 13:07:32.629654 25983 leader_election.cc:304] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:32.630436 26281 raft_consensus.cc:2804] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.630875 26281 raft_consensus.cc:697] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:32.630882 25943 raft_consensus.cc:2468] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 3.
I20260709 13:07:32.631732 26281 consensus_queue.cc:237] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:32.638823 25764 catalog_manager.cc:5697] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 2 to 3, leader changed from 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194) to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.831820 26281 raft_consensus.cc:993] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10: : Instructing follower 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:32.832373 26084 raft_consensus.cc:1081] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Signalling peer 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:32.833904 25943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:40788
I20260709 13:07:32.834460 25943 raft_consensus.cc:493] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.834800 25943 raft_consensus.cc:3060] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.839934 25943 raft_consensus.cc:515] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:32.841701 25943 leader_election.cc:290] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 2 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:32.842523 26216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:32.842872 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:32.843225 26216 raft_consensus.cc:3060] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.843497 26018 raft_consensus.cc:3055] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:32.843844 26018 raft_consensus.cc:740] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:32.844591 26018 consensus_queue.cc:260] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:32.845602 26018 raft_consensus.cc:3060] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:32.850049 26216 raft_consensus.cc:2468] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 2.
I20260709 13:07:32.851481 25909 leader_election.cc:304] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:32.851735 26018 raft_consensus.cc:2468] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 2.
I20260709 13:07:32.852233 26258 raft_consensus.cc:2804] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:32.852748 26258 raft_consensus.cc:697] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:32.853710 26258 consensus_queue.cc:237] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:32.860921 25764 catalog_manager.cc:5697] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 1 to 2, leader changed from 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195) to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.927556 26281 raft_consensus.cc:993] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10: : Instructing follower 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:32.928071 26084 raft_consensus.cc:1081] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Signalling peer 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:32.929595 25943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:40788
I20260709 13:07:32.930117 25943 raft_consensus.cc:493] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:32.930517 25943 raft_consensus.cc:3060] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.935853 25943 raft_consensus.cc:515] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:32.937633 25943 leader_election.cc:290] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 3 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:32.938582 26216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:32.938841 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "261eea069e2945fbaea718a92d9920b0" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:32.939224 26216 raft_consensus.cc:3060] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.939426 26018 raft_consensus.cc:3055] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:32.939841 26018 raft_consensus.cc:740] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:32.940505 26018 consensus_queue.cc:260] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:32.941433 26018 raft_consensus.cc:3060] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:32.944905 26216 raft_consensus.cc:2468] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 3.
I20260709 13:07:32.946316 25909 leader_election.cc:304] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:32.946486 26018 raft_consensus.cc:2468] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 3.
I20260709 13:07:32.947113 26258 raft_consensus.cc:2804] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:32.947646 26258 raft_consensus.cc:697] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:32.948458 26258 consensus_queue.cc:237] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:32.955245 25764 catalog_manager.cc:5697] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 2 to 3, leader changed from 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195) to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 3 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:33.119652 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:33.218673 26216 raft_consensus.cc:1275] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.220044 26084 consensus_queue.cc:1048] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.225951 25943 raft_consensus.cc:1275] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.227401 26281 consensus_queue.cc:1048] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.249722 26018 raft_consensus.cc:1275] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:33.251035 26258 consensus_queue.cc:1048] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:33.260691 26216 raft_consensus.cc:1275] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:33.262925 26258 consensus_queue.cc:1048] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:33.486304 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:33.494616 26018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
mode: GRACEFUL
new_leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:60134
I20260709 13:07:33.495090 26018 raft_consensus.cc:606] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Received request to transfer leadership to TS 66cca95e9f6d4dbabe5c9254d40cfb15
I20260709 13:07:33.497367 25943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
mode: GRACEFUL
new_leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:40802
I20260709 13:07:33.497962 25943 raft_consensus.cc:606] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Received request to transfer leadership to TS 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:33.500420 25943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
mode: GRACEFUL
new_leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:40802
I20260709 13:07:33.501024 25943 raft_consensus.cc:606] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 LEADER]: Received request to transfer leadership to TS 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:33.502247 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:33.502753 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:33.503402 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:33.518325 26018 raft_consensus.cc:1275] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.519682 26295 consensus_queue.cc:1048] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.531636 26213 raft_consensus.cc:1275] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:33.533767 26258 consensus_queue.cc:1048] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:33.572854 26084 raft_consensus.cc:993] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10: : Instructing follower 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:33.573308 26271 raft_consensus.cc:1081] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Signalling peer 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:33.574828 25943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:40788
I20260709 13:07:33.575341 25943 raft_consensus.cc:493] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.575675 25943 raft_consensus.cc:3060] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.581440 25943 raft_consensus.cc:515] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:33.583299 25943 leader_election.cc:290] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 3 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:33.584264 26213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:33.584286 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09615d2827524bb88374b9124e1b3a67" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:33.585243 26213 raft_consensus.cc:3060] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.585296 26018 raft_consensus.cc:3055] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:33.585798 26018 raft_consensus.cc:740] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:33.586498 26018 consensus_queue.cc:260] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:33.587426 26018 raft_consensus.cc:3060] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.591045 26213 raft_consensus.cc:2468] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 3.
I20260709 13:07:33.592267 25909 leader_election.cc:304] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:33.593148 26258 raft_consensus.cc:2804] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:33.593714 26258 raft_consensus.cc:697] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:33.593914 26018 raft_consensus.cc:2468] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 3.
I20260709 13:07:33.594643 26258 consensus_queue.cc:237] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:33.602346 25766 catalog_manager.cc:5697] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 2 to 3, leader changed from 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195) to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 3 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.838922 26160 raft_consensus.cc:993] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15: : Instructing follower 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:33.839488 26258 raft_consensus.cc:1081] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 LEADER]: Signalling peer 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:33.841307 26018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:60114
I20260709 13:07:33.841862 26018 raft_consensus.cc:493] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.842221 26018 raft_consensus.cc:3060] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.848804 26018 raft_consensus.cc:515] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:33.850317 26018 leader_election.cc:290] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 3 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:33.851397 25943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:33.851415 26213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a590fc2359d40c29b7385f46f63da54" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:33.852186 25943 raft_consensus.cc:3055] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:33.852276 26213 raft_consensus.cc:3060] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.852519 25943 raft_consensus.cc:740] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:33.853365 25943 consensus_queue.cc:260] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:33.854436 25943 raft_consensus.cc:3060] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:33.858503 26213 raft_consensus.cc:2468] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 3.
I20260709 13:07:33.859755 25983 leader_election.cc:304] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:33.859761 25943 raft_consensus.cc:2468] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 3.
I20260709 13:07:33.860780 26303 raft_consensus.cc:2804] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:33.861310 26303 raft_consensus.cc:697] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:33.862068 26303 consensus_queue.cc:237] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:33.868395 25766 catalog_manager.cc:5697] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 2 to 3, leader changed from 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194) to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.896420 26160 raft_consensus.cc:993] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15: : Instructing follower 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:33.896883 26258 raft_consensus.cc:1081] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Signalling peer 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:33.898500 26018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:60114
I20260709 13:07:33.898991 26018 raft_consensus.cc:493] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:33.899286 26018 raft_consensus.cc:3060] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.903901 26018 raft_consensus.cc:515] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:33.905439 26018 leader_election.cc:290] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:33.906453 26213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:33.906522 25943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:33.907346 26213 raft_consensus.cc:3060] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.907724 25943 raft_consensus.cc:3055] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:33.908129 25943 raft_consensus.cc:740] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:33.909083 25943 consensus_queue.cc:260] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:33.910046 25943 raft_consensus.cc:3060] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:33.913365 26213 raft_consensus.cc:2468] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:33.914141 26216 raft_consensus.cc:1240] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Rejecting Update request from peer 66cca95e9f6d4dbabe5c9254d40cfb15 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:33.914680 25983 leader_election.cc:304] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:33.915659 26303 raft_consensus.cc:2804] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:33.916023 25943 raft_consensus.cc:2468] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:33.916231 26303 raft_consensus.cc:697] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:33.917469 26303 consensus_queue.cc:237] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:33.925088 25766 catalog_manager.cc:5697] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 1 to 2, leader changed from 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194) to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:34.044354 26018 raft_consensus.cc:1275] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:34.045588 26258 consensus_queue.cc:1048] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:34.055698 26216 raft_consensus.cc:1275] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:34.057334 26295 consensus_queue.cc:1048] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:34.120659 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:34.370777 25943 raft_consensus.cc:1275] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:34.372296 26303 consensus_queue.cc:1048] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:34.382098 26216 raft_consensus.cc:1275] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:34.383747 26313 consensus_queue.cc:1048] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:34.383975 25943 raft_consensus.cc:1275] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:34.385911 26313 consensus_queue.cc:1048] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:34.401105 26216 raft_consensus.cc:1275] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:34.402841 26313 consensus_queue.cc:1048] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:34.509996 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:34.517526 25943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d733e5a2389b47b79587469926b7bd1c"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
mode: GRACEFUL
new_leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:40802
I20260709 13:07:34.518209 25943 raft_consensus.cc:606] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Received request to transfer leadership to TS 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:34.521019 26018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
mode: GRACEFUL
new_leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:60134
I20260709 13:07:34.521498 26018 raft_consensus.cc:606] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Received request to transfer leadership to TS 66cca95e9f6d4dbabe5c9254d40cfb15
I20260709 13:07:34.523805 26018 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
mode: GRACEFUL
new_leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:60134
I20260709 13:07:34.524269 26018 raft_consensus.cc:606] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 LEADER]: Received request to transfer leadership to TS 66cca95e9f6d4dbabe5c9254d40cfb15
I20260709 13:07:34.525239 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:34.525727 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:34.526320 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:34.652971 26304 raft_consensus.cc:993] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10: : Instructing follower 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:34.653471 26313 raft_consensus.cc:1081] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Signalling peer 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:34.655014 25943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:40788
I20260709 13:07:34.655532 25943 raft_consensus.cc:493] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.655851 25943 raft_consensus.cc:3060] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.661029 25943 raft_consensus.cc:515] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:34.662760 25943 leader_election.cc:290] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 3 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:34.663674 26216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:34.663833 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c9bb914bf048339a39c9af42c0c0a0" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:34.664443 26216 raft_consensus.cc:3060] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.664534 26018 raft_consensus.cc:3055] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:34.664974 26018 raft_consensus.cc:740] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:34.665720 26018 consensus_queue.cc:260] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:34.666738 26018 raft_consensus.cc:3060] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:34.670081 26216 raft_consensus.cc:2468] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 3.
I20260709 13:07:34.671418 25909 leader_election.cc:304] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:34.671569 26018 raft_consensus.cc:2468] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 3.
I20260709 13:07:34.672309 26295 raft_consensus.cc:2804] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:34.672813 26295 raft_consensus.cc:697] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:34.673743 26295 consensus_queue.cc:237] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:34.680627 25764 catalog_manager.cc:5697] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 2 to 3, leader changed from 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195) to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 3 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.937027 26304 raft_consensus.cc:993] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10: : Instructing follower 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:34.937511 26304 raft_consensus.cc:1081] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 LEADER]: Signalling peer 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:34.939577 25943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:40788
I20260709 13:07:34.940143 25943 raft_consensus.cc:493] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.940507 25943 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.946031 25943 raft_consensus.cc:515] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:34.948347 25943 leader_election.cc:290] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 4 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:34.948714 26216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:34.948882 26018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:34.949546 26216 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.949561 26018 raft_consensus.cc:3055] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:34.950096 26018 raft_consensus.cc:740] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:34.950934 26018 consensus_queue.cc:260] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:34.952193 26018 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.954699 26317 raft_consensus.cc:993] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15: : Instructing follower 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:34.955282 26295 raft_consensus.cc:1081] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Signalling peer 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:34.957072 26017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d733e5a2389b47b79587469926b7bd1c"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:60114
I20260709 13:07:34.957427 26216 raft_consensus.cc:2468] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 4.
I20260709 13:07:34.957603 26017 raft_consensus.cc:493] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.958060 26017 raft_consensus.cc:3060] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.958712 25909 leader_election.cc:304] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:34.959383 26018 raft_consensus.cc:2468] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 4.
I20260709 13:07:34.959611 26295 raft_consensus.cc:2804] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:34.960228 26295 raft_consensus.cc:697] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 4 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:34.961107 26295 consensus_queue.cc:237] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:34.966202 26017 raft_consensus.cc:515] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:34.968598 26017 leader_election.cc:290] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:34.969249 26216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d733e5a2389b47b79587469926b7bd1c" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:34.969992 26216 raft_consensus.cc:3060] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.970178 25943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d733e5a2389b47b79587469926b7bd1c" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:34.970791 25943 raft_consensus.cc:3055] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:34.971020 25943 raft_consensus.cc:740] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:34.971812 25943 consensus_queue.cc:260] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:34.972859 25943 raft_consensus.cc:3060] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.969681 25764 catalog_manager.cc:5697] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 3 to 4, leader changed from 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195) to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 4 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.976104 26216 raft_consensus.cc:2468] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:34.978556 25943 raft_consensus.cc:2468] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:34.978897 25983 leader_election.cc:304] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:34.979832 26304 raft_consensus.cc:2804] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:34.980305 26304 raft_consensus.cc:697] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:34.981251 26304 consensus_queue.cc:237] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:34.988605 25764 catalog_manager.cc:5697] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 1 to 2, leader changed from 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194) to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.099835 26216 raft_consensus.cc:1275] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.101157 26295 consensus_queue.cc:1048] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:35.111680 26017 raft_consensus.cc:1275] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:35.113723 26160 consensus_queue.cc:1048] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:35.121834 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:35.373368 26216 raft_consensus.cc:1275] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:35.374944 26304 consensus_queue.cc:1048] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:35.385967 25943 raft_consensus.cc:1275] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:35.387830 26303 consensus_queue.cc:1048] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:35.460150 26017 raft_consensus.cc:1275] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 4 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:35.461413 26295 consensus_queue.cc:1048] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:35.470100 26216 raft_consensus.cc:1275] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 4 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:35.471827 26295 consensus_queue.cc:1048] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:35.534397 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.542613 26017 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
mode: GRACEFUL
new_leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:60134
I20260709 13:07:35.543150 26017 raft_consensus.cc:606] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Received request to transfer leadership to TS 66cca95e9f6d4dbabe5c9254d40cfb15
I20260709 13:07:35.545698 25943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8525767dd89448c4a173a8f24f61adba"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
mode: GRACEFUL
new_leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:40802
I20260709 13:07:35.546149 25943 raft_consensus.cc:606] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Received request to transfer leadership to TS 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:35.548687 25943 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
mode: GRACEFUL
new_leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:40802
I20260709 13:07:35.549145 25943 raft_consensus.cc:606] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 4 LEADER]: Received request to transfer leadership to TS 5270e1a3c44b4438aa7478aac0f2db10
I20260709 13:07:35.550156 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:35.550707 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:35.551244 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.697477 26317 raft_consensus.cc:993] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15: : Instructing follower 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:35.698195 26317 raft_consensus.cc:1081] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Signalling peer 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:35.699692 26017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8525767dd89448c4a173a8f24f61adba"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:60114
I20260709 13:07:35.700214 26017 raft_consensus.cc:493] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.700541 26017 raft_consensus.cc:3060] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:35.706588 26017 raft_consensus.cc:515] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:35.708751 26017 leader_election.cc:290] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Requested vote from peers 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183), acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129)
I20260709 13:07:35.709635 25943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8525767dd89448c4a173a8f24f61adba" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:35.710278 25943 raft_consensus.cc:3055] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:35.710551 26216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8525767dd89448c4a173a8f24f61adba" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:35.710564 25943 raft_consensus.cc:740] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:35.711102 26216 raft_consensus.cc:3060] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:35.711532 25943 consensus_queue.cc:260] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:35.712545 25943 raft_consensus.cc:3060] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:35.716018 26216 raft_consensus.cc:2468] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:35.717293 25983 leader_election.cc:304] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:35.717572 25943 raft_consensus.cc:2468] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 2.
I20260709 13:07:35.718146 26303 raft_consensus.cc:2804] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:35.719163 26303 raft_consensus.cc:697] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:35.720593 26303 consensus_queue.cc:237] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } }
I20260709 13:07:35.728152 25765 catalog_manager.cc:5697] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 1 to 2, leader changed from 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194) to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.909521 26160 raft_consensus.cc:993] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15: : Instructing follower 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:35.910005 26317 raft_consensus.cc:1081] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 4 LEADER]: Signalling peer 5270e1a3c44b4438aa7478aac0f2db10 to start an election
I20260709 13:07:35.911453 26017 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5"
dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
 from {username='slave'} at 127.0.0.1:60114
I20260709 13:07:35.911983 26017 raft_consensus.cc:493] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.912315 26017 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.917518 26017 raft_consensus.cc:515] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:35.919180 26017 leader_election.cc:290] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 5 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183)
I20260709 13:07:35.920115 26216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:35.920159 25943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0e8f9b8bc3c4576976f05cf414220a5" candidate_uuid: "5270e1a3c44b4438aa7478aac0f2db10" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
I20260709 13:07:35.920710 26216 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.920903 25943 raft_consensus.cc:3055] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:35.921255 25943 raft_consensus.cc:740] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:35.921845 25943 consensus_queue.cc:260] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:35.922823 25943 raft_consensus.cc:3060] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:35.925598 26216 raft_consensus.cc:2468] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 5.
I20260709 13:07:35.926733 25983 leader_election.cc:304] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5270e1a3c44b4438aa7478aac0f2db10, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:35.927511 26303 raft_consensus.cc:2804] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:35.927708 25943 raft_consensus.cc:2468] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5270e1a3c44b4438aa7478aac0f2db10 in term 5.
I20260709 13:07:35.928042 26303 raft_consensus.cc:697] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 5 LEADER]: Becoming Leader. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:35.928887 26303 consensus_queue.cc:237] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:35.935129 25765 catalog_manager.cc:5697] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 reported cstate change: term changed from 4 to 5, leader changed from 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194) to 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195). New cstate: current_term: 5 leader_uuid: "5270e1a3c44b4438aa7478aac0f2db10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.051654 26313 raft_consensus.cc:993] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10: : Instructing follower 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:36.052141 26303 raft_consensus.cc:1081] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Signalling peer 66cca95e9f6d4dbabe5c9254d40cfb15 to start an election
I20260709 13:07:36.053627 25943 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c"
dest_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15"
 from {username='slave'} at 127.0.0.1:40788
I20260709 13:07:36.054060 25943 raft_consensus.cc:493] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.054381 25943 raft_consensus.cc:3060] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:36.059551 25943 raft_consensus.cc:515] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:36.061048 25943 leader_election.cc:290] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 3 election: Requested vote from peers acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129), 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195:34521)
I20260709 13:07:36.062268 26017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5270e1a3c44b4438aa7478aac0f2db10"
I20260709 13:07:36.062445 26216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22c9f0b306484add9940e5947cb3c63c" candidate_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "acac180e41d14920bd0350315f8b75c9"
I20260709 13:07:36.062938 26017 raft_consensus.cc:3055] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:36.063354 26216 raft_consensus.cc:3060] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:36.063393 26017 raft_consensus.cc:740] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5270e1a3c44b4438aa7478aac0f2db10, State: Running, Role: LEADER
I20260709 13:07:36.064535 26017 consensus_queue.cc:260] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:36.065677 26017 raft_consensus.cc:3060] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:36.068790 26216 raft_consensus.cc:2468] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 3.
I20260709 13:07:36.069952 25909 leader_election.cc:304] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cca95e9f6d4dbabe5c9254d40cfb15, acac180e41d14920bd0350315f8b75c9; no voters: 
I20260709 13:07:36.070734 26317 raft_consensus.cc:2804] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:36.071156 26317 raft_consensus.cc:697] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 LEADER]: Becoming Leader. State: Replica: 66cca95e9f6d4dbabe5c9254d40cfb15, State: Running, Role: LEADER
I20260709 13:07:36.071233 26017 raft_consensus.cc:2468] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cca95e9f6d4dbabe5c9254d40cfb15 in term 3.
I20260709 13:07:36.072000 26317 consensus_queue.cc:237] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } }
I20260709 13:07:36.078719 25765 catalog_manager.cc:5697] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 reported cstate change: term changed from 2 to 3, leader changed from 5270e1a3c44b4438aa7478aac0f2db10 (127.13.206.195) to 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194). New cstate: current_term: 3 leader_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:36.123034 25815 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:36.206645 26216 raft_consensus.cc:1275] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.208117 26303 consensus_queue.cc:1048] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.221535 25943 raft_consensus.cc:1275] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.223325 26313 consensus_queue.cc:1048] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.320065 25943 raft_consensus.cc:1275] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 5 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:36.321302 26304 consensus_queue.cc:1048] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66cca95e9f6d4dbabe5c9254d40cfb15" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:36.328815 26216 raft_consensus.cc:1275] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 5 FOLLOWER]: Refusing update from remote peer 5270e1a3c44b4438aa7478aac0f2db10: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:36.330370 26313 consensus_queue.cc:1048] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:36.492897 26216 raft_consensus.cc:1275] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:36.494328 26317 consensus_queue.cc:1048] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acac180e41d14920bd0350315f8b75c9" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 37129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:36.503976 26017 raft_consensus.cc:1275] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Refusing update from remote peer 66cca95e9f6d4dbabe5c9254d40cfb15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:36.507136 26160 consensus_queue.cc:1048] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5270e1a3c44b4438aa7478aac0f2db10" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 34521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:36.557459 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:36.593128 14139 tablet_server.cc:179] TabletServer@127.13.206.193:37129 shutting down...
I20260709 13:07:36.616758 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:36.617535 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:36.618294 14139 raft_consensus.cc:2243] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.618803 14139 raft_consensus.cc:2272] T 4a590fc2359d40c29b7385f46f63da54 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.620798 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:36.621383 14139 raft_consensus.cc:2243] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.621843 14139 raft_consensus.cc:2272] T 22c9f0b306484add9940e5947cb3c63c P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.624308 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:36.624922 14139 raft_consensus.cc:2243] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.625408 14139 raft_consensus.cc:2272] T f0e8f9b8bc3c4576976f05cf414220a5 P acac180e41d14920bd0350315f8b75c9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.627862 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:36.628453 14139 raft_consensus.cc:2243] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.628923 14139 raft_consensus.cc:2272] T 8525767dd89448c4a173a8f24f61adba P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.631472 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:36.632097 14139 raft_consensus.cc:2243] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.632548 14139 raft_consensus.cc:2272] T 1cccdbedba1f4f808712f240d624ad92 P acac180e41d14920bd0350315f8b75c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.634560 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:36.635088 14139 raft_consensus.cc:2243] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.635531 14139 raft_consensus.cc:2272] T 09615d2827524bb88374b9124e1b3a67 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.637387 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:36.637936 14139 raft_consensus.cc:2243] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.638429 14139 raft_consensus.cc:2272] T d733e5a2389b47b79587469926b7bd1c P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.640271 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:36.640934 14139 raft_consensus.cc:2243] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.641377 14139 raft_consensus.cc:2272] T 261eea069e2945fbaea718a92d9920b0 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.643388 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:36.643899 14139 raft_consensus.cc:2243] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.644332 14139 raft_consensus.cc:2272] T e3c9bb914bf048339a39c9af42c0c0a0 P acac180e41d14920bd0350315f8b75c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.646180 14139 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:36.646728 14139 raft_consensus.cc:2243] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.647169 14139 raft_consensus.cc:2272] T 86180566196d48cfa37affa4b8cb25ec P acac180e41d14920bd0350315f8b75c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.678050 14139 tablet_server.cc:196] TabletServer@127.13.206.193:37129 shutdown complete.
W20260709 13:07:36.678402 25983 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111) [suppressed 87 similar messages]
W20260709 13:07:36.683388 25983 consensus_peers.cc:597] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.699564 14139 tablet_server.cc:179] TabletServer@127.13.206.194:0 shutting down...
W20260709 13:07:36.719487 25983 consensus_peers.cc:597] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.729494 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:36.730479 14139 tablet_replica.cc:333] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15: stopping tablet replica
I20260709 13:07:36.731271 14139 raft_consensus.cc:2243] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.731779 14139 raft_consensus.cc:2272] T 8525767dd89448c4a173a8f24f61adba P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.734670 14139 tablet_replica.cc:333] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15: stopping tablet replica
I20260709 13:07:36.735306 14139 raft_consensus.cc:2243] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.735796 14139 raft_consensus.cc:2272] T 1cccdbedba1f4f808712f240d624ad92 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.737934 14139 tablet_replica.cc:333] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15: stopping tablet replica
I20260709 13:07:36.738605 14139 raft_consensus.cc:2243] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.739054 14139 raft_consensus.cc:2272] T 86180566196d48cfa37affa4b8cb25ec P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.741115 14139 tablet_replica.cc:333] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15: stopping tablet replica
I20260709 13:07:36.741681 14139 raft_consensus.cc:2243] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.742554 14139 raft_consensus.cc:2272] T 09615d2827524bb88374b9124e1b3a67 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.744791 14139 tablet_replica.cc:333] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15: stopping tablet replica
I20260709 13:07:36.745368 14139 raft_consensus.cc:2243] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.746484 14139 raft_consensus.cc:2272] T e3c9bb914bf048339a39c9af42c0c0a0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.748750 14139 tablet_replica.cc:333] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15: stopping tablet replica
I20260709 13:07:36.749346 14139 raft_consensus.cc:2243] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.751083 14139 raft_consensus.cc:2272] T 261eea069e2945fbaea718a92d9920b0 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.753588 14139 tablet_replica.cc:333] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15: stopping tablet replica
I20260709 13:07:36.754166 14139 raft_consensus.cc:2243] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.754685 14139 raft_consensus.cc:2272] T d733e5a2389b47b79587469926b7bd1c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.756889 14139 tablet_replica.cc:333] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15: stopping tablet replica
I20260709 13:07:36.757474 14139 raft_consensus.cc:2243] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.757926 14139 raft_consensus.cc:2272] T f0e8f9b8bc3c4576976f05cf414220a5 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.760978 14139 tablet_replica.cc:333] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15: stopping tablet replica
I20260709 13:07:36.761826 14139 raft_consensus.cc:2243] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.762782 14139 raft_consensus.cc:2272] T 22c9f0b306484add9940e5947cb3c63c P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.765878 14139 tablet_replica.cc:333] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15: stopping tablet replica
I20260709 13:07:36.766746 14139 raft_consensus.cc:2243] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.767292 14139 raft_consensus.cc:2272] T 4a590fc2359d40c29b7385f46f63da54 P 66cca95e9f6d4dbabe5c9254d40cfb15 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:36.769616 25983 consensus_peers.cc:597] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer acac180e41d14920bd0350315f8b75c9 (127.13.206.193:37129): Couldn't send request to peer acac180e41d14920bd0350315f8b75c9. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:37129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:36.802006 25982 consensus_peers.cc:597] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183): Couldn't send request to peer 66cca95e9f6d4dbabe5c9254d40cfb15. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:42183: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.803122 14139 tablet_server.cc:196] TabletServer@127.13.206.194:0 shutdown complete.
W20260709 13:07:36.810617 25982 consensus_peers.cc:597] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 -> Peer 66cca95e9f6d4dbabe5c9254d40cfb15 (127.13.206.194:42183): Couldn't send request to peer 66cca95e9f6d4dbabe5c9254d40cfb15. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:42183: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.829170 14139 tablet_server.cc:179] TabletServer@127.13.206.195:0 shutting down...
I20260709 13:07:36.856122 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:36.856834 14139 tablet_replica.cc:333] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10: stopping tablet replica
I20260709 13:07:36.857463 14139 raft_consensus.cc:2243] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.858502 14139 raft_consensus.cc:2272] T 86180566196d48cfa37affa4b8cb25ec P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.861011 14139 tablet_replica.cc:333] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10: stopping tablet replica
I20260709 13:07:36.861743 14139 raft_consensus.cc:2243] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.862295 14139 raft_consensus.cc:2272] T 09615d2827524bb88374b9124e1b3a67 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.864566 14139 tablet_replica.cc:333] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10: stopping tablet replica
I20260709 13:07:36.865185 14139 raft_consensus.cc:2243] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.865666 14139 raft_consensus.cc:2272] T e3c9bb914bf048339a39c9af42c0c0a0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.868086 14139 tablet_replica.cc:333] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10: stopping tablet replica
I20260709 13:07:36.868676 14139 raft_consensus.cc:2243] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.869517 14139 raft_consensus.cc:2272] T 8525767dd89448c4a173a8f24f61adba P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.872164 14139 tablet_replica.cc:333] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10: stopping tablet replica
I20260709 13:07:36.872797 14139 raft_consensus.cc:2243] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.873665 14139 raft_consensus.cc:2272] T 1cccdbedba1f4f808712f240d624ad92 P 5270e1a3c44b4438aa7478aac0f2db10 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.876118 14139 tablet_replica.cc:333] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10: stopping tablet replica
I20260709 13:07:36.876726 14139 raft_consensus.cc:2243] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.877193 14139 raft_consensus.cc:2272] T 261eea069e2945fbaea718a92d9920b0 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.879503 14139 tablet_replica.cc:333] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10: stopping tablet replica
I20260709 13:07:36.880080 14139 raft_consensus.cc:2243] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.880889 14139 raft_consensus.cc:2272] T d733e5a2389b47b79587469926b7bd1c P 5270e1a3c44b4438aa7478aac0f2db10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.883127 14139 tablet_replica.cc:333] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10: stopping tablet replica
I20260709 13:07:36.883708 14139 raft_consensus.cc:2243] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.884624 14139 raft_consensus.cc:2272] T f0e8f9b8bc3c4576976f05cf414220a5 P 5270e1a3c44b4438aa7478aac0f2db10 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.887871 14139 tablet_replica.cc:333] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10: stopping tablet replica
I20260709 13:07:36.888489 14139 raft_consensus.cc:2243] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:36.888989 14139 raft_consensus.cc:2272] T 22c9f0b306484add9940e5947cb3c63c P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.891927 14139 tablet_replica.cc:333] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10: stopping tablet replica
I20260709 13:07:36.892529 14139 raft_consensus.cc:2243] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.893450 14139 raft_consensus.cc:2272] T 4a590fc2359d40c29b7385f46f63da54 P 5270e1a3c44b4438aa7478aac0f2db10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.926890 14139 tablet_server.cc:196] TabletServer@127.13.206.195:0 shutdown complete.
I20260709 13:07:36.952636 14139 master.cc:562] Master@127.13.206.254:35753 shutting down...
I20260709 13:07:36.979718 14139 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:36.980255 14139 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:36.980533 14139 tablet_replica.cc:333] T 00000000000000000000000000000000 P f177caa1e82649d2915770eac08f69c0: stopping tablet replica
I20260709 13:07:37.002329 14139 master.cc:584] Master@127.13.206.254:35753 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13067 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:07:37.046808 14139 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.206.254:45337
I20260709 13:07:37.047991 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:37.053475 26353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:37.053520 26352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:37.055102 26355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:37.056087 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:37.057046 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:37.057255 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:37.057420 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602457057388 us; error 0 us; skew 500 ppm
I20260709 13:07:37.057967 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:37.060595 14139 webserver.cc:533] Webserver started at http://127.13.206.254:44681/ using document root <none> and password file <none>
I20260709 13:07:37.061113 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:37.061314 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:37.061604 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:37.062875 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/master-0-root/instance:
uuid: "8d9f7cb11da3412e915a61b42cd7b392"
format_stamp: "Formatted at 2026-07-09 13:07:37 on dist-test-slave-ml7r"
I20260709 13:07:37.067481 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:37.071151 26360 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.071916 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:37.072238 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/master-0-root
uuid: "8d9f7cb11da3412e915a61b42cd7b392"
format_stamp: "Formatted at 2026-07-09 13:07:37 on dist-test-slave-ml7r"
I20260709 13:07:37.072535 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:37.097508 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:37.098785 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:37.138092 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.254:45337
I20260709 13:07:37.138207 26411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.254:45337 every 8 connection(s)
I20260709 13:07:37.142199 26412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.154786 26412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392: Bootstrap starting.
I20260709 13:07:37.160132 26412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.164883 26412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392: No bootstrap required, opened a new log
I20260709 13:07:37.167343 26412 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7cb11da3412e915a61b42cd7b392" member_type: VOTER }
I20260709 13:07:37.167788 26412 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.167981 26412 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d9f7cb11da3412e915a61b42cd7b392, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.168540 26412 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7cb11da3412e915a61b42cd7b392" member_type: VOTER }
I20260709 13:07:37.169015 26412 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:37.169224 26412 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:37.169450 26412 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.174659 26412 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7cb11da3412e915a61b42cd7b392" member_type: VOTER }
I20260709 13:07:37.175222 26412 leader_election.cc:304] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d9f7cb11da3412e915a61b42cd7b392; no voters: 
I20260709 13:07:37.176517 26412 leader_election.cc:290] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:37.176964 26415 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.178416 26415 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 1 LEADER]: Becoming Leader. State: Replica: 8d9f7cb11da3412e915a61b42cd7b392, State: Running, Role: LEADER
I20260709 13:07:37.179162 26415 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7cb11da3412e915a61b42cd7b392" member_type: VOTER }
I20260709 13:07:37.179828 26412 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:37.184514 26417 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d9f7cb11da3412e915a61b42cd7b392. Latest consensus state: current_term: 1 leader_uuid: "8d9f7cb11da3412e915a61b42cd7b392" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7cb11da3412e915a61b42cd7b392" member_type: VOTER } }
I20260709 13:07:37.185487 26417 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:37.185819 26416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d9f7cb11da3412e915a61b42cd7b392" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d9f7cb11da3412e915a61b42cd7b392" member_type: VOTER } }
I20260709 13:07:37.186436 26416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:37.187876 26422 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:37.192950 26422 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:37.198086 14139 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:37.202282 26422 catalog_manager.cc:1383] Generated new cluster ID: 1672661d874540b0955bff8d9009530e
I20260709 13:07:37.202620 26422 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:37.233559 26422 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:37.234966 26422 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:37.256070 26422 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392: Generated new TSK 0
I20260709 13:07:37.256748 26422 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:37.267537 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:37.273911 26433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:37.275585 26434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:37.277071 14139 server_base.cc:1061] running on GCE node
W20260709 13:07:37.277050 26436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:37.278512 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:37.278720 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:37.278859 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602457278841 us; error 0 us; skew 500 ppm
I20260709 13:07:37.279412 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:37.282105 14139 webserver.cc:533] Webserver started at http://127.13.206.193:42417/ using document root <none> and password file <none>
I20260709 13:07:37.282677 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:37.282845 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:37.283072 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:37.284202 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-0-root/instance:
uuid: "d61000d938a347afbb0e99fd1ec75d19"
format_stamp: "Formatted at 2026-07-09 13:07:37 on dist-test-slave-ml7r"
I20260709 13:07:37.289120 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:07:37.292968 26441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.293817 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:37.294193 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-0-root
uuid: "d61000d938a347afbb0e99fd1ec75d19"
format_stamp: "Formatted at 2026-07-09 13:07:37 on dist-test-slave-ml7r"
I20260709 13:07:37.294593 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:37.304706 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:37.306012 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:37.307675 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:37.310133 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:37.310462 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:07:37.310762 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:37.310941 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.353945 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.193:39447
I20260709 13:07:37.354046 26503 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.193:39447 every 8 connection(s)
I20260709 13:07:37.359527 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:37.367993 26508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:37.369010 26509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:37.372187 26511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:37.373540 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:37.373911 26504 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45337
I20260709 13:07:37.374464 26504 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:37.375221 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:37.375579 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:37.375511 26504 heartbeater.cc:507] Master 127.13.206.254:45337 requested a full tablet report, sending...
I20260709 13:07:37.375972 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602457375948 us; error 0 us; skew 500 ppm
I20260709 13:07:37.376901 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:37.378693 26377 ts_manager.cc:194] Registered new tserver with Master: d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193:39447)
I20260709 13:07:37.380051 14139 webserver.cc:533] Webserver started at http://127.13.206.194:40807/ using document root <none> and password file <none>
I20260709 13:07:37.380868 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:37.381129 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:37.381438 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:37.381618 26377 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43200
I20260709 13:07:37.383064 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-1-root/instance:
uuid: "bac6cce0ef2f4ed4be1f75349f005387"
format_stamp: "Formatted at 2026-07-09 13:07:37 on dist-test-slave-ml7r"
I20260709 13:07:37.388631 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:07:37.392437 26516 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.393344 14139 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:37.393714 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-1-root
uuid: "bac6cce0ef2f4ed4be1f75349f005387"
format_stamp: "Formatted at 2026-07-09 13:07:37 on dist-test-slave-ml7r"
I20260709 13:07:37.394032 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:37.420140 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:37.421432 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:37.423058 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:37.425460 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:37.425704 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.426002 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:37.426173 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.469532 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.194:42111
I20260709 13:07:37.469636 26578 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.194:42111 every 8 connection(s)
I20260709 13:07:37.475023 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:37.483595 26582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:37.486110 26583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:37.486827 26579 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45337
I20260709 13:07:37.487367 26579 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:37.488545 26579 heartbeater.cc:507] Master 127.13.206.254:45337 requested a full tablet report, sending...
W20260709 13:07:37.488942 26585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:37.491420 26377 ts_manager.cc:194] Registered new tserver with Master: bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194:42111)
I20260709 13:07:37.491422 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:37.493078 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:37.493352 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:37.493543 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602457493523 us; error 0 us; skew 500 ppm
I20260709 13:07:37.493865 26377 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43210
I20260709 13:07:37.494091 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:37.497370 14139 webserver.cc:533] Webserver started at http://127.13.206.195:43497/ using document root <none> and password file <none>
I20260709 13:07:37.497916 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:37.498140 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:37.498514 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:37.499749 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-2-root/instance:
uuid: "aa25762e1d5146f1946c98236b0e9e99"
format_stamp: "Formatted at 2026-07-09 13:07:37 on dist-test-slave-ml7r"
I20260709 13:07:37.504611 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:37.508167 26590 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.509068 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:07:37.509428 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-2-root
uuid: "aa25762e1d5146f1946c98236b0e9e99"
format_stamp: "Formatted at 2026-07-09 13:07:37 on dist-test-slave-ml7r"
I20260709 13:07:37.509745 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602098938719-14139-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:37.529160 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:37.530529 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:37.532081 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:37.534591 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:37.534859 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.535116 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:37.535310 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.578967 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.195:37671
I20260709 13:07:37.579074 26652 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.195:37671 every 8 connection(s)
I20260709 13:07:37.593283 26653 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45337
I20260709 13:07:37.593729 26653 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:37.594542 26653 heartbeater.cc:507] Master 127.13.206.254:45337 requested a full tablet report, sending...
I20260709 13:07:37.596742 26377 ts_manager.cc:194] Registered new tserver with Master: aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:37.597028 14139 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014787166s
I20260709 13:07:37.598332 26377 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43226
I20260709 13:07:37.623389 26377 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43230:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:37.625695 26377 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:37.681337 26469 tablet_service.cc:1511] Processing CreateTablet for tablet dd8e4fbfaf3d41068a53f15f8195451e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5c2a4bc0c0424531925f1c866d18a3dc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:37.682960 26469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8e4fbfaf3d41068a53f15f8195451e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.683341 26468 tablet_service.cc:1511] Processing CreateTablet for tablet be972b528e744812b09e15cda370eaef (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5c2a4bc0c0424531925f1c866d18a3dc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:37.684602 26468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be972b528e744812b09e15cda370eaef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.691237 26544 tablet_service.cc:1511] Processing CreateTablet for tablet dd8e4fbfaf3d41068a53f15f8195451e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5c2a4bc0c0424531925f1c866d18a3dc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:37.691515 26543 tablet_service.cc:1511] Processing CreateTablet for tablet be972b528e744812b09e15cda370eaef (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5c2a4bc0c0424531925f1c866d18a3dc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:37.692896 26543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be972b528e744812b09e15cda370eaef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.693998 26544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8e4fbfaf3d41068a53f15f8195451e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.694924 26618 tablet_service.cc:1511] Processing CreateTablet for tablet dd8e4fbfaf3d41068a53f15f8195451e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5c2a4bc0c0424531925f1c866d18a3dc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:37.696445 26618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd8e4fbfaf3d41068a53f15f8195451e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.703096 26617 tablet_service.cc:1511] Processing CreateTablet for tablet be972b528e744812b09e15cda370eaef (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=5c2a4bc0c0424531925f1c866d18a3dc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:37.704583 26617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be972b528e744812b09e15cda370eaef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:37.712540 26668 tablet_bootstrap.cc:492] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19: Bootstrap starting.
I20260709 13:07:37.723702 26668 tablet_bootstrap.cc:654] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.727643 26669 tablet_bootstrap.cc:492] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387: Bootstrap starting.
I20260709 13:07:37.734957 26669 tablet_bootstrap.cc:654] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.741711 26671 tablet_bootstrap.cc:492] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99: Bootstrap starting.
I20260709 13:07:37.743710 26668 tablet_bootstrap.cc:492] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19: No bootstrap required, opened a new log
I20260709 13:07:37.744326 26668 ts_tablet_manager.cc:1403] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.000s
I20260709 13:07:37.744722 26669 tablet_bootstrap.cc:492] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387: No bootstrap required, opened a new log
I20260709 13:07:37.745285 26669 ts_tablet_manager.cc:1403] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:07:37.747611 26668 raft_consensus.cc:359] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:37.748452 26668 raft_consensus.cc:385] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.748891 26668 raft_consensus.cc:740] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d61000d938a347afbb0e99fd1ec75d19, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.748474 26669 raft_consensus.cc:359] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:37.749392 26669 raft_consensus.cc:385] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.749727 26669 raft_consensus.cc:740] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.749949 26671 tablet_bootstrap.cc:654] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.749886 26668 consensus_queue.cc:260] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:37.750559 26669 consensus_queue.cc:260] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:37.752671 26504 heartbeater.cc:499] Master 127.13.206.254:45337 was elected leader, sending a full tablet report...
I20260709 13:07:37.753589 26668 ts_tablet_manager.cc:1434] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:07:37.755360 26579 heartbeater.cc:499] Master 127.13.206.254:45337 was elected leader, sending a full tablet report...
I20260709 13:07:37.755914 26669 ts_tablet_manager.cc:1434] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387: Time spent starting tablet: real 0.010s	user 0.012s	sys 0.000s
I20260709 13:07:37.756248 26668 tablet_bootstrap.cc:492] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19: Bootstrap starting.
I20260709 13:07:37.756985 26669 tablet_bootstrap.cc:492] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387: Bootstrap starting.
I20260709 13:07:37.764144 26668 tablet_bootstrap.cc:654] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.767202 26669 tablet_bootstrap.cc:654] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.777853 26668 tablet_bootstrap.cc:492] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19: No bootstrap required, opened a new log
I20260709 13:07:37.778447 26668 ts_tablet_manager.cc:1403] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.010s
I20260709 13:07:37.781582 26668 raft_consensus.cc:359] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:37.782378 26668 raft_consensus.cc:385] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.782696 26668 raft_consensus.cc:740] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d61000d938a347afbb0e99fd1ec75d19, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.783571 26668 consensus_queue.cc:260] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:37.785782 26668 ts_tablet_manager.cc:1434] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:07:37.789539 26671 tablet_bootstrap.cc:492] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99: No bootstrap required, opened a new log
I20260709 13:07:37.790131 26669 tablet_bootstrap.cc:492] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387: No bootstrap required, opened a new log
I20260709 13:07:37.790131 26671 ts_tablet_manager.cc:1403] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.008s
I20260709 13:07:37.790895 26669 ts_tablet_manager.cc:1403] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.014s
I20260709 13:07:37.793681 26671 raft_consensus.cc:359] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:37.793963 26669 raft_consensus.cc:359] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:37.794459 26671 raft_consensus.cc:385] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.794731 26669 raft_consensus.cc:385] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.794842 26671 raft_consensus.cc:740] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25762e1d5146f1946c98236b0e9e99, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.795114 26669 raft_consensus.cc:740] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.795745 26671 consensus_queue.cc:260] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:37.795940 26669 consensus_queue.cc:260] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:37.798251 26669 ts_tablet_manager.cc:1434] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:07:37.798540 26653 heartbeater.cc:499] Master 127.13.206.254:45337 was elected leader, sending a full tablet report...
I20260709 13:07:37.799041 26671 ts_tablet_manager.cc:1434] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:07:37.800176 26671 tablet_bootstrap.cc:492] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99: Bootstrap starting.
I20260709 13:07:37.807142 26671 tablet_bootstrap.cc:654] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.812616 26671 tablet_bootstrap.cc:492] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99: No bootstrap required, opened a new log
I20260709 13:07:37.813040 26671 ts_tablet_manager.cc:1403] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:07:37.815337 26671 raft_consensus.cc:359] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:37.815876 26671 raft_consensus.cc:385] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.816075 26671 raft_consensus.cc:740] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25762e1d5146f1946c98236b0e9e99, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.816627 26671 consensus_queue.cc:260] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:37.818193 26671 ts_tablet_manager.cc:1434] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:07:37.860067 26674 raft_consensus.cc:493] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.860677 26674 raft_consensus.cc:515] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:37.862826 26674 leader_election.cc:290] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193:39447), aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:37.865597 26674 raft_consensus.cc:493] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.866120 26674 raft_consensus.cc:515] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:37.868403 26674 leader_election.cc:290] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193:39447), aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:37.873118 26479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e4fbfaf3d41068a53f15f8195451e" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d61000d938a347afbb0e99fd1ec75d19" is_pre_election: true
I20260709 13:07:37.873370 26478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be972b528e744812b09e15cda370eaef" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d61000d938a347afbb0e99fd1ec75d19" is_pre_election: true
I20260709 13:07:37.873981 26479 raft_consensus.cc:2468] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 0.
I20260709 13:07:37.874138 26478 raft_consensus.cc:2468] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 0.
I20260709 13:07:37.874886 26628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e4fbfaf3d41068a53f15f8195451e" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25762e1d5146f1946c98236b0e9e99" is_pre_election: true
I20260709 13:07:37.875380 26627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be972b528e744812b09e15cda370eaef" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25762e1d5146f1946c98236b0e9e99" is_pre_election: true
I20260709 13:07:37.875774 26628 raft_consensus.cc:2468] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 0.
I20260709 13:07:37.875723 26520 leader_election.cc:304] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bac6cce0ef2f4ed4be1f75349f005387, d61000d938a347afbb0e99fd1ec75d19; no voters: 
I20260709 13:07:37.876186 26627 raft_consensus.cc:2468] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 0.
I20260709 13:07:37.877013 26520 leader_election.cc:304] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bac6cce0ef2f4ed4be1f75349f005387, d61000d938a347afbb0e99fd1ec75d19; no voters: 
I20260709 13:07:37.877102 26674 raft_consensus.cc:2804] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.877724 26674 raft_consensus.cc:493] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.878062 26674 raft_consensus.cc:3060] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.879513 26681 raft_consensus.cc:2804] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.880002 26681 raft_consensus.cc:493] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.880335 26681 raft_consensus.cc:3060] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.884407 26674 raft_consensus.cc:515] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:37.886165 26674 leader_election.cc:290] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 election: Requested vote from peers d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193:39447), aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:37.886260 26681 raft_consensus.cc:515] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:37.887238 26478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e4fbfaf3d41068a53f15f8195451e" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d61000d938a347afbb0e99fd1ec75d19"
I20260709 13:07:37.887530 26627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e4fbfaf3d41068a53f15f8195451e" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25762e1d5146f1946c98236b0e9e99"
I20260709 13:07:37.887941 26478 raft_consensus.cc:3060] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.888127 26627 raft_consensus.cc:3060] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.888547 26681 leader_election.cc:290] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 election: Requested vote from peers d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193:39447), aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:37.889629 26628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be972b528e744812b09e15cda370eaef" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25762e1d5146f1946c98236b0e9e99"
I20260709 13:07:37.890273 26628 raft_consensus.cc:3060] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.890208 26479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be972b528e744812b09e15cda370eaef" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d61000d938a347afbb0e99fd1ec75d19"
I20260709 13:07:37.890977 26479 raft_consensus.cc:3060] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.896593 26478 raft_consensus.cc:2468] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 1.
I20260709 13:07:37.896672 26627 raft_consensus.cc:2468] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 1.
I20260709 13:07:37.898205 26520 leader_election.cc:304] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bac6cce0ef2f4ed4be1f75349f005387, d61000d938a347afbb0e99fd1ec75d19; no voters: 
I20260709 13:07:37.898988 26628 raft_consensus.cc:2468] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 1.
I20260709 13:07:37.899066 26681 raft_consensus.cc:2804] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.899343 26479 raft_consensus.cc:2468] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 1.
I20260709 13:07:37.899974 26681 raft_consensus.cc:697] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Becoming Leader. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Running, Role: LEADER
I20260709 13:07:37.900746 26520 leader_election.cc:304] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bac6cce0ef2f4ed4be1f75349f005387, d61000d938a347afbb0e99fd1ec75d19; no voters: 
I20260709 13:07:37.900873 26681 consensus_queue.cc:237] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:37.901787 26674 raft_consensus.cc:2804] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.902876 26674 raft_consensus.cc:697] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Becoming Leader. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Running, Role: LEADER
I20260709 13:07:37.903769 26674 consensus_queue.cc:237] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:37.911617 26376 catalog_manager.cc:5697] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 reported cstate change: term changed from 0 to 1, leader changed from <none> to bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "bac6cce0ef2f4ed4be1f75349f005387" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.926926 26376 catalog_manager.cc:5697] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 reported cstate change: term changed from 0 to 1, leader changed from <none> to bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "bac6cce0ef2f4ed4be1f75349f005387" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.009922 26376 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43234:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:38.012106 26376 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:38.036510 26469 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7ecc7d7ac844d2a25095cda9d7e095 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3436537236d14c059552e93c20d40102]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:38.037865 26469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7ecc7d7ac844d2a25095cda9d7e095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.037868 26543 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7ecc7d7ac844d2a25095cda9d7e095 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3436537236d14c059552e93c20d40102]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:38.039646 26543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7ecc7d7ac844d2a25095cda9d7e095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.039693 26617 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7ecc7d7ac844d2a25095cda9d7e095 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3436537236d14c059552e93c20d40102]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:38.041074 26617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7ecc7d7ac844d2a25095cda9d7e095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.044350 26544 tablet_service.cc:1511] Processing CreateTablet for tablet 1297bdf8fb014463bc5d8565020f846f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3436537236d14c059552e93c20d40102]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:38.044874 26618 tablet_service.cc:1511] Processing CreateTablet for tablet 1297bdf8fb014463bc5d8565020f846f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3436537236d14c059552e93c20d40102]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:38.045832 26544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1297bdf8fb014463bc5d8565020f846f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.046310 26618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1297bdf8fb014463bc5d8565020f846f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.049186 26468 tablet_service.cc:1511] Processing CreateTablet for tablet 1297bdf8fb014463bc5d8565020f846f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=3436537236d14c059552e93c20d40102]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:38.050633 26468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1297bdf8fb014463bc5d8565020f846f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.057690 26669 tablet_bootstrap.cc:492] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387: Bootstrap starting.
I20260709 13:07:38.059039 26668 tablet_bootstrap.cc:492] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19: Bootstrap starting.
I20260709 13:07:38.064705 26669 tablet_bootstrap.cc:654] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.067006 26671 tablet_bootstrap.cc:492] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99: Bootstrap starting.
I20260709 13:07:38.069344 26668 tablet_bootstrap.cc:654] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.075331 26671 tablet_bootstrap.cc:654] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.077962 26669 tablet_bootstrap.cc:492] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387: No bootstrap required, opened a new log
I20260709 13:07:38.078632 26669 ts_tablet_manager.cc:1403] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:07:38.086158 26668 tablet_bootstrap.cc:492] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19: No bootstrap required, opened a new log
I20260709 13:07:38.086915 26668 ts_tablet_manager.cc:1403] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.009s
I20260709 13:07:38.086311 26669 raft_consensus.cc:359] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.088721 26669 raft_consensus.cc:385] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.089020 26669 raft_consensus.cc:740] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.090045 26671 tablet_bootstrap.cc:492] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99: No bootstrap required, opened a new log
I20260709 13:07:38.089962 26669 consensus_queue.cc:260] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.090744 26671 ts_tablet_manager.cc:1403] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:07:38.094455 26671 raft_consensus.cc:359] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.095549 26669 ts_tablet_manager.cc:1434] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:07:38.095353 26671 raft_consensus.cc:385] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.096843 26671 raft_consensus.cc:740] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25762e1d5146f1946c98236b0e9e99, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.097810 26671 consensus_queue.cc:260] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.100368 26671 ts_tablet_manager.cc:1434] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:38.101462 26669 tablet_bootstrap.cc:492] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387: Bootstrap starting.
I20260709 13:07:38.098309 26668 raft_consensus.cc:359] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.104154 26668 raft_consensus.cc:385] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.104581 26668 raft_consensus.cc:740] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d61000d938a347afbb0e99fd1ec75d19, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.101518 26671 tablet_bootstrap.cc:492] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99: Bootstrap starting.
I20260709 13:07:38.106573 26668 consensus_queue.cc:260] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.109030 26668 ts_tablet_manager.cc:1434] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:07:38.110191 26668 tablet_bootstrap.cc:492] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19: Bootstrap starting.
I20260709 13:07:38.116020 26669 tablet_bootstrap.cc:654] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.117412 26668 tablet_bootstrap.cc:654] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.123503 26671 tablet_bootstrap.cc:654] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.131594 26669 tablet_bootstrap.cc:492] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387: No bootstrap required, opened a new log
I20260709 13:07:38.132332 26669 ts_tablet_manager.cc:1403] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387: Time spent bootstrapping tablet: real 0.031s	user 0.002s	sys 0.012s
I20260709 13:07:38.136533 26669 raft_consensus.cc:359] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.137621 26669 raft_consensus.cc:385] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.138032 26669 raft_consensus.cc:740] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.140069 26669 consensus_queue.cc:260] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.142510 26668 tablet_bootstrap.cc:492] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19: No bootstrap required, opened a new log
I20260709 13:07:38.143211 26668 ts_tablet_manager.cc:1403] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.011s
I20260709 13:07:38.145596 26669 ts_tablet_manager.cc:1434] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:07:38.150216 26668 raft_consensus.cc:359] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.151198 26668 raft_consensus.cc:385] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.155489 26668 raft_consensus.cc:740] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d61000d938a347afbb0e99fd1ec75d19, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.156476 26668 consensus_queue.cc:260] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.159050 26668 ts_tablet_manager.cc:1434] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:07:38.160465 26671 tablet_bootstrap.cc:492] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99: No bootstrap required, opened a new log
I20260709 13:07:38.161057 26671 ts_tablet_manager.cc:1403] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99: Time spent bootstrapping tablet: real 0.060s	user 0.023s	sys 0.019s
I20260709 13:07:38.164266 26671 raft_consensus.cc:359] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.165037 26671 raft_consensus.cc:385] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.165383 26671 raft_consensus.cc:740] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa25762e1d5146f1946c98236b0e9e99, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.166149 26671 consensus_queue.cc:260] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.168386 26671 ts_tablet_manager.cc:1434] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260709 13:07:38.191617 26425 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:38.236729 26674 raft_consensus.cc:493] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.237340 26674 raft_consensus.cc:515] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.239104 26674 leader_election.cc:290] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193:39447), aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:38.240130 26479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d61000d938a347afbb0e99fd1ec75d19" is_pre_election: true
I20260709 13:07:38.240433 26628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25762e1d5146f1946c98236b0e9e99" is_pre_election: true
I20260709 13:07:38.240921 26479 raft_consensus.cc:2468] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 0.
I20260709 13:07:38.241040 26628 raft_consensus.cc:2468] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 0.
I20260709 13:07:38.242128 26520 leader_election.cc:304] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25762e1d5146f1946c98236b0e9e99, bac6cce0ef2f4ed4be1f75349f005387; no voters: 
I20260709 13:07:38.242805 26674 raft_consensus.cc:2804] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.243165 26674 raft_consensus.cc:493] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.243562 26674 raft_consensus.cc:3060] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.249667 26674 raft_consensus.cc:515] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.251567 26674 leader_election.cc:290] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 election: Requested vote from peers d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193:39447), aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:38.252394 26479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d61000d938a347afbb0e99fd1ec75d19"
I20260709 13:07:38.252610 26628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25762e1d5146f1946c98236b0e9e99"
I20260709 13:07:38.253019 26479 raft_consensus.cc:3060] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.253194 26628 raft_consensus.cc:3060] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.258220 26479 raft_consensus.cc:2468] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 1.
I20260709 13:07:38.258340 26628 raft_consensus.cc:2468] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 1.
I20260709 13:07:38.259473 26520 leader_election.cc:304] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bac6cce0ef2f4ed4be1f75349f005387, d61000d938a347afbb0e99fd1ec75d19; no voters: 
I20260709 13:07:38.260159 26674 raft_consensus.cc:2804] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.260584 26674 raft_consensus.cc:697] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Becoming Leader. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Running, Role: LEADER
I20260709 13:07:38.261251 26674 consensus_queue.cc:237] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.268589 26374 catalog_manager.cc:5697] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 reported cstate change: term changed from 0 to 1, leader changed from <none> to bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "bac6cce0ef2f4ed4be1f75349f005387" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.283849 26673 raft_consensus.cc:493] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.284421 26673 raft_consensus.cc:515] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.286605 26673 leader_election.cc:290] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194:42111), aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:38.299088 26554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7ecc7d7ac844d2a25095cda9d7e095" candidate_uuid: "d61000d938a347afbb0e99fd1ec75d19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bac6cce0ef2f4ed4be1f75349f005387" is_pre_election: true
I20260709 13:07:38.299345 26628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7ecc7d7ac844d2a25095cda9d7e095" candidate_uuid: "d61000d938a347afbb0e99fd1ec75d19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25762e1d5146f1946c98236b0e9e99" is_pre_election: true
I20260709 13:07:38.299832 26554 raft_consensus.cc:2468] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d61000d938a347afbb0e99fd1ec75d19 in term 0.
I20260709 13:07:38.300021 26628 raft_consensus.cc:2468] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d61000d938a347afbb0e99fd1ec75d19 in term 0.
I20260709 13:07:38.301174 26442 leader_election.cc:304] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bac6cce0ef2f4ed4be1f75349f005387, d61000d938a347afbb0e99fd1ec75d19; no voters: 
I20260709 13:07:38.301951 26673 raft_consensus.cc:2804] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.302299 26673 raft_consensus.cc:493] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.302591 26673 raft_consensus.cc:3060] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.307881 26673 raft_consensus.cc:515] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.309580 26673 leader_election.cc:290] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [CANDIDATE]: Term 1 election: Requested vote from peers bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194:42111), aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:38.310680 26554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7ecc7d7ac844d2a25095cda9d7e095" candidate_uuid: "d61000d938a347afbb0e99fd1ec75d19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bac6cce0ef2f4ed4be1f75349f005387"
I20260709 13:07:38.310729 26628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7ecc7d7ac844d2a25095cda9d7e095" candidate_uuid: "d61000d938a347afbb0e99fd1ec75d19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa25762e1d5146f1946c98236b0e9e99"
I20260709 13:07:38.311607 26554 raft_consensus.cc:3060] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.312065 26628 raft_consensus.cc:3060] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.318202 26554 raft_consensus.cc:2468] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d61000d938a347afbb0e99fd1ec75d19 in term 1.
I20260709 13:07:38.318630 26628 raft_consensus.cc:2468] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d61000d938a347afbb0e99fd1ec75d19 in term 1.
I20260709 13:07:38.319504 26442 leader_election.cc:304] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bac6cce0ef2f4ed4be1f75349f005387, d61000d938a347afbb0e99fd1ec75d19; no voters: 
I20260709 13:07:38.320302 26673 raft_consensus.cc:2804] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.321228 26673 raft_consensus.cc:697] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 1 LEADER]: Becoming Leader. State: Replica: d61000d938a347afbb0e99fd1ec75d19, State: Running, Role: LEADER
I20260709 13:07:38.322031 26673 consensus_queue.cc:237] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.329136 26374 catalog_manager.cc:5697] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 reported cstate change: term changed from 0 to 1, leader changed from <none> to d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "d61000d938a347afbb0e99fd1ec75d19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.354058 26674 consensus_queue.cc:1048] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.369911 26674 consensus_queue.cc:1048] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.371127 26682 consensus_queue.cc:1048] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.391404 26554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd8e4fbfaf3d41068a53f15f8195451e"
dest_uuid: "bac6cce0ef2f4ed4be1f75349f005387"
mode: GRACEFUL
new_leader_uuid: "d61000d938a347afbb0e99fd1ec75d19"
 from {username='slave'} at 127.0.0.1:57986
I20260709 13:07:38.395674 26554 raft_consensus.cc:606] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Received request to transfer leadership to TS d61000d938a347afbb0e99fd1ec75d19
I20260709 13:07:38.398329 26674 consensus_queue.cc:1048] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.405854 26554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be972b528e744812b09e15cda370eaef"
dest_uuid: "bac6cce0ef2f4ed4be1f75349f005387"
mode: GRACEFUL
new_leader_uuid: "aa25762e1d5146f1946c98236b0e9e99"
 from {username='slave'} at 127.0.0.1:57986
I20260709 13:07:38.406647 26554 raft_consensus.cc:606] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Received request to transfer leadership to TS aa25762e1d5146f1946c98236b0e9e99
I20260709 13:07:38.409204 26682 raft_consensus.cc:993] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387: : Instructing follower d61000d938a347afbb0e99fd1ec75d19 to start an election
I20260709 13:07:38.409701 26674 raft_consensus.cc:1081] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Signalling peer d61000d938a347afbb0e99fd1ec75d19 to start an election
I20260709 13:07:38.411309 26479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd8e4fbfaf3d41068a53f15f8195451e"
dest_uuid: "d61000d938a347afbb0e99fd1ec75d19"
 from {username='slave'} at 127.0.0.1:47794
I20260709 13:07:38.411984 26479 raft_consensus.cc:493] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.412349 26479 raft_consensus.cc:3060] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.416725 26554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f"
dest_uuid: "bac6cce0ef2f4ed4be1f75349f005387"
mode: GRACEFUL
new_leader_uuid: "d61000d938a347afbb0e99fd1ec75d19"
 from {username='slave'} at 127.0.0.1:57986
I20260709 13:07:38.417337 26554 raft_consensus.cc:606] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Received request to transfer leadership to TS d61000d938a347afbb0e99fd1ec75d19
I20260709 13:07:38.418794 26479 raft_consensus.cc:515] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:38.421182 26479 leader_election.cc:290] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [CANDIDATE]: Term 2 election: Requested vote from peers aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671), bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194:42111)
I20260709 13:07:38.421916 26628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e4fbfaf3d41068a53f15f8195451e" candidate_uuid: "d61000d938a347afbb0e99fd1ec75d19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa25762e1d5146f1946c98236b0e9e99"
I20260709 13:07:38.422629 26554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd8e4fbfaf3d41068a53f15f8195451e" candidate_uuid: "d61000d938a347afbb0e99fd1ec75d19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bac6cce0ef2f4ed4be1f75349f005387"
I20260709 13:07:38.422650 26628 raft_consensus.cc:3060] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.426183 26554 raft_consensus.cc:3055] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.426637 26554 raft_consensus.cc:740] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Running, Role: LEADER
I20260709 13:07:38.427560 26554 consensus_queue.cc:260] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:38.428930 26554 raft_consensus.cc:3060] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.430107 26628 raft_consensus.cc:2468] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d61000d938a347afbb0e99fd1ec75d19 in term 2.
I20260709 13:07:38.431600 26445 leader_election.cc:304] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25762e1d5146f1946c98236b0e9e99, d61000d938a347afbb0e99fd1ec75d19; no voters: 
I20260709 13:07:38.432595 26673 raft_consensus.cc:2804] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.433063 26673 raft_consensus.cc:697] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 2 LEADER]: Becoming Leader. State: Replica: d61000d938a347afbb0e99fd1ec75d19, State: Running, Role: LEADER
I20260709 13:07:38.433831 26673 consensus_queue.cc:237] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } }
I20260709 13:07:38.435844 26554 raft_consensus.cc:2468] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d61000d938a347afbb0e99fd1ec75d19 in term 2.
I20260709 13:07:38.440975 26374 catalog_manager.cc:5697] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 reported cstate change: term changed from 1 to 2, leader changed from bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194) to d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "d61000d938a347afbb0e99fd1ec75d19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.689911 26674 consensus_queue.cc:1048] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.696769 26682 raft_consensus.cc:993] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387: : Instructing follower d61000d938a347afbb0e99fd1ec75d19 to start an election
I20260709 13:07:38.697273 26681 raft_consensus.cc:1081] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Signalling peer d61000d938a347afbb0e99fd1ec75d19 to start an election
I20260709 13:07:38.699707 26478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f"
dest_uuid: "d61000d938a347afbb0e99fd1ec75d19"
 from {username='slave'} at 127.0.0.1:47794
I20260709 13:07:38.701725 26478 raft_consensus.cc:493] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.702184 26478 raft_consensus.cc:3060] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.704178 26681 consensus_queue.cc:1048] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.712137 26478 raft_consensus.cc:515] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.720121 26478 leader_election.cc:290] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [CANDIDATE]: Term 2 election: Requested vote from peers bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194:42111), aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:38.721693 26554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f" candidate_uuid: "d61000d938a347afbb0e99fd1ec75d19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bac6cce0ef2f4ed4be1f75349f005387"
I20260709 13:07:38.722456 26554 raft_consensus.cc:3055] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.722822 26554 raft_consensus.cc:740] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Running, Role: LEADER
I20260709 13:07:38.722873 26628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f" candidate_uuid: "d61000d938a347afbb0e99fd1ec75d19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa25762e1d5146f1946c98236b0e9e99"
I20260709 13:07:38.723663 26628 raft_consensus.cc:3060] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.723760 26554 consensus_queue.cc:260] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.725713 26554 raft_consensus.cc:3060] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.731482 26628 raft_consensus.cc:2468] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d61000d938a347afbb0e99fd1ec75d19 in term 2.
I20260709 13:07:38.733027 26554 raft_consensus.cc:2468] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d61000d938a347afbb0e99fd1ec75d19 in term 2.
I20260709 13:07:38.732999 26445 leader_election.cc:304] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25762e1d5146f1946c98236b0e9e99, d61000d938a347afbb0e99fd1ec75d19; no voters: 
I20260709 13:07:38.734135 26673 raft_consensus.cc:2804] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.734687 26673 raft_consensus.cc:697] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 2 LEADER]: Becoming Leader. State: Replica: d61000d938a347afbb0e99fd1ec75d19, State: Running, Role: LEADER
I20260709 13:07:38.735540 26673 consensus_queue.cc:237] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.742406 26376 catalog_manager.cc:5697] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 reported cstate change: term changed from 1 to 2, leader changed from bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194) to d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "d61000d938a347afbb0e99fd1ec75d19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.799268 26673 consensus_queue.cc:1048] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.808274 26700 consensus_queue.cc:1048] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.870828 26628 raft_consensus.cc:1275] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 2 FOLLOWER]: Refusing update from remote peer d61000d938a347afbb0e99fd1ec75d19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:38.872323 26700 consensus_queue.cc:1048] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:38.877967 26554 raft_consensus.cc:1275] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Refusing update from remote peer d61000d938a347afbb0e99fd1ec75d19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:38.880138 26673 consensus_queue.cc:1048] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:38.899572 26674 raft_consensus.cc:993] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387: : Instructing follower aa25762e1d5146f1946c98236b0e9e99 to start an election
I20260709 13:07:38.900139 26714 raft_consensus.cc:1081] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Signalling peer aa25762e1d5146f1946c98236b0e9e99 to start an election
I20260709 13:07:38.902021 26627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be972b528e744812b09e15cda370eaef"
dest_uuid: "aa25762e1d5146f1946c98236b0e9e99"
 from {username='slave'} at 127.0.0.1:41792
I20260709 13:07:38.902714 26627 raft_consensus.cc:493] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.903119 26627 raft_consensus.cc:3060] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.909035 26627 raft_consensus.cc:515] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.911186 26627 leader_election.cc:290] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [CANDIDATE]: Term 2 election: Requested vote from peers d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193:39447), bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194:42111)
I20260709 13:07:38.923872 26478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be972b528e744812b09e15cda370eaef" candidate_uuid: "aa25762e1d5146f1946c98236b0e9e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d61000d938a347afbb0e99fd1ec75d19"
I20260709 13:07:38.924556 26478 raft_consensus.cc:3060] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.925822 26554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be972b528e744812b09e15cda370eaef" candidate_uuid: "aa25762e1d5146f1946c98236b0e9e99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bac6cce0ef2f4ed4be1f75349f005387"
I20260709 13:07:38.926566 26554 raft_consensus.cc:3055] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.926927 26554 raft_consensus.cc:740] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Running, Role: LEADER
I20260709 13:07:38.927753 26554 consensus_queue.cc:260] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.929154 26554 raft_consensus.cc:3060] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.932416 26478 raft_consensus.cc:2468] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25762e1d5146f1946c98236b0e9e99 in term 2.
I20260709 13:07:38.933929 26594 leader_election.cc:304] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25762e1d5146f1946c98236b0e9e99, d61000d938a347afbb0e99fd1ec75d19; no voters: 
I20260709 13:07:38.935015 26678 raft_consensus.cc:2804] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.936371 26678 raft_consensus.cc:697] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 2 LEADER]: Becoming Leader. State: Replica: aa25762e1d5146f1946c98236b0e9e99, State: Running, Role: LEADER
I20260709 13:07:38.936368 26554 raft_consensus.cc:2468] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa25762e1d5146f1946c98236b0e9e99 in term 2.
I20260709 13:07:38.937463 26678 consensus_queue.cc:237] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:38.943933 26377 catalog_manager.cc:5697] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 reported cstate change: term changed from 1 to 2, leader changed from bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194) to aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "aa25762e1d5146f1946c98236b0e9e99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.133131 26554 raft_consensus.cc:1275] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Refusing update from remote peer d61000d938a347afbb0e99fd1ec75d19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.134621 26673 consensus_queue.cc:1048] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.136093 26627 raft_consensus.cc:1275] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 2 FOLLOWER]: Refusing update from remote peer d61000d938a347afbb0e99fd1ec75d19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.137604 26673 consensus_queue.cc:1048] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.172245 14139 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:07:39.173878 14139 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:07:39.174347 14139 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:07:39.186609 26478 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f"
dest_uuid: "d61000d938a347afbb0e99fd1ec75d19"
mode: GRACEFUL
new_leader_uuid: "bac6cce0ef2f4ed4be1f75349f005387"
 from {username='slave'} at 127.0.0.1:47810
I20260709 13:07:39.187179 26478 raft_consensus.cc:606] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 2 LEADER]: Received request to transfer leadership to TS bac6cce0ef2f4ed4be1f75349f005387
I20260709 13:07:39.188409 14139 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:07:39.498492 26554 raft_consensus.cc:1275] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Refusing update from remote peer aa25762e1d5146f1946c98236b0e9e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.499809 26678 consensus_queue.cc:1048] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.512061 26478 raft_consensus.cc:1275] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 2 FOLLOWER]: Refusing update from remote peer aa25762e1d5146f1946c98236b0e9e99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:39.513676 26723 consensus_queue.cc:1048] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:39.581205 26720 raft_consensus.cc:993] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19: : Instructing follower bac6cce0ef2f4ed4be1f75349f005387 to start an election
I20260709 13:07:39.581780 26673 raft_consensus.cc:1081] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 2 LEADER]: Signalling peer bac6cce0ef2f4ed4be1f75349f005387 to start an election
I20260709 13:07:39.583361 26554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f"
dest_uuid: "bac6cce0ef2f4ed4be1f75349f005387"
 from {username='slave'} at 127.0.0.1:57972
I20260709 13:07:39.583877 26554 raft_consensus.cc:493] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:39.584196 26554 raft_consensus.cc:3060] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:39.589645 26554 raft_consensus.cc:515] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:39.591512 26554 leader_election.cc:290] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 3 election: Requested vote from peers d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193:39447), aa25762e1d5146f1946c98236b0e9e99 (127.13.206.195:37671)
I20260709 13:07:39.592350 26478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d61000d938a347afbb0e99fd1ec75d19"
I20260709 13:07:39.592588 26627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1297bdf8fb014463bc5d8565020f846f" candidate_uuid: "bac6cce0ef2f4ed4be1f75349f005387" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa25762e1d5146f1946c98236b0e9e99"
I20260709 13:07:39.593135 26478 raft_consensus.cc:3055] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:39.593140 26627 raft_consensus.cc:3060] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:39.593679 26478 raft_consensus.cc:740] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d61000d938a347afbb0e99fd1ec75d19, State: Running, Role: LEADER
I20260709 13:07:39.594535 26478 consensus_queue.cc:260] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:39.595536 26478 raft_consensus.cc:3060] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:39.599557 26627 raft_consensus.cc:2468] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 3.
I20260709 13:07:39.600845 26520 leader_election.cc:304] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aa25762e1d5146f1946c98236b0e9e99, bac6cce0ef2f4ed4be1f75349f005387; no voters: 
I20260709 13:07:39.601387 26478 raft_consensus.cc:2468] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bac6cce0ef2f4ed4be1f75349f005387 in term 3.
I20260709 13:07:39.601579 26714 raft_consensus.cc:2804] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:39.603019 26714 raft_consensus.cc:697] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 3 LEADER]: Becoming Leader. State: Replica: bac6cce0ef2f4ed4be1f75349f005387, State: Running, Role: LEADER
I20260709 13:07:39.603725 26714 consensus_queue.cc:237] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } }
I20260709 13:07:39.610028 26377 catalog_manager.cc:5697] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 reported cstate change: term changed from 2 to 3, leader changed from d61000d938a347afbb0e99fd1ec75d19 (127.13.206.193) to bac6cce0ef2f4ed4be1f75349f005387 (127.13.206.194). New cstate: current_term: 3 leader_uuid: "bac6cce0ef2f4ed4be1f75349f005387" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d61000d938a347afbb0e99fd1ec75d19" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 39447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bac6cce0ef2f4ed4be1f75349f005387" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa25762e1d5146f1946c98236b0e9e99" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 37671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.807390 14139 tablet_server.cc:179] TabletServer@127.13.206.193:0 shutting down...
I20260709 13:07:39.826874 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:39.827575 14139 tablet_replica.cc:333] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19: stopping tablet replica
I20260709 13:07:39.828172 14139 raft_consensus.cc:2243] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.828606 14139 raft_consensus.cc:2272] T 1297bdf8fb014463bc5d8565020f846f P d61000d938a347afbb0e99fd1ec75d19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.830991 14139 tablet_replica.cc:333] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19: stopping tablet replica
I20260709 13:07:39.831555 14139 raft_consensus.cc:2243] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.832393 14139 raft_consensus.cc:2272] T 0d7ecc7d7ac844d2a25095cda9d7e095 P d61000d938a347afbb0e99fd1ec75d19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.834427 14139 tablet_replica.cc:333] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19: stopping tablet replica
I20260709 13:07:39.834915 14139 raft_consensus.cc:2243] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.835336 14139 raft_consensus.cc:2272] T be972b528e744812b09e15cda370eaef P d61000d938a347afbb0e99fd1ec75d19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.837602 14139 tablet_replica.cc:333] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19: stopping tablet replica
I20260709 13:07:39.838135 14139 raft_consensus.cc:2243] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.838997 14139 raft_consensus.cc:2272] T dd8e4fbfaf3d41068a53f15f8195451e P d61000d938a347afbb0e99fd1ec75d19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.862632 14139 tablet_server.cc:196] TabletServer@127.13.206.193:0 shutdown complete.
I20260709 13:07:39.876176 14139 tablet_server.cc:179] TabletServer@127.13.206.194:0 shutting down...
I20260709 13:07:39.896247 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:39.896842 14139 tablet_replica.cc:333] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387: stopping tablet replica
I20260709 13:07:39.897360 14139 raft_consensus.cc:2243] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.897972 14139 pending_rounds.cc:70] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387: Trying to abort 1 pending ops.
I20260709 13:07:39.898140 14139 pending_rounds.cc:77] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305635674543919104 op_type: NO_OP noop_request { }
I20260709 13:07:39.898543 14139 raft_consensus.cc:2889] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:39.898818 14139 raft_consensus.cc:2272] T 1297bdf8fb014463bc5d8565020f846f P bac6cce0ef2f4ed4be1f75349f005387 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.900907 14139 tablet_replica.cc:333] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387: stopping tablet replica
I20260709 13:07:39.901425 14139 raft_consensus.cc:2243] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.901816 14139 raft_consensus.cc:2272] T 0d7ecc7d7ac844d2a25095cda9d7e095 P bac6cce0ef2f4ed4be1f75349f005387 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.903805 14139 tablet_replica.cc:333] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387: stopping tablet replica
I20260709 13:07:39.904265 14139 raft_consensus.cc:2243] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.904631 14139 raft_consensus.cc:2272] T be972b528e744812b09e15cda370eaef P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.906950 14139 tablet_replica.cc:333] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387: stopping tablet replica
I20260709 13:07:39.907421 14139 raft_consensus.cc:2243] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.907819 14139 raft_consensus.cc:2272] T dd8e4fbfaf3d41068a53f15f8195451e P bac6cce0ef2f4ed4be1f75349f005387 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.920351 14139 tablet_server.cc:196] TabletServer@127.13.206.194:0 shutdown complete.
I20260709 13:07:39.932986 14139 tablet_server.cc:179] TabletServer@127.13.206.195:0 shutting down...
I20260709 13:07:39.953963 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:39.954663 14139 tablet_replica.cc:333] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99: stopping tablet replica
I20260709 13:07:39.955200 14139 raft_consensus.cc:2243] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.955612 14139 raft_consensus.cc:2272] T 0d7ecc7d7ac844d2a25095cda9d7e095 P aa25762e1d5146f1946c98236b0e9e99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.957466 14139 tablet_replica.cc:333] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99: stopping tablet replica
I20260709 13:07:39.957963 14139 raft_consensus.cc:2243] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.958434 14139 raft_consensus.cc:2272] T 1297bdf8fb014463bc5d8565020f846f P aa25762e1d5146f1946c98236b0e9e99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.961344 14139 tablet_replica.cc:333] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99: stopping tablet replica
I20260709 13:07:39.961839 14139 raft_consensus.cc:2243] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.962299 14139 raft_consensus.cc:2272] T dd8e4fbfaf3d41068a53f15f8195451e P aa25762e1d5146f1946c98236b0e9e99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.964097 14139 tablet_replica.cc:333] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99: stopping tablet replica
I20260709 13:07:39.964537 14139 raft_consensus.cc:2243] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.965330 14139 raft_consensus.cc:2272] T be972b528e744812b09e15cda370eaef P aa25762e1d5146f1946c98236b0e9e99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.978608 14139 tablet_server.cc:196] TabletServer@127.13.206.195:0 shutdown complete.
I20260709 13:07:39.991447 14139 master.cc:562] Master@127.13.206.254:45337 shutting down...
I20260709 13:07:40.008144 14139 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.008726 14139 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.009061 14139 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8d9f7cb11da3412e915a61b42cd7b392: stopping tablet replica
I20260709 13:07:40.027750 14139 master.cc:584] Master@127.13.206.254:45337 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3008 ms)
[----------] 6 tests from LeaderRebalancerTest (360952 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:07:40.055717 14139 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.206.254:45053
I20260709 13:07:40.056921 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:40.061986 26731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:40.062424 26732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:40.063598 26734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:40.064505 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:40.065316 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:40.065538 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:40.065693 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602460065661 us; error 0 us; skew 500 ppm
I20260709 13:07:40.066273 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:40.068552 14139 webserver.cc:533] Webserver started at http://127.13.206.254:37915/ using document root <none> and password file <none>
I20260709 13:07:40.069069 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:40.069273 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:40.069572 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:40.070772 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/master-0-root/instance:
uuid: "11e4636f148641b3aba0ac0b0b40898e"
format_stamp: "Formatted at 2026-07-09 13:07:40 on dist-test-slave-ml7r"
I20260709 13:07:40.075471 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:07:40.079162 26739 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:40.079985 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:40.080322 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/master-0-root
uuid: "11e4636f148641b3aba0ac0b0b40898e"
format_stamp: "Formatted at 2026-07-09 13:07:40 on dist-test-slave-ml7r"
I20260709 13:07:40.080646 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:40.096099 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:40.097180 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:40.133203 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.254:45053
I20260709 13:07:40.133297 26790 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.254:45053 every 8 connection(s)
I20260709 13:07:40.137360 26791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.148347 26791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e: Bootstrap starting.
I20260709 13:07:40.152984 26791 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.157155 26791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e: No bootstrap required, opened a new log
I20260709 13:07:40.159361 26791 raft_consensus.cc:359] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4636f148641b3aba0ac0b0b40898e" member_type: VOTER }
I20260709 13:07:40.159754 26791 raft_consensus.cc:385] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.160005 26791 raft_consensus.cc:740] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11e4636f148641b3aba0ac0b0b40898e, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.160645 26791 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4636f148641b3aba0ac0b0b40898e" member_type: VOTER }
I20260709 13:07:40.161134 26791 raft_consensus.cc:399] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:40.161369 26791 raft_consensus.cc:493] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:40.161648 26791 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.166507 26791 raft_consensus.cc:515] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4636f148641b3aba0ac0b0b40898e" member_type: VOTER }
I20260709 13:07:40.167081 26791 leader_election.cc:304] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11e4636f148641b3aba0ac0b0b40898e; no voters: 
I20260709 13:07:40.168222 26791 leader_election.cc:290] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:40.168574 26794 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:40.169960 26794 raft_consensus.cc:697] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 1 LEADER]: Becoming Leader. State: Replica: 11e4636f148641b3aba0ac0b0b40898e, State: Running, Role: LEADER
I20260709 13:07:40.170679 26794 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4636f148641b3aba0ac0b0b40898e" member_type: VOTER }
I20260709 13:07:40.171353 26791 sys_catalog.cc:565] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:40.173568 26795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11e4636f148641b3aba0ac0b0b40898e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4636f148641b3aba0ac0b0b40898e" member_type: VOTER } }
I20260709 13:07:40.173532 26796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11e4636f148641b3aba0ac0b0b40898e. Latest consensus state: current_term: 1 leader_uuid: "11e4636f148641b3aba0ac0b0b40898e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11e4636f148641b3aba0ac0b0b40898e" member_type: VOTER } }
I20260709 13:07:40.174369 26795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:40.174467 26796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:40.179677 26799 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:40.188076 26799 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:40.189074 14139 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:40.197459 26799 catalog_manager.cc:1383] Generated new cluster ID: f39e0ab470d44d08a2589c3f6df21746
I20260709 13:07:40.197742 26799 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:40.224411 26799 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:40.225724 26799 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:40.242136 26799 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e: Generated new TSK 0
I20260709 13:07:40.242780 26799 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:40.255704 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:40.261641 26812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:40.263384 26813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:40.264418 26815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:40.264984 14139 server_base.cc:1061] running on GCE node
I20260709 13:07:40.265898 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:40.266109 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:40.266345 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602460266324 us; error 0 us; skew 500 ppm
I20260709 13:07:40.266894 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:40.269290 14139 webserver.cc:533] Webserver started at http://127.13.206.193:46257/ using document root <none> and password file <none>
I20260709 13:07:40.269795 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:40.269994 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:40.270341 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:40.271459 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-0-root/instance:
uuid: "4bb85182ef4d40b9a2d55592dd224e42"
format_stamp: "Formatted at 2026-07-09 13:07:40 on dist-test-slave-ml7r"
I20260709 13:07:40.276482 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:07:40.280323 26820 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:40.281136 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:40.281540 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-0-root
uuid: "4bb85182ef4d40b9a2d55592dd224e42"
format_stamp: "Formatted at 2026-07-09 13:07:40 on dist-test-slave-ml7r"
I20260709 13:07:40.281978 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:40.308471 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:40.309708 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:40.311295 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:40.313639 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:40.313896 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:40.314152 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:40.314404 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:07:40.353647 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.193:40947
I20260709 13:07:40.353734 26882 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.193:40947 every 8 connection(s)
I20260709 13:07:40.358999 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:40.366328 26887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:40.367383 26888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:40.371467 14139 server_base.cc:1061] running on GCE node
W20260709 13:07:40.372025 26891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:40.372687 26883 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45053
I20260709 13:07:40.373172 26883 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:40.373745 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:40.374027 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:40.374081 26883 heartbeater.cc:507] Master 127.13.206.254:45053 requested a full tablet report, sending...
I20260709 13:07:40.374264 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602460374219 us; error 0 us; skew 500 ppm
I20260709 13:07:40.375010 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:40.376511 26756 ts_manager.cc:194] Registered new tserver with Master: 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947)
I20260709 13:07:40.377908 14139 webserver.cc:533] Webserver started at http://127.13.206.194:40553/ using document root <none> and password file <none>
I20260709 13:07:40.378559 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:40.378599 26756 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54986
I20260709 13:07:40.378788 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:40.379253 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:40.380398 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-1-root/instance:
uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
format_stamp: "Formatted at 2026-07-09 13:07:40 on dist-test-slave-ml7r"
I20260709 13:07:40.385166 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:40.388700 26895 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:40.389518 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:40.389865 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-1-root
uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
format_stamp: "Formatted at 2026-07-09 13:07:40 on dist-test-slave-ml7r"
I20260709 13:07:40.390161 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:40.406715 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:40.407927 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:40.409438 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:40.412086 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:40.412344 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:40.412609 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:40.412791 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:40.451818 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.194:45519
I20260709 13:07:40.451892 26957 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.194:45519 every 8 connection(s)
I20260709 13:07:40.456784 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:40.462904 26961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:40.463922 26962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:40.467028 14139 server_base.cc:1061] running on GCE node
W20260709 13:07:40.466998 26964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:40.468777 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:40.469091 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:40.469254 26958 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45053
I20260709 13:07:40.469324 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602460469304 us; error 0 us; skew 500 ppm
I20260709 13:07:40.469885 26958 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:40.470379 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:40.470839 26958 heartbeater.cc:507] Master 127.13.206.254:45053 requested a full tablet report, sending...
I20260709 13:07:40.473203 14139 webserver.cc:533] Webserver started at http://127.13.206.195:40813/ using document root <none> and password file <none>
I20260709 13:07:40.473431 26756 ts_manager.cc:194] Registered new tserver with Master: 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:40.473943 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:40.474278 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:40.474609 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:40.475406 26756 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54998
I20260709 13:07:40.476111 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-2-root/instance:
uuid: "693f641ab9504007b7e12bc60bb0d373"
format_stamp: "Formatted at 2026-07-09 13:07:40 on dist-test-slave-ml7r"
I20260709 13:07:40.481384 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:07:40.485313 26969 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:40.486121 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:40.486476 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-2-root
uuid: "693f641ab9504007b7e12bc60bb0d373"
format_stamp: "Formatted at 2026-07-09 13:07:40 on dist-test-slave-ml7r"
I20260709 13:07:40.486728 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602098938719-14139-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:40.499220 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:40.500262 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:40.501690 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:40.504062 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:40.504293 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:40.504608 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:40.504805 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:40.543910 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.195:45865
I20260709 13:07:40.544034 27031 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.195:45865 every 8 connection(s)
I20260709 13:07:40.559158 27032 heartbeater.cc:344] Connected to a master server at 127.13.206.254:45053
I20260709 13:07:40.559638 27032 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:40.560400 27032 heartbeater.cc:507] Master 127.13.206.254:45053 requested a full tablet report, sending...
I20260709 13:07:40.562431 26756 ts_manager.cc:194] Registered new tserver with Master: 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:40.563304 14139 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016005434s
I20260709 13:07:40.563902 26756 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55010
I20260709 13:07:40.588636 26756 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55026:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:40.591351 26756 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:40.659312 26923 tablet_service.cc:1511] Processing CreateTablet for tablet ec6eb8d6c5e74beb8708231d82f94d19 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:40.660774 26923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6eb8d6c5e74beb8708231d82f94d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.661804 26922 tablet_service.cc:1511] Processing CreateTablet for tablet cde382db1c8b4f65b375329cb3f378e5 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:40.663343 26922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde382db1c8b4f65b375329cb3f378e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.663627 26919 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2dd08cc08949bc89f23c4489f6d831 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:40.665051 26919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2dd08cc08949bc89f23c4489f6d831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.667449 26920 tablet_service.cc:1511] Processing CreateTablet for tablet ba4b5dcf83be4ecaa6465dd4ca4f9260 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:40.668964 26920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4b5dcf83be4ecaa6465dd4ca4f9260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.670495 26918 tablet_service.cc:1511] Processing CreateTablet for tablet 4e09d1b43eb74b2085a251469681bcca (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:40.671335 26921 tablet_service.cc:1511] Processing CreateTablet for tablet 40a8e356629840f89d7da57a66beed52 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:40.675897 26921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40a8e356629840f89d7da57a66beed52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.677356 26918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e09d1b43eb74b2085a251469681bcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.686146 26917 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc38c9005824015ae61c281264adfb8 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:40.687760 26917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc38c9005824015ae61c281264adfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.687944 26847 tablet_service.cc:1511] Processing CreateTablet for tablet cde382db1c8b4f65b375329cb3f378e5 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:40.686146 26848 tablet_service.cc:1511] Processing CreateTablet for tablet ec6eb8d6c5e74beb8708231d82f94d19 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:40.689755 26847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde382db1c8b4f65b375329cb3f378e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.692421 26848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6eb8d6c5e74beb8708231d82f94d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.691637 26846 tablet_service.cc:1511] Processing CreateTablet for tablet 40a8e356629840f89d7da57a66beed52 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:40.694262 26846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40a8e356629840f89d7da57a66beed52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.710089 26845 tablet_service.cc:1511] Processing CreateTablet for tablet ba4b5dcf83be4ecaa6465dd4ca4f9260 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:40.712319 26845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4b5dcf83be4ecaa6465dd4ca4f9260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.712772 26995 tablet_service.cc:1511] Processing CreateTablet for tablet 40a8e356629840f89d7da57a66beed52 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:40.715401 26994 tablet_service.cc:1511] Processing CreateTablet for tablet ba4b5dcf83be4ecaa6465dd4ca4f9260 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:40.715855 26844 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2dd08cc08949bc89f23c4489f6d831 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:40.717746 26993 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2dd08cc08949bc89f23c4489f6d831 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:40.719343 26916 tablet_service.cc:1511] Processing CreateTablet for tablet 220f537ca99946228d7ae4913e7b8f8f (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:40.720108 26992 tablet_service.cc:1511] Processing CreateTablet for tablet 4e09d1b43eb74b2085a251469681bcca (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:40.720855 26916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220f537ca99946228d7ae4913e7b8f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.722574 26996 tablet_service.cc:1511] Processing CreateTablet for tablet cde382db1c8b4f65b375329cb3f378e5 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:40.723785 26842 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc38c9005824015ae61c281264adfb8 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:40.725024 26991 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc38c9005824015ae61c281264adfb8 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:40.727097 26843 tablet_service.cc:1511] Processing CreateTablet for tablet 4e09d1b43eb74b2085a251469681bcca (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:40.727944 26990 tablet_service.cc:1511] Processing CreateTablet for tablet 220f537ca99946228d7ae4913e7b8f8f (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:40.711083 26997 tablet_service.cc:1511] Processing CreateTablet for tablet ec6eb8d6c5e74beb8708231d82f94d19 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:40.730538 26841 tablet_service.cc:1511] Processing CreateTablet for tablet 220f537ca99946228d7ae4913e7b8f8f (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:40.732286 26995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40a8e356629840f89d7da57a66beed52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.717732 26844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2dd08cc08949bc89f23c4489f6d831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.734742 26842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc38c9005824015ae61c281264adfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.738652 26843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e09d1b43eb74b2085a251469681bcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.738399 26915 tablet_service.cc:1511] Processing CreateTablet for tablet fca78226789d4f70bafdb40b1e7a0f30 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:40.739938 26915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca78226789d4f70bafdb40b1e7a0f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.739845 26989 tablet_service.cc:1511] Processing CreateTablet for tablet fca78226789d4f70bafdb40b1e7a0f30 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:40.741381 26989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca78226789d4f70bafdb40b1e7a0f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.742628 26841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220f537ca99946228d7ae4913e7b8f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.742765 26991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc38c9005824015ae61c281264adfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.746130 26993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2dd08cc08949bc89f23c4489f6d831. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.748292 26996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cde382db1c8b4f65b375329cb3f378e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.750648 26997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec6eb8d6c5e74beb8708231d82f94d19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.753139 26994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba4b5dcf83be4ecaa6465dd4ca4f9260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.754747 26990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 220f537ca99946228d7ae4913e7b8f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.758630 26992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e09d1b43eb74b2085a251469681bcca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.784379 26840 tablet_service.cc:1511] Processing CreateTablet for tablet fca78226789d4f70bafdb40b1e7a0f30 (DEFAULT_TABLE table=test-workload [id=5de37f6165cd4697b3e9bb195c2b8a66]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:40.785920 26840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fca78226789d4f70bafdb40b1e7a0f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.844761 27047 tablet_bootstrap.cc:492] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:40.849781 27048 tablet_bootstrap.cc:492] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:40.863278 27047 tablet_bootstrap.cc:654] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.893025 27048 tablet_bootstrap.cc:654] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.897451 27049 tablet_bootstrap.cc:492] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:40.904639 27047 tablet_bootstrap.cc:492] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:40.905256 27047 ts_tablet_manager.cc:1403] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.009s
I20260709 13:07:40.905364 27049 tablet_bootstrap.cc:654] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.907670 27048 tablet_bootstrap.cc:492] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:40.908197 27048 ts_tablet_manager.cc:1403] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.000s
I20260709 13:07:40.908665 27047 raft_consensus.cc:359] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.909401 27047 raft_consensus.cc:385] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.909718 27047 raft_consensus.cc:740] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.910815 27049 tablet_bootstrap.cc:492] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:40.910543 27047 consensus_queue.cc:260] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.911376 27049 ts_tablet_manager.cc:1403] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:07:40.911053 27048 raft_consensus.cc:359] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.911896 27048 raft_consensus.cc:385] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.912261 27048 raft_consensus.cc:740] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.913007 27048 consensus_queue.cc:260] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.915217 27032 heartbeater.cc:499] Master 127.13.206.254:45053 was elected leader, sending a full tablet report...
I20260709 13:07:40.915501 27048 ts_tablet_manager.cc:1434] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:07:40.916527 27048 tablet_bootstrap.cc:492] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:40.918911 27049 raft_consensus.cc:359] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.919894 27049 raft_consensus.cc:385] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.920272 27049 raft_consensus.cc:740] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.921314 27049 consensus_queue.cc:260] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.922834 27048 tablet_bootstrap.cc:654] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.924054 26958 heartbeater.cc:499] Master 127.13.206.254:45053 was elected leader, sending a full tablet report...
I20260709 13:07:40.933192 27047 ts_tablet_manager.cc:1434] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.028s	user 0.012s	sys 0.008s
I20260709 13:07:40.934489 27047 tablet_bootstrap.cc:492] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:40.940819 27047 tablet_bootstrap.cc:654] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.945860 27048 tablet_bootstrap.cc:492] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:40.946697 27048 ts_tablet_manager.cc:1403] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.012s
I20260709 13:07:40.950834 27048 raft_consensus.cc:359] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.951974 27048 raft_consensus.cc:385] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.952399 27048 raft_consensus.cc:740] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.953856 27047 tablet_bootstrap.cc:492] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:40.953605 27048 consensus_queue.cc:260] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.954470 27047 ts_tablet_manager.cc:1403] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 13:07:40.957070 27048 ts_tablet_manager.cc:1434] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:07:40.958652 27048 tablet_bootstrap.cc:492] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:40.958514 27047 raft_consensus.cc:359] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.959503 27047 raft_consensus.cc:385] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.959846 27047 raft_consensus.cc:740] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.960896 27047 consensus_queue.cc:260] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.962095 27053 raft_consensus.cc:493] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.962623 27053 raft_consensus.cc:515] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:40.966526 27048 tablet_bootstrap.cc:654] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.965593 27053 leader_election.cc:290] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:40.972293 26883 heartbeater.cc:499] Master 127.13.206.254:45053 was elected leader, sending a full tablet report...
I20260709 13:07:40.974404 27049 ts_tablet_manager.cc:1434] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.063s	user 0.020s	sys 0.025s
I20260709 13:07:40.976152 27049 tablet_bootstrap.cc:492] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:40.992462 27049 tablet_bootstrap.cc:654] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.997502 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:40.998397 26858 raft_consensus.cc:2468] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:41.000989 27048 tablet_bootstrap.cc:492] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:41.001616 27048 ts_tablet_manager.cc:1403] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.024s
I20260709 13:07:41.002276 27047 ts_tablet_manager.cc:1434] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.047s	user 0.015s	sys 0.006s
I20260709 13:07:41.003464 27047 tablet_bootstrap.cc:492] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:41.004328 27048 raft_consensus.cc:359] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.004979 27048 raft_consensus.cc:385] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.005244 27048 raft_consensus.cc:740] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.006137 27049 tablet_bootstrap.cc:492] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:41.006006 27048 consensus_queue.cc:260] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.006771 27049 ts_tablet_manager.cc:1403] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.007s
I20260709 13:07:41.007119 26897 leader_election.cc:304] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:41.009980 27047 tablet_bootstrap.cc:654] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.010354 27058 raft_consensus.cc:2804] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.011015 27058 raft_consensus.cc:493] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.010385 27049 raft_consensus.cc:359] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.011415 27058 raft_consensus.cc:3060] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.011487 27049 raft_consensus.cc:385] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.012040 27049 raft_consensus.cc:740] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.008334 27048 ts_tablet_manager.cc:1434] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:41.012893 27049 consensus_queue.cc:260] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.016062 27049 ts_tablet_manager.cc:1434] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:41.013900 27048 tablet_bootstrap.cc:492] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:41.017529 27049 tablet_bootstrap.cc:492] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:41.029136 27048 tablet_bootstrap.cc:654] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.031679 27049 tablet_bootstrap.cc:654] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.035296 27058 raft_consensus.cc:515] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.037103 27048 tablet_bootstrap.cc:492] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:41.037478 27007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:41.040920 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:41.040978 27048 ts_tablet_manager.cc:1403] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:07:41.040993 27007 raft_consensus.cc:2468] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:41.041682 26858 raft_consensus.cc:3060] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.044502 27048 raft_consensus.cc:359] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.045377 27048 raft_consensus.cc:385] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.045693 27048 raft_consensus.cc:740] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.048789 27007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:41.049495 27007 raft_consensus.cc:3060] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.049685 27058 leader_election.cc:290] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.051421 26858 raft_consensus.cc:2468] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:41.051424 27048 consensus_queue.cc:260] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.053194 26897 leader_election.cc:304] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:41.054198 27048 ts_tablet_manager.cc:1434] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:07:41.055361 27048 tablet_bootstrap.cc:492] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:41.058708 27058 raft_consensus.cc:2804] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.060350 27058 raft_consensus.cc:697] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:41.062670 27058 consensus_queue.cc:237] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.061228 27007 raft_consensus.cc:2468] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:41.061707 27048 tablet_bootstrap.cc:654] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.064992 27047 tablet_bootstrap.cc:492] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:41.065001 27049 tablet_bootstrap.cc:492] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:41.066008 27047 ts_tablet_manager.cc:1403] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.009s
I20260709 13:07:41.066617 27049 ts_tablet_manager.cc:1403] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.019s
I20260709 13:07:41.073427 27048 tablet_bootstrap.cc:492] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:41.109223 27048 ts_tablet_manager.cc:1403] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.000s
I20260709 13:07:41.073565 27047 raft_consensus.cc:359] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.110466 27047 raft_consensus.cc:385] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.110996 27047 raft_consensus.cc:740] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.112429 27047 consensus_queue.cc:260] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.117523 27047 ts_tablet_manager.cc:1434] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.050s	user 0.011s	sys 0.001s
I20260709 13:07:41.120246 27047 tablet_bootstrap.cc:492] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:41.123087 27049 raft_consensus.cc:359] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.124330 27049 raft_consensus.cc:385] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.124682 27049 raft_consensus.cc:740] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.125926 27049 consensus_queue.cc:260] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.126722 26756 catalog_manager.cc:5697] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.129400 27049 ts_tablet_manager.cc:1434] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.004s
I20260709 13:07:41.131238 27047 tablet_bootstrap.cc:654] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.116361 27048 raft_consensus.cc:359] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.138410 27048 raft_consensus.cc:385] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.138799 27048 raft_consensus.cc:740] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.139891 27048 consensus_queue.cc:260] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.143769 27048 ts_tablet_manager.cc:1434] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.012s
I20260709 13:07:41.145613 27048 tablet_bootstrap.cc:492] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:41.131773 27049 tablet_bootstrap.cc:492] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:41.149516 27054 raft_consensus.cc:493] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.150327 27054 raft_consensus.cc:515] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.154729 27054 leader_election.cc:290] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:41.159260 27058 raft_consensus.cc:493] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.160185 27058 raft_consensus.cc:515] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.166618 27007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc38c9005824015ae61c281264adfb8" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:41.167877 27007 raft_consensus.cc:2468] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:41.171504 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc38c9005824015ae61c281264adfb8" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
W20260709 13:07:41.175284 26897 leader_election.cc:343] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.175706 27048 tablet_bootstrap.cc:654] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.176399 26897 leader_election.cc:304] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:41.164007 27058 leader_election.cc:290] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.179091 27058 raft_consensus.cc:2804] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.179533 27058 raft_consensus.cc:493] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.179932 27058 raft_consensus.cc:3060] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.182319 27047 tablet_bootstrap.cc:492] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:41.183912 27047 ts_tablet_manager.cc:1403] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.014s
W20260709 13:07:41.189363 26804 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:41.191747 27047 raft_consensus.cc:359] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.192807 27047 raft_consensus.cc:385] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.193111 27047 raft_consensus.cc:740] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.198975 27054 raft_consensus.cc:493] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.200276 27054 raft_consensus.cc:515] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.203477 27054 leader_election.cc:290] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947)
I20260709 13:07:41.209858 27055 raft_consensus.cc:493] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.210575 27047 consensus_queue.cc:260] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.210822 27055 raft_consensus.cc:515] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.213860 27049 tablet_bootstrap.cc:654] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.218791 27055 leader_election.cc:290] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.228070 27047 ts_tablet_manager.cc:1434] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.010s
I20260709 13:07:41.231052 27047 tablet_bootstrap.cc:492] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:41.240513 27049 tablet_bootstrap.cc:492] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:41.241153 27049 ts_tablet_manager.cc:1403] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.007s
I20260709 13:07:41.243005 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a8e356629840f89d7da57a66beed52" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:41.243278 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:41.244069 26857 raft_consensus.cc:2468] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 0.
W20260709 13:07:41.245177 26971 leader_election.cc:343] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.246482 26971 leader_election.cc:304] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:41.247653 27054 raft_consensus.cc:2804] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.248107 27054 raft_consensus.cc:493] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.248453 27054 raft_consensus.cc:3060] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.250703 27058 raft_consensus.cc:515] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.251147 27049 raft_consensus.cc:359] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.262988 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc38c9005824015ae61c281264adfb8" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:41.263703 27006 raft_consensus.cc:3060] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.252830 27049 raft_consensus.cc:385] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.265146 27049 raft_consensus.cc:740] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.266314 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a8e356629840f89d7da57a66beed52" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:41.268289 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
W20260709 13:07:41.269838 26972 leader_election.cc:343] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.270383 26972 leader_election.cc:304] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373; no voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:41.270484 27049 consensus_queue.cc:260] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.273864 27006 raft_consensus.cc:2468] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:41.275082 26897 leader_election.cc:304] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:41.275970 27053 raft_consensus.cc:2804] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.276084 27049 ts_tablet_manager.cc:1434] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 13:07:41.277513 27053 raft_consensus.cc:697] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:41.256073 27047 tablet_bootstrap.cc:654] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.259088 27048 tablet_bootstrap.cc:492] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:41.278883 27048 ts_tablet_manager.cc:1403] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.134s	user 0.026s	sys 0.006s
I20260709 13:07:41.278764 27053 consensus_queue.cc:237] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.277791 27049 tablet_bootstrap.cc:492] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:41.262036 27058 leader_election.cc:290] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.253440 27007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:41.261883 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc38c9005824015ae61c281264adfb8" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
W20260709 13:07:41.287784 26972 leader_election.cc:343] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.287007 27048 raft_consensus.cc:359] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.289796 27048 raft_consensus.cc:385] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.290203 27048 raft_consensus.cc:740] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
W20260709 13:07:41.287784 26897 leader_election.cc:343] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.291488 27048 consensus_queue.cc:260] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.294798 27047 tablet_bootstrap.cc:492] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:41.294763 27078 raft_consensus.cc:2749] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.295517 27047 ts_tablet_manager.cc:1403] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.007s
I20260709 13:07:41.301554 27047 raft_consensus.cc:359] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.302363 27047 raft_consensus.cc:385] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.302731 27047 raft_consensus.cc:740] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.303722 27049 tablet_bootstrap.cc:654] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.303818 27047 consensus_queue.cc:260] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.307432 27047 ts_tablet_manager.cc:1434] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:07:41.310595 27047 tablet_bootstrap.cc:492] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:41.311466 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:41.312299 26932 raft_consensus.cc:2468] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 0.
I20260709 13:07:41.314427 26823 leader_election.cc:304] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:41.314597 27054 raft_consensus.cc:515] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.316009 27007 raft_consensus.cc:2393] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bb85182ef4d40b9a2d55592dd224e42 in current term 1: Already voted for candidate 693f641ab9504007b7e12bc60bb0d373 in this term.
I20260709 13:07:41.315924 27055 raft_consensus.cc:2804] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.317057 27055 raft_consensus.cc:493] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.317407 27055 raft_consensus.cc:3060] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.324167 27047 tablet_bootstrap.cc:654] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.325691 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:41.326498 26932 raft_consensus.cc:3060] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.329922 26756 catalog_manager.cc:5697] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.336457 27048 ts_tablet_manager.cc:1434] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.018s
I20260709 13:07:41.338722 27048 tablet_bootstrap.cc:492] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:41.350139 27082 raft_consensus.cc:493] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.350538 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:41.350875 27082 raft_consensus.cc:515] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.351342 27054 leader_election.cc:290] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947)
I20260709 13:07:41.353478 27082 leader_election.cc:290] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:41.354462 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f537ca99946228d7ae4913e7b8f8f" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:41.355497 26858 raft_consensus.cc:2468] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 0.
I20260709 13:07:41.355734 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f537ca99946228d7ae4913e7b8f8f" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:41.357475 26971 leader_election.cc:304] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:41.358917 27082 raft_consensus.cc:2804] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:41.359257 26972 leader_election.cc:343] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.359495 27082 raft_consensus.cc:493] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.360863 27082 raft_consensus.cc:3060] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.366355 27049 tablet_bootstrap.cc:492] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:41.367044 27049 ts_tablet_manager.cc:1403] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.090s	user 0.020s	sys 0.036s
I20260709 13:07:41.369582 27048 tablet_bootstrap.cc:654] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.370813 27049 raft_consensus.cc:359] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.371712 27049 raft_consensus.cc:385] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.372061 27049 raft_consensus.cc:740] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.373086 27049 consensus_queue.cc:260] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.375475 27047 tablet_bootstrap.cc:492] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:41.376153 27047 ts_tablet_manager.cc:1403] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.066s	user 0.027s	sys 0.027s
I20260709 13:07:41.379523 27055 raft_consensus.cc:515] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.380961 26857 raft_consensus.cc:2393] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 693f641ab9504007b7e12bc60bb0d373 in current term 1: Already voted for candidate 4bb85182ef4d40b9a2d55592dd224e42 in this term.
I20260709 13:07:41.390321 27054 raft_consensus.cc:493] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.391160 27054 raft_consensus.cc:515] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.402577 27007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:41.403510 27007 raft_consensus.cc:2393] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4bb85182ef4d40b9a2d55592dd224e42 in current term 1: Already voted for candidate 693f641ab9504007b7e12bc60bb0d373 in this term.
I20260709 13:07:41.403782 27049 ts_tablet_manager.cc:1434] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.011s
I20260709 13:07:41.404642 27048 tablet_bootstrap.cc:492] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:41.404915 26933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:41.405262 27048 ts_tablet_manager.cc:1403] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.010s
I20260709 13:07:41.405241 26931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2dd08cc08949bc89f23c4489f6d831" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:41.401659 27047 raft_consensus.cc:359] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.406991 27047 raft_consensus.cc:385] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:41.407393 26972 leader_election.cc:343] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.408452 26822 leader_election.cc:304] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42; no voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:41.409010 27053 raft_consensus.cc:493] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.409127 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2dd08cc08949bc89f23c4489f6d831" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:41.407430 27047 raft_consensus.cc:740] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.409730 27053 raft_consensus.cc:515] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.409113 27048 raft_consensus.cc:359] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.411154 27048 raft_consensus.cc:385] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.411484 27048 raft_consensus.cc:740] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.412150 27053 leader_election.cc:290] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.412858 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b5dcf83be4ecaa6465dd4ca4f9260" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
W20260709 13:07:41.413491 26971 leader_election.cc:343] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.412401 27048 consensus_queue.cc:260] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.413622 26857 raft_consensus.cc:2468] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:41.413676 27007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b5dcf83be4ecaa6465dd4ca4f9260" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:41.414068 26971 leader_election.cc:304] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373; no voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:41.410305 27054 leader_election.cc:290] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:41.415216 27078 raft_consensus.cc:2749] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.416301 27048 ts_tablet_manager.cc:1434] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
W20260709 13:07:41.417232 26897 leader_election.cc:343] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.417981 27048 tablet_bootstrap.cc:492] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:41.418159 26897 leader_election.cc:304] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 693f641ab9504007b7e12bc60bb0d373
I20260709 13:07:41.413494 27086 raft_consensus.cc:2749] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.417981 27049 tablet_bootstrap.cc:492] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:41.421305 27055 leader_election.cc:290] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.418651 27082 raft_consensus.cc:515] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.425060 26931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f537ca99946228d7ae4913e7b8f8f" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
W20260709 13:07:41.426553 26972 leader_election.cc:343] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.426764 27053 raft_consensus.cc:2804] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.427037 27048 tablet_bootstrap.cc:654] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.427454 27053 raft_consensus.cc:493] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.427925 27053 raft_consensus.cc:3060] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.431071 26932 raft_consensus.cc:2468] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 1.
I20260709 13:07:41.431996 27049 tablet_bootstrap.cc:654] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.432552 26972 leader_election.cc:304] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:41.433495 27078 raft_consensus.cc:2804] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.433935 27082 leader_election.cc:290] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:41.433990 27078 raft_consensus.cc:697] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:41.435618 27078 consensus_queue.cc:237] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.439025 27048 tablet_bootstrap.cc:492] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:41.439786 27048 ts_tablet_manager.cc:1403] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:07:41.443430 27048 raft_consensus.cc:359] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.444476 27048 raft_consensus.cc:385] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.444829 27048 raft_consensus.cc:740] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.445132 27058 raft_consensus.cc:493] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.445796 27058 raft_consensus.cc:515] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.445626 27048 consensus_queue.cc:260] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.447973 27058 leader_election.cc:290] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.448452 27048 ts_tablet_manager.cc:1434] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:07:41.449709 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e09d1b43eb74b2085a251469681bcca" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
W20260709 13:07:41.452231 26897 leader_election.cc:343] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.452775 27007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e09d1b43eb74b2085a251469681bcca" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:41.453568 27007 raft_consensus.cc:2468] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:41.449805 27048 tablet_bootstrap.cc:492] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:41.410835 27047 consensus_queue.cc:260] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.455204 26897 leader_election.cc:304] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:41.456187 27058 raft_consensus.cc:2804] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.456584 27058 raft_consensus.cc:493] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.456768 27047 ts_tablet_manager.cc:1434] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 13:07:41.456948 27058 raft_consensus.cc:3060] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.458282 27047 tablet_bootstrap.cc:492] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:41.458510 27049 tablet_bootstrap.cc:492] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:41.459115 27049 ts_tablet_manager.cc:1403] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.000s
I20260709 13:07:41.461740 27048 tablet_bootstrap.cc:654] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.462726 27049 raft_consensus.cc:359] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.463657 27049 raft_consensus.cc:385] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.464004 27049 raft_consensus.cc:740] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.465364 27053 raft_consensus.cc:515] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.469064 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b5dcf83be4ecaa6465dd4ca4f9260" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
W20260709 13:07:41.469389 26971 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.193:40947, user_credentials={real_user=slave}} blocked reactor thread for 55956.2us
I20260709 13:07:41.469811 26857 raft_consensus.cc:3060] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.473863 27048 tablet_bootstrap.cc:492] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:41.474586 27048 ts_tablet_manager.cc:1403] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.011s
I20260709 13:07:41.476079 27007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b5dcf83be4ecaa6465dd4ca4f9260" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:41.467841 27053 leader_election.cc:290] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.476835 27007 raft_consensus.cc:3060] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.477795 27048 raft_consensus.cc:359] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.478729 27048 raft_consensus.cc:385] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.479035 27048 raft_consensus.cc:740] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.479790 27048 consensus_queue.cc:260] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.480477 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f537ca99946228d7ae4913e7b8f8f" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:41.481141 26858 raft_consensus.cc:3060] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.482337 27048 ts_tablet_manager.cc:1434] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:41.482501 27053 raft_consensus.cc:493] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.487639 27053 raft_consensus.cc:515] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.488703 27079 consensus_queue.cc:1048] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:41.489581 27049 consensus_queue.cc:260] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.490442 27079 consensus_queue.cc:1048] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:41.492211 27049 ts_tablet_manager.cc:1434] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:07:41.492306 26858 raft_consensus.cc:2468] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 1.
I20260709 13:07:41.493744 27049 tablet_bootstrap.cc:492] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:41.493794 26971 leader_election.cc:304] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:41.494144 27053 leader_election.cc:290] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.488392 26857 raft_consensus.cc:2468] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:41.476372 27047 tablet_bootstrap.cc:654] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.486665 27058 raft_consensus.cc:515] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.498492 27088 raft_consensus.cc:2804] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.499693 27088 raft_consensus.cc:697] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:41.500686 27088 consensus_queue.cc:237] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.502506 27049 tablet_bootstrap.cc:654] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.501261 27058 leader_election.cc:290] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.520319 27007 raft_consensus.cc:2468] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:41.524396 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e09d1b43eb74b2085a251469681bcca" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:41.524698 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a8e356629840f89d7da57a66beed52" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:41.525317 27006 raft_consensus.cc:2468] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:41.526873 26897 leader_election.cc:304] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:41.527777 27079 raft_consensus.cc:2804] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.528316 27079 raft_consensus.cc:697] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:41.529182 27079 consensus_queue.cc:237] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.530755 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a8e356629840f89d7da57a66beed52" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:41.531457 26857 raft_consensus.cc:2468] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:41.532894 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e09d1b43eb74b2085a251469681bcca" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:41.533640 27006 raft_consensus.cc:3060] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:41.535064 26897 leader_election.cc:343] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.538370 26897 leader_election.cc:304] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:41.542618 27058 raft_consensus.cc:2804] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.543139 27058 raft_consensus.cc:493] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.543558 27058 raft_consensus.cc:3060] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.552799 27058 raft_consensus.cc:515] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.561923 27058 leader_election.cc:290] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.563871 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a8e356629840f89d7da57a66beed52" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:41.570336 26857 raft_consensus.cc:3060] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.580654 26857 raft_consensus.cc:2468] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:41.566147 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a8e356629840f89d7da57a66beed52" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:41.553763 27006 raft_consensus.cc:2468] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:41.591933 27004 raft_consensus.cc:3060] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.599414 26897 leader_election.cc:304] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:41.600585 27093 raft_consensus.cc:2804] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.601846 27047 tablet_bootstrap.cc:492] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:41.601962 27093 raft_consensus.cc:697] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:41.602813 27047 ts_tablet_manager.cc:1403] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.012s
I20260709 13:07:41.603009 27004 raft_consensus.cc:2468] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:41.604034 27093 consensus_queue.cc:237] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.589694 26756 catalog_manager.cc:5697] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.607685 26897 leader_election.cc:304] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:41.609479 27053 raft_consensus.cc:2804] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.609992 27049 tablet_bootstrap.cc:492] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:41.610096 27053 raft_consensus.cc:697] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:41.611095 27049 ts_tablet_manager.cc:1403] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.118s	user 0.041s	sys 0.066s
I20260709 13:07:41.609721 27047 raft_consensus.cc:359] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.611773 27047 raft_consensus.cc:385] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.611433 27053 consensus_queue.cc:237] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.612959 27047 raft_consensus.cc:740] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.617614 27047 consensus_queue.cc:260] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.621127 27047 ts_tablet_manager.cc:1434] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:07:41.623045 27047 tablet_bootstrap.cc:492] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:41.615644 27049 raft_consensus.cc:359] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.626427 27049 raft_consensus.cc:385] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.626809 27049 raft_consensus.cc:740] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.627911 27049 consensus_queue.cc:260] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.627947 26755 catalog_manager.cc:5697] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.630522 27049 ts_tablet_manager.cc:1434] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:07:41.630183 26755 catalog_manager.cc:5697] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.631875 27049 tablet_bootstrap.cc:492] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:41.636401 27047 tablet_bootstrap.cc:654] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.639955 27049 tablet_bootstrap.cc:654] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.648092 27047 tablet_bootstrap.cc:492] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:41.648627 27047 ts_tablet_manager.cc:1403] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.005s
I20260709 13:07:41.648699 27049 tablet_bootstrap.cc:492] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:41.649246 27049 ts_tablet_manager.cc:1403] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:07:41.651793 27047 raft_consensus.cc:359] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.652128 27049 raft_consensus.cc:359] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.652608 27047 raft_consensus.cc:385] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.652930 27049 raft_consensus.cc:385] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.653074 27047 raft_consensus.cc:740] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.653290 27049 raft_consensus.cc:740] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.654110 27049 consensus_queue.cc:260] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.654074 27047 consensus_queue.cc:260] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.656150 27049 ts_tablet_manager.cc:1434] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:41.656693 27047 ts_tablet_manager.cc:1434] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:41.657366 27049 tablet_bootstrap.cc:492] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:41.657191 26753 catalog_manager.cc:5697] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.660002 26753 catalog_manager.cc:5697] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.663969 27049 tablet_bootstrap.cc:654] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.664883 27093 raft_consensus.cc:493] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.665537 27093 raft_consensus.cc:515] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.670464 27047 tablet_bootstrap.cc:492] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:41.673085 27088 raft_consensus.cc:493] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.673909 27088 raft_consensus.cc:515] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.677932 27047 tablet_bootstrap.cc:654] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.678889 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca78226789d4f70bafdb40b1e7a0f30" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:41.679950 26858 raft_consensus.cc:2468] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 0.
I20260709 13:07:41.682209 26971 leader_election.cc:304] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:41.683646 27078 raft_consensus.cc:2804] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.684226 27078 raft_consensus.cc:493] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.684659 27078 raft_consensus.cc:3060] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.688711 27093 leader_election.cc:290] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.693068 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca78226789d4f70bafdb40b1e7a0f30" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:41.694635 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca78226789d4f70bafdb40b1e7a0f30" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:41.695401 26858 raft_consensus.cc:2468] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:41.695686 27049 tablet_bootstrap.cc:492] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:41.696404 27049 ts_tablet_manager.cc:1403] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.024s
I20260709 13:07:41.697074 26897 leader_election.cc:304] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:41.699501 27088 leader_election.cc:290] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:41.699733 27049 raft_consensus.cc:359] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.700141 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca78226789d4f70bafdb40b1e7a0f30" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:41.700790 27049 raft_consensus.cc:385] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.701227 27049 raft_consensus.cc:740] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.700532 27093 raft_consensus.cc:2804] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.701905 27049 consensus_queue.cc:260] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.702661 26932 raft_consensus.cc:2468] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 0.
I20260709 13:07:41.705421 27093 raft_consensus.cc:493] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.705924 27093 raft_consensus.cc:3060] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.706935 27049 ts_tablet_manager.cc:1434] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:41.708015 27078 raft_consensus.cc:515] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.709430 27005 raft_consensus.cc:2393] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e72c084cb0f4ef88534cd1cd6d6836d in current term 1: Already voted for candidate 693f641ab9504007b7e12bc60bb0d373 in this term.
I20260709 13:07:41.710507 27078 leader_election.cc:290] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:41.711742 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca78226789d4f70bafdb40b1e7a0f30" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:41.713371 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca78226789d4f70bafdb40b1e7a0f30" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:41.714068 26858 raft_consensus.cc:3060] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.720883 26858 raft_consensus.cc:2468] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 1.
I20260709 13:07:41.722015 26971 leader_election.cc:304] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:41.722883 27078 raft_consensus.cc:2804] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.723368 27078 raft_consensus.cc:697] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:41.724113 27078 consensus_queue.cc:237] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.727118 27093 raft_consensus.cc:515] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.728986 26932 raft_consensus.cc:2393] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 693f641ab9504007b7e12bc60bb0d373 in current term 1: Already voted for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in this term.
I20260709 13:07:41.731259 27093 leader_election.cc:290] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.733523 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca78226789d4f70bafdb40b1e7a0f30" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:41.733850 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fca78226789d4f70bafdb40b1e7a0f30" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:41.733256 26755 catalog_manager.cc:5697] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:41.734452 26858 raft_consensus.cc:2393] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e72c084cb0f4ef88534cd1cd6d6836d in current term 1: Already voted for candidate 693f641ab9504007b7e12bc60bb0d373 in this term.
I20260709 13:07:41.734754 27047 tablet_bootstrap.cc:492] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:41.735337 27047 ts_tablet_manager.cc:1403] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.078s	user 0.031s	sys 0.021s
I20260709 13:07:41.735906 26897 leader_election.cc:304] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373
I20260709 13:07:41.736690 27093 raft_consensus.cc:2749] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.738507 27047 raft_consensus.cc:359] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.739321 27047 raft_consensus.cc:385] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.739589 27047 raft_consensus.cc:740] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.740352 27047 consensus_queue.cc:260] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.742734 27047 ts_tablet_manager.cc:1434] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:41.743139 26858 raft_consensus.cc:3060] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.743279 27055 raft_consensus.cc:493] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.743901 27055 raft_consensus.cc:515] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.746253 27055 leader_election.cc:290] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.747488 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e09d1b43eb74b2085a251469681bcca" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:41.747463 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e09d1b43eb74b2085a251469681bcca" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:41.748696 27005 raft_consensus.cc:2393] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4bb85182ef4d40b9a2d55592dd224e42 in current term 1: Already voted for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in this term.
I20260709 13:07:41.749984 26823 leader_election.cc:304] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42; no voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:41.750931 27055 raft_consensus.cc:3060] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.754581 27093 raft_consensus.cc:493] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.755229 27093 raft_consensus.cc:515] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.758782 27055 raft_consensus.cc:2749] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.758534 27053 consensus_queue.cc:1048] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:41.758900 27093 leader_election.cc:290] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.760361 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2dd08cc08949bc89f23c4489f6d831" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:41.760663 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2dd08cc08949bc89f23c4489f6d831" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:41.761116 26858 raft_consensus.cc:2468] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:41.761390 27005 raft_consensus.cc:2468] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:41.762262 26897 leader_election.cc:304] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:41.763314 27053 raft_consensus.cc:2804] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.763687 27053 raft_consensus.cc:493] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.764011 27053 raft_consensus.cc:3060] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.774289 27053 raft_consensus.cc:515] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.774616 27079 consensus_queue.cc:1048] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:41.776537 27053 leader_election.cc:290] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.777441 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2dd08cc08949bc89f23c4489f6d831" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:41.778179 26857 raft_consensus.cc:3060] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.779793 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2dd08cc08949bc89f23c4489f6d831" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:41.780488 27004 raft_consensus.cc:3060] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.788980 27004 raft_consensus.cc:2468] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:41.789284 26857 raft_consensus.cc:2468] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:41.790658 26897 leader_election.cc:304] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:41.791661 27053 raft_consensus.cc:2804] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.792213 27053 raft_consensus.cc:697] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:41.793069 27053 consensus_queue.cc:237] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.800684 26756 catalog_manager.cc:5697] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.929090 27078 consensus_queue.cc:1048] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:41.940245 27088 consensus_queue.cc:1048] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:41.966341 27053 raft_consensus.cc:493] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.966836 27053 raft_consensus.cc:515] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:41.968650 27053 leader_election.cc:290] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:41.969645 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f537ca99946228d7ae4913e7b8f8f" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:41.969944 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f537ca99946228d7ae4913e7b8f8f" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:41.970412 26857 raft_consensus.cc:2393] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e72c084cb0f4ef88534cd1cd6d6836d in current term 1: Already voted for candidate 693f641ab9504007b7e12bc60bb0d373 in this term.
I20260709 13:07:41.971743 26897 leader_election.cc:304] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373
I20260709 13:07:41.972440 27053 raft_consensus.cc:3060] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.977903 27053 raft_consensus.cc:2749] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:41.988862 27053 consensus_queue.cc:1048] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.001861 27053 consensus_queue.cc:1048] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.069635 27053 consensus_queue.cc:1048] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.081172 27079 consensus_queue.cc:1048] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.086797 27054 consensus_queue.cc:1048] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.101948 27053 consensus_queue.cc:1048] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.110525 27054 consensus_queue.cc:1048] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.112790 27079 consensus_queue.cc:1048] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.119169 27006 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19"
dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
mode: GRACEFUL
new_leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:59086
I20260709 13:07:42.120005 27006 raft_consensus.cc:606] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Received request to transfer leadership to TS 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:42.120237 27054 consensus_queue.cc:1048] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.141522 27078 consensus_queue.cc:1048] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.158373 26932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
mode: GRACEFUL
new_leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:58194
I20260709 13:07:42.158924 26932 raft_consensus.cc:606] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Received request to transfer leadership to TS 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:42.164986 26932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40a8e356629840f89d7da57a66beed52"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
mode: GRACEFUL
new_leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:58194
I20260709 13:07:42.165649 26932 raft_consensus.cc:606] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Received request to transfer leadership to TS 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:42.171125 26932 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba4b5dcf83be4ecaa6465dd4ca4f9260"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
mode: GRACEFUL
new_leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:58194
I20260709 13:07:42.171669 26932 raft_consensus.cc:606] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Received request to transfer leadership to TS 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:42.187949 27005 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "220f537ca99946228d7ae4913e7b8f8f"
dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
mode: GRACEFUL
new_leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
 from {username='slave'} at 127.0.0.1:59086
I20260709 13:07:42.188532 27005 raft_consensus.cc:606] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Received request to transfer leadership to TS 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:42.270748 27053 consensus_queue.cc:1048] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.282590 27093 consensus_queue.cc:1048] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.348809 27088 raft_consensus.cc:993] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373: : Instructing follower 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:42.349296 27078 raft_consensus.cc:1081] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Signalling peer 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:42.350914 26856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19"
dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:36282
I20260709 13:07:42.351399 26856 raft_consensus.cc:493] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.351653 26856 raft_consensus.cc:3060] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.357160 26856 raft_consensus.cc:515] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.358871 26856 leader_election.cc:290] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:42.359834 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:42.360078 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec6eb8d6c5e74beb8708231d82f94d19" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:42.360579 26932 raft_consensus.cc:3060] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.360633 27005 raft_consensus.cc:3055] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:42.361055 27005 raft_consensus.cc:740] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:42.361975 27005 consensus_queue.cc:260] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.363360 27005 raft_consensus.cc:3060] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.368531 26932 raft_consensus.cc:2468] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:42.369908 26823 leader_election.cc:304] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:42.370715 27055 raft_consensus.cc:2804] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.371236 27005 raft_consensus.cc:2468] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:42.371798 27055 raft_consensus.cc:697] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:42.372848 27055 consensus_queue.cc:237] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.379573 26754 catalog_manager.cc:5697] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 reported cstate change: term changed from 1 to 2, leader changed from 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195) to 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.618873 27093 raft_consensus.cc:993] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d: : Instructing follower 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:42.619535 27058 raft_consensus.cc:1081] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Signalling peer 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:42.621145 26856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba4b5dcf83be4ecaa6465dd4ca4f9260"
dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:36272
I20260709 13:07:42.621676 26856 raft_consensus.cc:493] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.621994 26856 raft_consensus.cc:3060] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.627310 26856 raft_consensus.cc:515] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.629204 26856 leader_election.cc:290] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:42.630093 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b5dcf83be4ecaa6465dd4ca4f9260" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:42.630424 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba4b5dcf83be4ecaa6465dd4ca4f9260" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:42.630759 26932 raft_consensus.cc:3055] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:42.631027 27005 raft_consensus.cc:3060] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.631155 26932 raft_consensus.cc:740] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:42.632000 26932 consensus_queue.cc:260] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.633003 26932 raft_consensus.cc:3060] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.636859 27005 raft_consensus.cc:2468] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:42.638080 26932 raft_consensus.cc:2468] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:42.638471 26822 leader_election.cc:304] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:42.639467 27055 raft_consensus.cc:2804] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.639961 27055 raft_consensus.cc:697] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:42.640712 27055 consensus_queue.cc:237] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.646917 26755 catalog_manager.cc:5697] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 reported cstate change: term changed from 1 to 2, leader changed from 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194) to 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.659147 27058 raft_consensus.cc:993] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d: : Instructing follower 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:42.659613 27093 raft_consensus.cc:1081] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Signalling peer 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:42.661103 26856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5"
dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:36272
I20260709 13:07:42.661554 26856 raft_consensus.cc:493] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.661808 26856 raft_consensus.cc:3060] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.668167 26856 raft_consensus.cc:515] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.669977 26856 leader_election.cc:290] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:42.670917 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:42.671315 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:42.671537 26932 raft_consensus.cc:3055] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:42.671941 27005 raft_consensus.cc:3060] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.671959 26932 raft_consensus.cc:740] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:42.672899 26932 consensus_queue.cc:260] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.673944 26932 raft_consensus.cc:3060] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.678601 27005 raft_consensus.cc:2468] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:42.680222 26822 leader_election.cc:304] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:42.680509 26932 raft_consensus.cc:2468] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:42.681170 27055 raft_consensus.cc:2804] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.681421 27058 raft_consensus.cc:993] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d: : Instructing follower 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:42.681769 27055 raft_consensus.cc:697] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:42.682030 27058 raft_consensus.cc:1081] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Signalling peer 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:42.682921 27055 consensus_queue.cc:237] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.684211 26856 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40a8e356629840f89d7da57a66beed52"
dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:36272
I20260709 13:07:42.684968 26856 raft_consensus.cc:493] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.685384 26856 raft_consensus.cc:3060] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.691256 26755 catalog_manager.cc:5697] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 reported cstate change: term changed from 1 to 2, leader changed from 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194) to 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.691937 26856 raft_consensus.cc:515] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.693981 26856 leader_election.cc:290] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:42.694736 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a8e356629840f89d7da57a66beed52" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:42.695068 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40a8e356629840f89d7da57a66beed52" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:42.695407 26932 raft_consensus.cc:3055] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:42.695819 27005 raft_consensus.cc:3060] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.695791 26932 raft_consensus.cc:740] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:42.697209 26932 consensus_queue.cc:260] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.698444 26932 raft_consensus.cc:3060] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.702829 27005 raft_consensus.cc:2468] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:42.704056 26822 leader_election.cc:304] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:42.704928 27055 raft_consensus.cc:2804] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.705063 26932 raft_consensus.cc:2468] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:42.705436 27055 raft_consensus.cc:697] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:42.706459 27055 consensus_queue.cc:237] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.712709 27078 raft_consensus.cc:993] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373: : Instructing follower 9e72c084cb0f4ef88534cd1cd6d6836d to start an election
I20260709 13:07:42.713321 27088 raft_consensus.cc:1081] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Signalling peer 9e72c084cb0f4ef88534cd1cd6d6836d to start an election
I20260709 13:07:42.715216 26932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "220f537ca99946228d7ae4913e7b8f8f"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
 from {username='slave'} at 127.0.0.1:58176
I20260709 13:07:42.714874 26754 catalog_manager.cc:5697] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 reported cstate change: term changed from 1 to 2, leader changed from 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194) to 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.715947 26932 raft_consensus.cc:493] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:42.716396 26932 raft_consensus.cc:3060] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.722569 26932 raft_consensus.cc:515] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.724684 26932 leader_election.cc:290] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 2 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:42.725632 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f537ca99946228d7ae4913e7b8f8f" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:42.725809 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "220f537ca99946228d7ae4913e7b8f8f" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:42.726425 26856 raft_consensus.cc:3060] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.726538 27005 raft_consensus.cc:3055] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:42.727006 27005 raft_consensus.cc:740] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:42.727875 27005 consensus_queue.cc:260] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.729178 27005 raft_consensus.cc:3060] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.732110 26856 raft_consensus.cc:2468] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 2.
I20260709 13:07:42.733495 26897 leader_election.cc:304] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:42.734403 27093 raft_consensus.cc:2804] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.734875 27093 raft_consensus.cc:697] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:42.734982 27005 raft_consensus.cc:2468] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 2.
I20260709 13:07:42.735700 27093 consensus_queue.cc:237] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:42.742672 26754 catalog_manager.cc:5697] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 1 to 2, leader changed from 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195) to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 2 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.776839 27005 raft_consensus.cc:1275] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.778110 27055 consensus_queue.cc:1048] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.789505 26932 raft_consensus.cc:1275] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.791095 27136 consensus_queue.cc:1048] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.068380 27005 raft_consensus.cc:1275] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.069727 27136 consensus_queue.cc:1048] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.076368 27004 raft_consensus.cc:1275] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.079761 26932 raft_consensus.cc:1275] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.079686 27130 consensus_queue.cc:1048] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:43.082377 27130 consensus_queue.cc:1048] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.093454 26932 raft_consensus.cc:1275] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.098412 27136 consensus_queue.cc:1048] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.137472 26932 raft_consensus.cc:1275] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.139000 27136 consensus_queue.cc:1048] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.151459 27004 raft_consensus.cc:1275] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.152995 27130 consensus_queue.cc:1048] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.189334 27005 raft_consensus.cc:1275] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Refusing update from remote peer 9e72c084cb0f4ef88534cd1cd6d6836d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.190747 27093 consensus_queue.cc:1048] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.199951 26856 raft_consensus.cc:1275] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Refusing update from remote peer 9e72c084cb0f4ef88534cd1cd6d6836d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.202256 27058 consensus_queue.cc:1048] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:45.220232 26756 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48184:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:45.222853 26756 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:45.280405 26843 tablet_service.cc:1511] Processing CreateTablet for tablet cd1b22f2d7054c6db3cd2d5128b44371 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:45.281219 26919 tablet_service.cc:1511] Processing CreateTablet for tablet cd1b22f2d7054c6db3cd2d5128b44371 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:45.282099 26843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1b22f2d7054c6db3cd2d5128b44371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.282687 26919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1b22f2d7054c6db3cd2d5128b44371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.282934 26989 tablet_service.cc:1511] Processing CreateTablet for tablet cd1b22f2d7054c6db3cd2d5128b44371 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:45.284348 26989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd1b22f2d7054c6db3cd2d5128b44371. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.291524 26842 tablet_service.cc:1511] Processing CreateTablet for tablet 2da81f74ec8548acae8eafa4cbbc2087 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:45.293201 26842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da81f74ec8548acae8eafa4cbbc2087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.293933 26915 tablet_service.cc:1511] Processing CreateTablet for tablet 2da81f74ec8548acae8eafa4cbbc2087 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:45.295456 26915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da81f74ec8548acae8eafa4cbbc2087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.297034 26994 tablet_service.cc:1511] Processing CreateTablet for tablet 2da81f74ec8548acae8eafa4cbbc2087 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:45.298734 26994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da81f74ec8548acae8eafa4cbbc2087. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.302104 26844 tablet_service.cc:1511] Processing CreateTablet for tablet 0e197d6d9b9842dd829a2e2fe8c08e1d (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:45.303771 26844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e197d6d9b9842dd829a2e2fe8c08e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.304091 26916 tablet_service.cc:1511] Processing CreateTablet for tablet 0e197d6d9b9842dd829a2e2fe8c08e1d (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:45.305613 26916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e197d6d9b9842dd829a2e2fe8c08e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.306916 26993 tablet_service.cc:1511] Processing CreateTablet for tablet 0e197d6d9b9842dd829a2e2fe8c08e1d (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:45.308578 26993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e197d6d9b9842dd829a2e2fe8c08e1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.312999 26847 tablet_service.cc:1511] Processing CreateTablet for tablet 2365ca803d97449884a99d10e6dcc977 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:45.314409 26921 tablet_service.cc:1511] Processing CreateTablet for tablet 2365ca803d97449884a99d10e6dcc977 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:45.315774 26847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2365ca803d97449884a99d10e6dcc977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.315883 26921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2365ca803d97449884a99d10e6dcc977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.320080 26992 tablet_service.cc:1511] Processing CreateTablet for tablet 2365ca803d97449884a99d10e6dcc977 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:45.321702 26992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2365ca803d97449884a99d10e6dcc977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.326220 26840 tablet_service.cc:1511] Processing CreateTablet for tablet 630d20fa978d44ecafe2d95add3e1c3c (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:45.328091 26840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630d20fa978d44ecafe2d95add3e1c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.340466 26922 tablet_service.cc:1511] Processing CreateTablet for tablet 630d20fa978d44ecafe2d95add3e1c3c (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:45.342015 26922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630d20fa978d44ecafe2d95add3e1c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.343150 26991 tablet_service.cc:1511] Processing CreateTablet for tablet 630d20fa978d44ecafe2d95add3e1c3c (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:45.344775 26991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 630d20fa978d44ecafe2d95add3e1c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.347663 26846 tablet_service.cc:1511] Processing CreateTablet for tablet dc3c60d773ff48b8889b12aff6214080 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:45.349339 26846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3c60d773ff48b8889b12aff6214080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.350342 26990 tablet_service.cc:1511] Processing CreateTablet for tablet dc3c60d773ff48b8889b12aff6214080 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:45.351636 26923 tablet_service.cc:1511] Processing CreateTablet for tablet dc3c60d773ff48b8889b12aff6214080 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:45.353188 26923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3c60d773ff48b8889b12aff6214080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.351840 26990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3c60d773ff48b8889b12aff6214080. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.374040 26841 tablet_service.cc:1511] Processing CreateTablet for tablet f7e0d89b678842a28b00cf8aadf9205c (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:45.375872 26841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e0d89b678842a28b00cf8aadf9205c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.380451 26918 tablet_service.cc:1511] Processing CreateTablet for tablet f7e0d89b678842a28b00cf8aadf9205c (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:45.381095 26995 tablet_service.cc:1511] Processing CreateTablet for tablet f7e0d89b678842a28b00cf8aadf9205c (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:45.382059 26918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e0d89b678842a28b00cf8aadf9205c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.382639 26995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e0d89b678842a28b00cf8aadf9205c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.405229 26845 tablet_service.cc:1511] Processing CreateTablet for tablet 857e954342e44db59dc5cac866437bfc (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:45.406368 26922 tablet_service.cc:1511] Processing CreateTablet for tablet 857e954342e44db59dc5cac866437bfc (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:45.408026 26845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857e954342e44db59dc5cac866437bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.408349 26922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857e954342e44db59dc5cac866437bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.429647 26848 tablet_service.cc:1511] Processing CreateTablet for tablet 82d6ce64a03b468ea82c2c1d91e156e3 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:45.431718 26848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d6ce64a03b468ea82c2c1d91e156e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.429538 26995 tablet_service.cc:1511] Processing CreateTablet for tablet 857e954342e44db59dc5cac866437bfc (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:45.460626 26990 tablet_service.cc:1511] Processing CreateTablet for tablet 82d6ce64a03b468ea82c2c1d91e156e3 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:45.466871 26995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857e954342e44db59dc5cac866437bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.471386 26916 tablet_service.cc:1511] Processing CreateTablet for tablet 82d6ce64a03b468ea82c2c1d91e156e3 (DEFAULT_TABLE table=soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:45.472838 26916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d6ce64a03b468ea82c2c1d91e156e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.477695 26990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d6ce64a03b468ea82c2c1d91e156e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.503765 27160 tablet_bootstrap.cc:492] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:45.508571 27159 tablet_bootstrap.cc:492] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:45.513288 27160 tablet_bootstrap.cc:654] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.554744 27159 tablet_bootstrap.cc:654] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.573912 27161 tablet_bootstrap.cc:492] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:45.574692 27160 tablet_bootstrap.cc:492] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:45.575525 27160 ts_tablet_manager.cc:1403] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.072s	user 0.033s	sys 0.019s
I20260709 13:07:45.578794 27160 raft_consensus.cc:359] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.579576 27160 raft_consensus.cc:385] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.579890 27160 raft_consensus.cc:740] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.580668 27160 consensus_queue.cc:260] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.583554 27160 ts_tablet_manager.cc:1434] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:07:45.584703 27160 tablet_bootstrap.cc:492] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:45.585760 27161 tablet_bootstrap.cc:654] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.591046 27159 tablet_bootstrap.cc:492] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:45.591815 27160 tablet_bootstrap.cc:654] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.591966 27159 ts_tablet_manager.cc:1403] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.084s	user 0.015s	sys 0.011s
I20260709 13:07:45.596874 27159 raft_consensus.cc:359] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.598114 27159 raft_consensus.cc:385] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.598664 27159 raft_consensus.cc:740] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.599924 27159 consensus_queue.cc:260] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.603391 27159 ts_tablet_manager.cc:1434] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:07:45.604157 27160 tablet_bootstrap.cc:492] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:45.604772 27160 ts_tablet_manager.cc:1403] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:07:45.605125 27159 tablet_bootstrap.cc:492] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:45.608007 27160 raft_consensus.cc:359] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.608772 27160 raft_consensus.cc:385] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.609087 27160 raft_consensus.cc:740] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.610055 27160 consensus_queue.cc:260] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.611104 27088 raft_consensus.cc:493] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.611588 27088 raft_consensus.cc:515] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.614179 27088 leader_election.cc:290] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:45.615330 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b22f2d7054c6db3cd2d5128b44371" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:45.616928 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b22f2d7054c6db3cd2d5128b44371" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
W20260709 13:07:45.617826 26971 leader_election.cc:343] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.618021 26932 raft_consensus.cc:2468] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 0.
I20260709 13:07:45.619729 27160 ts_tablet_manager.cc:1434] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.009s
I20260709 13:07:45.620288 26972 leader_election.cc:304] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:45.621174 27160 tablet_bootstrap.cc:492] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:45.624855 27167 raft_consensus.cc:2804] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.625437 27167 raft_consensus.cc:493] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.625833 27167 raft_consensus.cc:3060] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.627242 27159 tablet_bootstrap.cc:654] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.636888 27161 tablet_bootstrap.cc:492] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:45.637629 27161 ts_tablet_manager.cc:1403] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.031s
I20260709 13:07:45.641899 27160 tablet_bootstrap.cc:654] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.642130 27161 raft_consensus.cc:359] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.643272 27161 raft_consensus.cc:385] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.643671 27161 raft_consensus.cc:740] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.644719 27161 consensus_queue.cc:260] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.649344 27167 raft_consensus.cc:515] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.651809 27167 leader_election.cc:290] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:45.652657 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b22f2d7054c6db3cd2d5128b44371" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:45.653079 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b22f2d7054c6db3cd2d5128b44371" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:45.653776 26932 raft_consensus.cc:3060] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:45.654074 26971 leader_election.cc:343] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.656826 27161 ts_tablet_manager.cc:1434] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.006s
I20260709 13:07:45.658066 27161 tablet_bootstrap.cc:492] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:45.660794 27160 tablet_bootstrap.cc:492] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:45.661461 27160 ts_tablet_manager.cc:1403] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.001s
I20260709 13:07:45.662091 26932 raft_consensus.cc:2468] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 1.
I20260709 13:07:45.663704 26972 leader_election.cc:304] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:45.664675 27167 raft_consensus.cc:2804] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:45.660799 27159 tablet_bootstrap.cc:492] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:45.665328 27167 raft_consensus.cc:697] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:45.665511 27159 ts_tablet_manager.cc:1403] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.019s
I20260709 13:07:45.666347 27167 consensus_queue.cc:237] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.668691 27160 raft_consensus.cc:359] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.669227 27161 tablet_bootstrap.cc:654] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.668998 27159 raft_consensus.cc:359] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.671785 27160 raft_consensus.cc:385] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.671850 27159 raft_consensus.cc:385] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.672343 27160 raft_consensus.cc:740] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.672397 27159 raft_consensus.cc:740] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.673383 27160 consensus_queue.cc:260] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.673458 27159 consensus_queue.cc:260] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.676270 27159 ts_tablet_manager.cc:1434] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:45.677388 27159 tablet_bootstrap.cc:492] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:45.684507 27160 ts_tablet_manager.cc:1434] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.005s
I20260709 13:07:45.685307 27159 tablet_bootstrap.cc:654] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.685609 27160 tablet_bootstrap.cc:492] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:45.688594 27161 tablet_bootstrap.cc:492] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:45.692013 27161 ts_tablet_manager.cc:1403] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.010s
I20260709 13:07:45.692958 26755 catalog_manager.cc:5697] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.695745 27161 raft_consensus.cc:359] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.696789 27161 raft_consensus.cc:385] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.697124 27161 raft_consensus.cc:740] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.698083 27161 consensus_queue.cc:260] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.699869 27160 tablet_bootstrap.cc:654] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.700958 27161 ts_tablet_manager.cc:1434] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:45.702220 27161 tablet_bootstrap.cc:492] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:45.712488 27161 tablet_bootstrap.cc:654] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.717450 27160 tablet_bootstrap.cc:492] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:45.717443 27159 tablet_bootstrap.cc:492] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:45.718142 27160 ts_tablet_manager.cc:1403] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.000s
I20260709 13:07:45.718400 27159 ts_tablet_manager.cc:1403] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.013s
I20260709 13:07:45.721917 27148 raft_consensus.cc:493] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.721545 27160 raft_consensus.cc:359] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.722471 27160 raft_consensus.cc:385] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.722802 27160 raft_consensus.cc:740] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.723254 27159 raft_consensus.cc:359] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.723611 27160 consensus_queue.cc:260] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.724399 27159 raft_consensus.cc:385] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.724849 27159 raft_consensus.cc:740] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.726608 27160 ts_tablet_manager.cc:1434] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:45.727835 27160 tablet_bootstrap.cc:492] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:45.722482 27148 raft_consensus.cc:515] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.730340 27148 leader_election.cc:290] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:45.731323 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e197d6d9b9842dd829a2e2fe8c08e1d" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:45.725885 27159 consensus_queue.cc:260] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.735273 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e197d6d9b9842dd829a2e2fe8c08e1d" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:45.735982 27159 ts_tablet_manager.cc:1434] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:07:45.737167 27159 tablet_bootstrap.cc:492] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
W20260709 13:07:45.739092 26897 leader_election.cc:343] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:45.740607 26897 leader_election.cc:343] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.741156 26897 leader_election.cc:304] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373
I20260709 13:07:45.744081 27159 tablet_bootstrap.cc:654] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.745090 27148 raft_consensus.cc:2749] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:45.746793 27160 tablet_bootstrap.cc:654] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.748793 27148 raft_consensus.cc:493] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.749751 27161 tablet_bootstrap.cc:492] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:45.749408 27148 raft_consensus.cc:515] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.750463 27161 ts_tablet_manager.cc:1403] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.011s
I20260709 13:07:45.752063 27148 leader_election.cc:290] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:45.754112 27159 tablet_bootstrap.cc:492] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:45.754766 27159 ts_tablet_manager.cc:1403] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:07:45.758104 27159 raft_consensus.cc:359] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.758595 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da81f74ec8548acae8eafa4cbbc2087" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:45.759001 27159 raft_consensus.cc:385] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.759338 26856 raft_consensus.cc:2468] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:45.759476 27159 raft_consensus.cc:740] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.760425 27159 consensus_queue.cc:260] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.762310 26897 leader_election.cc:304] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:45.763244 27148 raft_consensus.cc:2804] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.763398 27159 ts_tablet_manager.cc:1434] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:45.763698 27148 raft_consensus.cc:493] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.764096 27148 raft_consensus.cc:3060] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.764938 27159 tablet_bootstrap.cc:492] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:45.764696 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da81f74ec8548acae8eafa4cbbc2087" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:45.774056 27159 tablet_bootstrap.cc:654] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.779045 27167 raft_consensus.cc:493] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.779665 27167 raft_consensus.cc:515] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.780740 27159 tablet_bootstrap.cc:492] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:45.781342 27159 ts_tablet_manager.cc:1403] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.001s
I20260709 13:07:45.781945 27167 leader_election.cc:290] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:45.782770 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630d20fa978d44ecafe2d95add3e1c3c" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:45.783085 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630d20fa978d44ecafe2d95add3e1c3c" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:45.783792 26932 raft_consensus.cc:2468] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 0.
W20260709 13:07:45.784754 26971 leader_election.cc:343] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.785622 26972 leader_election.cc:304] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:45.785914 27159 raft_consensus.cc:359] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.786553 27167 raft_consensus.cc:2804] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.786757 27159 raft_consensus.cc:385] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:45.781360 26897 leader_election.cc:343] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.786975 27167 raft_consensus.cc:493] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.787629 27159 raft_consensus.cc:740] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.787910 27167 raft_consensus.cc:3060] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.787532 27148 raft_consensus.cc:515] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.788749 27159 consensus_queue.cc:260] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.789606 27160 tablet_bootstrap.cc:492] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:45.790023 27148 leader_election.cc:290] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:45.790267 27160 ts_tablet_manager.cc:1403] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.022s
I20260709 13:07:45.753829 27161 raft_consensus.cc:359] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.791038 27161 raft_consensus.cc:385] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.791424 27159 ts_tablet_manager.cc:1434] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:45.791680 27161 raft_consensus.cc:740] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.793016 27159 tablet_bootstrap.cc:492] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:45.792737 27161 consensus_queue.cc:260] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.794288 27160 raft_consensus.cc:359] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.795156 27160 raft_consensus.cc:385] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.795523 27160 raft_consensus.cc:740] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.796456 27160 consensus_queue.cc:260] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.799198 27160 ts_tablet_manager.cc:1434] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:45.795585 27161 ts_tablet_manager.cc:1434] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:07:45.800531 27161 tablet_bootstrap.cc:492] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:45.801354 27159 tablet_bootstrap.cc:654] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.806569 27167 raft_consensus.cc:515] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.808123 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da81f74ec8548acae8eafa4cbbc2087" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:45.808772 27160 tablet_bootstrap.cc:492] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:45.809275 27163 raft_consensus.cc:493] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.810637 27167 leader_election.cc:290] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:45.811386 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630d20fa978d44ecafe2d95add3e1c3c" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:45.811918 26932 raft_consensus.cc:3060] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.809846 27163 raft_consensus.cc:515] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.817453 27163 leader_election.cc:290] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:45.817484 27161 tablet_bootstrap.cc:654] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.818703 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e0d89b678842a28b00cf8aadf9205c" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:45.819425 26931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e0d89b678842a28b00cf8aadf9205c" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:45.819423 27005 raft_consensus.cc:2468] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 0.
I20260709 13:07:45.820619 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630d20fa978d44ecafe2d95add3e1c3c" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:45.821175 26822 leader_election.cc:304] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:45.822117 27163 raft_consensus.cc:2804] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:45.822270 26971 leader_election.cc:343] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.822584 27163 raft_consensus.cc:493] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.822964 27163 raft_consensus.cc:3060] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.823175 27160 tablet_bootstrap.cc:654] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.823257 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da81f74ec8548acae8eafa4cbbc2087" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
W20260709 13:07:45.824090 26823 leader_election.cc:343] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.824595 26856 raft_consensus.cc:3060] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.832059 26932 raft_consensus.cc:2468] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 1.
I20260709 13:07:45.833405 26972 leader_election.cc:304] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:45.835704 26856 raft_consensus.cc:2468] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
W20260709 13:07:45.833444 26897 leader_election.cc:343] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.838030 27160 tablet_bootstrap.cc:492] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:45.839460 27160 ts_tablet_manager.cc:1403] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.000s
I20260709 13:07:45.840775 26897 leader_election.cc:304] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 693f641ab9504007b7e12bc60bb0d373
I20260709 13:07:45.842154 27167 raft_consensus.cc:2804] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:45.843381 27176 raft_consensus.cc:2804] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:45.843954 27176 raft_consensus.cc:697] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:45.844802 27176 consensus_queue.cc:237] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.841280 27163 raft_consensus.cc:515] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.848620 27160 raft_consensus.cc:359] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.849592 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e0d89b678842a28b00cf8aadf9205c" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:45.851424 27160 raft_consensus.cc:385] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:45.852684 26823 leader_election.cc:343] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.852743 27160 raft_consensus.cc:740] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.852098 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e0d89b678842a28b00cf8aadf9205c" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:45.854645 27005 raft_consensus.cc:3060] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.854775 27163 leader_election.cc:290] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:45.857884 27161 tablet_bootstrap.cc:492] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:45.858831 27161 ts_tablet_manager.cc:1403] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.012s
I20260709 13:07:45.861995 27167 raft_consensus.cc:697] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:45.855006 27160 consensus_queue.cc:260] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.864975 27160 ts_tablet_manager.cc:1434] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:07:45.867010 27161 raft_consensus.cc:359] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.867769 27161 raft_consensus.cc:385] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.868076 27161 raft_consensus.cc:740] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.869272 27159 tablet_bootstrap.cc:492] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:45.868875 27161 consensus_queue.cc:260] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.869798 27160 tablet_bootstrap.cc:492] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:45.869884 27159 ts_tablet_manager.cc:1403] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.031s
I20260709 13:07:45.876394 27159 raft_consensus.cc:359] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.877157 27159 raft_consensus.cc:385] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.877526 27159 raft_consensus.cc:740] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.877637 27160 tablet_bootstrap.cc:654] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.878436 27159 consensus_queue.cc:260] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.879069 26753 catalog_manager.cc:5697] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.881243 27159 ts_tablet_manager.cc:1434] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:45.882213 27161 ts_tablet_manager.cc:1434] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:07:45.883522 27161 tablet_bootstrap.cc:492] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:45.883994 27160 tablet_bootstrap.cc:492] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:45.884582 27160 ts_tablet_manager.cc:1403] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 13:07:45.889221 27159 tablet_bootstrap.cc:492] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:45.890379 27160 raft_consensus.cc:359] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.891224 27160 raft_consensus.cc:385] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.891553 27160 raft_consensus.cc:740] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.892397 27160 consensus_queue.cc:260] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.894007 27161 tablet_bootstrap.cc:654] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.895385 27160 ts_tablet_manager.cc:1434] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:07:45.896579 27160 tablet_bootstrap.cc:492] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:45.871524 27005 raft_consensus.cc:2468] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 1.
I20260709 13:07:45.899971 26822 leader_election.cc:304] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:45.900892 27159 tablet_bootstrap.cc:654] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.869971 27167 consensus_queue.cc:237] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.901858 27163 raft_consensus.cc:2804] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:45.902453 27163 raft_consensus.cc:697] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:45.903482 27160 tablet_bootstrap.cc:654] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.903316 27163 consensus_queue.cc:237] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.912159 27159 tablet_bootstrap.cc:492] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:45.912730 27159 ts_tablet_manager.cc:1403] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 13:07:45.912866 27160 tablet_bootstrap.cc:492] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:45.913403 27160 ts_tablet_manager.cc:1403] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.009s
I20260709 13:07:45.916000 27159 raft_consensus.cc:359] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.916909 27159 raft_consensus.cc:385] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.917302 27159 raft_consensus.cc:740] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.918326 27159 consensus_queue.cc:260] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.916271 27160 raft_consensus.cc:359] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.919319 27161 tablet_bootstrap.cc:492] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:45.919366 27160 raft_consensus.cc:385] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.919924 27161 ts_tablet_manager.cc:1403] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.006s
I20260709 13:07:45.920059 27160 raft_consensus.cc:740] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.920885 27160 consensus_queue.cc:260] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.923431 27161 raft_consensus.cc:359] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.923991 27160 ts_tablet_manager.cc:1434] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:07:45.924264 27161 raft_consensus.cc:385] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.924600 27161 raft_consensus.cc:740] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.925092 27160 tablet_bootstrap.cc:492] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373: Bootstrap starting.
I20260709 13:07:45.925275 27163 raft_consensus.cc:493] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.925383 27161 consensus_queue.cc:260] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.926005 27163 raft_consensus.cc:515] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.926192 26753 catalog_manager.cc:5697] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.928045 27161 ts_tablet_manager.cc:1434] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:07:45.928453 27163 leader_election.cc:290] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:45.929330 27161 tablet_bootstrap.cc:492] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:45.929749 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e197d6d9b9842dd829a2e2fe8c08e1d" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:45.930460 27005 raft_consensus.cc:2468] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 0.
I20260709 13:07:45.931978 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e197d6d9b9842dd829a2e2fe8c08e1d" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:45.921502 26754 catalog_manager.cc:5697] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:45.933483 27159 ts_tablet_manager.cc:1434] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:07:45.934759 27159 tablet_bootstrap.cc:492] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:45.936976 27161 tablet_bootstrap.cc:654] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.938496 26822 leader_election.cc:304] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:45.932732 26932 raft_consensus.cc:2468] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 0.
I20260709 13:07:45.940071 27163 raft_consensus.cc:2804] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.942137 27163 raft_consensus.cc:493] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.942603 27163 raft_consensus.cc:3060] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.942886 27159 tablet_bootstrap.cc:654] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.932003 27160 tablet_bootstrap.cc:654] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.954435 27163 raft_consensus.cc:515] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.957775 27163 leader_election.cc:290] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:45.961613 27161 tablet_bootstrap.cc:492] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:45.961462 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e197d6d9b9842dd829a2e2fe8c08e1d" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:45.962337 26932 raft_consensus.cc:3060] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.962393 27161 ts_tablet_manager.cc:1403] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.010s
I20260709 13:07:45.966735 27161 raft_consensus.cc:359] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.967742 27161 raft_consensus.cc:385] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:45.968112 27161 raft_consensus.cc:740] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:45.969553 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e197d6d9b9842dd829a2e2fe8c08e1d" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:45.969113 27161 consensus_queue.cc:260] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.970279 27004 raft_consensus.cc:3060] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.972803 27161 ts_tablet_manager.cc:1434] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:45.974987 27167 raft_consensus.cc:493] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.975630 27167 raft_consensus.cc:515] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:45.983574 27161 tablet_bootstrap.cc:492] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:45.984100 27167 leader_election.cc:290] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:45.985322 26931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
W20260709 13:07:45.986799 26972 leader_election.cc:343] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:45.988941 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:45.989766 26856 raft_consensus.cc:2468] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 0.
I20260709 13:07:45.991250 26971 leader_election.cc:304] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:45.992334 27161 tablet_bootstrap.cc:654] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:45.992712 27167 raft_consensus.cc:2804] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:45.993201 27167 raft_consensus.cc:493] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.993613 27167 raft_consensus.cc:3060] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:45.995281 27160 tablet_bootstrap.cc:492] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373: No bootstrap required, opened a new log
I20260709 13:07:45.995883 27160 ts_tablet_manager.cc:1403] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.010s
I20260709 13:07:45.999589 27160 raft_consensus.cc:359] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.000463 27160 raft_consensus.cc:385] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.000821 27160 raft_consensus.cc:740] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.002910 27004 raft_consensus.cc:2468] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 1.
I20260709 13:07:46.003991 26932 raft_consensus.cc:2468] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 1.
I20260709 13:07:46.001807 27160 consensus_queue.cc:260] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.005677 26822 leader_election.cc:304] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:46.004969 27167 raft_consensus.cc:515] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.007296 27163 raft_consensus.cc:2804] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.007800 27163 raft_consensus.cc:697] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:46.008687 27163 consensus_queue.cc:237] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.009161 27167 leader_election.cc:290] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:46.011327 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:46.012217 27160 ts_tablet_manager.cc:1434] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
W20260709 13:07:46.012799 26972 leader_election.cc:343] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:46.014851 27161 tablet_bootstrap.cc:492] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:46.015414 27161 ts_tablet_manager.cc:1403] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.012s
I20260709 13:07:46.015511 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:46.016197 26856 raft_consensus.cc:3060] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.005129 27159 tablet_bootstrap.cc:492] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:46.017232 27159 ts_tablet_manager.cc:1403] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.083s	user 0.021s	sys 0.010s
I20260709 13:07:46.018741 27161 raft_consensus.cc:359] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.019527 27161 raft_consensus.cc:385] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.019825 27161 raft_consensus.cc:740] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.020339 27159 raft_consensus.cc:359] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.020601 27161 consensus_queue.cc:260] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.021152 27159 raft_consensus.cc:385] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.021807 27159 raft_consensus.cc:740] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.023202 27161 ts_tablet_manager.cc:1434] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:46.022935 27159 consensus_queue.cc:260] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.024369 27161 tablet_bootstrap.cc:492] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:46.024811 26856 raft_consensus.cc:2468] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 1.
I20260709 13:07:46.029080 26971 leader_election.cc:304] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:46.030005 27167 raft_consensus.cc:2804] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.030784 27167 raft_consensus.cc:697] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:46.024803 27159 ts_tablet_manager.cc:1434] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:46.031713 27161 tablet_bootstrap.cc:654] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.031667 27167 consensus_queue.cc:237] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.034483 26753 catalog_manager.cc:5697] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.036612 27159 tablet_bootstrap.cc:492] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d: Bootstrap starting.
I20260709 13:07:46.044593 27161 tablet_bootstrap.cc:492] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:46.045163 27161 ts_tablet_manager.cc:1403] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:07:46.047880 27159 tablet_bootstrap.cc:654] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.048493 27161 raft_consensus.cc:359] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.049285 27161 raft_consensus.cc:385] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.049588 27161 raft_consensus.cc:740] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.050320 27161 consensus_queue.cc:260] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.052498 27161 ts_tablet_manager.cc:1434] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:46.053473 27161 tablet_bootstrap.cc:492] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42: Bootstrap starting.
I20260709 13:07:46.053933 26756 catalog_manager.cc:5697] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.059924 27161 tablet_bootstrap.cc:654] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:46.069116 27159 tablet_bootstrap.cc:492] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d: No bootstrap required, opened a new log
I20260709 13:07:46.069482 27161 tablet_bootstrap.cc:492] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42: No bootstrap required, opened a new log
I20260709 13:07:46.069658 27159 ts_tablet_manager.cc:1403] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.010s
I20260709 13:07:46.070056 27161 ts_tablet_manager.cc:1403] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:07:46.072954 27159 raft_consensus.cc:359] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.073144 27161 raft_consensus.cc:359] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.073740 27159 raft_consensus.cc:385] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.073872 27161 raft_consensus.cc:385] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:46.074090 27159 raft_consensus.cc:740] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.074141 27161 raft_consensus.cc:740] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Initialized, Role: FOLLOWER
I20260709 13:07:46.075016 27161 consensus_queue.cc:260] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.075114 27159 consensus_queue.cc:260] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.077188 27159 ts_tablet_manager.cc:1434] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:07:46.077214 27161 ts_tablet_manager.cc:1434] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:46.090451 27163 raft_consensus.cc:493] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.090938 27163 raft_consensus.cc:515] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.092897 27163 leader_election.cc:290] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.093638 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2365ca803d97449884a99d10e6dcc977" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:46.093839 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2365ca803d97449884a99d10e6dcc977" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:46.094331 26932 raft_consensus.cc:2468] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 0.
I20260709 13:07:46.094514 27004 raft_consensus.cc:2468] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 0.
I20260709 13:07:46.095307 26823 leader_election.cc:304] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:46.096169 27163 raft_consensus.cc:2804] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.096546 27163 raft_consensus.cc:493] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.096791 27163 raft_consensus.cc:3060] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.101902 27163 raft_consensus.cc:515] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.102516 27176 raft_consensus.cc:493] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.103078 27176 raft_consensus.cc:515] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.105008 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2365ca803d97449884a99d10e6dcc977" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:46.105216 27176 leader_election.cc:290] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.105461 27163 leader_election.cc:290] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.105535 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2365ca803d97449884a99d10e6dcc977" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:46.105706 26932 raft_consensus.cc:3060] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.106436 27004 raft_consensus.cc:3060] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.107259 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d6ce64a03b468ea82c2c1d91e156e3" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:46.107614 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d6ce64a03b468ea82c2c1d91e156e3" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:46.107961 27005 raft_consensus.cc:2468] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:46.108270 26856 raft_consensus.cc:2468] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:46.109340 26897 leader_election.cc:304] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:46.109570 27176 raft_consensus.cc:493] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.110106 27176 raft_consensus.cc:515] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.110988 27148 raft_consensus.cc:2804] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.111420 27148 raft_consensus.cc:493] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.111788 27148 raft_consensus.cc:3060] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.113216 26856 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e954342e44db59dc5cac866437bfc" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:46.113680 27004 raft_consensus.cc:2468] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 1.
I20260709 13:07:46.113691 26932 raft_consensus.cc:2468] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 1.
I20260709 13:07:46.113958 26856 raft_consensus.cc:2468] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:46.115334 27176 leader_election.cc:290] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.115265 26823 leader_election.cc:304] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:46.115556 26897 leader_election.cc:304] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:46.116148 27055 raft_consensus.cc:2804] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.116931 27176 raft_consensus.cc:2804] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:46.117374 27176 raft_consensus.cc:493] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.117712 27176 raft_consensus.cc:3060] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.121534 27148 raft_consensus.cc:515] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.123596 27055 raft_consensus.cc:697] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:46.122742 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e954342e44db59dc5cac866437bfc" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:46.124838 27055 consensus_queue.cc:237] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.126827 27004 raft_consensus.cc:2468] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 0.
I20260709 13:07:46.126957 26856 raft_consensus.cc:3060] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.128890 27148 leader_election.cc:290] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.131928 27176 raft_consensus.cc:515] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.134461 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d6ce64a03b468ea82c2c1d91e156e3" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:46.135452 26857 raft_consensus.cc:3060] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.135509 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d6ce64a03b468ea82c2c1d91e156e3" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:46.136513 27004 raft_consensus.cc:3060] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.136572 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e954342e44db59dc5cac866437bfc" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:46.137411 26858 raft_consensus.cc:3060] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.144459 26857 raft_consensus.cc:2468] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:46.145936 27167 raft_consensus.cc:493] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.146023 26897 leader_election.cc:304] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:46.146390 27176 leader_election.cc:290] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.146685 27167 raft_consensus.cc:515] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.150880 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857e954342e44db59dc5cac866437bfc" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:46.151197 27167 leader_election.cc:290] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:46.151568 27005 raft_consensus.cc:3060] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.152057 27148 raft_consensus.cc:2804] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.153154 27004 raft_consensus.cc:2468] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:46.152383 26932 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da81f74ec8548acae8eafa4cbbc2087" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" is_pre_election: true
I20260709 13:07:46.153861 27148 raft_consensus.cc:697] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:46.154902 27148 consensus_queue.cc:237] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.155153 27167 consensus_queue.cc:1048] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.145530 26858 raft_consensus.cc:2468] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:46.157568 26755 catalog_manager.cc:5697] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.157562 26897 leader_election.cc:304] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:46.160323 27176 raft_consensus.cc:2804] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:46.160794 27176 raft_consensus.cc:697] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:46.161240 27005 raft_consensus.cc:2468] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 1.
I20260709 13:07:46.161650 27176 consensus_queue.cc:237] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.162883 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da81f74ec8548acae8eafa4cbbc2087" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:46.163897 26857 raft_consensus.cc:2393] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 693f641ab9504007b7e12bc60bb0d373 in current term 1: Already voted for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in this term.
I20260709 13:07:46.165329 26971 leader_election.cc:304] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373; no voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:46.167074 27167 raft_consensus.cc:3060] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.177862 27167 raft_consensus.cc:2749] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:46.192937 27167 consensus_queue.cc:1048] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.197511 26755 catalog_manager.cc:5697] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.218303 26755 catalog_manager.cc:5697] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 1 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.245661 27176 consensus_queue.cc:1048] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:46.262957 27148 consensus_queue.cc:1048] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.294473 26857 raft_consensus.cc:3060] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.302003 27183 consensus_queue.cc:1048] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.312840 27055 consensus_queue.cc:1048] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.315045 27213 consensus_queue.cc:1048] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.333770 26932 raft_consensus.cc:3060] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.342319 27055 consensus_queue.cc:1048] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.406620 27148 raft_consensus.cc:493] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.407156 27148 raft_consensus.cc:515] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.409216 27148 leader_election.cc:290] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.409825 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42" is_pre_election: true
I20260709 13:07:46.410524 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "693f641ab9504007b7e12bc60bb0d373" is_pre_election: true
I20260709 13:07:46.410861 26858 raft_consensus.cc:2393] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9e72c084cb0f4ef88534cd1cd6d6836d in current term 1: Already voted for candidate 693f641ab9504007b7e12bc60bb0d373 in this term.
I20260709 13:07:46.412261 26897 leader_election.cc:304] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373
I20260709 13:07:46.413025 27148 raft_consensus.cc:3060] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:46.418645 27148 raft_consensus.cc:2749] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:46.430891 27004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd1b22f2d7054c6db3cd2d5128b44371"
dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
mode: GRACEFUL
new_leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:59086
I20260709 13:07:46.431489 27004 raft_consensus.cc:606] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Received request to transfer leadership to TS 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:46.436867 26931 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2da81f74ec8548acae8eafa4cbbc2087"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
mode: GRACEFUL
new_leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:58194
I20260709 13:07:46.437546 26931 raft_consensus.cc:606] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Received request to transfer leadership to TS 4bb85182ef4d40b9a2d55592dd224e42
I20260709 13:07:46.437409 27055 consensus_queue.cc:1048] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.449509 27163 consensus_queue.cc:1048] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.450897 27004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "630d20fa978d44ecafe2d95add3e1c3c"
dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
mode: GRACEFUL
new_leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
 from {username='slave'} at 127.0.0.1:59086
I20260709 13:07:46.451691 27004 raft_consensus.cc:606] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Received request to transfer leadership to TS 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:46.460534 27004 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080"
dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
mode: GRACEFUL
new_leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
 from {username='slave'} at 127.0.0.1:59086
I20260709 13:07:46.461185 27004 raft_consensus.cc:606] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Received request to transfer leadership to TS 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:46.480477 27183 consensus_queue.cc:1048] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.483331 26858 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7e0d89b678842a28b00cf8aadf9205c"
dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
mode: GRACEFUL
new_leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
 from {username='slave'} at 127.0.0.1:47648
I20260709 13:07:46.483934 26858 raft_consensus.cc:606] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Received request to transfer leadership to TS 9e72c084cb0f4ef88534cd1cd6d6836d
I20260709 13:07:46.489378 27213 raft_consensus.cc:993] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373: : Instructing follower 9e72c084cb0f4ef88534cd1cd6d6836d to start an election
I20260709 13:07:46.489876 27213 raft_consensus.cc:1081] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Signalling peer 9e72c084cb0f4ef88534cd1cd6d6836d to start an election
I20260709 13:07:46.493532 26932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
 from {username='slave'} at 127.0.0.1:58176
I20260709 13:07:46.494095 26932 raft_consensus.cc:493] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.494436 26932 raft_consensus.cc:3060] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.495246 27088 consensus_queue.cc:1048] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:46.495358 26933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82d6ce64a03b468ea82c2c1d91e156e3"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
mode: GRACEFUL
new_leader_uuid: "693f641ab9504007b7e12bc60bb0d373"
 from {username='slave'} at 127.0.0.1:58194
I20260709 13:07:46.496241 26933 raft_consensus.cc:606] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Received request to transfer leadership to TS 693f641ab9504007b7e12bc60bb0d373
I20260709 13:07:46.501677 26932 raft_consensus.cc:515] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.504398 26932 leader_election.cc:290] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 2 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.505352 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:46.505671 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:46.506011 27005 raft_consensus.cc:3055] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:46.506299 26858 raft_consensus.cc:3060] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.506381 27005 raft_consensus.cc:740] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:46.506520 26931 raft_consensus.cc:1240] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Rejecting Update request from peer 693f641ab9504007b7e12bc60bb0d373 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:46.507277 27005 consensus_queue.cc:260] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.508447 27005 raft_consensus.cc:3060] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.515856 26858 raft_consensus.cc:2468] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 2.
I20260709 13:07:46.516981 27005 raft_consensus.cc:2468] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 2.
I20260709 13:07:46.517118 26897 leader_election.cc:304] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:46.517998 27148 raft_consensus.cc:2804] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:46.518471 27148 raft_consensus.cc:697] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:46.519423 27148 consensus_queue.cc:237] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.526475 26756 catalog_manager.cc:5697] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 1 to 2, leader changed from 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195) to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 2 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.593663 27163 consensus_queue.cc:1048] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.601316 27200 consensus_queue.cc:1048] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.639308 27213 raft_consensus.cc:993] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373: : Instructing follower 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:46.639770 27088 raft_consensus.cc:1081] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Signalling peer 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:46.641394 26858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd1b22f2d7054c6db3cd2d5128b44371"
dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:36282
I20260709 13:07:46.641887 26858 raft_consensus.cc:493] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.642149 26858 raft_consensus.cc:3060] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.648279 26858 raft_consensus.cc:515] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.650231 26858 leader_election.cc:290] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.651093 26931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b22f2d7054c6db3cd2d5128b44371" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:46.651384 27005 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd1b22f2d7054c6db3cd2d5128b44371" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:46.651749 26931 raft_consensus.cc:3060] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.652032 27005 raft_consensus.cc:3055] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:46.652354 27005 raft_consensus.cc:740] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:46.653013 27005 consensus_queue.cc:260] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.653894 27005 raft_consensus.cc:3060] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.657609 26931 raft_consensus.cc:2468] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:46.658631 27005 raft_consensus.cc:2468] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:46.659118 26823 leader_election.cc:304] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:46.660022 27200 raft_consensus.cc:2804] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:46.660429 27200 raft_consensus.cc:697] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:46.661072 27200 consensus_queue.cc:237] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.668273 26756 catalog_manager.cc:5697] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 reported cstate change: term changed from 1 to 2, leader changed from 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195) to 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.712520 27148 consensus_queue.cc:1048] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.727520 27210 consensus_queue.cc:1048] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.744405 27055 raft_consensus.cc:993] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42: : Instructing follower 9e72c084cb0f4ef88534cd1cd6d6836d to start an election
I20260709 13:07:46.744962 27055 raft_consensus.cc:1081] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Signalling peer 9e72c084cb0f4ef88534cd1cd6d6836d to start an election
I20260709 13:07:46.746784 26931 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7e0d89b678842a28b00cf8aadf9205c"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
 from {username='slave'} at 127.0.0.1:58178
I20260709 13:07:46.747399 26931 raft_consensus.cc:493] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.747786 26931 raft_consensus.cc:3060] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.748461 27210 raft_consensus.cc:993] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d: : Instructing follower 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:46.749037 27175 raft_consensus.cc:1081] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Signalling peer 4bb85182ef4d40b9a2d55592dd224e42 to start an election
I20260709 13:07:46.750749 26858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2da81f74ec8548acae8eafa4cbbc2087"
dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
 from {username='slave'} at 127.0.0.1:36272
I20260709 13:07:46.750728 27175 consensus_queue.cc:1048] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:46.751457 26858 raft_consensus.cc:493] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.751842 26858 raft_consensus.cc:3060] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.755246 26931 raft_consensus.cc:515] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.757753 26931 leader_election.cc:290] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 2 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.758922 26857 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e0d89b678842a28b00cf8aadf9205c" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:46.759620 26857 raft_consensus.cc:3055] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:46.759985 26857 raft_consensus.cc:740] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:46.760856 26857 consensus_queue.cc:260] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.761984 27004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e0d89b678842a28b00cf8aadf9205c" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:46.762207 26857 raft_consensus.cc:3060] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.762652 27004 raft_consensus.cc:3060] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.764526 26858 raft_consensus.cc:515] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.768002 26858 leader_election.cc:290] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Requested vote from peers 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.769213 26931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da81f74ec8548acae8eafa4cbbc2087" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:46.769515 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da81f74ec8548acae8eafa4cbbc2087" candidate_uuid: "4bb85182ef4d40b9a2d55592dd224e42" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:46.769932 26931 raft_consensus.cc:3055] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:46.770175 27006 raft_consensus.cc:3060] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.770383 26931 raft_consensus.cc:740] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:46.771054 27004 raft_consensus.cc:2468] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 2.
I20260709 13:07:46.771512 26931 consensus_queue.cc:260] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.772902 26931 raft_consensus.cc:3060] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.773576 26897 leader_election.cc:304] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:46.773741 26857 raft_consensus.cc:2468] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 2.
I20260709 13:07:46.774524 27175 raft_consensus.cc:2804] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:46.775048 27175 raft_consensus.cc:697] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:46.775899 27175 consensus_queue.cc:237] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.779228 27006 raft_consensus.cc:2468] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:46.780836 26931 raft_consensus.cc:2468] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb85182ef4d40b9a2d55592dd224e42 in term 2.
I20260709 13:07:46.781116 26822 leader_election.cc:304] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:46.782841 27055 raft_consensus.cc:2804] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:46.783526 27055 raft_consensus.cc:697] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Becoming Leader. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:46.784639 27055 consensus_queue.cc:237] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.790045 26756 catalog_manager.cc:5697] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 1 to 2, leader changed from 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193) to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 2 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.791205 27210 consensus_queue.cc:1048] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:46.794939 27148 raft_consensus.cc:993] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d: : Instructing follower 693f641ab9504007b7e12bc60bb0d373 to start an election
I20260709 13:07:46.795454 27148 raft_consensus.cc:1081] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Signalling peer 693f641ab9504007b7e12bc60bb0d373 to start an election
I20260709 13:07:46.799651 26753 catalog_manager.cc:5697] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 reported cstate change: term changed from 1 to 2, leader changed from 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194) to 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "4bb85182ef4d40b9a2d55592dd224e42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:46.802013 27006 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82d6ce64a03b468ea82c2c1d91e156e3"
dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
 from {username='slave'} at 127.0.0.1:59070
I20260709 13:07:46.802729 27006 raft_consensus.cc:493] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.803123 27006 raft_consensus.cc:3060] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.817973 27006 raft_consensus.cc:515] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.820880 27006 leader_election.cc:290] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:46.821871 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d6ce64a03b468ea82c2c1d91e156e3" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:46.822477 26931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d6ce64a03b468ea82c2c1d91e156e3" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:46.822621 26858 raft_consensus.cc:3060] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.823128 26931 raft_consensus.cc:3055] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:46.823479 26931 raft_consensus.cc:740] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:46.824301 26931 consensus_queue.cc:260] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.825387 26931 raft_consensus.cc:3060] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.829571 26858 raft_consensus.cc:2468] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 2.
I20260709 13:07:46.830951 26971 leader_election.cc:304] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:46.831328 26931 raft_consensus.cc:2468] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 2.
I20260709 13:07:46.831843 27088 raft_consensus.cc:2804] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:46.832414 27088 raft_consensus.cc:697] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 2 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:46.833238 27088 consensus_queue.cc:237] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.840842 26753 catalog_manager.cc:5697] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 1 to 2, leader changed from 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194) to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.934648 27213 raft_consensus.cc:993] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373: : Instructing follower 9e72c084cb0f4ef88534cd1cd6d6836d to start an election
I20260709 13:07:46.935177 27088 raft_consensus.cc:1081] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Signalling peer 9e72c084cb0f4ef88534cd1cd6d6836d to start an election
I20260709 13:07:46.936858 26932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "630d20fa978d44ecafe2d95add3e1c3c"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
 from {username='slave'} at 127.0.0.1:58176
I20260709 13:07:46.937355 26932 raft_consensus.cc:493] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:46.937647 26932 raft_consensus.cc:3060] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.942970 26932 raft_consensus.cc:515] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.944715 26932 leader_election.cc:290] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 2 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195:45865)
I20260709 13:07:46.945580 26858 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630d20fa978d44ecafe2d95add3e1c3c" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:46.945739 27006 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "630d20fa978d44ecafe2d95add3e1c3c" candidate_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
I20260709 13:07:46.946302 26858 raft_consensus.cc:3060] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.946410 27006 raft_consensus.cc:3055] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:46.946866 27006 raft_consensus.cc:740] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:46.947521 27006 consensus_queue.cc:260] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.948483 27006 raft_consensus.cc:3060] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:46.952083 26858 raft_consensus.cc:2468] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 2.
I20260709 13:07:46.953555 26897 leader_election.cc:304] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:46.954425 27228 raft_consensus.cc:2804] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:46.954681 27006 raft_consensus.cc:2468] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e72c084cb0f4ef88534cd1cd6d6836d in term 2.
I20260709 13:07:46.954893 27228 raft_consensus.cc:697] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Becoming Leader. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:46.955931 27228 consensus_queue.cc:237] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:46.962441 26753 catalog_manager.cc:5697] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d reported cstate change: term changed from 1 to 2, leader changed from 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195) to 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194). New cstate: current_term: 2 leader_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.058378 27006 raft_consensus.cc:1275] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Refusing update from remote peer 9e72c084cb0f4ef88534cd1cd6d6836d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.059713 27228 consensus_queue.cc:1048] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.060005 26932 raft_consensus.cc:1275] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.061798 27200 consensus_queue.cc:1048] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.063853 26858 raft_consensus.cc:1275] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Refusing update from remote peer 9e72c084cb0f4ef88534cd1cd6d6836d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.071012 27175 consensus_queue.cc:1048] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.074667 27006 raft_consensus.cc:1275] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.077669 27200 consensus_queue.cc:1048] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.246615 26858 raft_consensus.cc:1275] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Refusing update from remote peer 9e72c084cb0f4ef88534cd1cd6d6836d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.247918 27228 consensus_queue.cc:1048] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.256430 27006 raft_consensus.cc:1275] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Refusing update from remote peer 9e72c084cb0f4ef88534cd1cd6d6836d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.258972 27210 consensus_queue.cc:1048] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.320160 26931 raft_consensus.cc:1275] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.321760 27200 consensus_queue.cc:1048] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.332697 27006 raft_consensus.cc:1275] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Refusing update from remote peer 4bb85182ef4d40b9a2d55592dd224e42: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.334092 27200 consensus_queue.cc:1048] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.437289 26931 raft_consensus.cc:1275] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Refusing update from remote peer 693f641ab9504007b7e12bc60bb0d373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.438620 27088 consensus_queue.cc:1048] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.447166 26858 raft_consensus.cc:1275] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Refusing update from remote peer 693f641ab9504007b7e12bc60bb0d373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.449760 27088 consensus_queue.cc:1048] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.458685 27006 raft_consensus.cc:1275] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Refusing update from remote peer 9e72c084cb0f4ef88534cd1cd6d6836d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.460203 27210 consensus_queue.cc:1048] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:47.475028 26858 raft_consensus.cc:1275] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Refusing update from remote peer 9e72c084cb0f4ef88534cd1cd6d6836d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:47.477574 27176 consensus_queue.cc:1048] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:49.500563 26755 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48184:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:07:49.519513 26755 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48184:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:07:49.561815 14139 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:07:49.678015 27258 log.cc:927] Time spent T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373: Append to log took a long time: real 0.075s	user 0.004s	sys 0.000s
W20260709 13:07:49.756686 27264 log.cc:927] Time spent T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:07:49.766907 27260 log.cc:927] Time spent T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d: Append to log took a long time: real 0.149s	user 0.003s	sys 0.000s
W20260709 13:07:49.767553 27263 log.cc:927] Time spent T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
W20260709 13:07:49.778563 26823 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:45519, user_credentials={real_user=slave}} blocked reactor thread for 94649.7us
W20260709 13:07:49.781082 27259 log.cc:927] Time spent T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42: Append to log took a long time: real 0.178s	user 0.000s	sys 0.002s
W20260709 13:07:49.810129 27261 log.cc:927] Time spent T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42: Append to log took a long time: real 0.206s	user 0.003s	sys 0.000s
W20260709 13:07:49.864902 26897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:40947, user_credentials={real_user=slave}} blocked reactor thread for 95884.5us
W20260709 13:07:49.904762 27277 log.cc:927] Time spent T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:49.944756 27296 tablet.cc:1724] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:49.947491 27299 tablet.cc:1724] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:07:49.949461 26897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.193:40947, user_credentials={real_user=slave}} blocked reactor thread for 83574.9us
W20260709 13:07:49.922441 27280 log.cc:927] Time spent T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373: Append to log took a long time: real 0.071s	user 0.002s	sys 0.001s
I20260709 13:07:49.958225 27298 tablet.cc:1724] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:49.952994 27294 tablet.cc:1724] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:07:49.978488 26884 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:0e197d6d9b9842dd829a2e2fe8c08e1d)
W20260709 13:07:49.983986 26884 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:0e197d6d9b9842dd829a2e2fe8c08e1d)
I20260709 13:07:49.976188 27295 tablet.cc:1724] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.037262 27299 tablet.cc:1724] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:49.999177 27303 tablet.cc:1724] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.075212 27301 tablet.cc:1724] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.075834 27307 tablet.cc:1724] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.079732 27299 tablet.cc:1724] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.083293 27308 tablet.cc:1724] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.092430 27309 tablet.cc:1724] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.106566 27305 tablet.cc:1724] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.108088 27296 tablet.cc:1724] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.102545 26857 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e197d6d9b9842dd829a2e2fe8c08e1d"
dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
mode: GRACEFUL
new_leader_uuid: "693f641ab9504007b7e12bc60bb0d373"
 from {username='slave'} at 127.0.0.1:47660
I20260709 13:07:50.117797 26857 raft_consensus.cc:606] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Received request to transfer leadership to TS 693f641ab9504007b7e12bc60bb0d373
W20260709 13:07:50.115342 26897 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.195:45865, user_credentials={real_user=slave}} blocked reactor thread for 124532us
W20260709 13:07:50.141466 26959 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:0e197d6d9b9842dd829a2e2fe8c08e1d)
I20260709 13:07:50.168263 27304 tablet.cc:1724] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.171113 27295 tablet.cc:1724] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.174042 27294 tablet.cc:1724] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.172114 27299 tablet.cc:1724] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.187893 27307 tablet.cc:1724] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.196676 27303 tablet.cc:1724] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.194325 27309 tablet.cc:1724] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.202785 27308 tablet.cc:1724] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.197952 27301 tablet.cc:1724] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.212594 27309 tablet.cc:1724] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.215303 27295 tablet.cc:1724] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.220109 27298 tablet.cc:1724] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.226177 27309 tablet.cc:1724] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:07:50.253959 26930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
mode: GRACEFUL
new_leader_uuid: "693f641ab9504007b7e12bc60bb0d373"
 from {username='slave'} at 127.0.0.1:34104
I20260709 13:07:50.254642 26930 raft_consensus.cc:606] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Received request to transfer leadership to TS 693f641ab9504007b7e12bc60bb0d373
I20260709 13:07:50.256247 14139 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:07:50.256916 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:50.269308 26930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f2dd08cc08949bc89f23c4489f6d831"
dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
mode: GRACEFUL
new_leader_uuid: "693f641ab9504007b7e12bc60bb0d373"
 from {username='slave'} at 127.0.0.1:34104
I20260709 13:07:50.270081 26930 raft_consensus.cc:606] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Received request to transfer leadership to TS 693f641ab9504007b7e12bc60bb0d373
I20260709 13:07:50.273953 26855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5"
dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
mode: GRACEFUL
new_leader_uuid: "693f641ab9504007b7e12bc60bb0d373"
 from {username='slave'} at 127.0.0.1:47660
I20260709 13:07:50.274654 26855 raft_consensus.cc:606] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Received request to transfer leadership to TS 693f641ab9504007b7e12bc60bb0d373
I20260709 13:07:50.276051 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:50.276795 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:50.283087 26756 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e: soft_deleted_table [id=7991422e0e8c4793908a3c5796fc4ef1] alter complete (version 1)
I20260709 13:07:50.317132 27238 raft_consensus.cc:993] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42: : Instructing follower 693f641ab9504007b7e12bc60bb0d373 to start an election
I20260709 13:07:50.317790 27297 raft_consensus.cc:1081] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Signalling peer 693f641ab9504007b7e12bc60bb0d373 to start an election
I20260709 13:07:50.319564 27003 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5"
dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
 from {username='slave'} at 127.0.0.1:59078
I20260709 13:07:50.320148 27003 raft_consensus.cc:493] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:50.320398 27270 raft_consensus.cc:993] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d: : Instructing follower 693f641ab9504007b7e12bc60bb0d373 to start an election
I20260709 13:07:50.320604 27003 raft_consensus.cc:3060] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.321061 27311 raft_consensus.cc:1081] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Signalling peer 693f641ab9504007b7e12bc60bb0d373 to start an election
I20260709 13:07:50.322652 27007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f2dd08cc08949bc89f23c4489f6d831"
dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
 from {username='slave'} at 127.0.0.1:59070
I20260709 13:07:50.323220 27007 raft_consensus.cc:493] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:50.323535 27007 raft_consensus.cc:3060] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:50.326831 27003 raft_consensus.cc:515] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.329144 27003 leader_election.cc:290] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 3 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:50.329936 26855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:50.330307 26930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cde382db1c8b4f65b375329cb3f378e5" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:50.330683 26855 raft_consensus.cc:3055] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:50.330993 26930 raft_consensus.cc:3060] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.331122 26855 raft_consensus.cc:740] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:50.331053 27007 raft_consensus.cc:515] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.332276 26855 consensus_queue.cc:260] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.333619 26855 raft_consensus.cc:3060] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.334991 26854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2dd08cc08949bc89f23c4489f6d831" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:50.335876 26854 raft_consensus.cc:3060] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:50.341907 26930 raft_consensus.cc:2468] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 3.
I20260709 13:07:50.342648 26931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2dd08cc08949bc89f23c4489f6d831" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:50.343334 26931 raft_consensus.cc:3055] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:50.343660 26972 leader_election.cc:304] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:50.343679 26931 raft_consensus.cc:740] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:50.342579 26855 raft_consensus.cc:2468] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 3.
I20260709 13:07:50.345005 27237 raft_consensus.cc:2804] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:50.345600 27237 raft_consensus.cc:697] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 3 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:50.345095 26931 consensus_queue.cc:260] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.345862 26854 raft_consensus.cc:2468] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 2.
I20260709 13:07:50.346482 26931 raft_consensus.cc:3060] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:50.348070 26971 leader_election.cc:304] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:50.349018 27284 raft_consensus.cc:2804] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:50.350113 27284 raft_consensus.cc:697] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 2 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:50.351037 27284 consensus_queue.cc:237] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.346875 27007 leader_election.cc:290] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:50.346545 27237 consensus_queue.cc:237] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.354600 26931 raft_consensus.cc:2468] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 2.
I20260709 13:07:50.365566 26755 catalog_manager.cc:5697] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 2 to 3, leader changed from 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193) to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.377883 26755 catalog_manager.cc:5697] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 1 to 2, leader changed from 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194) to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.536768 27297 raft_consensus.cc:993] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42: : Instructing follower 693f641ab9504007b7e12bc60bb0d373 to start an election
I20260709 13:07:50.537240 27238 raft_consensus.cc:1081] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Signalling peer 693f641ab9504007b7e12bc60bb0d373 to start an election
I20260709 13:07:50.538727 27007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e197d6d9b9842dd829a2e2fe8c08e1d"
dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
 from {username='slave'} at 127.0.0.1:59078
I20260709 13:07:50.539184 27007 raft_consensus.cc:493] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:50.539434 27007 raft_consensus.cc:3060] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:50.545903 27007 raft_consensus.cc:515] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.547995 27007 leader_election.cc:290] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 2 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:50.548688 26854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e197d6d9b9842dd829a2e2fe8c08e1d" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:50.549285 26854 raft_consensus.cc:3055] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:50.549316 26931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e197d6d9b9842dd829a2e2fe8c08e1d" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:50.549611 26854 raft_consensus.cc:740] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bb85182ef4d40b9a2d55592dd224e42, State: Running, Role: LEADER
I20260709 13:07:50.549985 26931 raft_consensus.cc:3060] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:50.550403 26854 consensus_queue.cc:260] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.551451 26854 raft_consensus.cc:3060] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:50.556658 26931 raft_consensus.cc:2468] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 2.
I20260709 13:07:50.557999 26854 raft_consensus.cc:2468] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 2.
I20260709 13:07:50.558017 26972 leader_election.cc:304] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 693f641ab9504007b7e12bc60bb0d373, 9e72c084cb0f4ef88534cd1cd6d6836d; no voters: 
I20260709 13:07:50.559121 27284 raft_consensus.cc:2804] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:50.559635 27284 raft_consensus.cc:697] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 2 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:50.560393 27284 consensus_queue.cc:237] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.568166 26755 catalog_manager.cc:5697] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 1 to 2, leader changed from 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193) to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.620446 27270 raft_consensus.cc:993] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d: : Instructing follower 693f641ab9504007b7e12bc60bb0d373 to start an election
I20260709 13:07:50.620900 27311 raft_consensus.cc:1081] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Signalling peer 693f641ab9504007b7e12bc60bb0d373 to start an election
I20260709 13:07:50.622426 27007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080"
dest_uuid: "693f641ab9504007b7e12bc60bb0d373"
 from {username='slave'} at 127.0.0.1:59070
I20260709 13:07:50.622957 27007 raft_consensus.cc:493] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:50.623276 27007 raft_consensus.cc:3060] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.628401 27007 raft_consensus.cc:515] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.630306 27007 leader_election.cc:290] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 3 election: Requested vote from peers 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947), 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519)
I20260709 13:07:50.631362 26931 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d"
I20260709 13:07:50.631246 26854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3c60d773ff48b8889b12aff6214080" candidate_uuid: "693f641ab9504007b7e12bc60bb0d373" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4bb85182ef4d40b9a2d55592dd224e42"
I20260709 13:07:50.632149 26931 raft_consensus.cc:3055] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:50.632226 26854 raft_consensus.cc:3060] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.632477 26931 raft_consensus.cc:740] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e72c084cb0f4ef88534cd1cd6d6836d, State: Running, Role: LEADER
I20260709 13:07:50.633389 26931 consensus_queue.cc:260] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.634544 26931 raft_consensus.cc:3060] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.638314 26854 raft_consensus.cc:2468] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 3.
I20260709 13:07:50.639680 26971 leader_election.cc:304] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bb85182ef4d40b9a2d55592dd224e42, 693f641ab9504007b7e12bc60bb0d373; no voters: 
I20260709 13:07:50.640620 27284 raft_consensus.cc:2804] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:50.641064 27284 raft_consensus.cc:697] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 3 LEADER]: Becoming Leader. State: Replica: 693f641ab9504007b7e12bc60bb0d373, State: Running, Role: LEADER
I20260709 13:07:50.641216 26931 raft_consensus.cc:2468] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 693f641ab9504007b7e12bc60bb0d373 in term 3.
I20260709 13:07:50.641834 27284 consensus_queue.cc:237] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } }
I20260709 13:07:50.651630 26755 catalog_manager.cc:5697] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 reported cstate change: term changed from 2 to 3, leader changed from 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194) to 693f641ab9504007b7e12bc60bb0d373 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "693f641ab9504007b7e12bc60bb0d373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "693f641ab9504007b7e12bc60bb0d373" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 45865 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.756834 26931 raft_consensus.cc:1275] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 3 FOLLOWER]: Refusing update from remote peer 693f641ab9504007b7e12bc60bb0d373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:50.758312 27284 consensus_queue.cc:1048] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:50.760972 26854 raft_consensus.cc:1275] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Refusing update from remote peer 693f641ab9504007b7e12bc60bb0d373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:50.762758 27284 consensus_queue.cc:1048] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:50.771418 26855 raft_consensus.cc:1275] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 3 FOLLOWER]: Refusing update from remote peer 693f641ab9504007b7e12bc60bb0d373: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:50.773406 27316 consensus_queue.cc:1048] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:50.787207 26931 raft_consensus.cc:1275] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Refusing update from remote peer 693f641ab9504007b7e12bc60bb0d373: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:50.788892 27237 consensus_queue.cc:1048] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:50.988821 26931 raft_consensus.cc:1275] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Refusing update from remote peer 693f641ab9504007b7e12bc60bb0d373: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:07:50.990300 27237 consensus_queue.cc:1048] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:50.997884 26854 raft_consensus.cc:1275] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Refusing update from remote peer 693f641ab9504007b7e12bc60bb0d373: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:07:50.999850 27316 consensus_queue.cc:1048] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:51.198583 26854 raft_consensus.cc:1275] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 3 FOLLOWER]: Refusing update from remote peer 693f641ab9504007b7e12bc60bb0d373: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:51.201707 27316 consensus_queue.cc:1048] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb85182ef4d40b9a2d55592dd224e42" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 40947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:51.225160 26931 raft_consensus.cc:1275] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 3 FOLLOWER]: Refusing update from remote peer 693f641ab9504007b7e12bc60bb0d373: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:07:51.227411 27237 consensus_queue.cc:1048] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e72c084cb0f4ef88534cd1cd6d6836d" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 45519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:51.349361 14139 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:07:51.354743 14139 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:07:51.355216 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:51.361296 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:07:51.362605 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:52.396204 14139 tablet_server.cc:179] TabletServer@127.13.206.193:0 shutting down...
I20260709 13:07:52.433561 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:52.434569 14139 tablet_replica.cc:333] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.435724 14139 raft_consensus.cc:2243] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.436444 14139 raft_consensus.cc:2272] T 857e954342e44db59dc5cac866437bfc P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.439320 14139 tablet_replica.cc:333] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.440059 14139 raft_consensus.cc:2243] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.440696 14139 raft_consensus.cc:2272] T 630d20fa978d44ecafe2d95add3e1c3c P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.443079 14139 tablet_replica.cc:333] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.443759 14139 raft_consensus.cc:2243] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.444741 14139 raft_consensus.cc:2272] T cd1b22f2d7054c6db3cd2d5128b44371 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.447525 14139 tablet_replica.cc:333] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.448175 14139 raft_consensus.cc:2243] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.448796 14139 raft_consensus.cc:2272] T 82d6ce64a03b468ea82c2c1d91e156e3 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.451483 14139 tablet_replica.cc:333] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.452263 14139 raft_consensus.cc:2243] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.452837 14139 raft_consensus.cc:2272] T dc3c60d773ff48b8889b12aff6214080 P 4bb85182ef4d40b9a2d55592dd224e42 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.455572 14139 tablet_replica.cc:333] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.456305 14139 raft_consensus.cc:2243] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.456876 14139 raft_consensus.cc:2272] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.459661 14139 tablet_replica.cc:333] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.460372 14139 raft_consensus.cc:2243] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.460924 14139 raft_consensus.cc:2272] T 4f2dd08cc08949bc89f23c4489f6d831 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.463536 14139 tablet_replica.cc:333] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.464165 14139 raft_consensus.cc:2243] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.465162 14139 raft_consensus.cc:2272] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.467705 14139 tablet_replica.cc:333] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.468315 14139 raft_consensus.cc:2243] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.468822 14139 raft_consensus.cc:2272] T 5dc38c9005824015ae61c281264adfb8 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.471276 14139 tablet_replica.cc:333] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.471859 14139 raft_consensus.cc:2243] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.472462 14139 raft_consensus.cc:2272] T 220f537ca99946228d7ae4913e7b8f8f P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.475116 14139 tablet_replica.cc:333] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.475911 14139 raft_consensus.cc:2243] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.476573 14139 raft_consensus.cc:2272] T 4e09d1b43eb74b2085a251469681bcca P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.479701 14139 tablet_replica.cc:333] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.480535 14139 raft_consensus.cc:2243] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.481812 14139 raft_consensus.cc:2272] T 2365ca803d97449884a99d10e6dcc977 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.484829 14139 tablet_replica.cc:333] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.485406 14139 raft_consensus.cc:2243] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.486300 14139 raft_consensus.cc:2272] T 2da81f74ec8548acae8eafa4cbbc2087 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.489004 14139 tablet_replica.cc:333] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.489570 14139 raft_consensus.cc:2243] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.490051 14139 raft_consensus.cc:2272] T fca78226789d4f70bafdb40b1e7a0f30 P 4bb85182ef4d40b9a2d55592dd224e42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.492625 14139 tablet_replica.cc:333] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.493134 14139 raft_consensus.cc:2243] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.494037 14139 raft_consensus.cc:2272] T 40a8e356629840f89d7da57a66beed52 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.496796 14139 tablet_replica.cc:333] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.497400 14139 raft_consensus.cc:2243] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.498054 14139 raft_consensus.cc:2272] T f7e0d89b678842a28b00cf8aadf9205c P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.500588 14139 tablet_replica.cc:333] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.501174 14139 raft_consensus.cc:2243] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.502140 14139 raft_consensus.cc:2272] T ec6eb8d6c5e74beb8708231d82f94d19 P 4bb85182ef4d40b9a2d55592dd224e42 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.504648 14139 tablet_replica.cc:333] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42: stopping tablet replica
I20260709 13:07:52.505214 14139 raft_consensus.cc:2243] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.505767 14139 raft_consensus.cc:2272] T cde382db1c8b4f65b375329cb3f378e5 P 4bb85182ef4d40b9a2d55592dd224e42 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:52.518399 26897 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 13:07:52.522312 26897 consensus_peers.cc:597] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d -> Peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Couldn't send request to peer 4bb85182ef4d40b9a2d55592dd224e42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:52.528985 26897 consensus_peers.cc:597] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d -> Peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Couldn't send request to peer 4bb85182ef4d40b9a2d55592dd224e42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:52.529011 26971 consensus_peers.cc:597] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 -> Peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Couldn't send request to peer 4bb85182ef4d40b9a2d55592dd224e42. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.558678 14139 tablet_server.cc:196] TabletServer@127.13.206.193:0 shutdown complete.
W20260709 13:07:52.569288 26897 consensus_peers.cc:597] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d -> Peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Couldn't send request to peer 4bb85182ef4d40b9a2d55592dd224e42. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40947: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.609510 14139 tablet_server.cc:179] TabletServer@127.13.206.194:0 shutting down...
W20260709 13:07:52.618076 26972 consensus_peers.cc:597] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 -> Peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Couldn't send request to peer 9e72c084cb0f4ef88534cd1cd6d6836d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:52.632427 26972 consensus_peers.cc:597] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 -> Peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Couldn't send request to peer 9e72c084cb0f4ef88534cd1cd6d6836d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:52.648896 26971 consensus_peers.cc:597] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 -> Peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Couldn't send request to peer 4bb85182ef4d40b9a2d55592dd224e42. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40947: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.651042 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:52.652099 14139 tablet_replica.cc:333] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.653319 14139 raft_consensus.cc:2243] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.654592 14139 raft_consensus.cc:2272] T f7e0d89b678842a28b00cf8aadf9205c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.657114 14139 tablet_replica.cc:333] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.657687 14139 raft_consensus.cc:2243] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.658124 14139 raft_consensus.cc:2272] T dc3c60d773ff48b8889b12aff6214080 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.660400 14139 tablet_replica.cc:333] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.661037 14139 raft_consensus.cc:2243] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.661912 14139 raft_consensus.cc:2272] T 857e954342e44db59dc5cac866437bfc P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.664299 14139 tablet_replica.cc:333] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.664856 14139 raft_consensus.cc:2243] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.665731 14139 raft_consensus.cc:2272] T 630d20fa978d44ecafe2d95add3e1c3c P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.668124 14139 tablet_replica.cc:333] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.668704 14139 raft_consensus.cc:2243] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.669178 14139 raft_consensus.cc:2272] T 2365ca803d97449884a99d10e6dcc977 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.671532 14139 tablet_replica.cc:333] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.672081 14139 raft_consensus.cc:2243] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.672653 14139 raft_consensus.cc:2272] T 2da81f74ec8548acae8eafa4cbbc2087 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.675213 14139 tablet_replica.cc:333] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.675828 14139 raft_consensus.cc:2243] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.676443 14139 raft_consensus.cc:2272] T 82d6ce64a03b468ea82c2c1d91e156e3 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.678902 14139 tablet_replica.cc:333] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.679504 14139 raft_consensus.cc:2243] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.680099 14139 raft_consensus.cc:2272] T cd1b22f2d7054c6db3cd2d5128b44371 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.682610 14139 tablet_replica.cc:333] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.683333 14139 raft_consensus.cc:2243] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.683841 14139 raft_consensus.cc:2272] T 4f2dd08cc08949bc89f23c4489f6d831 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.686094 14139 tablet_replica.cc:333] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.686689 14139 raft_consensus.cc:2243] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.687294 14139 raft_consensus.cc:2272] T fca78226789d4f70bafdb40b1e7a0f30 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.690389 14139 tablet_replica.cc:333] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.691044 14139 raft_consensus.cc:2243] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.691746 14139 raft_consensus.cc:2272] T 40a8e356629840f89d7da57a66beed52 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:52.692438 26971 consensus_peers.cc:597] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 -> Peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Couldn't send request to peer 4bb85182ef4d40b9a2d55592dd224e42. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40947: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.694360 14139 tablet_replica.cc:333] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.695055 14139 raft_consensus.cc:2243] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.695592 14139 raft_consensus.cc:2272] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.697979 14139 tablet_replica.cc:333] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.698655 14139 raft_consensus.cc:2243] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.699641 14139 raft_consensus.cc:2272] T 220f537ca99946228d7ae4913e7b8f8f P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.701954 14139 tablet_replica.cc:333] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.702574 14139 raft_consensus.cc:2243] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.703517 14139 raft_consensus.cc:2272] T 5dc38c9005824015ae61c281264adfb8 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.706120 14139 tablet_replica.cc:333] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.706854 14139 raft_consensus.cc:2243] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.707460 14139 raft_consensus.cc:2272] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.709606 14139 tablet_replica.cc:333] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.710186 14139 raft_consensus.cc:2243] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.711171 14139 raft_consensus.cc:2272] T 4e09d1b43eb74b2085a251469681bcca P 9e72c084cb0f4ef88534cd1cd6d6836d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.713565 14139 tablet_replica.cc:333] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.714107 14139 raft_consensus.cc:2243] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.714687 14139 raft_consensus.cc:2272] T ec6eb8d6c5e74beb8708231d82f94d19 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.717123 14139 tablet_replica.cc:333] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d: stopping tablet replica
I20260709 13:07:52.717787 14139 raft_consensus.cc:2243] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.718472 14139 raft_consensus.cc:2272] T cde382db1c8b4f65b375329cb3f378e5 P 9e72c084cb0f4ef88534cd1cd6d6836d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:52.742009 26971 consensus_peers.cc:597] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 -> Peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Couldn't send request to peer 4bb85182ef4d40b9a2d55592dd224e42. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40947: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:52.755010 26972 consensus_peers.cc:597] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 -> Peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Couldn't send request to peer 9e72c084cb0f4ef88534cd1cd6d6836d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:45519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.756702 14139 tablet_server.cc:196] TabletServer@127.13.206.194:0 shutdown complete.
W20260709 13:07:52.764499 26972 consensus_peers.cc:597] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 -> Peer 9e72c084cb0f4ef88534cd1cd6d6836d (127.13.206.194:45519): Couldn't send request to peer 9e72c084cb0f4ef88534cd1cd6d6836d. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.194:45519: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.801928 14139 tablet_server.cc:179] TabletServer@127.13.206.195:0 shutting down...
W20260709 13:07:52.832732 26971 consensus_peers.cc:597] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 -> Peer 4bb85182ef4d40b9a2d55592dd224e42 (127.13.206.193:40947): Couldn't send request to peer 4bb85182ef4d40b9a2d55592dd224e42. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:40947: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.837888 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:52.838923 14139 tablet_replica.cc:333] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.840111 14139 raft_consensus.cc:2243] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.840900 14139 raft_consensus.cc:2272] T 857e954342e44db59dc5cac866437bfc P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.843361 14139 tablet_replica.cc:333] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.843963 14139 raft_consensus.cc:2243] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.844415 14139 raft_consensus.cc:2272] T 2365ca803d97449884a99d10e6dcc977 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.846657 14139 tablet_replica.cc:333] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.847189 14139 raft_consensus.cc:2243] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.847630 14139 raft_consensus.cc:2272] T 2da81f74ec8548acae8eafa4cbbc2087 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.849887 14139 tablet_replica.cc:333] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.850538 14139 raft_consensus.cc:2243] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.851339 14139 raft_consensus.cc:2272] T 0e197d6d9b9842dd829a2e2fe8c08e1d P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.853502 14139 tablet_replica.cc:333] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.854020 14139 raft_consensus.cc:2243] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.854576 14139 raft_consensus.cc:2272] T 630d20fa978d44ecafe2d95add3e1c3c P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.857580 14139 tablet_replica.cc:333] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.858117 14139 raft_consensus.cc:2243] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.858703 14139 raft_consensus.cc:2272] T f7e0d89b678842a28b00cf8aadf9205c P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.860898 14139 tablet_replica.cc:333] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.861420 14139 raft_consensus.cc:2243] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.862342 14139 raft_consensus.cc:2272] T 82d6ce64a03b468ea82c2c1d91e156e3 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.864475 14139 tablet_replica.cc:333] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.865031 14139 raft_consensus.cc:2243] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.865501 14139 raft_consensus.cc:2272] T cd1b22f2d7054c6db3cd2d5128b44371 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.867699 14139 tablet_replica.cc:333] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.868206 14139 raft_consensus.cc:2243] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.868636 14139 raft_consensus.cc:2272] T 5dc38c9005824015ae61c281264adfb8 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.870841 14139 tablet_replica.cc:333] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.871326 14139 raft_consensus.cc:2243] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.871798 14139 raft_consensus.cc:2272] T 220f537ca99946228d7ae4913e7b8f8f P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.874192 14139 tablet_replica.cc:333] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.874792 14139 raft_consensus.cc:2243] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.875276 14139 raft_consensus.cc:2272] T ba4b5dcf83be4ecaa6465dd4ca4f9260 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.877453 14139 tablet_replica.cc:333] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.877976 14139 raft_consensus.cc:2243] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.878405 14139 raft_consensus.cc:2272] T 4e09d1b43eb74b2085a251469681bcca P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.880388 14139 tablet_replica.cc:333] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.880882 14139 raft_consensus.cc:2243] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.881659 14139 raft_consensus.cc:2272] T 4f2dd08cc08949bc89f23c4489f6d831 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.884086 14139 tablet_replica.cc:333] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.884646 14139 raft_consensus.cc:2243] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.885464 14139 raft_consensus.cc:2272] T dc3c60d773ff48b8889b12aff6214080 P 693f641ab9504007b7e12bc60bb0d373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.887743 14139 tablet_replica.cc:333] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.888329 14139 raft_consensus.cc:2243] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.889321 14139 raft_consensus.cc:2272] T fca78226789d4f70bafdb40b1e7a0f30 P 693f641ab9504007b7e12bc60bb0d373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.891574 14139 tablet_replica.cc:333] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.892146 14139 raft_consensus.cc:2243] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.892652 14139 raft_consensus.cc:2272] T 40a8e356629840f89d7da57a66beed52 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.894886 14139 tablet_replica.cc:333] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.895439 14139 raft_consensus.cc:2243] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:52.895958 14139 raft_consensus.cc:2272] T ec6eb8d6c5e74beb8708231d82f94d19 P 693f641ab9504007b7e12bc60bb0d373 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.898180 14139 tablet_replica.cc:333] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373: stopping tablet replica
I20260709 13:07:52.898726 14139 raft_consensus.cc:2243] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:52.899583 14139 raft_consensus.cc:2272] T cde382db1c8b4f65b375329cb3f378e5 P 693f641ab9504007b7e12bc60bb0d373 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:52.940196 14139 tablet_server.cc:196] TabletServer@127.13.206.195:0 shutdown complete.
I20260709 13:07:52.981189 14139 master.cc:562] Master@127.13.206.254:45053 shutting down...
I20260709 13:07:53.005172 14139 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:53.005927 14139 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.006368 14139 tablet_replica.cc:333] T 00000000000000000000000000000000 P 11e4636f148641b3aba0ac0b0b40898e: stopping tablet replica
I20260709 13:07:53.027603 14139 master.cc:584] Master@127.13.206.254:45053 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13025 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:07:53.081451 14139 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.206.254:33029
I20260709 13:07:53.082770 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:53.088830 27337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:53.088948 27338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:53.090081 14139 server_base.cc:1061] running on GCE node
W20260709 13:07:53.090509 27340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:53.091538 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:53.091722 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:53.091871 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602473091859 us; error 0 us; skew 500 ppm
I20260709 13:07:53.092319 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:53.094879 14139 webserver.cc:533] Webserver started at http://127.13.206.254:42187/ using document root <none> and password file <none>
I20260709 13:07:53.095345 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:53.095510 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:53.095734 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:53.096863 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/master-0-root/instance:
uuid: "ea80c6a5d6e14de490786d97c283beed"
format_stamp: "Formatted at 2026-07-09 13:07:53 on dist-test-slave-ml7r"
I20260709 13:07:53.101313 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:07:53.104753 27345 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.105538 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:53.105818 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/master-0-root
uuid: "ea80c6a5d6e14de490786d97c283beed"
format_stamp: "Formatted at 2026-07-09 13:07:53 on dist-test-slave-ml7r"
I20260709 13:07:53.106096 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:53.115953 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:53.117170 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:53.157750 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.254:33029
I20260709 13:07:53.157845 27396 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.254:33029 every 8 connection(s)
I20260709 13:07:53.161767 27397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.174212 27397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed: Bootstrap starting.
I20260709 13:07:53.179575 27397 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.184406 27397 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed: No bootstrap required, opened a new log
I20260709 13:07:53.186866 27397 raft_consensus.cc:359] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea80c6a5d6e14de490786d97c283beed" member_type: VOTER }
I20260709 13:07:53.187304 27397 raft_consensus.cc:385] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.187559 27397 raft_consensus.cc:740] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea80c6a5d6e14de490786d97c283beed, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.188203 27397 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea80c6a5d6e14de490786d97c283beed" member_type: VOTER }
I20260709 13:07:53.188694 27397 raft_consensus.cc:399] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:53.188930 27397 raft_consensus.cc:493] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:53.189208 27397 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:53.194453 27397 raft_consensus.cc:515] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea80c6a5d6e14de490786d97c283beed" member_type: VOTER }
I20260709 13:07:53.195086 27397 leader_election.cc:304] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea80c6a5d6e14de490786d97c283beed; no voters: 
I20260709 13:07:53.196308 27397 leader_election.cc:290] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:53.196761 27400 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:53.198179 27400 raft_consensus.cc:697] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 1 LEADER]: Becoming Leader. State: Replica: ea80c6a5d6e14de490786d97c283beed, State: Running, Role: LEADER
I20260709 13:07:53.198945 27400 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea80c6a5d6e14de490786d97c283beed" member_type: VOTER }
I20260709 13:07:53.199717 27397 sys_catalog.cc:565] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:53.204258 27402 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea80c6a5d6e14de490786d97c283beed. Latest consensus state: current_term: 1 leader_uuid: "ea80c6a5d6e14de490786d97c283beed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea80c6a5d6e14de490786d97c283beed" member_type: VOTER } }
I20260709 13:07:53.205170 27402 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:53.204340 27401 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea80c6a5d6e14de490786d97c283beed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea80c6a5d6e14de490786d97c283beed" member_type: VOTER } }
I20260709 13:07:53.206868 27401 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:53.207403 27407 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:53.212658 27407 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:53.216662 14139 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:53.222172 27407 catalog_manager.cc:1383] Generated new cluster ID: 2900aec069464ad5a91d3a83bbcb62a9
I20260709 13:07:53.222523 27407 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:53.239753 27407 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:53.241086 27407 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:53.260614 27407 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed: Generated new TSK 0
I20260709 13:07:53.261309 27407 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:53.283812 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:53.290027 27418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:53.291236 27419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:53.293100 14139 server_base.cc:1061] running on GCE node
W20260709 13:07:53.293663 27421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:53.294735 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:53.295006 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:53.295204 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602473295167 us; error 0 us; skew 500 ppm
I20260709 13:07:53.295751 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:53.298050 14139 webserver.cc:533] Webserver started at http://127.13.206.193:42137/ using document root <none> and password file <none>
I20260709 13:07:53.298623 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:53.298820 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:53.299100 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:53.300258 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-0-root/instance:
uuid: "6133756cc28a47d491b159f8bd124060"
format_stamp: "Formatted at 2026-07-09 13:07:53 on dist-test-slave-ml7r"
I20260709 13:07:53.305051 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:07:53.308859 27426 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.309643 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:07:53.309989 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-0-root
uuid: "6133756cc28a47d491b159f8bd124060"
format_stamp: "Formatted at 2026-07-09 13:07:53 on dist-test-slave-ml7r"
I20260709 13:07:53.310406 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:53.330533 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:53.331827 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:53.333356 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:53.335985 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:53.336230 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.336479 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:53.336692 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.378695 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.193:35339
I20260709 13:07:53.378767 27488 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.193:35339 every 8 connection(s)
I20260709 13:07:53.384274 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:53.391796 27493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:53.392926 27494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:53.394882 14139 server_base.cc:1061] running on GCE node
W20260709 13:07:53.395848 27496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:53.396831 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:53.397071 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:53.397294 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602473397275 us; error 0 us; skew 500 ppm
I20260709 13:07:53.397843 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:53.400309 14139 webserver.cc:533] Webserver started at http://127.13.206.194:46167/ using document root <none> and password file <none>
I20260709 13:07:53.400882 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:53.401116 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:53.401434 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:53.403126 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-1-root/instance:
uuid: "a85d0c8e244c4191bb2a39f74b217f37"
format_stamp: "Formatted at 2026-07-09 13:07:53 on dist-test-slave-ml7r"
I20260709 13:07:53.404676 27489 heartbeater.cc:344] Connected to a master server at 127.13.206.254:33029
I20260709 13:07:53.405130 27489 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:53.405908 27489 heartbeater.cc:507] Master 127.13.206.254:33029 requested a full tablet report, sending...
I20260709 13:07:53.408475 27362 ts_manager.cc:194] Registered new tserver with Master: 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339)
I20260709 13:07:53.408877 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:53.410579 27362 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33664
I20260709 13:07:53.413259 27501 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.414289 14139 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:53.414621 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-1-root
uuid: "a85d0c8e244c4191bb2a39f74b217f37"
format_stamp: "Formatted at 2026-07-09 13:07:53 on dist-test-slave-ml7r"
I20260709 13:07:53.414918 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:53.436475 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:53.437757 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:53.439405 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:53.441970 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:53.442226 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.442512 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:53.442698 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.484169 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.194:36135
I20260709 13:07:53.484287 27563 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.194:36135 every 8 connection(s)
I20260709 13:07:53.489248 14139 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:53.495973 27567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:53.496793 27568 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:53.500272 14139 server_base.cc:1061] running on GCE node
W20260709 13:07:53.500838 27570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:53.502544 14139 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:07:53.502794 27564 heartbeater.cc:344] Connected to a master server at 127.13.206.254:33029
W20260709 13:07:53.502844 14139 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:53.503304 14139 hybrid_clock.cc:648] HybridClock initialized: now 1783602473503277 us; error 0 us; skew 500 ppm
I20260709 13:07:53.503347 27564 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:53.503981 14139 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:53.504298 27564 heartbeater.cc:507] Master 127.13.206.254:33029 requested a full tablet report, sending...
I20260709 13:07:53.506925 27362 ts_manager.cc:194] Registered new tserver with Master: a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:53.507072 14139 webserver.cc:533] Webserver started at http://127.13.206.195:46591/ using document root <none> and password file <none>
I20260709 13:07:53.507786 14139 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:53.508041 14139 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:53.508471 14139 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:53.508975 27362 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33666
I20260709 13:07:53.510162 14139 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-2-root/instance:
uuid: "da55bab8ad794364aa77430da1cf0bc8"
format_stamp: "Formatted at 2026-07-09 13:07:53 on dist-test-slave-ml7r"
I20260709 13:07:53.515643 14139 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:53.519246 27575 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.520064 14139 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:53.520352 14139 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-2-root
uuid: "da55bab8ad794364aa77430da1cf0bc8"
format_stamp: "Formatted at 2026-07-09 13:07:53 on dist-test-slave-ml7r"
I20260709 13:07:53.520617 14139 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskxkPU5E/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602098938719-14139-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:53.546173 14139 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:53.547456 14139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:53.548867 14139 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:53.551229 14139 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:53.551450 14139 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.551729 14139 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:53.551913 14139 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:53.593034 14139 rpc_server.cc:307] RPC server started. Bound to: 127.13.206.195:41047
I20260709 13:07:53.593137 27637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.206.195:41047 every 8 connection(s)
I20260709 13:07:53.609778 27638 heartbeater.cc:344] Connected to a master server at 127.13.206.254:33029
I20260709 13:07:53.610200 27638 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:53.611068 27638 heartbeater.cc:507] Master 127.13.206.254:33029 requested a full tablet report, sending...
I20260709 13:07:53.613304 27362 ts_manager.cc:194] Registered new tserver with Master: da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:53.613615 14139 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017277279s
I20260709 13:07:53.614907 27362 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33682
I20260709 13:07:53.640805 27362 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33692:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:53.643766 27362 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:53.735096 27454 tablet_service.cc:1511] Processing CreateTablet for tablet 7a8972cf673b4bcf9590c1260354901a (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:53.738144 27453 tablet_service.cc:1511] Processing CreateTablet for tablet c503892b567043d5874be704fe436d70 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:53.739470 27602 tablet_service.cc:1511] Processing CreateTablet for tablet c503892b567043d5874be704fe436d70 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:53.741125 27602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c503892b567043d5874be704fe436d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.741876 27451 tablet_service.cc:1511] Processing CreateTablet for tablet 0ffe9b21b446483f969e15a1af04275a (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:53.742004 27450 tablet_service.cc:1511] Processing CreateTablet for tablet 2151f36a277a43a0a6282bffd280bfbb (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:53.743170 27526 tablet_service.cc:1511] Processing CreateTablet for tablet 0ffe9b21b446483f969e15a1af04275a (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:53.744769 27526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ffe9b21b446483f969e15a1af04275a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.744472 27528 tablet_service.cc:1511] Processing CreateTablet for tablet c503892b567043d5874be704fe436d70 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:53.745961 27528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c503892b567043d5874be704fe436d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.745743 27600 tablet_service.cc:1511] Processing CreateTablet for tablet 0ffe9b21b446483f969e15a1af04275a (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:53.746433 27452 tablet_service.cc:1511] Processing CreateTablet for tablet 15bd073603094e9e89099d89e23c71c7 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:53.734141 27603 tablet_service.cc:1511] Processing CreateTablet for tablet 7a8972cf673b4bcf9590c1260354901a (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:53.741886 27527 tablet_service.cc:1511] Processing CreateTablet for tablet 15bd073603094e9e89099d89e23c71c7 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:53.748652 27527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15bd073603094e9e89099d89e23c71c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.744544 27601 tablet_service.cc:1511] Processing CreateTablet for tablet 15bd073603094e9e89099d89e23c71c7 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:53.750250 27529 tablet_service.cc:1511] Processing CreateTablet for tablet 7a8972cf673b4bcf9590c1260354901a (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:53.747216 27600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ffe9b21b446483f969e15a1af04275a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.751598 27529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a8972cf673b4bcf9590c1260354901a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.754817 27601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15bd073603094e9e89099d89e23c71c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.762252 27603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a8972cf673b4bcf9590c1260354901a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.748652 27454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a8972cf673b4bcf9590c1260354901a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.768358 27525 tablet_service.cc:1511] Processing CreateTablet for tablet 2151f36a277a43a0a6282bffd280bfbb (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:53.769898 27525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2151f36a277a43a0a6282bffd280bfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.770808 27599 tablet_service.cc:1511] Processing CreateTablet for tablet 2151f36a277a43a0a6282bffd280bfbb (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:53.772840 27599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2151f36a277a43a0a6282bffd280bfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.778991 27452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15bd073603094e9e89099d89e23c71c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.780825 27453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c503892b567043d5874be704fe436d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.782414 27450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2151f36a277a43a0a6282bffd280bfbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.783892 27451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ffe9b21b446483f969e15a1af04275a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.807163 27449 tablet_service.cc:1511] Processing CreateTablet for tablet 8885eb6b7a02460fa90480e1c3a00907 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:53.808629 27653 tablet_bootstrap.cc:492] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:53.808818 27449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8885eb6b7a02460fa90480e1c3a00907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.813925 27529 tablet_service.cc:1511] Processing CreateTablet for tablet 8885eb6b7a02460fa90480e1c3a00907 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:53.815523 27529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8885eb6b7a02460fa90480e1c3a00907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.821586 27654 tablet_bootstrap.cc:492] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:53.824334 27602 tablet_service.cc:1511] Processing CreateTablet for tablet 8885eb6b7a02460fa90480e1c3a00907 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:53.827099 27448 tablet_service.cc:1511] Processing CreateTablet for tablet cda617f16b0b4900a2c1e421ff81aa84 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:53.828676 27448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda617f16b0b4900a2c1e421ff81aa84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.830857 27598 tablet_service.cc:1511] Processing CreateTablet for tablet cda617f16b0b4900a2c1e421ff81aa84 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:53.832510 27598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda617f16b0b4900a2c1e421ff81aa84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.834990 27602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8885eb6b7a02460fa90480e1c3a00907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.847530 27447 tablet_service.cc:1511] Processing CreateTablet for tablet d8060b5b61484f78971bec004c171c0b (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:53.849153 27447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8060b5b61484f78971bec004c171c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.849524 27528 tablet_service.cc:1511] Processing CreateTablet for tablet d8060b5b61484f78971bec004c171c0b (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:53.850991 27528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8060b5b61484f78971bec004c171c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.855394 27653 tablet_bootstrap.cc:654] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.862375 27597 tablet_service.cc:1511] Processing CreateTablet for tablet d8060b5b61484f78971bec004c171c0b (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:53.864039 27597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8060b5b61484f78971bec004c171c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.831991 27527 tablet_service.cc:1511] Processing CreateTablet for tablet cda617f16b0b4900a2c1e421ff81aa84 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:53.875501 27527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cda617f16b0b4900a2c1e421ff81aa84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.886685 27446 tablet_service.cc:1511] Processing CreateTablet for tablet a0832f611c88444f84f9c0791be88152 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:53.888301 27446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0832f611c88444f84f9c0791be88152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.888602 27525 tablet_service.cc:1511] Processing CreateTablet for tablet a0832f611c88444f84f9c0791be88152 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:53.889601 27596 tablet_service.cc:1511] Processing CreateTablet for tablet a0832f611c88444f84f9c0791be88152 (DEFAULT_TABLE table=test-workload [id=74ac05df8ee140df8ec62f84c657e83a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:53.890089 27525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0832f611c88444f84f9c0791be88152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.891084 27596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0832f611c88444f84f9c0791be88152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.918633 27654 tablet_bootstrap.cc:654] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.961109 27656 tablet_bootstrap.cc:492] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:53.962496 27653 tablet_bootstrap.cc:492] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:53.963112 27653 ts_tablet_manager.cc:1403] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.155s	user 0.018s	sys 0.022s
I20260709 13:07:53.970427 27653 raft_consensus.cc:359] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:53.971220 27653 raft_consensus.cc:385] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.971553 27653 raft_consensus.cc:740] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.972409 27653 consensus_queue.cc:260] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:53.977391 27656 tablet_bootstrap.cc:654] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:53.989130 27654 tablet_bootstrap.cc:492] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:53.989868 27654 ts_tablet_manager.cc:1403] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.172s	user 0.013s	sys 0.006s
I20260709 13:07:53.992182 27564 heartbeater.cc:499] Master 127.13.206.254:33029 was elected leader, sending a full tablet report...
I20260709 13:07:53.993551 27653 ts_tablet_manager.cc:1434] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.011s
I20260709 13:07:53.993889 27654 raft_consensus.cc:359] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:53.994792 27653 tablet_bootstrap.cc:492] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:53.994796 27654 raft_consensus.cc:385] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:53.995461 27654 raft_consensus.cc:740] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:53.996843 27656 tablet_bootstrap.cc:492] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:53.996469 27654 consensus_queue.cc:260] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:53.997577 27656 ts_tablet_manager.cc:1403] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.006s
I20260709 13:07:54.001004 27656 raft_consensus.cc:359] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.002135 27653 tablet_bootstrap.cc:654] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.002652 27656 raft_consensus.cc:385] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.003063 27656 raft_consensus.cc:740] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.004230 27656 consensus_queue.cc:260] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.007215 27638 heartbeater.cc:499] Master 127.13.206.254:33029 was elected leader, sending a full tablet report...
I20260709 13:07:54.007778 27654 ts_tablet_manager.cc:1434] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.008s
I20260709 13:07:54.009068 27654 tablet_bootstrap.cc:492] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:54.009537 27653 tablet_bootstrap.cc:492] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:54.010283 27653 ts_tablet_manager.cc:1403] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 13:07:54.015125 27489 heartbeater.cc:499] Master 127.13.206.254:33029 was elected leader, sending a full tablet report...
I20260709 13:07:54.016383 27656 ts_tablet_manager.cc:1434] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:07:54.016549 27654 tablet_bootstrap.cc:654] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.017695 27656 tablet_bootstrap.cc:492] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:54.024824 27656 tablet_bootstrap.cc:654] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.013666 27653 raft_consensus.cc:359] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.025590 27653 raft_consensus.cc:385] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.025949 27653 raft_consensus.cc:740] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.026809 27654 tablet_bootstrap.cc:492] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:54.027421 27654 ts_tablet_manager.cc:1403] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:07:54.026827 27653 consensus_queue.cc:260] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.030344 27653 ts_tablet_manager.cc:1434] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.005s
I20260709 13:07:54.031450 27653 tablet_bootstrap.cc:492] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:54.032142 27654 raft_consensus.cc:359] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.033097 27654 raft_consensus.cc:385] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.033470 27654 raft_consensus.cc:740] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.034435 27654 consensus_queue.cc:260] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.036899 27654 ts_tablet_manager.cc:1434] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:54.038053 27654 tablet_bootstrap.cc:492] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:54.039384 27653 tablet_bootstrap.cc:654] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.045905 27654 tablet_bootstrap.cc:654] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.052902 27656 tablet_bootstrap.cc:492] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:54.053473 27656 ts_tablet_manager.cc:1403] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 13:07:54.056624 27656 raft_consensus.cc:359] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:54.057211 27653 tablet_bootstrap.cc:492] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:54.057441 27656 raft_consensus.cc:385] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.057803 27656 raft_consensus.cc:740] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.057847 27653 ts_tablet_manager.cc:1403] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.013s
I20260709 13:07:54.059188 27654 tablet_bootstrap.cc:492] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:54.058888 27656 consensus_queue.cc:260] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:54.059778 27654 ts_tablet_manager.cc:1403] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.002s
I20260709 13:07:54.061455 27656 ts_tablet_manager.cc:1434] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:54.061304 27653 raft_consensus.cc:359] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.062162 27653 raft_consensus.cc:385] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.062522 27653 raft_consensus.cc:740] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.062610 27656 tablet_bootstrap.cc:492] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:54.063011 27654 raft_consensus.cc:359] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.063819 27654 raft_consensus.cc:385] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.063483 27653 consensus_queue.cc:260] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.064172 27654 raft_consensus.cc:740] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.065042 27654 consensus_queue.cc:260] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.067708 27654 ts_tablet_manager.cc:1434] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:07:54.068789 27654 tablet_bootstrap.cc:492] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:54.069557 27656 tablet_bootstrap.cc:654] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.072908 27653 ts_tablet_manager.cc:1434] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:07:54.074262 27653 tablet_bootstrap.cc:492] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:54.075645 27654 tablet_bootstrap.cc:654] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.081059 27653 tablet_bootstrap.cc:654] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.081334 27656 tablet_bootstrap.cc:492] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:54.081544 27654 tablet_bootstrap.cc:492] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:54.081898 27656 ts_tablet_manager.cc:1403] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:07:54.082108 27654 ts_tablet_manager.cc:1403] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:07:54.085434 27654 raft_consensus.cc:359] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.086254 27654 raft_consensus.cc:385] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.086949 27654 raft_consensus.cc:740] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.086141 27656 raft_consensus.cc:359] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.087591 27656 raft_consensus.cc:385] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.087992 27656 raft_consensus.cc:740] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.087812 27654 consensus_queue.cc:260] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.089134 27656 consensus_queue.cc:260] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.092382 27656 ts_tablet_manager.cc:1434] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:54.093647 27656 tablet_bootstrap.cc:492] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:54.093724 27654 ts_tablet_manager.cc:1434] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:07:54.095219 27654 tablet_bootstrap.cc:492] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:54.100709 27656 tablet_bootstrap.cc:654] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.103049 27654 tablet_bootstrap.cc:654] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.105177 27653 tablet_bootstrap.cc:492] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:54.112183 27653 ts_tablet_manager.cc:1403] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.013s
I20260709 13:07:54.114848 27658 raft_consensus.cc:493] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.115702 27658 raft_consensus.cc:515] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:54.116430 27653 raft_consensus.cc:359] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.117692 27653 raft_consensus.cc:385] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.118208 27653 raft_consensus.cc:740] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.119509 27658 leader_election.cc:290] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047), 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339)
I20260709 13:07:54.119238 27653 consensus_queue.cc:260] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.123178 27656 tablet_bootstrap.cc:492] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:54.123821 27656 ts_tablet_manager.cc:1403] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.019s
I20260709 13:07:54.125528 27654 tablet_bootstrap.cc:492] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:54.125806 27653 ts_tablet_manager.cc:1434] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:07:54.126375 27654 ts_tablet_manager.cc:1403] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.007s
I20260709 13:07:54.127327 27653 tablet_bootstrap.cc:492] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:54.130793 27662 raft_consensus.cc:493] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.131453 27662 raft_consensus.cc:515] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.130419 27656 raft_consensus.cc:359] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.133071 27654 raft_consensus.cc:359] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:54.137908 27654 raft_consensus.cc:385] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.143079 27654 raft_consensus.cc:740] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.144173 27654 consensus_queue.cc:260] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:54.134889 27662 leader_election.cc:290] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.138965 27653 tablet_bootstrap.cc:654] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.134719 27656 raft_consensus.cc:385] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.149143 27656 raft_consensus.cc:740] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.150077 27656 consensus_queue.cc:260] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.150972 27654 ts_tablet_manager.cc:1434] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 13:07:54.152182 27654 tablet_bootstrap.cc:492] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:54.152796 27656 ts_tablet_manager.cc:1434] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:07:54.154008 27656 tablet_bootstrap.cc:492] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:54.161048 27656 tablet_bootstrap.cc:654] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.168386 27654 tablet_bootstrap.cc:654] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.168556 27653 tablet_bootstrap.cc:492] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:54.169636 27653 ts_tablet_manager.cc:1403] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.002s
I20260709 13:07:54.174381 27653 raft_consensus.cc:359] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.175916 27613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8972cf673b4bcf9590c1260354901a" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:54.177146 27613 raft_consensus.cc:2468] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 0.
I20260709 13:07:54.179121 27502 leader_election.cc:304] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:54.180413 27658 raft_consensus.cc:2804] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.180902 27658 raft_consensus.cc:493] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.181322 27658 raft_consensus.cc:3060] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.175652 27653 raft_consensus.cc:385] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.186858 27653 raft_consensus.cc:740] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.188176 27653 consensus_queue.cc:260] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.206979 27660 raft_consensus.cc:493] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.207858 27660 raft_consensus.cc:515] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.207890 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8972cf673b4bcf9590c1260354901a" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
W20260709 13:07:54.211186 27410 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:54.211337 27464 raft_consensus.cc:2468] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 0.
I20260709 13:07:54.212827 27662 raft_consensus.cc:493] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.213510 27662 raft_consensus.cc:515] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:54.193761 27658 raft_consensus.cc:515] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:54.219213 27681 raft_consensus.cc:493] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.219816 27681 raft_consensus.cc:515] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.224368 27660 leader_election.cc:290] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:54.226330 27662 leader_election.cc:290] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:54.240033 27653 ts_tablet_manager.cc:1434] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.013s
I20260709 13:07:54.245601 27613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8972cf673b4bcf9590c1260354901a" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:54.246348 27613 raft_consensus.cc:3060] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.247711 27681 leader_election.cc:290] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:54.252077 27653 tablet_bootstrap.cc:492] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:54.262440 27653 tablet_bootstrap.cc:654] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.276510 27653 tablet_bootstrap.cc:492] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:54.277290 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8972cf673b4bcf9590c1260354901a" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:54.278313 27464 raft_consensus.cc:3060] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.289558 27464 raft_consensus.cc:2468] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 1.
I20260709 13:07:54.290361 27658 leader_election.cc:290] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Requested vote from peers da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047), 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339)
I20260709 13:07:54.277256 27653 ts_tablet_manager.cc:1403] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:07:54.294584 27681 raft_consensus.cc:493] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.295186 27681 raft_consensus.cc:515] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.295706 27658 raft_consensus.cc:493] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.296257 27658 raft_consensus.cc:515] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.296840 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:54.297559 27681 leader_election.cc:290] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:54.298173 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8972cf673b4bcf9590c1260354901a" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:54.261839 27613 raft_consensus.cc:2468] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 1.
I20260709 13:07:54.299156 27538 raft_consensus.cc:2393] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6133756cc28a47d491b159f8bd124060 in current term 1: Already voted for candidate a85d0c8e244c4191bb2a39f74b217f37 in this term.
I20260709 13:07:54.301537 27658 leader_election.cc:290] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.301749 27656 tablet_bootstrap.cc:492] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:54.303089 27656 ts_tablet_manager.cc:1403] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.149s	user 0.061s	sys 0.071s
I20260709 13:07:54.306331 27613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:54.306849 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8972cf673b4bcf9590c1260354901a" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:54.307230 27613 raft_consensus.cc:2468] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:54.307757 27612 raft_consensus.cc:2393] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6133756cc28a47d491b159f8bd124060 in current term 1: Already voted for candidate a85d0c8e244c4191bb2a39f74b217f37 in this term.
I20260709 13:07:54.295213 27653 raft_consensus.cc:359] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.299979 27463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c503892b567043d5874be704fe436d70" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:54.299823 27502 leader_election.cc:304] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: 
I20260709 13:07:54.309646 27427 leader_election.cc:304] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:54.297628 27539 raft_consensus.cc:2468] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:54.310402 27662 raft_consensus.cc:493] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.308718 27653 raft_consensus.cc:385] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.310948 27662 raft_consensus.cc:515] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.310982 27653 raft_consensus.cc:740] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.313282 27662 leader_election.cc:290] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.313025 27653 consensus_queue.cc:260] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.314602 27680 raft_consensus.cc:2804] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.314457 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:54.315567 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:54.315798 27653 ts_tablet_manager.cc:1434] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:07:54.316869 27427 leader_election.cc:304] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6133756cc28a47d491b159f8bd124060; no voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:54.310529 27656 raft_consensus.cc:359] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.317536 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:54.317764 27653 tablet_bootstrap.cc:492] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:54.318379 27539 raft_consensus.cc:2468] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:54.319934 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:54.320297 27463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:54.321033 27463 raft_consensus.cc:2468] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:54.322326 27462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:54.315869 27538 raft_consensus.cc:2468] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:54.324687 27576 leader_election.cc:304] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:54.324807 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c503892b567043d5874be704fe436d70" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:54.325661 27681 raft_consensus.cc:2804] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.325719 27612 raft_consensus.cc:2468] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 0.
I20260709 13:07:54.326144 27681 raft_consensus.cc:493] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.326548 27681 raft_consensus.cc:3060] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.328151 27502 leader_election.cc:304] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:54.329964 27653 tablet_bootstrap.cc:654] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.325752 27662 raft_consensus.cc:2804] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.317956 27656 raft_consensus.cc:385] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:54.330641 27579 leader_election.cc:343] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.335067 27656 raft_consensus.cc:740] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.335484 27579 leader_election.cc:304] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:54.335275 27681 raft_consensus.cc:515] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.337081 27660 raft_consensus.cc:2804] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.337489 27660 raft_consensus.cc:493] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.334779 27662 raft_consensus.cc:493] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.338145 27662 raft_consensus.cc:3060] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.337865 27660 raft_consensus.cc:3060] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.338567 27463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:54.339309 27463 raft_consensus.cc:3060] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.341287 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:54.344122 27658 raft_consensus.cc:2804] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.344672 27658 raft_consensus.cc:493] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.345026 27658 raft_consensus.cc:3060] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.347855 27463 raft_consensus.cc:2468] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:54.337839 27656 consensus_queue.cc:260] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.349321 27576 leader_election.cc:304] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:54.351814 27462 raft_consensus.cc:2468] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:54.359539 27660 raft_consensus.cc:515] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.367623 27680 raft_consensus.cc:697] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:54.368848 27690 raft_consensus.cc:2804] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.363797 27662 raft_consensus.cc:515] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.333079 27654 tablet_bootstrap.cc:492] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:54.364692 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:54.370843 27654 ts_tablet_manager.cc:1403] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.219s	user 0.036s	sys 0.059s
I20260709 13:07:54.371626 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:54.372022 27462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:54.372541 27537 raft_consensus.cc:3060] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.370798 27538 raft_consensus.cc:3060] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.374751 27654 raft_consensus.cc:359] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.375640 27654 raft_consensus.cc:385] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.375959 27654 raft_consensus.cc:740] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.377272 27464 raft_consensus.cc:2393] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate da55bab8ad794364aa77430da1cf0bc8 in current term 1: Already voted for candidate 6133756cc28a47d491b159f8bd124060 in this term.
I20260709 13:07:54.379670 27686 raft_consensus.cc:493] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.380299 27686 raft_consensus.cc:515] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.382747 27576 leader_election.cc:304] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:54.383755 27662 leader_election.cc:290] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.385938 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2151f36a277a43a0a6282bffd280bfbb" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:54.383930 27660 leader_election.cc:290] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
W20260709 13:07:54.387681 27502 leader_election.cc:343] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.384652 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:54.387998 27660 raft_consensus.cc:2804] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.385452 27538 raft_consensus.cc:2468] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:54.388599 27660 raft_consensus.cc:493] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.389083 27660 raft_consensus.cc:3060] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.384680 27686 leader_election.cc:290] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.385982 27662 raft_consensus.cc:2749] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.383803 27537 raft_consensus.cc:2468] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:54.368873 27680 consensus_queue.cc:237] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:54.392627 27681 leader_election.cc:290] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:54.393397 27579 leader_election.cc:304] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 6133756cc28a47d491b159f8bd124060
I20260709 13:07:54.385067 27654 consensus_queue.cc:260] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.396152 27692 raft_consensus.cc:2804] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.396458 27653 tablet_bootstrap.cc:492] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:54.396696 27692 raft_consensus.cc:697] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:54.397250 27653 ts_tablet_manager.cc:1403] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.080s	user 0.006s	sys 0.025s
I20260709 13:07:54.398301 27654 ts_tablet_manager.cc:1434] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 13:07:54.398360 27690 raft_consensus.cc:697] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:54.399546 27654 tablet_bootstrap.cc:492] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
W20260709 13:07:54.400004 27427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:41047, user_credentials={real_user=slave}} blocked reactor thread for 83235.1us
I20260709 13:07:54.399688 27690 consensus_queue.cc:237] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
W20260709 13:07:54.401091 27502 leader_election.cc:343] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.402153 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:54.400816 27658 raft_consensus.cc:515] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.404871 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:54.406617 27656 ts_tablet_manager.cc:1434] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.103s	user 0.016s	sys 0.009s
I20260709 13:07:54.407841 27656 tablet_bootstrap.cc:492] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:54.412511 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c503892b567043d5874be704fe436d70" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:54.413293 27612 raft_consensus.cc:3060] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.413386 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2151f36a277a43a0a6282bffd280bfbb" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:54.413920 27362 catalog_manager.cc:5697] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.415395 27656 tablet_bootstrap.cc:654] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.415251 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c503892b567043d5874be704fe436d70" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
W20260709 13:07:54.416723 27502 leader_election.cc:343] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.417112 27658 leader_election.cc:290] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.417194 27502 leader_election.cc:304] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37; no voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:54.418128 27653 raft_consensus.cc:359] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
W20260709 13:07:54.419253 27502 leader_election.cc:343] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.421535 27653 raft_consensus.cc:385] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.422314 27653 raft_consensus.cc:740] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.424492 27658 raft_consensus.cc:2749] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.420300 27660 raft_consensus.cc:515] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.424127 27427 leader_election.cc:304] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6133756cc28a47d491b159f8bd124060; no voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:54.426534 27687 raft_consensus.cc:2749] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.424077 27653 consensus_queue.cc:260] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.428457 27427 leader_election.cc:304] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6133756cc28a47d491b159f8bd124060; no voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:54.429247 27654 tablet_bootstrap.cc:654] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.397746 27692 consensus_queue.cc:237] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.431295 27687 raft_consensus.cc:2749] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.432660 27660 leader_election.cc:290] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:54.432874 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:54.434777 27464 raft_consensus.cc:3060] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.433362 27653 ts_tablet_manager.cc:1434] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:07:54.436661 27612 raft_consensus.cc:2468] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 1.
I20260709 13:07:54.437196 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:54.438184 27502 leader_election.cc:304] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 6133756cc28a47d491b159f8bd124060
W20260709 13:07:54.439469 27579 leader_election.cc:343] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.440238 27653 tablet_bootstrap.cc:492] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:54.439527 27658 raft_consensus.cc:2804] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.443415 27658 raft_consensus.cc:697] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:54.444633 27658 consensus_queue.cc:237] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.450856 27680 raft_consensus.cc:493] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.451682 27680 raft_consensus.cc:515] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.456054 27680 leader_election.cc:290] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.456616 27464 raft_consensus.cc:2468] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:54.458271 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bd073603094e9e89099d89e23c71c7" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:54.458352 27576 leader_election.cc:304] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:54.459885 27690 raft_consensus.cc:2804] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.460414 27690 raft_consensus.cc:697] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:54.460038 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bd073603094e9e89099d89e23c71c7" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:54.461802 27612 raft_consensus.cc:2468] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 0.
I20260709 13:07:54.462917 27690 consensus_queue.cc:237] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
W20260709 13:07:54.460038 27502 leader_election.cc:343] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.463922 27656 tablet_bootstrap.cc:492] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:54.464525 27656 ts_tablet_manager.cc:1403] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.013s
I20260709 13:07:54.464358 27502 leader_election.cc:304] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 6133756cc28a47d491b159f8bd124060
I20260709 13:07:54.465662 27680 raft_consensus.cc:2804] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.465991 27680 raft_consensus.cc:493] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.468487 27656 raft_consensus.cc:359] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.467141 27680 raft_consensus.cc:3060] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.469412 27656 raft_consensus.cc:385] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.469815 27656 raft_consensus.cc:740] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.470690 27656 consensus_queue.cc:260] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.473553 27656 ts_tablet_manager.cc:1434] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:07:54.478909 27653 tablet_bootstrap.cc:654] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.482656 27656 tablet_bootstrap.cc:492] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:54.482896 27680 raft_consensus.cc:515] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.493314 27680 leader_election.cc:290] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.496333 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bd073603094e9e89099d89e23c71c7" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
W20260709 13:07:54.501060 27502 leader_election.cc:343] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.503885 27654 tablet_bootstrap.cc:492] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:54.504462 27654 ts_tablet_manager.cc:1403] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.105s	user 0.013s	sys 0.007s
I20260709 13:07:54.504987 27656 tablet_bootstrap.cc:654] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.505788 27653 tablet_bootstrap.cc:492] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:54.498971 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bd073603094e9e89099d89e23c71c7" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:54.506414 27653 ts_tablet_manager.cc:1403] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.000s
I20260709 13:07:54.506634 27612 raft_consensus.cc:3060] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.512241 27359 catalog_manager.cc:5697] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.515391 27654 raft_consensus.cc:359] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.519979 27612 raft_consensus.cc:2468] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 1.
I20260709 13:07:54.519711 27362 catalog_manager.cc:5697] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.521394 27502 leader_election.cc:304] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 6133756cc28a47d491b159f8bd124060
I20260709 13:07:54.522822 27680 raft_consensus.cc:2804] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.523409 27680 raft_consensus.cc:697] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:54.524286 27680 consensus_queue.cc:237] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.516278 27654 raft_consensus.cc:385] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.526716 27654 raft_consensus.cc:740] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.527518 27654 consensus_queue.cc:260] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.531368 27654 ts_tablet_manager.cc:1434] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.002s
I20260709 13:07:54.532982 27654 tablet_bootstrap.cc:492] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:54.532779 27690 raft_consensus.cc:493] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.533846 27690 raft_consensus.cc:515] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.538870 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0832f611c88444f84f9c0791be88152" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:54.539711 27653 raft_consensus.cc:359] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.540828 27653 raft_consensus.cc:385] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.541256 27653 raft_consensus.cc:740] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
W20260709 13:07:54.541311 27579 leader_election.cc:343] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.542804 27653 consensus_queue.cc:260] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.544046 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0832f611c88444f84f9c0791be88152" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:54.545078 27464 raft_consensus.cc:2468] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:54.545760 27653 ts_tablet_manager.cc:1434] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:07:54.546893 27690 leader_election.cc:290] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:54.552675 27654 tablet_bootstrap.cc:654] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.547219 27653 tablet_bootstrap.cc:492] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:54.547914 27576 leader_election.cc:304] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:54.556141 27690 raft_consensus.cc:2804] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.556821 27690 raft_consensus.cc:493] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.557385 27690 raft_consensus.cc:3060] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.567052 27359 catalog_manager.cc:5697] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.570096 27359 catalog_manager.cc:5697] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.576696 27654 tablet_bootstrap.cc:492] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:54.577457 27654 ts_tablet_manager.cc:1403] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.006s
I20260709 13:07:54.579185 27653 tablet_bootstrap.cc:654] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.579424 27690 raft_consensus.cc:515] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.581724 27654 raft_consensus.cc:359] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.582520 27654 raft_consensus.cc:385] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.583179 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0832f611c88444f84f9c0791be88152" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:54.583499 27656 tablet_bootstrap.cc:492] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:54.583899 27464 raft_consensus.cc:3060] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.584057 27656 ts_tablet_manager.cc:1403] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.109s	user 0.040s	sys 0.040s
I20260709 13:07:54.582798 27654 raft_consensus.cc:740] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.586550 27654 consensus_queue.cc:260] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.587409 27656 raft_consensus.cc:359] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.588269 27656 raft_consensus.cc:385] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.588558 27656 raft_consensus.cc:740] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.589447 27656 consensus_queue.cc:260] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.590342 27654 ts_tablet_manager.cc:1434] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:07:54.591436 27654 tablet_bootstrap.cc:492] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:54.592298 27656 ts_tablet_manager.cc:1434] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:54.593508 27656 tablet_bootstrap.cc:492] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:54.597548 27654 tablet_bootstrap.cc:654] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.600301 27656 tablet_bootstrap.cc:654] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.609238 27360 catalog_manager.cc:5697] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.613632 27464 raft_consensus.cc:2468] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:54.618800 27576 leader_election.cc:304] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:54.615667 27690 leader_election.cc:290] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:54.619855 27660 raft_consensus.cc:2804] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.620458 27660 raft_consensus.cc:697] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:54.621378 27660 consensus_queue.cc:237] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.616902 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0832f611c88444f84f9c0791be88152" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
W20260709 13:07:54.624243 27579 leader_election.cc:343] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:54.624285 27654 tablet_bootstrap.cc:492] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:54.625164 27654 ts_tablet_manager.cc:1403] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.002s
I20260709 13:07:54.627300 27653 tablet_bootstrap.cc:492] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:54.627847 27653 ts_tablet_manager.cc:1403] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.009s
I20260709 13:07:54.628156 27654 raft_consensus.cc:359] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.628939 27654 raft_consensus.cc:385] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.629233 27654 raft_consensus.cc:740] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.630031 27654 consensus_queue.cc:260] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.630764 27653 raft_consensus.cc:359] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.631489 27653 raft_consensus.cc:385] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.631774 27653 raft_consensus.cc:740] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.632386 27654 ts_tablet_manager.cc:1434] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:54.634555 27653 consensus_queue.cc:260] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.635975 27656 tablet_bootstrap.cc:492] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:54.636607 27656 ts_tablet_manager.cc:1403] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.007s
I20260709 13:07:54.636768 27653 ts_tablet_manager.cc:1434] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:07:54.639657 27656 raft_consensus.cc:359] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.640515 27656 raft_consensus.cc:385] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.640872 27656 raft_consensus.cc:740] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.641713 27656 consensus_queue.cc:260] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.643932 27656 ts_tablet_manager.cc:1434] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:54.644949 27656 tablet_bootstrap.cc:492] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:54.650844 27656 tablet_bootstrap.cc:654] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:54.651895 27361 catalog_manager.cc:5697] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.655910 27656 tablet_bootstrap.cc:492] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:54.656528 27656 ts_tablet_manager.cc:1403] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:07:54.659075 27656 raft_consensus.cc:359] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.659633 27656 raft_consensus.cc:385] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:54.659868 27656 raft_consensus.cc:740] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:54.660531 27656 consensus_queue.cc:260] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.662446 27656 ts_tablet_manager.cc:1434] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:07:54.669786 27680 raft_consensus.cc:493] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.670382 27680 raft_consensus.cc:515] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.670945 27687 raft_consensus.cc:493] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.671526 27687 raft_consensus.cc:515] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.672502 27680 leader_election.cc:290] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.673753 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:54.674814 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:54.675331 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2151f36a277a43a0a6282bffd280bfbb" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:54.675702 27464 raft_consensus.cc:2393] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a85d0c8e244c4191bb2a39f74b217f37 in current term 1: Already voted for candidate da55bab8ad794364aa77430da1cf0bc8 in this term.
I20260709 13:07:54.675930 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2151f36a277a43a0a6282bffd280bfbb" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:54.676046 27537 raft_consensus.cc:2468] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:54.676709 27612 raft_consensus.cc:2468] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:54.676854 27502 leader_election.cc:304] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37; no voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:54.673785 27687 leader_election.cc:290] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.677408 27430 leader_election.cc:304] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: 
I20260709 13:07:54.677809 27680 raft_consensus.cc:3060] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.682509 27687 raft_consensus.cc:2804] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.682857 27687 raft_consensus.cc:493] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.683209 27687 raft_consensus.cc:3060] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.683544 27680 raft_consensus.cc:2749] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:54.688756 27687 raft_consensus.cc:515] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.690783 27687 leader_election.cc:290] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.691601 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2151f36a277a43a0a6282bffd280bfbb" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:54.692015 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2151f36a277a43a0a6282bffd280bfbb" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:54.692411 27537 raft_consensus.cc:3060] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.692734 27612 raft_consensus.cc:3060] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.700111 27537 raft_consensus.cc:2468] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 1.
I20260709 13:07:54.700111 27612 raft_consensus.cc:2468] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 1.
I20260709 13:07:54.701592 27430 leader_election.cc:304] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: 
I20260709 13:07:54.702328 27687 raft_consensus.cc:2804] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.702848 27687 raft_consensus.cc:697] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:54.703594 27687 consensus_queue.cc:237] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.711222 27361 catalog_manager.cc:5697] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.732564 27660 raft_consensus.cc:493] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.733180 27660 raft_consensus.cc:515] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.735023 27660 leader_election.cc:290] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:54.735911 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda617f16b0b4900a2c1e421ff81aa84" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:54.736073 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda617f16b0b4900a2c1e421ff81aa84" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:54.736827 27537 raft_consensus.cc:2468] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:54.736827 27464 raft_consensus.cc:2468] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:54.738107 27576 leader_election.cc:304] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:54.738916 27660 raft_consensus.cc:2804] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:54.739250 27660 raft_consensus.cc:493] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.739517 27660 raft_consensus.cc:3060] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.744984 27660 raft_consensus.cc:515] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.746690 27660 leader_election.cc:290] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:54.747709 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda617f16b0b4900a2c1e421ff81aa84" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:54.747851 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda617f16b0b4900a2c1e421ff81aa84" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:54.748319 27464 raft_consensus.cc:3060] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.748469 27537 raft_consensus.cc:3060] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.753876 27464 raft_consensus.cc:2468] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:54.753901 27537 raft_consensus.cc:2468] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:54.755227 27576 leader_election.cc:304] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:54.756019 27660 raft_consensus.cc:2804] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:54.756522 27660 raft_consensus.cc:697] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:54.757287 27660 consensus_queue.cc:237] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.764926 27361 catalog_manager.cc:5697] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.812716 27660 consensus_queue.cc:1048] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.826638 27690 consensus_queue.cc:1048] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.853773 27464 raft_consensus.cc:3060] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.862458 27680 consensus_queue.cc:1048] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.876538 27658 consensus_queue.cc:1048] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.878115 27537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a8972cf673b4bcf9590c1260354901a"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
mode: GRACEFUL
new_leader_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56604
I20260709 13:07:54.879081 27537 raft_consensus.cc:606] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Received request to transfer leadership to TS 6133756cc28a47d491b159f8bd124060
I20260709 13:07:54.886281 27537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c503892b567043d5874be704fe436d70"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
mode: GRACEFUL
new_leader_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56604
I20260709 13:07:54.886855 27537 raft_consensus.cc:606] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Received request to transfer leadership to TS 6133756cc28a47d491b159f8bd124060
W20260709 13:07:54.891258 27490 tablet.cc:2406] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:54.892401 27537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15bd073603094e9e89099d89e23c71c7"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
mode: GRACEFUL
new_leader_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56604
I20260709 13:07:54.893123 27537 raft_consensus.cc:606] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Received request to transfer leadership to TS 6133756cc28a47d491b159f8bd124060
I20260709 13:07:54.903362 27690 consensus_queue.cc:1048] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.909013 27612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
mode: GRACEFUL
new_leader_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:58282
I20260709 13:07:54.909584 27612 raft_consensus.cc:606] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Received request to transfer leadership to TS 6133756cc28a47d491b159f8bd124060
I20260709 13:07:54.919421 27660 raft_consensus.cc:993] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8: : Instructing follower 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:54.919910 27660 raft_consensus.cc:1081] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Signalling peer 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:54.924060 27462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56578
I20260709 13:07:54.924762 27462 raft_consensus.cc:493] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.925172 27462 raft_consensus.cc:3060] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.930171 27660 consensus_queue.cc:1048] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.931602 27464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2151f36a277a43a0a6282bffd280bfbb"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
mode: GRACEFUL
new_leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:56590
I20260709 13:07:54.932403 27464 raft_consensus.cc:606] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Received request to transfer leadership to TS a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:54.933387 27462 raft_consensus.cc:515] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.936619 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:54.938645 27462 leader_election.cc:290] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.939782 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:54.940444 27612 raft_consensus.cc:3055] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:54.940769 27612 raft_consensus.cc:740] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:54.939669 27613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
mode: GRACEFUL
new_leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:58282
I20260709 13:07:54.941519 27613 raft_consensus.cc:606] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Received request to transfer leadership to TS a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:54.941726 27612 consensus_queue.cc:260] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.943025 27612 raft_consensus.cc:3060] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.949900 27611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cda617f16b0b4900a2c1e421ff81aa84"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
mode: GRACEFUL
new_leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:58282
I20260709 13:07:54.950438 27612 raft_consensus.cc:2468] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:54.950707 27611 raft_consensus.cc:606] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Received request to transfer leadership to TS a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:54.951753 27427 leader_election.cc:304] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:54.952165 27658 consensus_queue.cc:1048] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.952661 27687 raft_consensus.cc:2804] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:54.953205 27687 raft_consensus.cc:697] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:54.953625 27660 consensus_queue.cc:1048] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:54.954036 27687 consensus_queue.cc:237] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.959407 27612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
mode: GRACEFUL
new_leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:58282
I20260709 13:07:54.960110 27612 raft_consensus.cc:606] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Received request to transfer leadership to TS a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:54.969496 27729 raft_consensus.cc:493] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.970495 27729 raft_consensus.cc:515] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:54.971410 27686 consensus_queue.cc:1048] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:54.972473 27729 leader_election.cc:290] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:54.974092 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bd073603094e9e89099d89e23c71c7" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:54.974604 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bd073603094e9e89099d89e23c71c7" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:54.975502 27612 raft_consensus.cc:2393] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6133756cc28a47d491b159f8bd124060 in current term 1: Already voted for candidate a85d0c8e244c4191bb2a39f74b217f37 in this term.
I20260709 13:07:54.976728 27427 leader_election.cc:304] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6133756cc28a47d491b159f8bd124060; no voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:54.975788 27360 catalog_manager.cc:5697] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 1 to 2, leader changed from da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195) to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.979701 27729 raft_consensus.cc:3060] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:54.991034 27690 consensus_queue.cc:1048] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.002002 27692 raft_consensus.cc:993] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8: : Instructing follower a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:55.002565 27692 raft_consensus.cc:1081] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Signalling peer a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:55.004041 27729 raft_consensus.cc:2749] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.004534 27537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:56602
I20260709 13:07:55.005227 27537 raft_consensus.cc:493] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:55.005646 27537 raft_consensus.cc:3060] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.012109 27686 raft_consensus.cc:993] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37: : Instructing follower 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:55.012717 27686 raft_consensus.cc:1081] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Signalling peer 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:55.012521 27658 consensus_queue.cc:1048] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.014022 27537 raft_consensus.cc:515] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.016337 27537 leader_election.cc:290] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:55.017441 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:55.017937 27463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:55.018184 27612 raft_consensus.cc:3055] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:55.018596 27612 raft_consensus.cc:740] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:55.018596 27463 raft_consensus.cc:3060] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.019593 27612 consensus_queue.cc:260] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.020548 27462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a8972cf673b4bcf9590c1260354901a"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56572
I20260709 13:07:55.020972 27612 raft_consensus.cc:3060] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.021186 27462 raft_consensus.cc:493] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:55.021734 27462 raft_consensus.cc:3060] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.026911 27463 raft_consensus.cc:2468] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:55.030448 27680 consensus_queue.cc:1048] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.034616 27462 raft_consensus.cc:515] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:55.037336 27612 raft_consensus.cc:2468] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:55.038791 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8972cf673b4bcf9590c1260354901a" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:55.039494 27612 raft_consensus.cc:3060] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.039726 27502 leader_election.cc:304] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:55.041329 27680 raft_consensus.cc:2804] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:55.041167 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a8972cf673b4bcf9590c1260354901a" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:55.042035 27680 raft_consensus.cc:697] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:55.042193 27537 raft_consensus.cc:3055] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:55.042809 27537 raft_consensus.cc:740] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:55.042992 27680 consensus_queue.cc:237] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.044013 27537 consensus_queue.cc:260] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:55.045899 27537 raft_consensus.cc:3060] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.052134 27462 leader_election.cc:290] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Requested vote from peers da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:55.049430 27612 raft_consensus.cc:2468] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:55.056345 27427 leader_election.cc:304] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:55.056562 27359 catalog_manager.cc:5697] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 1 to 2, leader changed from da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195) to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.057583 27729 raft_consensus.cc:2804] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:55.058142 27729 raft_consensus.cc:697] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:55.059031 27729 consensus_queue.cc:237] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } }
I20260709 13:07:55.063488 27537 raft_consensus.cc:2468] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:55.075644 27686 raft_consensus.cc:993] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37: : Instructing follower 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:55.076500 27686 raft_consensus.cc:1081] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Signalling peer 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:55.078295 27462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15bd073603094e9e89099d89e23c71c7"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56572
I20260709 13:07:55.078931 27462 raft_consensus.cc:493] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:55.079319 27462 raft_consensus.cc:3060] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.087225 27360 catalog_manager.cc:5697] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 1 to 2, leader changed from a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194) to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.088457 27462 raft_consensus.cc:515] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.089495 27464 raft_consensus.cc:1240] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Rejecting Update request from peer a85d0c8e244c4191bb2a39f74b217f37 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:55.091506 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bd073603094e9e89099d89e23c71c7" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:55.092505 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15bd073603094e9e89099d89e23c71c7" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:55.093168 27537 raft_consensus.cc:3055] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:55.093169 27611 raft_consensus.cc:3060] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.093741 27537 raft_consensus.cc:740] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:55.091817 27462 leader_election.cc:290] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:55.094941 27680 consensus_queue.cc:1059] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.096885 27537 consensus_queue.cc:260] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.098277 27537 raft_consensus.cc:3060] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.098539 27680 raft_consensus.cc:493] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.099102 27680 raft_consensus.cc:515] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.101388 27680 leader_election.cc:290] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:55.102002 27611 raft_consensus.cc:2468] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:55.102458 27462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0832f611c88444f84f9c0791be88152" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:55.103224 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0832f611c88444f84f9c0791be88152" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:55.103358 27462 raft_consensus.cc:2393] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a85d0c8e244c4191bb2a39f74b217f37 in current term 1: Already voted for candidate da55bab8ad794364aa77430da1cf0bc8 in this term.
I20260709 13:07:55.103353 27427 leader_election.cc:304] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:55.104940 27729 raft_consensus.cc:2804] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:55.105441 27729 raft_consensus.cc:697] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:55.106166 27537 raft_consensus.cc:2468] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:55.106314 27729 consensus_queue.cc:237] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.106793 27502 leader_election.cc:304] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37; no voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8
W20260709 13:07:55.106917 27658 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:07:55.107847 27680 raft_consensus.cc:3060] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.115240 27680 raft_consensus.cc:2749] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:55.115922 27360 catalog_manager.cc:5697] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 1 to 2, leader changed from a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194) to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.117898 27690 consensus_queue.cc:1048] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.130954 27690 consensus_queue.cc:1048] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.190084 27692 consensus_queue.cc:1048] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.194334 27729 consensus_queue.cc:1048] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.198173 27692 raft_consensus.cc:993] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8: : Instructing follower a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:55.198705 27692 raft_consensus.cc:1081] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Signalling peer a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:55.201149 27538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cda617f16b0b4900a2c1e421ff81aa84"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:56602
I20260709 13:07:55.201793 27538 raft_consensus.cc:493] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:55.202188 27538 raft_consensus.cc:3060] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.207444 27692 consensus_queue.cc:1048] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:55.211239 27662 consensus_queue.cc:1048] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.215456 27538 raft_consensus.cc:515] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.217470 27537 raft_consensus.cc:1240] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Rejecting Update request from peer da55bab8ad794364aa77430da1cf0bc8 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:55.218842 27538 leader_election.cc:290] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:55.220250 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda617f16b0b4900a2c1e421ff81aa84" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:55.221876 27692 consensus_queue.cc:1059] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:55.222816 27692 raft_consensus.cc:3055] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:55.223299 27692 raft_consensus.cc:740] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:55.224438 27692 consensus_queue.cc:260] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.226046 27692 raft_consensus.cc:3060] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.234189 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cda617f16b0b4900a2c1e421ff81aa84" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:55.237212 27662 raft_consensus.cc:993] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060: : Instructing follower a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:55.237808 27662 raft_consensus.cc:1081] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Signalling peer a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:55.239955 27539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2151f36a277a43a0a6282bffd280bfbb"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:56600
I20260709 13:07:55.240620 27539 raft_consensus.cc:493] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:55.241031 27539 raft_consensus.cc:3060] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.244825 27611 raft_consensus.cc:2468] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:55.246963 27502 leader_election.cc:304] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 6133756cc28a47d491b159f8bd124060
I20260709 13:07:55.248396 27680 raft_consensus.cc:2804] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:55.248934 27680 raft_consensus.cc:697] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:55.249837 27680 consensus_queue.cc:237] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.252211 27539 raft_consensus.cc:515] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.254782 27539 leader_election.cc:290] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:55.255795 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2151f36a277a43a0a6282bffd280bfbb" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:55.255760 27462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2151f36a277a43a0a6282bffd280bfbb" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:55.256690 27611 raft_consensus.cc:3060] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.256757 27462 raft_consensus.cc:3055] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:55.257247 27462 raft_consensus.cc:740] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:55.258072 27462 consensus_queue.cc:260] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.259424 27462 raft_consensus.cc:3060] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.262907 27360 catalog_manager.cc:5697] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 1 to 2, leader changed from da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195) to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.264752 27611 raft_consensus.cc:2468] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:55.266124 27502 leader_election.cc:304] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:55.267068 27680 raft_consensus.cc:2804] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:55.267299 27462 raft_consensus.cc:2468] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:55.267642 27680 raft_consensus.cc:697] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:55.268563 27680 consensus_queue.cc:237] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.277621 27360 catalog_manager.cc:5697] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 1 to 2, leader changed from 6133756cc28a47d491b159f8bd124060 (127.13.206.193) to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.373356 27658 raft_consensus.cc:993] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37: : Instructing follower 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:55.373833 27680 raft_consensus.cc:1081] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Signalling peer 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:55.375545 27462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c503892b567043d5874be704fe436d70"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56572
I20260709 13:07:55.376075 27462 raft_consensus.cc:493] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:55.376401 27462 raft_consensus.cc:3060] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.381814 27462 raft_consensus.cc:515] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.383809 27462 leader_election.cc:290] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:55.384842 27539 raft_consensus.cc:3060] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.384915 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c503892b567043d5874be704fe436d70" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:55.385054 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c503892b567043d5874be704fe436d70" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:55.386001 27611 raft_consensus.cc:3060] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.386122 27538 raft_consensus.cc:3055] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:55.386629 27538 raft_consensus.cc:740] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:55.387507 27538 consensus_queue.cc:260] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.388872 27538 raft_consensus.cc:3060] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.391549 27611 raft_consensus.cc:2468] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:55.392827 27427 leader_election.cc:304] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:55.393231 27539 raft_consensus.cc:1275] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.393555 27729 raft_consensus.cc:2804] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:55.394129 27729 raft_consensus.cc:697] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:55.394779 27687 consensus_queue.cc:1048] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.395052 27729 consensus_queue.cc:237] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.397876 27538 raft_consensus.cc:2468] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:55.408758 27611 raft_consensus.cc:1275] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.410573 27687 consensus_queue.cc:1048] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.410081 27361 catalog_manager.cc:5697] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 1 to 2, leader changed from a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194) to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.434417 27660 raft_consensus.cc:993] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8: : Instructing follower a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:55.434885 27692 raft_consensus.cc:1081] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Signalling peer a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:55.436400 27539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:56602
I20260709 13:07:55.436929 27539 raft_consensus.cc:493] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:55.437263 27539 raft_consensus.cc:3060] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.442703 27539 raft_consensus.cc:515] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.444470 27539 leader_election.cc:290] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:55.445497 27462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:55.445834 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8885eb6b7a02460fa90480e1c3a00907" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:55.446260 27462 raft_consensus.cc:3060] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.446467 27611 raft_consensus.cc:3055] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:55.446841 27611 raft_consensus.cc:740] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:55.447679 27611 consensus_queue.cc:260] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.448975 27611 raft_consensus.cc:3060] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.453976 27462 raft_consensus.cc:2468] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:55.455415 27502 leader_election.cc:304] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: 
I20260709 13:07:55.456266 27680 raft_consensus.cc:2804] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:55.456465 27611 raft_consensus.cc:2468] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:55.456701 27680 raft_consensus.cc:697] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:55.457674 27680 consensus_queue.cc:237] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:55.464141 27361 catalog_manager.cc:5697] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 1 to 2, leader changed from da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195) to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.511184 27539 raft_consensus.cc:1275] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.512683 27729 consensus_queue.cc:1048] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.521162 27611 raft_consensus.cc:1275] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.522817 27662 consensus_queue.cc:1048] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.564807 27462 raft_consensus.cc:1275] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.566306 27680 consensus_queue.cc:1048] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.574945 27611 raft_consensus.cc:1275] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.579355 27741 consensus_queue.cc:1048] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.583659 27538 raft_consensus.cc:1275] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.584335 27612 raft_consensus.cc:1275] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.585711 27687 consensus_queue.cc:1048] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:55.587366 27662 consensus_queue.cc:1048] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.806623 27612 raft_consensus.cc:1275] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.808048 27686 consensus_queue.cc:1048] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.817629 27464 raft_consensus.cc:3060] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.826316 27464 raft_consensus.cc:1275] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.827785 27741 consensus_queue.cc:1048] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.836419 27464 raft_consensus.cc:1275] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.837875 27741 consensus_queue.cc:1048] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.846019 27612 raft_consensus.cc:1275] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.847652 27686 consensus_queue.cc:1048] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.914709 27538 raft_consensus.cc:1275] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.916155 27687 consensus_queue.cc:1048] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.925664 27612 raft_consensus.cc:1275] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.929932 27662 consensus_queue.cc:1048] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.984532 27612 raft_consensus.cc:1275] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.985782 27686 consensus_queue.cc:1048] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.995599 27464 raft_consensus.cc:1275] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.997581 27741 consensus_queue.cc:1048] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:57.994773 27360 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33702:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:57.997365 27360 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:58.050388 27452 tablet_service.cc:1511] Processing CreateTablet for tablet e5ded325c85849a09dfad3c05f3bfe24 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:58.051782 27452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5ded325c85849a09dfad3c05f3bfe24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.051581 27525 tablet_service.cc:1511] Processing CreateTablet for tablet e5ded325c85849a09dfad3c05f3bfe24 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:58.052934 27525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5ded325c85849a09dfad3c05f3bfe24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.052973 27598 tablet_service.cc:1511] Processing CreateTablet for tablet e5ded325c85849a09dfad3c05f3bfe24 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:58.054402 27598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5ded325c85849a09dfad3c05f3bfe24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.057592 27526 tablet_service.cc:1511] Processing CreateTablet for tablet 1924e7444c624464bdb57bab0f2dde3f (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:58.059095 27526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1924e7444c624464bdb57bab0f2dde3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.062147 27448 tablet_service.cc:1511] Processing CreateTablet for tablet 1924e7444c624464bdb57bab0f2dde3f (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:58.063658 27448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1924e7444c624464bdb57bab0f2dde3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.081041 27757 tablet_bootstrap.cc:492] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:58.083187 27758 tablet_bootstrap.cc:492] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:58.091775 27598 tablet_service.cc:1511] Processing CreateTablet for tablet 1924e7444c624464bdb57bab0f2dde3f (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:58.093619 27598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1924e7444c624464bdb57bab0f2dde3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.096130 27453 tablet_service.cc:1511] Processing CreateTablet for tablet 9b96543c470a41e5b707cf0d5e6b7a15 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:58.097548 27453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b96543c470a41e5b707cf0d5e6b7a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.099710 27596 tablet_service.cc:1511] Processing CreateTablet for tablet 9b96543c470a41e5b707cf0d5e6b7a15 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:58.101192 27596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b96543c470a41e5b707cf0d5e6b7a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.104600 27451 tablet_service.cc:1511] Processing CreateTablet for tablet 15091c264fdc44fe80269b67ca37f4d0 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:58.105568 27599 tablet_service.cc:1511] Processing CreateTablet for tablet 15091c264fdc44fe80269b67ca37f4d0 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:58.107002 27599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15091c264fdc44fe80269b67ca37f4d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.107308 27758 tablet_bootstrap.cc:654] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.106055 27451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15091c264fdc44fe80269b67ca37f4d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.110414 27450 tablet_service.cc:1511] Processing CreateTablet for tablet 8714f50868d24d89ad89615c1fe470b2 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:58.111759 27450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8714f50868d24d89ad89615c1fe470b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.115437 27525 tablet_service.cc:1511] Processing CreateTablet for tablet 9b96543c470a41e5b707cf0d5e6b7a15 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:58.116922 27525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b96543c470a41e5b707cf0d5e6b7a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.119307 27527 tablet_service.cc:1511] Processing CreateTablet for tablet 15091c264fdc44fe80269b67ca37f4d0 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:58.126581 27527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15091c264fdc44fe80269b67ca37f4d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.129527 27528 tablet_service.cc:1511] Processing CreateTablet for tablet 8714f50868d24d89ad89615c1fe470b2 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:58.131011 27528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8714f50868d24d89ad89615c1fe470b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.131445 27759 tablet_bootstrap.cc:492] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:58.139173 27601 tablet_service.cc:1511] Processing CreateTablet for tablet 8714f50868d24d89ad89615c1fe470b2 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:58.140089 27759 tablet_bootstrap.cc:654] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.140652 27601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8714f50868d24d89ad89615c1fe470b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.154724 27526 tablet_service.cc:1511] Processing CreateTablet for tablet 678daad614014e7ab9313d6bf77345b8 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:58.156857 27526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678daad614014e7ab9313d6bf77345b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.106109 27757 tablet_bootstrap.cc:654] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.163362 27448 tablet_service.cc:1511] Processing CreateTablet for tablet 678daad614014e7ab9313d6bf77345b8 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:58.175146 27448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678daad614014e7ab9313d6bf77345b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.176067 27758 tablet_bootstrap.cc:492] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:58.176818 27758 ts_tablet_manager.cc:1403] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.094s	user 0.007s	sys 0.006s
I20260709 13:07:58.178361 27603 tablet_service.cc:1511] Processing CreateTablet for tablet 678daad614014e7ab9313d6bf77345b8 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:58.180059 27603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 678daad614014e7ab9313d6bf77345b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.181084 27451 tablet_service.cc:1511] Processing CreateTablet for tablet e7869f9006bd4c70861abc7805f5892d (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:58.182500 27451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7869f9006bd4c70861abc7805f5892d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.196554 27599 tablet_service.cc:1511] Processing CreateTablet for tablet e7869f9006bd4c70861abc7805f5892d (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:58.201756 27599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7869f9006bd4c70861abc7805f5892d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.205933 27452 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3f5420ef3044d7bd996ffc7e270f66 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:58.207505 27452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3f5420ef3044d7bd996ffc7e270f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.213685 27759 tablet_bootstrap.cc:492] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:58.214347 27759 ts_tablet_manager.cc:1403] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.104s	user 0.028s	sys 0.030s
I20260709 13:07:58.214066 27529 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3f5420ef3044d7bd996ffc7e270f66 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:58.215554 27529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3f5420ef3044d7bd996ffc7e270f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.197129 27758 raft_consensus.cc:359] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.216604 27758 raft_consensus.cc:385] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.216946 27758 raft_consensus.cc:740] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.218037 27758 consensus_queue.cc:260] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.221088 27757 tablet_bootstrap.cc:492] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:58.227792 27757 ts_tablet_manager.cc:1403] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.147s	user 0.009s	sys 0.009s
I20260709 13:07:58.226291 27596 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3f5420ef3044d7bd996ffc7e270f66 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:58.228902 27596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3f5420ef3044d7bd996ffc7e270f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.231068 27757 raft_consensus.cc:359] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.232031 27757 raft_consensus.cc:385] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.233572 27757 raft_consensus.cc:740] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.234328 27451 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0edf3f3eec46a9aa7741a0306309b9 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:58.234575 27757 consensus_queue.cc:260] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.235746 27451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0edf3f3eec46a9aa7741a0306309b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.237114 27757 ts_tablet_manager.cc:1434] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:58.226218 27759 raft_consensus.cc:359] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.239490 27759 raft_consensus.cc:385] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.239804 27759 raft_consensus.cc:740] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.242780 27759 consensus_queue.cc:260] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.244606 27758 ts_tablet_manager.cc:1434] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:07:58.247162 27757 tablet_bootstrap.cc:492] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:58.251506 27525 tablet_service.cc:1511] Processing CreateTablet for tablet e7869f9006bd4c70861abc7805f5892d (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:58.253481 27525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7869f9006bd4c70861abc7805f5892d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.255789 27527 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0edf3f3eec46a9aa7741a0306309b9 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:58.256781 27759 ts_tablet_manager.cc:1434] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.001s
I20260709 13:07:58.257505 27527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0edf3f3eec46a9aa7741a0306309b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.263168 27602 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0edf3f3eec46a9aa7741a0306309b9 (DEFAULT_TABLE table=soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:58.264565 27602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0edf3f3eec46a9aa7741a0306309b9. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:58.277880 27410 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:58.283099 27759 tablet_bootstrap.cc:492] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:58.290719 27759 tablet_bootstrap.cc:654] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.293443 27757 tablet_bootstrap.cc:654] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.246057 27758 tablet_bootstrap.cc:492] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:58.304591 27759 tablet_bootstrap.cc:492] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:58.305166 27759 ts_tablet_manager.cc:1403] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:07:58.309777 27759 raft_consensus.cc:359] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.310567 27759 raft_consensus.cc:385] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.311498 27759 raft_consensus.cc:740] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.312538 27759 consensus_queue.cc:260] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.315239 27759 ts_tablet_manager.cc:1434] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:58.317265 27759 tablet_bootstrap.cc:492] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:58.317374 27757 tablet_bootstrap.cc:492] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:58.330606 27757 ts_tablet_manager.cc:1403] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.008s
I20260709 13:07:58.337472 27759 tablet_bootstrap.cc:654] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.340250 27757 raft_consensus.cc:359] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.341089 27757 raft_consensus.cc:385] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.341380 27757 raft_consensus.cc:740] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.323792 27758 tablet_bootstrap.cc:654] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.342002 27757 consensus_queue.cc:260] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.344511 27757 ts_tablet_manager.cc:1434] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:58.350476 27759 tablet_bootstrap.cc:492] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:58.351009 27757 tablet_bootstrap.cc:492] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:58.351200 27759 ts_tablet_manager.cc:1403] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.008s
I20260709 13:07:58.354715 27759 raft_consensus.cc:359] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.355448 27759 raft_consensus.cc:385] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.355774 27759 raft_consensus.cc:740] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.356731 27759 consensus_queue.cc:260] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.360366 27658 raft_consensus.cc:493] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.360983 27658 raft_consensus.cc:515] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.361397 27758 tablet_bootstrap.cc:492] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:58.362036 27758 ts_tablet_manager.cc:1403] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.008s
I20260709 13:07:58.365046 27758 raft_consensus.cc:359] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.365550 27757 tablet_bootstrap.cc:654] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.365780 27758 raft_consensus.cc:385] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.366173 27758 raft_consensus.cc:740] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.366990 27758 consensus_queue.cc:260] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.367940 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ded325c85849a09dfad3c05f3bfe24" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:58.368677 27464 raft_consensus.cc:2468] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 0.
I20260709 13:07:58.369550 27758 ts_tablet_manager.cc:1434] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:07:58.369249 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ded325c85849a09dfad3c05f3bfe24" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:58.370350 27612 raft_consensus.cc:2468] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 0.
I20260709 13:07:58.370715 27758 tablet_bootstrap.cc:492] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:58.375013 27502 leader_election.cc:304] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: 
I20260709 13:07:58.377533 27758 tablet_bootstrap.cc:654] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.379544 27746 raft_consensus.cc:2804] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.379997 27746 raft_consensus.cc:493] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.380594 27746 raft_consensus.cc:3060] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.366778 27658 leader_election.cc:290] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.414647 27746 raft_consensus.cc:515] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.417169 27759 ts_tablet_manager.cc:1434] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.004s
I20260709 13:07:58.418468 27759 tablet_bootstrap.cc:492] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:58.419286 27757 tablet_bootstrap.cc:492] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:58.419895 27757 ts_tablet_manager.cc:1403] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.029s
I20260709 13:07:58.418385 27758 tablet_bootstrap.cc:492] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:58.422664 27758 ts_tablet_manager.cc:1403] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.052s	user 0.026s	sys 0.016s
I20260709 13:07:58.423249 27757 raft_consensus.cc:359] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.424111 27757 raft_consensus.cc:385] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.424427 27757 raft_consensus.cc:740] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.425212 27757 consensus_queue.cc:260] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.425653 27746 leader_election.cc:290] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.425896 27758 raft_consensus.cc:359] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.426687 27758 raft_consensus.cc:385] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.426978 27758 raft_consensus.cc:740] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.427161 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ded325c85849a09dfad3c05f3bfe24" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:58.427824 27612 raft_consensus.cc:3060] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.427773 27758 consensus_queue.cc:260] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.430300 27758 ts_tablet_manager.cc:1434] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:07:58.431380 27758 tablet_bootstrap.cc:492] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:58.433135 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ded325c85849a09dfad3c05f3bfe24" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:58.433823 27464 raft_consensus.cc:3060] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.436483 27746 raft_consensus.cc:493] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.440737 27746 raft_consensus.cc:515] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.442198 27464 raft_consensus.cc:2468] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 1.
I20260709 13:07:58.443081 27746 leader_election.cc:290] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.438340 27758 tablet_bootstrap.cc:654] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.444698 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
W20260709 13:07:58.446341 27502 leader_election.cc:343] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.447113 27502 leader_election.cc:304] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: 
I20260709 13:07:58.447219 27612 raft_consensus.cc:2468] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 1.
I20260709 13:07:58.448796 27746 raft_consensus.cc:2804] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.449509 27746 raft_consensus.cc:697] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:58.450304 27759 tablet_bootstrap.cc:654] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.450443 27746 consensus_queue.cc:237] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.453496 27757 ts_tablet_manager.cc:1434] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.002s
I20260709 13:07:58.454807 27757 tablet_bootstrap.cc:492] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:58.456455 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:58.457522 27464 raft_consensus.cc:2468] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 0.
I20260709 13:07:58.458894 27502 leader_election.cc:304] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:58.459849 27658 raft_consensus.cc:2804] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.460266 27658 raft_consensus.cc:493] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.460644 27658 raft_consensus.cc:3060] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.463112 27757 tablet_bootstrap.cc:654] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.470217 27658 raft_consensus.cc:515] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.471222 27759 tablet_bootstrap.cc:492] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:58.470882 27758 tablet_bootstrap.cc:492] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:58.471822 27759 ts_tablet_manager.cc:1403] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.003s
I20260709 13:07:58.471891 27758 ts_tablet_manager.cc:1403] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.024s
I20260709 13:07:58.476028 27759 raft_consensus.cc:359] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.478811 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:58.478600 27758 raft_consensus.cc:359] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.479714 27658 leader_election.cc:290] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.480769 27758 raft_consensus.cc:385] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.480768 27359 catalog_manager.cc:5697] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.480937 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:58.483074 27464 raft_consensus.cc:3060] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:58.484913 27502 leader_election.cc:343] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.488361 27758 raft_consensus.cc:740] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.507570 27769 raft_consensus.cc:493] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.508548 27769 raft_consensus.cc:515] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.515568 27758 consensus_queue.cc:260] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.518551 27758 ts_tablet_manager.cc:1434] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.046s	user 0.013s	sys 0.022s
I20260709 13:07:58.518997 27769 leader_election.cc:290] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.519258 27759 raft_consensus.cc:385] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.521858 27759 raft_consensus.cc:740] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.522789 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15091c264fdc44fe80269b67ca37f4d0" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:58.523826 27759 consensus_queue.cc:260] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
W20260709 13:07:58.524521 27430 leader_election.cc:343] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.525563 27464 raft_consensus.cc:2468] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 1.
I20260709 13:07:58.526386 27759 ts_tablet_manager.cc:1434] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.004s
I20260709 13:07:58.527074 27502 leader_election.cc:304] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:58.527493 27759 tablet_bootstrap.cc:492] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:58.531765 27746 raft_consensus.cc:2804] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.532289 27746 raft_consensus.cc:697] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:58.532406 27758 tablet_bootstrap.cc:492] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:58.533223 27746 consensus_queue.cc:237] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.525584 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15091c264fdc44fe80269b67ca37f4d0" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:58.538338 27612 raft_consensus.cc:2468] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:58.539759 27757 tablet_bootstrap.cc:492] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:58.539899 27427 leader_election.cc:304] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:58.540488 27757 ts_tablet_manager.cc:1403] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.086s	user 0.046s	sys 0.016s
I20260709 13:07:58.541303 27662 raft_consensus.cc:2804] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.541786 27662 raft_consensus.cc:493] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.542120 27662 raft_consensus.cc:3060] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.543514 27658 raft_consensus.cc:493] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.544165 27757 raft_consensus.cc:359] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.545023 27757 raft_consensus.cc:385] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.545367 27757 raft_consensus.cc:740] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.544178 27658 raft_consensus.cc:515] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.546576 27757 consensus_queue.cc:260] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.565109 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b96543c470a41e5b707cf0d5e6b7a15" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:58.565565 27658 leader_election.cc:290] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
W20260709 13:07:58.567574 27502 leader_election.cc:343] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.567963 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b96543c470a41e5b707cf0d5e6b7a15" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:58.568719 27611 raft_consensus.cc:2468] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 0.
I20260709 13:07:58.569276 27662 raft_consensus.cc:515] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.570451 27758 tablet_bootstrap.cc:654] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.572834 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15091c264fdc44fe80269b67ca37f4d0" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
W20260709 13:07:58.574467 27430 leader_election.cc:343] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.575179 27502 leader_election.cc:304] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 6133756cc28a47d491b159f8bd124060
I20260709 13:07:58.575501 27759 tablet_bootstrap.cc:654] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.576390 27662 leader_election.cc:290] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.579115 27775 raft_consensus.cc:2804] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.579869 27775 raft_consensus.cc:493] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.580310 27613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15091c264fdc44fe80269b67ca37f4d0" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:58.581255 27613 raft_consensus.cc:3060] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.582743 27757 ts_tablet_manager.cc:1434] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.042s	user 0.025s	sys 0.005s
I20260709 13:07:58.584453 27757 tablet_bootstrap.cc:492] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:58.580379 27775 raft_consensus.cc:3060] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.589030 27758 tablet_bootstrap.cc:492] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:58.589691 27758 ts_tablet_manager.cc:1403] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.009s
I20260709 13:07:58.592278 27757 tablet_bootstrap.cc:654] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.591813 27358 catalog_manager.cc:5697] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.593091 27758 raft_consensus.cc:359] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.593972 27758 raft_consensus.cc:385] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.594313 27758 raft_consensus.cc:740] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.595988 27775 raft_consensus.cc:515] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.598382 27775 leader_election.cc:290] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.599502 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b96543c470a41e5b707cf0d5e6b7a15" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:58.599967 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b96543c470a41e5b707cf0d5e6b7a15" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:58.600214 27611 raft_consensus.cc:3060] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.600307 27759 tablet_bootstrap.cc:492] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:58.600970 27759 ts_tablet_manager.cc:1403] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.001s
W20260709 13:07:58.601640 27502 leader_election.cc:343] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.595129 27758 consensus_queue.cc:260] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.605682 27758 ts_tablet_manager.cc:1434] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.008s
I20260709 13:07:58.606853 27758 tablet_bootstrap.cc:492] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:58.606513 27759 raft_consensus.cc:359] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.607647 27759 raft_consensus.cc:385] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.608026 27759 raft_consensus.cc:740] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.609568 27613 raft_consensus.cc:2468] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 1.
I20260709 13:07:58.609153 27759 consensus_queue.cc:260] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.614060 27611 raft_consensus.cc:2468] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 1.
I20260709 13:07:58.615684 27758 tablet_bootstrap.cc:654] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.617062 27759 ts_tablet_manager.cc:1434] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:07:58.619630 27759 tablet_bootstrap.cc:492] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:58.626415 27757 tablet_bootstrap.cc:492] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:58.630290 27757 ts_tablet_manager.cc:1403] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.012s
I20260709 13:07:58.634792 27757 raft_consensus.cc:359] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.635705 27757 raft_consensus.cc:385] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.636080 27757 raft_consensus.cc:740] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.636965 27757 consensus_queue.cc:260] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.637755 27427 leader_election.cc:304] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:58.641392 27758 tablet_bootstrap.cc:492] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:58.644212 27758 ts_tablet_manager.cc:1403] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.023s
I20260709 13:07:58.644822 27662 raft_consensus.cc:2804] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.645143 27502 leader_election.cc:304] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 6133756cc28a47d491b159f8bd124060
I20260709 13:07:58.645416 27757 ts_tablet_manager.cc:1434] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.006s
I20260709 13:07:58.645452 27662 raft_consensus.cc:697] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:58.646643 27775 raft_consensus.cc:2804] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.643349 27759 tablet_bootstrap.cc:654] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.646664 27757 tablet_bootstrap.cc:492] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:58.647326 27775 raft_consensus.cc:697] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:58.646715 27662 consensus_queue.cc:237] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.648242 27775 consensus_queue.cc:237] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.651328 27758 raft_consensus.cc:359] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.652393 27758 raft_consensus.cc:385] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.652717 27758 raft_consensus.cc:740] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.653716 27758 consensus_queue.cc:260] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.656224 27758 ts_tablet_manager.cc:1434] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:07:58.657392 27758 tablet_bootstrap.cc:492] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:58.657472 27757 tablet_bootstrap.cc:654] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.670704 27757 tablet_bootstrap.cc:492] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:58.671355 27757 ts_tablet_manager.cc:1403] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:07:58.674969 27757 raft_consensus.cc:359] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.675885 27757 raft_consensus.cc:385] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.676287 27757 raft_consensus.cc:740] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.677248 27757 consensus_queue.cc:260] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.679970 27692 raft_consensus.cc:493] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.680827 27692 raft_consensus.cc:515] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.681324 27757 ts_tablet_manager.cc:1434] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:58.683192 27757 tablet_bootstrap.cc:492] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:58.684734 27758 tablet_bootstrap.cc:654] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.685177 27692 leader_election.cc:290] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:58.686024 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8714f50868d24d89ad89615c1fe470b2" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:58.686443 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8714f50868d24d89ad89615c1fe470b2" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:58.686842 27464 raft_consensus.cc:2468] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:58.687202 27362 catalog_manager.cc:5697] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.688313 27576 leader_election.cc:304] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
W20260709 13:07:58.689206 27579 leader_election.cc:343] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.690282 27692 raft_consensus.cc:2804] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.690812 27692 raft_consensus.cc:493] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.691205 27692 raft_consensus.cc:3060] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.704144 27757 tablet_bootstrap.cc:654] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.704495 27359 catalog_manager.cc:5697] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 0 to 1, leader changed from <none> to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 1 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.705916 27692 raft_consensus.cc:515] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.706540 27759 tablet_bootstrap.cc:492] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:58.707165 27759 ts_tablet_manager.cc:1403] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.014s
I20260709 13:07:58.709403 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8714f50868d24d89ad89615c1fe470b2" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:58.710386 27464 raft_consensus.cc:3060] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.713392 27759 raft_consensus.cc:359] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.713930 27758 tablet_bootstrap.cc:492] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:58.709400 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8714f50868d24d89ad89615c1fe470b2" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:58.714198 27759 raft_consensus.cc:385] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.714552 27758 ts_tablet_manager.cc:1403] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.001s
I20260709 13:07:58.714578 27759 raft_consensus.cc:740] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
W20260709 13:07:58.715837 27579 leader_election.cc:343] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:58.715685 27759 consensus_queue.cc:260] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.718699 27759 ts_tablet_manager.cc:1434] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:07:58.719955 27759 tablet_bootstrap.cc:492] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:58.721143 27758 raft_consensus.cc:359] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.722065 27758 raft_consensus.cc:385] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.724890 27758 raft_consensus.cc:740] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.725646 27464 raft_consensus.cc:2468] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:58.725714 27758 consensus_queue.cc:260] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.727093 27576 leader_election.cc:304] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:58.728380 27759 tablet_bootstrap.cc:654] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.736195 27692 leader_election.cc:290] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:58.739212 27787 raft_consensus.cc:2804] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.740017 27787 raft_consensus.cc:697] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:58.741184 27787 consensus_queue.cc:237] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.744342 27758 ts_tablet_manager.cc:1434] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.012s
I20260709 13:07:58.745512 27758 tablet_bootstrap.cc:492] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:58.748724 27759 tablet_bootstrap.cc:492] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:58.749351 27759 ts_tablet_manager.cc:1403] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.011s
I20260709 13:07:58.752341 27759 raft_consensus.cc:359] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.752851 27757 tablet_bootstrap.cc:492] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:58.752912 27759 raft_consensus.cc:385] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.753577 27759 raft_consensus.cc:740] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.753854 27757 ts_tablet_manager.cc:1403] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.005s
I20260709 13:07:58.754285 27759 consensus_queue.cc:260] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.756385 27758 tablet_bootstrap.cc:654] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.757279 27759 ts_tablet_manager.cc:1434] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:07:58.757478 27757 raft_consensus.cc:359] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.758327 27757 raft_consensus.cc:385] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.758546 27759 tablet_bootstrap.cc:492] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:58.758625 27757 raft_consensus.cc:740] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.759707 27757 consensus_queue.cc:260] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.762387 27757 ts_tablet_manager.cc:1434] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:58.763473 27757 tablet_bootstrap.cc:492] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:58.767160 27759 tablet_bootstrap.cc:654] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.769824 27757 tablet_bootstrap.cc:654] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.772959 27758 tablet_bootstrap.cc:492] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:58.773553 27758 ts_tablet_manager.cc:1403] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.013s
I20260709 13:07:58.777554 27758 raft_consensus.cc:359] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.778268 27758 raft_consensus.cc:385] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.778541 27758 raft_consensus.cc:740] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.779168 27758 consensus_queue.cc:260] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.781245 27758 ts_tablet_manager.cc:1434] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:58.782266 27758 tablet_bootstrap.cc:492] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8: Bootstrap starting.
I20260709 13:07:58.788285 27758 tablet_bootstrap.cc:654] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.792862 27759 tablet_bootstrap.cc:492] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:58.793385 27759 ts_tablet_manager.cc:1403] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.020s
I20260709 13:07:58.796123 27759 raft_consensus.cc:359] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.797083 27759 raft_consensus.cc:385] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.797444 27759 raft_consensus.cc:740] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.798465 27759 consensus_queue.cc:260] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.801723 27362 catalog_manager.cc:5697] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.816233 27759 ts_tablet_manager.cc:1434] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:07:58.819504 27758 tablet_bootstrap.cc:492] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8: No bootstrap required, opened a new log
I20260709 13:07:58.820122 27758 ts_tablet_manager.cc:1403] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.011s
I20260709 13:07:58.820741 27759 tablet_bootstrap.cc:492] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060: Bootstrap starting.
I20260709 13:07:58.823004 27758 raft_consensus.cc:359] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.823706 27758 raft_consensus.cc:385] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.823984 27758 raft_consensus.cc:740] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.824676 27758 consensus_queue.cc:260] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.826771 27758 ts_tablet_manager.cc:1434] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:58.831846 27759 tablet_bootstrap.cc:654] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.837742 27757 tablet_bootstrap.cc:492] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:58.838289 27757 ts_tablet_manager.cc:1403] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.075s	user 0.031s	sys 0.012s
I20260709 13:07:58.840368 27757 raft_consensus.cc:359] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.840925 27757 raft_consensus.cc:385] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.841169 27757 raft_consensus.cc:740] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.841871 27757 consensus_queue.cc:260] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.842675 27759 tablet_bootstrap.cc:492] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060: No bootstrap required, opened a new log
I20260709 13:07:58.843218 27759 ts_tablet_manager.cc:1403] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:07:58.844110 27757 ts_tablet_manager.cc:1434] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:07:58.845161 27757 tablet_bootstrap.cc:492] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37: Bootstrap starting.
I20260709 13:07:58.845992 27759 raft_consensus.cc:359] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.846763 27759 raft_consensus.cc:385] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.847035 27759 raft_consensus.cc:740] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.847738 27759 consensus_queue.cc:260] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.851435 27759 ts_tablet_manager.cc:1434] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:58.851603 27757 tablet_bootstrap.cc:654] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.858613 27757 tablet_bootstrap.cc:492] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37: No bootstrap required, opened a new log
I20260709 13:07:58.859105 27757 ts_tablet_manager.cc:1403] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:07:58.859368 27662 raft_consensus.cc:493] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.859947 27662 raft_consensus.cc:515] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.861471 27757 raft_consensus.cc:359] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.862116 27662 leader_election.cc:290] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.862887 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7869f9006bd4c70861abc7805f5892d" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:58.862280 27757 raft_consensus.cc:385] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.863646 27757 raft_consensus.cc:740] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.863662 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7869f9006bd4c70861abc7805f5892d" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:58.864426 27612 raft_consensus.cc:2468] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:58.864367 27757 consensus_queue.cc:260] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.865379 27538 raft_consensus.cc:2468] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:58.865768 27427 leader_election.cc:304] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:58.866675 27662 raft_consensus.cc:2804] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.867095 27662 raft_consensus.cc:493] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.867506 27662 raft_consensus.cc:3060] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.867777 27757 ts_tablet_manager.cc:1434] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:58.874651 27662 raft_consensus.cc:515] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.875689 27775 raft_consensus.cc:493] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.876199 27775 raft_consensus.cc:515] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.877260 27662 leader_election.cc:290] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.877842 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7869f9006bd4c70861abc7805f5892d" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:58.879055 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15091c264fdc44fe80269b67ca37f4d0" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:58.879304 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7869f9006bd4c70861abc7805f5892d" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:58.880026 27612 raft_consensus.cc:3060] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.880735 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15091c264fdc44fe80269b67ca37f4d0" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:58.881349 27611 raft_consensus.cc:2393] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a85d0c8e244c4191bb2a39f74b217f37 in current term 1: Already voted for candidate 6133756cc28a47d491b159f8bd124060 in this term.
I20260709 13:07:58.879211 27775 leader_election.cc:290] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.879024 27538 raft_consensus.cc:3060] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.882326 27502 leader_election.cc:304] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37; no voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:58.883191 27775 raft_consensus.cc:3060] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.887957 27612 raft_consensus.cc:2468] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 1.
I20260709 13:07:58.888072 27538 raft_consensus.cc:2468] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 1.
I20260709 13:07:58.889750 27427 leader_election.cc:304] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:58.890622 27662 raft_consensus.cc:2804] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.890988 27775 raft_consensus.cc:2749] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:58.891183 27662 raft_consensus.cc:697] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:58.892217 27662 consensus_queue.cc:237] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.892926 27775 consensus_queue.cc:1048] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:58.893865 27769 raft_consensus.cc:493] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.894392 27769 raft_consensus.cc:515] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.896414 27769 leader_election.cc:290] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.897035 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b96543c470a41e5b707cf0d5e6b7a15" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:58.899313 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b96543c470a41e5b707cf0d5e6b7a15" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:58.900550 27611 raft_consensus.cc:2393] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6133756cc28a47d491b159f8bd124060 in current term 1: Already voted for candidate a85d0c8e244c4191bb2a39f74b217f37 in this term.
I20260709 13:07:58.901476 27362 catalog_manager.cc:5697] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.902027 27427 leader_election.cc:304] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6133756cc28a47d491b159f8bd124060; no voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:58.903232 27769 raft_consensus.cc:3060] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.911054 27769 raft_consensus.cc:2749] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:58.916262 27787 raft_consensus.cc:493] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.916971 27787 raft_consensus.cc:515] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.919024 27658 consensus_queue.cc:1048] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:58.919507 27769 raft_consensus.cc:493] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.920046 27769 raft_consensus.cc:515] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.921357 27464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:58.922034 27464 raft_consensus.cc:2468] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:58.923408 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:58.924008 27576 leader_election.cc:304] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:58.924168 27611 raft_consensus.cc:2468] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:58.924968 27692 raft_consensus.cc:2804] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.925345 27692 raft_consensus.cc:493] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.925680 27692 raft_consensus.cc:3060] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.925535 27427 leader_election.cc:304] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:58.923573 27769 leader_election.cc:290] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.927393 27662 raft_consensus.cc:2804] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.927894 27662 raft_consensus.cc:493] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.928341 27662 raft_consensus.cc:3060] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.932499 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:58.933296 27539 raft_consensus.cc:2468] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:58.934384 27769 raft_consensus.cc:493] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.935189 27787 leader_election.cc:290] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:58.935453 27769 raft_consensus.cc:515] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.938606 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:58.942510 27611 raft_consensus.cc:3060] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.939567 27538 raft_consensus.cc:2468] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:58.942129 27692 raft_consensus.cc:515] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.953465 27787 raft_consensus.cc:493] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.957388 27787 raft_consensus.cc:515] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.957891 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:58.958586 27538 raft_consensus.cc:3060] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.959734 27787 leader_election.cc:290] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:58.961061 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678daad614014e7ab9313d6bf77345b8" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:58.961812 27539 raft_consensus.cc:2468] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:58.962659 27662 raft_consensus.cc:515] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:58.964008 27579 leader_election.cc:304] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:58.966692 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:58.968762 27787 raft_consensus.cc:2804] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.969365 27787 raft_consensus.cc:493] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.974129 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0edf3f3eec46a9aa7741a0306309b9" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:58.974931 27539 raft_consensus.cc:2468] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:58.976318 27430 leader_election.cc:304] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: 
I20260709 13:07:58.976994 27662 leader_election.cc:290] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.977527 27769 leader_election.cc:290] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:58.970758 27692 leader_election.cc:290] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:58.978791 27662 raft_consensus.cc:2804] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:58.979300 27662 raft_consensus.cc:493] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.979681 27662 raft_consensus.cc:3060] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.971501 27787 raft_consensus.cc:3060] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.997076 27658 consensus_queue.cc:1048] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:58.997177 27692 raft_consensus.cc:493] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.000222 27692 raft_consensus.cc:515] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.004686 27538 raft_consensus.cc:2468] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:59.006021 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37" is_pre_election: true
I20260709 13:07:59.008951 27579 leader_election.cc:304] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:59.011365 27692 leader_election.cc:290] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:59.010855 27786 raft_consensus.cc:2804] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.014950 27786 raft_consensus.cc:697] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:59.018399 27462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:59.019749 27462 raft_consensus.cc:2393] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate da55bab8ad794364aa77430da1cf0bc8 in current term 1: Already voted for candidate 6133756cc28a47d491b159f8bd124060 in this term.
I20260709 13:07:59.021878 27462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678daad614014e7ab9313d6bf77345b8" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:59.023202 27462 raft_consensus.cc:2468] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 0.
I20260709 13:07:59.025660 27462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:59.026775 27462 raft_consensus.cc:2468] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:59.035214 27576 leader_election.cc:304] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:59.034751 27786 consensus_queue.cc:237] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
W20260709 13:07:59.036761 27430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.194:36135, user_credentials={real_user=slave}} blocked reactor thread for 60545.4us
I20260709 13:07:59.040529 27804 raft_consensus.cc:2804] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:59.041042 27804 raft_consensus.cc:493] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a85d0c8e244c4191bb2a39f74b217f37)
I20260709 13:07:59.041402 27804 raft_consensus.cc:3060] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.046448 27662 raft_consensus.cc:515] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.048898 27662 leader_election.cc:290] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:59.050971 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0edf3f3eec46a9aa7741a0306309b9" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:59.052420 27539 raft_consensus.cc:3060] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.056339 27787 raft_consensus.cc:515] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.059877 27787 leader_election.cc:290] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:59.063934 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678daad614014e7ab9313d6bf77345b8" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:59.065112 27538 raft_consensus.cc:3060] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:59.068140 27427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.206.195:41047, user_credentials={real_user=slave}} blocked reactor thread for 142687us
I20260709 13:07:59.070425 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:59.073220 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0edf3f3eec46a9aa7741a0306309b9" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:59.073994 27612 raft_consensus.cc:2468] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 0.
I20260709 13:07:59.075186 27462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678daad614014e7ab9313d6bf77345b8" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:59.075891 27462 raft_consensus.cc:3060] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.079389 27658 consensus_queue.cc:1048] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.080307 27612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0edf3f3eec46a9aa7741a0306309b9" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:59.080986 27612 raft_consensus.cc:3060] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.087836 27539 raft_consensus.cc:2468] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 1.
I20260709 13:07:59.079077 27804 raft_consensus.cc:515] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.096448 27611 raft_consensus.cc:1240] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Rejecting Update request from peer a85d0c8e244c4191bb2a39f74b217f37 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:59.097589 27804 leader_election.cc:290] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 2 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:59.099465 27537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:59.100023 27658 raft_consensus.cc:493] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.100149 27462 raft_consensus.cc:2468] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:59.100018 27463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:59.102159 27463 raft_consensus.cc:3060] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.106889 27658 raft_consensus.cc:515] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.107187 27576 leader_election.cc:304] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:59.107975 27359 catalog_manager.cc:5697] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.110867 27610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8714f50868d24d89ad89615c1fe470b2" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da55bab8ad794364aa77430da1cf0bc8" is_pre_election: true
I20260709 13:07:59.111104 27427 leader_election.cc:304] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6133756cc28a47d491b159f8bd124060; no voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:59.111069 27775 consensus_queue.cc:1048] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:59.109408 27658 leader_election.cc:290] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:59.114331 27538 raft_consensus.cc:2468] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 1.
I20260709 13:07:59.111388 27786 raft_consensus.cc:2804] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.110677 27612 raft_consensus.cc:2468] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 1.
I20260709 13:07:59.118360 27662 raft_consensus.cc:2749] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.118327 27786 raft_consensus.cc:697] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:59.120851 27786 consensus_queue.cc:237] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.112285 27746 consensus_queue.cc:1048] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:07:59.124892 27430 leader_election.cc:304] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: 
I20260709 13:07:59.129550 27662 raft_consensus.cc:2804] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.130026 27662 raft_consensus.cc:697] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:59.130828 27662 consensus_queue.cc:237] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.136231 27538 raft_consensus.cc:3060] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.133018 27463 raft_consensus.cc:2468] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 2.
I20260709 13:07:59.141650 27576 leader_election.cc:304] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:59.142416 27804 raft_consensus.cc:2804] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.143193 27804 raft_consensus.cc:697] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 2 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:59.144119 27804 consensus_queue.cc:237] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.151000 27804 consensus_queue.cc:1048] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.159391 27746 consensus_queue.cc:1059] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.160233 27775 raft_consensus.cc:3055] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.160605 27775 raft_consensus.cc:740] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:59.162011 27775 consensus_queue.cc:260] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.163605 27462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8714f50868d24d89ad89615c1fe470b2" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6133756cc28a47d491b159f8bd124060" is_pre_election: true
I20260709 13:07:59.165097 27464 raft_consensus.cc:1240] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Rejecting Update request from peer a85d0c8e244c4191bb2a39f74b217f37 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:07:59.168628 27502 leader_election.cc:304] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37; no voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:59.166558 27804 consensus_queue.cc:1048] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.169516 27658 raft_consensus.cc:2749] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.171164 27803 consensus_queue.cc:1048] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.168143 27775 raft_consensus.cc:3060] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.170879 27362 catalog_manager.cc:5697] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 1 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.177645 27362 catalog_manager.cc:5697] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 1 to 2, leader changed from a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194) to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.178563 27359 catalog_manager.cc:5697] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 1 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.216693 27801 consensus_queue.cc:1048] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.226559 27537 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5ded325c85849a09dfad3c05f3bfe24"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
mode: GRACEFUL
new_leader_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56604
I20260709 13:07:59.227236 27537 raft_consensus.cc:606] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Received request to transfer leadership to TS 6133756cc28a47d491b159f8bd124060
I20260709 13:07:59.247589 27613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
mode: GRACEFUL
new_leader_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:58282
I20260709 13:07:59.248311 27613 raft_consensus.cc:606] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 2 LEADER]: Received request to transfer leadership to TS 6133756cc28a47d491b159f8bd124060
I20260709 13:07:59.272869 27539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b96543c470a41e5b707cf0d5e6b7a15"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
mode: GRACEFUL
new_leader_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56604
I20260709 13:07:59.273665 27539 raft_consensus.cc:606] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Received request to transfer leadership to TS 6133756cc28a47d491b159f8bd124060
I20260709 13:07:59.283466 27746 raft_consensus.cc:993] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37: : Instructing follower 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:59.283998 27746 raft_consensus.cc:1081] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Signalling peer 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:59.286353 27461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b96543c470a41e5b707cf0d5e6b7a15"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56572
I20260709 13:07:59.287070 27461 raft_consensus.cc:493] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.287484 27461 raft_consensus.cc:3060] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.290318 27613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8714f50868d24d89ad89615c1fe470b2"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
mode: GRACEFUL
new_leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:58282
I20260709 13:07:59.291002 27613 raft_consensus.cc:606] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Received request to transfer leadership to TS a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:59.299058 27613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "678daad614014e7ab9313d6bf77345b8"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
mode: GRACEFUL
new_leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:58282
I20260709 13:07:59.299639 27613 raft_consensus.cc:606] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Received request to transfer leadership to TS a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:59.307004 27460 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7869f9006bd4c70861abc7805f5892d"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
mode: GRACEFUL
new_leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:56590
I20260709 13:07:59.307698 27460 raft_consensus.cc:606] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Received request to transfer leadership to TS a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:59.308804 27461 raft_consensus.cc:515] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.310669 27463 raft_consensus.cc:1240] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Rejecting Update request from peer a85d0c8e244c4191bb2a39f74b217f37 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:59.314318 27775 consensus_queue.cc:1059] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.315173 27775 raft_consensus.cc:3055] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.315171 27461 leader_election.cc:290] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:59.315591 27775 raft_consensus.cc:740] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:59.316792 27775 consensus_queue.cc:260] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.317968 27775 raft_consensus.cc:3060] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.324193 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b96543c470a41e5b707cf0d5e6b7a15" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:59.325450 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b96543c470a41e5b707cf0d5e6b7a15" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:59.326282 27611 raft_consensus.cc:3060] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.332077 27613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
mode: GRACEFUL
new_leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:58282
I20260709 13:07:59.332973 27613 raft_consensus.cc:606] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Received request to transfer leadership to TS a85d0c8e244c4191bb2a39f74b217f37
I20260709 13:07:59.337918 27611 raft_consensus.cc:2468] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:59.339819 27427 leader_election.cc:304] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:59.342219 27801 raft_consensus.cc:2804] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.342903 27801 raft_consensus.cc:697] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:59.343956 27801 consensus_queue.cc:237] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.351119 27806 raft_consensus.cc:993] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37: : Instructing follower 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:59.351701 27806 raft_consensus.cc:1081] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Signalling peer 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:59.354382 27461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5ded325c85849a09dfad3c05f3bfe24"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56572
I20260709 13:07:59.357599 27461 raft_consensus.cc:493] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.358395 27463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b0edf3f3eec46a9aa7741a0306309b9"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
mode: GRACEFUL
new_leader_uuid: "da55bab8ad794364aa77430da1cf0bc8"
 from {username='slave'} at 127.0.0.1:56590
I20260709 13:07:59.361986 27539 raft_consensus.cc:2468] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:59.362727 27463 raft_consensus.cc:606] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Received request to transfer leadership to TS da55bab8ad794364aa77430da1cf0bc8
I20260709 13:07:59.365401 27461 raft_consensus.cc:3060] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.369925 27359 catalog_manager.cc:5697] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 1 to 2, leader changed from a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194) to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.374745 27461 raft_consensus.cc:515] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.378664 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ded325c85849a09dfad3c05f3bfe24" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:59.379357 27611 raft_consensus.cc:3060] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.381505 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5ded325c85849a09dfad3c05f3bfe24" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:59.382766 27539 raft_consensus.cc:3055] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.383134 27539 raft_consensus.cc:740] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:59.385084 27539 consensus_queue.cc:260] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.387264 27539 raft_consensus.cc:3060] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.388015 27611 raft_consensus.cc:2468] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:59.388878 27461 leader_election.cc:290] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:59.389326 27427 leader_election.cc:304] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:59.390093 27801 raft_consensus.cc:2804] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.390610 27801 raft_consensus.cc:697] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:59.391431 27801 consensus_queue.cc:237] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.397066 27539 raft_consensus.cc:2468] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 2.
I20260709 13:07:59.399811 27359 catalog_manager.cc:5697] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 1 to 2, leader changed from a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194) to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 2 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.431474 27801 consensus_queue.cc:1048] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.446488 27803 consensus_queue.cc:1048] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.456919 27803 raft_consensus.cc:993] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060: : Instructing follower a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:59.457412 27803 raft_consensus.cc:1081] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Signalling peer a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:59.459399 27539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7869f9006bd4c70861abc7805f5892d"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:56600
I20260709 13:07:59.460049 27539 raft_consensus.cc:493] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.460587 27539 raft_consensus.cc:3060] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.463791 27692 consensus_queue.cc:1048] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.469595 27539 raft_consensus.cc:515] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.475162 27539 leader_election.cc:290] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:59.479336 27461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7869f9006bd4c70861abc7805f5892d" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:59.479909 27461 raft_consensus.cc:3055] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.480194 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7869f9006bd4c70861abc7805f5892d" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:59.480926 27611 raft_consensus.cc:3060] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.480237 27461 raft_consensus.cc:740] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:59.483604 27461 consensus_queue.cc:260] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.484979 27461 raft_consensus.cc:3060] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.490384 27804 raft_consensus.cc:993] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8: : Instructing follower a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:59.490988 27804 raft_consensus.cc:1081] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Signalling peer a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:59.493414 27539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:56602
I20260709 13:07:59.492324 27611 raft_consensus.cc:2468] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:59.495898 27502 leader_election.cc:304] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:59.496153 27787 consensus_queue.cc:1048] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.496866 27775 raft_consensus.cc:2804] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.497359 27775 raft_consensus.cc:697] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:59.498260 27775 consensus_queue.cc:237] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.507738 27539 raft_consensus.cc:493] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.508452 27539 raft_consensus.cc:3060] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.513152 27461 raft_consensus.cc:2468] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:59.518908 27539 raft_consensus.cc:515] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.525736 27539 leader_election.cc:290] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:59.527420 27460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:59.529065 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3f5420ef3044d7bd996ffc7e270f66" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:59.529734 27611 raft_consensus.cc:3055] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.530090 27611 raft_consensus.cc:740] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:59.530503 27359 catalog_manager.cc:5697] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 1 to 2, leader changed from 6133756cc28a47d491b159f8bd124060 (127.13.206.193) to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.530961 27611 consensus_queue.cc:260] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.532511 27611 raft_consensus.cc:3060] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:59.537547 27692 consensus_queue.cc:1175] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6133756cc28a47d491b159f8bd124060" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:07:59.540405 27611 raft_consensus.cc:2468] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:59.541818 27502 leader_election.cc:304] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 6133756cc28a47d491b159f8bd124060
I20260709 13:07:59.542704 27775 raft_consensus.cc:2804] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.543277 27775 raft_consensus.cc:697] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:59.544215 27775 consensus_queue.cc:237] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.554723 27360 catalog_manager.cc:5697] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 1 to 2, leader changed from da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195) to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.561228 27692 consensus_queue.cc:1048] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.568403 27787 raft_consensus.cc:993] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8: : Instructing follower a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:59.568969 27786 raft_consensus.cc:1081] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Signalling peer a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:59.570905 27538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "678daad614014e7ab9313d6bf77345b8"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:56602
I20260709 13:07:59.571525 27538 raft_consensus.cc:493] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.571945 27538 raft_consensus.cc:3060] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.575205 27786 consensus_queue.cc:1048] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.584278 27538 raft_consensus.cc:515] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.586567 27538 leader_election.cc:290] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:59.587612 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678daad614014e7ab9313d6bf77345b8" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:59.588289 27611 raft_consensus.cc:3055] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.588380 27463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "678daad614014e7ab9313d6bf77345b8" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:59.588694 27611 raft_consensus.cc:740] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:59.589164 27463 raft_consensus.cc:3060] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.589570 27611 consensus_queue.cc:260] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.590637 27611 raft_consensus.cc:3060] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.595597 27611 raft_consensus.cc:2468] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:59.596078 27463 raft_consensus.cc:2468] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:59.596733 27502 leader_election.cc:304] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:59.597591 27775 raft_consensus.cc:2804] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.598074 27775 raft_consensus.cc:697] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:59.598868 27775 consensus_queue.cc:237] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.606709 27360 catalog_manager.cc:5697] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 1 to 2, leader changed from da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195) to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.615826 27463 raft_consensus.cc:1275] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Refusing update from remote peer da55bab8ad794364aa77430da1cf0bc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.617290 27786 consensus_queue.cc:1048] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.621220 27662 consensus_queue.cc:1048] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.625330 27787 raft_consensus.cc:993] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8: : Instructing follower 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:59.625797 27787 raft_consensus.cc:1081] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 2 LEADER]: Signalling peer 6133756cc28a47d491b159f8bd124060 to start an election
I20260709 13:07:59.630657 27539 raft_consensus.cc:1275] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Refusing update from remote peer da55bab8ad794364aa77430da1cf0bc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.633008 27804 consensus_queue.cc:1048] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.636633 27460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
 from {username='slave'} at 127.0.0.1:56578
I20260709 13:07:59.637353 27460 raft_consensus.cc:493] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.637693 27460 raft_consensus.cc:3060] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:59.648072 27460 raft_consensus.cc:515] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.649719 27463 raft_consensus.cc:1240] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Rejecting Update request from peer da55bab8ad794364aa77430da1cf0bc8 for earlier term 2. Current term is 3. Ops: []
I20260709 13:07:59.651624 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:59.651508 27786 consensus_queue.cc:1059] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:59.651652 27539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1924e7444c624464bdb57bab0f2dde3f" candidate_uuid: "6133756cc28a47d491b159f8bd124060" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:59.652467 27786 raft_consensus.cc:3055] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:59.652932 27786 raft_consensus.cc:740] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:59.652736 27539 raft_consensus.cc:3060] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:59.653930 27786 consensus_queue.cc:260] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.655186 27786 raft_consensus.cc:3060] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:59.656139 27460 leader_election.cc:290] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 3 election: Requested vote from peers a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:59.661265 27803 consensus_queue.cc:1048] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:59.670853 27786 raft_consensus.cc:993] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8: : Instructing follower a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:59.671347 27787 raft_consensus.cc:1081] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Signalling peer a85d0c8e244c4191bb2a39f74b217f37 to start an election
I20260709 13:07:59.673027 27538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8714f50868d24d89ad89615c1fe470b2"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
 from {username='slave'} at 127.0.0.1:56602
I20260709 13:07:59.673650 27538 raft_consensus.cc:493] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.674006 27538 raft_consensus.cc:3060] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.675455 27611 raft_consensus.cc:2468] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 3.
I20260709 13:07:59.676204 27539 raft_consensus.cc:2468] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6133756cc28a47d491b159f8bd124060 in term 3.
I20260709 13:07:59.677659 27430 leader_election.cc:304] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: 
I20260709 13:07:59.678583 27802 raft_consensus.cc:2804] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:59.679080 27802 raft_consensus.cc:697] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 3 LEADER]: Becoming Leader. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:59.679912 27802 consensus_queue.cc:237] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.681538 27803 raft_consensus.cc:993] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060: : Instructing follower da55bab8ad794364aa77430da1cf0bc8 to start an election
I20260709 13:07:59.682088 27803 raft_consensus.cc:1081] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Signalling peer da55bab8ad794364aa77430da1cf0bc8 to start an election
I20260709 13:07:59.684212 27613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b0edf3f3eec46a9aa7741a0306309b9"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
 from {username='slave'} at 127.0.0.1:58274
I20260709 13:07:59.684844 27613 raft_consensus.cc:493] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.684799 27538 raft_consensus.cc:515] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.685462 27613 raft_consensus.cc:3060] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.687780 27538 leader_election.cc:290] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195:41047)
I20260709 13:07:59.687795 27460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8714f50868d24d89ad89615c1fe470b2" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:59.688898 27460 raft_consensus.cc:3060] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.691759 27360 catalog_manager.cc:5697] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 reported cstate change: term changed from 2 to 3, leader changed from da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195) to 6133756cc28a47d491b159f8bd124060 (127.13.206.193). New cstate: current_term: 3 leader_uuid: "6133756cc28a47d491b159f8bd124060" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.693281 27611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8714f50868d24d89ad89615c1fe470b2" candidate_uuid: "a85d0c8e244c4191bb2a39f74b217f37" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
I20260709 13:07:59.693976 27611 raft_consensus.cc:3055] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.694310 27611 raft_consensus.cc:740] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:59.695066 27611 consensus_queue.cc:260] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.696282 27611 raft_consensus.cc:3060] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.696417 27460 raft_consensus.cc:2468] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:59.697803 27502 leader_election.cc:304] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, a85d0c8e244c4191bb2a39f74b217f37; no voters: 
I20260709 13:07:59.698720 27775 raft_consensus.cc:2804] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.698596 27613 raft_consensus.cc:515] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.699340 27775 raft_consensus.cc:697] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Becoming Leader. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:07:59.700248 27775 consensus_queue.cc:237] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.702101 27460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0edf3f3eec46a9aa7741a0306309b9" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:07:59.702811 27460 raft_consensus.cc:3055] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.703184 27460 raft_consensus.cc:740] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:07:59.704109 27460 consensus_queue.cc:260] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.705228 27460 raft_consensus.cc:3060] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.710182 27611 raft_consensus.cc:2468] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a85d0c8e244c4191bb2a39f74b217f37 in term 2.
I20260709 13:07:59.710532 27613 leader_election.cc:290] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 2 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:07:59.712152 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0edf3f3eec46a9aa7741a0306309b9" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:07:59.712807 27538 raft_consensus.cc:3060] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.713485 27360 catalog_manager.cc:5697] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 reported cstate change: term changed from 1 to 2, leader changed from da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195) to a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194). New cstate: current_term: 2 leader_uuid: "a85d0c8e244c4191bb2a39f74b217f37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.719681 27460 raft_consensus.cc:2468] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 2.
I20260709 13:07:59.719839 27538 raft_consensus.cc:2468] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 2.
I20260709 13:07:59.721108 27576 leader_election.cc:304] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:07:59.721952 27787 raft_consensus.cc:2804] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.722514 27787 raft_consensus.cc:697] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 2 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:07:59.723362 27787 consensus_queue.cc:237] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:07:59.731175 27360 catalog_manager.cc:5697] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 1 to 2, leader changed from 6133756cc28a47d491b159f8bd124060 (127.13.206.193) to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 2 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.738402 27613 raft_consensus.cc:1275] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.739955 27803 consensus_queue.cc:1048] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.749003 27538 raft_consensus.cc:1275] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.750485 27802 consensus_queue.cc:1048] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.804209 27538 raft_consensus.cc:1275] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.805445 27802 consensus_queue.cc:1048] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.813356 27613 raft_consensus.cc:1275] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.814939 27803 consensus_queue.cc:1048] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.965025 27460 raft_consensus.cc:3060] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.970741 27460 raft_consensus.cc:1275] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.972254 27775 consensus_queue.cc:1048] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.983592 27613 raft_consensus.cc:1275] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.985656 27460 raft_consensus.cc:1275] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.987005 27826 consensus_queue.cc:1048] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.990095 27658 consensus_queue.cc:1048] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.990104 27460 raft_consensus.cc:1275] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.994072 27611 raft_consensus.cc:1275] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.997336 27775 consensus_queue.cc:1048] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.997895 27827 consensus_queue.cc:1048] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:00.024889 27613 raft_consensus.cc:1275] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.028949 27826 consensus_queue.cc:1048] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.095518 27613 raft_consensus.cc:1275] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 3 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:00.096840 27802 consensus_queue.cc:1048] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.105542 27538 raft_consensus.cc:1275] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Refusing update from remote peer 6133756cc28a47d491b159f8bd124060: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:00.107276 27802 consensus_queue.cc:1048] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:00.210668 27460 raft_consensus.cc:1275] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Refusing update from remote peer da55bab8ad794364aa77430da1cf0bc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.212168 27787 consensus_queue.cc:1048] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.220625 27538 raft_consensus.cc:1275] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Refusing update from remote peer da55bab8ad794364aa77430da1cf0bc8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.222467 27787 consensus_queue.cc:1048] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.262873 27613 raft_consensus.cc:1275] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.264285 27775 consensus_queue.cc:1048] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.275764 27460 raft_consensus.cc:1275] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Refusing update from remote peer a85d0c8e244c4191bb2a39f74b217f37: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.277061 27827 consensus_queue.cc:1048] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:02.367745 27359 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33702:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:08:02.397468 27359 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33702:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:08:02.442797 14139 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:02.803479 27884 tablet.cc:1724] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:02.774312 27871 tablet.cc:1724] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:02.818162 27887 tablet.cc:1724] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:02.820623 27877 log.cc:927] Time spent T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
W20260709 13:08:02.818306 27864 log.cc:927] Time spent T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:08:02.853883 27892 tablet.cc:1724] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:02.830757 27885 tablet.cc:1724] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:02.860939 27865 log.cc:927] Time spent T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:08:02.864516 27882 log.cc:927] Time spent T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:08:02.874496 27430 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.206.194:36135, user_credentials={real_user=slave}} blocked reactor thread for 116554us
W20260709 13:08:02.875062 27881 log.cc:927] Time spent T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37: Append to log took a long time: real 0.127s	user 0.000s	sys 0.003s
I20260709 13:08:02.919971 27463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a"
dest_uuid: "6133756cc28a47d491b159f8bd124060"
mode: GRACEFUL
new_leader_uuid: "da55bab8ad794364aa77430da1cf0bc8"
 from {username='slave'} at 127.0.0.1:56594
I20260709 13:08:02.920853 27463 raft_consensus.cc:606] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Received request to transfer leadership to TS da55bab8ad794364aa77430da1cf0bc8
W20260709 13:08:02.961875 27886 log.cc:927] Time spent T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8: Append to log took a long time: real 0.161s	user 0.000s	sys 0.003s
I20260709 13:08:03.001353 27885 tablet.cc:1724] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.006479 27899 tablet.cc:1724] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.006699 27902 tablet.cc:1724] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.020466 27903 tablet.cc:1724] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.023958 27662 raft_consensus.cc:993] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060: : Instructing follower da55bab8ad794364aa77430da1cf0bc8 to start an election
I20260709 13:08:03.024576 27662 raft_consensus.cc:1081] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Signalling peer da55bab8ad794364aa77430da1cf0bc8 to start an election
I20260709 13:08:03.029412 27608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
 from {username='slave'} at 127.0.0.1:58274
I20260709 13:08:03.030218 27608 raft_consensus.cc:493] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.032320 27608 raft_consensus.cc:3060] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:03.032121 27898 log.cc:927] Time spent T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.002s
I20260709 13:08:03.038386 27892 tablet.cc:1724] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.027134 27900 tablet.cc:1724] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.048942 27907 tablet.cc:1724] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.050572 27887 tablet.cc:1724] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.053663 27908 tablet.cc:1724] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.062597 27901 tablet.cc:1724] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.062505 27871 tablet.cc:1724] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.083015 27885 tablet.cc:1724] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.089221 27899 tablet.cc:1724] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.089650 27903 tablet.cc:1724] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.061160 27884 tablet.cc:1724] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.099920 27608 raft_consensus.cc:515] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:08:03.108093 27460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:08:03.108887 27460 raft_consensus.cc:3055] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:03.109248 27460 raft_consensus.cc:740] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6133756cc28a47d491b159f8bd124060, State: Running, Role: LEADER
I20260709 13:08:03.115032 27535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b"
dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
mode: GRACEFUL
new_leader_uuid: "da55bab8ad794364aa77430da1cf0bc8"
 from {username='slave'} at 127.0.0.1:33758
I20260709 13:08:03.115800 27535 raft_consensus.cc:606] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Received request to transfer leadership to TS da55bab8ad794364aa77430da1cf0bc8
I20260709 13:08:03.117458 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ffe9b21b446483f969e15a1af04275a" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:08:03.118165 27538 raft_consensus.cc:3060] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:03.118538 14139 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:03.119261 14139 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:03.112622 27460 consensus_queue.cc:260] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:08:03.123680 27460 raft_consensus.cc:3060] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:03.113512 27608 leader_election.cc:290] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 3 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:08:03.131814 27902 tablet.cc:1724] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.135006 27871 tablet.cc:1724] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.137734 27538 raft_consensus.cc:2468] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 3.
I20260709 13:08:03.139451 27579 leader_election.cc:304] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a85d0c8e244c4191bb2a39f74b217f37, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:08:03.144511 27870 raft_consensus.cc:2804] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:03.145088 27870 raft_consensus.cc:697] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 3 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:08:03.146121 27870 consensus_queue.cc:237] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:08:03.148104 27900 tablet.cc:1724] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.154345 27901 tablet.cc:1724] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.133817 27887 tablet.cc:1724] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.170578 27460 raft_consensus.cc:2468] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 3.
I20260709 13:08:03.178033 27907 tablet.cc:1724] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.185034 27901 tablet.cc:1724] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:03.199062 27360 catalog_manager.cc:5697] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 2 to 3, leader changed from 6133756cc28a47d491b159f8bd124060 (127.13.206.193) to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.226179 27359 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed: soft_deleted_table [id=1d5c4a4b243445858e65f235f1b304ef] alter complete (version 1)
I20260709 13:08:03.293596 27906 raft_consensus.cc:993] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37: : Instructing follower da55bab8ad794364aa77430da1cf0bc8 to start an election
I20260709 13:08:03.294185 27905 raft_consensus.cc:1081] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Signalling peer da55bab8ad794364aa77430da1cf0bc8 to start an election
I20260709 13:08:03.295826 27608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b"
dest_uuid: "da55bab8ad794364aa77430da1cf0bc8"
 from {username='slave'} at 127.0.0.1:58272
I20260709 13:08:03.296353 27608 raft_consensus.cc:493] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:03.296671 27608 raft_consensus.cc:3060] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:03.302016 27608 raft_consensus.cc:515] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:08:03.303932 27608 leader_election.cc:290] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 3 election: Requested vote from peers 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339), a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135)
I20260709 13:08:03.304826 27460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6133756cc28a47d491b159f8bd124060"
I20260709 13:08:03.305019 27538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8060b5b61484f78971bec004c171c0b" candidate_uuid: "da55bab8ad794364aa77430da1cf0bc8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a85d0c8e244c4191bb2a39f74b217f37"
I20260709 13:08:03.305423 27460 raft_consensus.cc:3060] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:03.305600 27538 raft_consensus.cc:3055] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:03.306005 27538 raft_consensus.cc:740] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a85d0c8e244c4191bb2a39f74b217f37, State: Running, Role: LEADER
I20260709 13:08:03.306773 27538 consensus_queue.cc:260] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:08:03.307989 27538 raft_consensus.cc:3060] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:03.311372 27460 raft_consensus.cc:2468] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 3.
I20260709 13:08:03.312875 27576 leader_election.cc:304] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6133756cc28a47d491b159f8bd124060, da55bab8ad794364aa77430da1cf0bc8; no voters: 
I20260709 13:08:03.313405 27538 raft_consensus.cc:2468] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da55bab8ad794364aa77430da1cf0bc8 in term 3.
I20260709 13:08:03.313834 27870 raft_consensus.cc:2804] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:03.314455 27870 raft_consensus.cc:697] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 3 LEADER]: Becoming Leader. State: Replica: da55bab8ad794364aa77430da1cf0bc8, State: Running, Role: LEADER
I20260709 13:08:03.315330 27870 consensus_queue.cc:237] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } }
I20260709 13:08:03.323746 27359 catalog_manager.cc:5697] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 reported cstate change: term changed from 2 to 3, leader changed from a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194) to da55bab8ad794364aa77430da1cf0bc8 (127.13.206.195). New cstate: current_term: 3 leader_uuid: "da55bab8ad794364aa77430da1cf0bc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da55bab8ad794364aa77430da1cf0bc8" member_type: VOTER last_known_addr { host: "127.13.206.195" port: 41047 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.594820 27538 raft_consensus.cc:1275] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Refusing update from remote peer da55bab8ad794364aa77430da1cf0bc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:03.596088 27870 consensus_queue.cc:1048] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.621260 27460 raft_consensus.cc:1275] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Refusing update from remote peer da55bab8ad794364aa77430da1cf0bc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:03.623502 27919 consensus_queue.cc:1048] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:03.854175 27538 raft_consensus.cc:1275] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Refusing update from remote peer da55bab8ad794364aa77430da1cf0bc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:03.855592 27919 consensus_queue.cc:1048] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a85d0c8e244c4191bb2a39f74b217f37" member_type: VOTER last_known_addr { host: "127.13.206.194" port: 36135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.865047 27462 raft_consensus.cc:1275] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Refusing update from remote peer da55bab8ad794364aa77430da1cf0bc8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:03.867717 27919 consensus_queue.cc:1048] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6133756cc28a47d491b159f8bd124060" member_type: VOTER last_known_addr { host: "127.13.206.193" port: 35339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:04.180022 14139 tablet_server.cc:179] TabletServer@127.13.206.193:0 shutting down...
W20260709 13:08:04.212931 27502 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260709 13:08:04.217164 27502 consensus_peers.cc:597] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 -> Peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Couldn't send request to peer 6133756cc28a47d491b159f8bd124060. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.220090 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:04.221065 14139 tablet_replica.cc:333] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.222026 14139 raft_consensus.cc:2243] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.222666 14139 raft_consensus.cc:2272] T 678daad614014e7ab9313d6bf77345b8 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.224896 14139 tablet_replica.cc:333] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.225541 14139 raft_consensus.cc:2243] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.226028 14139 raft_consensus.cc:2272] T e7869f9006bd4c70861abc7805f5892d P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.228250 14139 tablet_replica.cc:333] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.228880 14139 raft_consensus.cc:2243] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.229357 14139 raft_consensus.cc:2272] T 8b0edf3f3eec46a9aa7741a0306309b9 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.231554 14139 tablet_replica.cc:333] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.232187 14139 raft_consensus.cc:2243] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.233074 14139 raft_consensus.cc:2272] T 9b96543c470a41e5b707cf0d5e6b7a15 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.235468 14139 tablet_replica.cc:333] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.236071 14139 raft_consensus.cc:2243] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.236883 14139 raft_consensus.cc:2272] T 1924e7444c624464bdb57bab0f2dde3f P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.239045 14139 tablet_replica.cc:333] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.239627 14139 raft_consensus.cc:2243] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.240113 14139 raft_consensus.cc:2272] T 2151f36a277a43a0a6282bffd280bfbb P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.243453 14139 tablet_replica.cc:333] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.244372 14139 raft_consensus.cc:2243] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.245652 14139 raft_consensus.cc:2272] T 15091c264fdc44fe80269b67ca37f4d0 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:04.246502 27576 consensus_peers.cc:597] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 -> Peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Couldn't send request to peer 6133756cc28a47d491b159f8bd124060. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.248625 14139 tablet_replica.cc:333] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.249405 14139 raft_consensus.cc:2243] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.249943 14139 raft_consensus.cc:2272] T 8714f50868d24d89ad89615c1fe470b2 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.252847 14139 tablet_replica.cc:333] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.253516 14139 raft_consensus.cc:2243] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.254393 14139 raft_consensus.cc:2272] T c503892b567043d5874be704fe436d70 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.256704 14139 tablet_replica.cc:333] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.257303 14139 raft_consensus.cc:2243] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.258152 14139 raft_consensus.cc:2272] T 15bd073603094e9e89099d89e23c71c7 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.260404 14139 tablet_replica.cc:333] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.261063 14139 raft_consensus.cc:2243] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.261559 14139 raft_consensus.cc:2272] T cda617f16b0b4900a2c1e421ff81aa84 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.263872 14139 tablet_replica.cc:333] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.264561 14139 raft_consensus.cc:2243] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.265393 14139 raft_consensus.cc:2272] T e5ded325c85849a09dfad3c05f3bfe24 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.267576 14139 tablet_replica.cc:333] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.268132 14139 raft_consensus.cc:2243] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.268573 14139 raft_consensus.cc:2272] T 0ffe9b21b446483f969e15a1af04275a P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.271947 14139 tablet_replica.cc:333] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.272627 14139 raft_consensus.cc:2243] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.273461 14139 raft_consensus.cc:2272] T 7a8972cf673b4bcf9590c1260354901a P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.275978 14139 tablet_replica.cc:333] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.276494 14139 raft_consensus.cc:2243] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.276911 14139 raft_consensus.cc:2272] T 6e3f5420ef3044d7bd996ffc7e270f66 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.279241 14139 tablet_replica.cc:333] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.279937 14139 raft_consensus.cc:2243] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.280467 14139 raft_consensus.cc:2272] T a0832f611c88444f84f9c0791be88152 P 6133756cc28a47d491b159f8bd124060 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.283238 14139 tablet_replica.cc:333] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.283830 14139 raft_consensus.cc:2243] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.284279 14139 raft_consensus.cc:2272] T d8060b5b61484f78971bec004c171c0b P 6133756cc28a47d491b159f8bd124060 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.286949 14139 tablet_replica.cc:333] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060: stopping tablet replica
I20260709 13:08:04.287444 14139 raft_consensus.cc:2243] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.287918 14139 raft_consensus.cc:2272] T 8885eb6b7a02460fa90480e1c3a00907 P 6133756cc28a47d491b159f8bd124060 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:04.295866 27576 consensus_peers.cc:597] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 -> Peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Couldn't send request to peer 6133756cc28a47d491b159f8bd124060. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:04.300680 27502 consensus_peers.cc:597] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 -> Peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Couldn't send request to peer 6133756cc28a47d491b159f8bd124060. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.334208 14139 tablet_server.cc:196] TabletServer@127.13.206.193:0 shutdown complete.
W20260709 13:08:04.352500 27502 consensus_peers.cc:597] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 -> Peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Couldn't send request to peer 6133756cc28a47d491b159f8bd124060. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.373332 14139 tablet_server.cc:179] TabletServer@127.13.206.194:0 shutting down...
W20260709 13:08:04.407366 27579 consensus_peers.cc:597] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 -> Peer a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135): Couldn't send request to peer a85d0c8e244c4191bb2a39f74b217f37. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.412078 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:04.413053 14139 tablet_replica.cc:333] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.414167 14139 raft_consensus.cc:2243] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.415319 14139 raft_consensus.cc:2272] T e7869f9006bd4c70861abc7805f5892d P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.418215 14139 tablet_replica.cc:333] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
W20260709 13:08:04.418509 27579 consensus_peers.cc:597] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 -> Peer a85d0c8e244c4191bb2a39f74b217f37 (127.13.206.194:36135): Couldn't send request to peer a85d0c8e244c4191bb2a39f74b217f37. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.419112 14139 raft_consensus.cc:2243] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.420022 14139 raft_consensus.cc:2272] T 678daad614014e7ab9313d6bf77345b8 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.422400 14139 tablet_replica.cc:333] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.423066 14139 raft_consensus.cc:2243] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.423494 14139 raft_consensus.cc:2272] T 8b0edf3f3eec46a9aa7741a0306309b9 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.425851 14139 tablet_replica.cc:333] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.426708 14139 raft_consensus.cc:2243] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.427232 14139 raft_consensus.cc:2272] T 9b96543c470a41e5b707cf0d5e6b7a15 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.429736 14139 tablet_replica.cc:333] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
W20260709 13:08:04.430169 27576 consensus_peers.cc:597] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 -> Peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Couldn't send request to peer 6133756cc28a47d491b159f8bd124060. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.430508 14139 raft_consensus.cc:2243] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.431181 14139 raft_consensus.cc:2272] T 1924e7444c624464bdb57bab0f2dde3f P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.433602 14139 tablet_replica.cc:333] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.434309 14139 raft_consensus.cc:2243] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.434818 14139 raft_consensus.cc:2272] T e5ded325c85849a09dfad3c05f3bfe24 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.437019 14139 tablet_replica.cc:333] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.437611 14139 raft_consensus.cc:2243] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.438107 14139 raft_consensus.cc:2272] T 0ffe9b21b446483f969e15a1af04275a P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.440768 14139 tablet_replica.cc:333] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.441404 14139 raft_consensus.cc:2243] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.441905 14139 raft_consensus.cc:2272] T 15bd073603094e9e89099d89e23c71c7 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.444389 14139 tablet_replica.cc:333] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.445016 14139 raft_consensus.cc:2243] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.445925 14139 raft_consensus.cc:2272] T cda617f16b0b4900a2c1e421ff81aa84 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.448230 14139 tablet_replica.cc:333] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.448822 14139 raft_consensus.cc:2243] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.449292 14139 raft_consensus.cc:2272] T 15091c264fdc44fe80269b67ca37f4d0 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.451448 14139 tablet_replica.cc:333] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.452020 14139 raft_consensus.cc:2243] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.452878 14139 raft_consensus.cc:2272] T 2151f36a277a43a0a6282bffd280bfbb P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.455255 14139 tablet_replica.cc:333] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.455996 14139 raft_consensus.cc:2243] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.456561 14139 raft_consensus.cc:2272] T d8060b5b61484f78971bec004c171c0b P a85d0c8e244c4191bb2a39f74b217f37 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:04.459751 27502 consensus_peers.cc:597] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 -> Peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Couldn't send request to peer 6133756cc28a47d491b159f8bd124060. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.460168 14139 tablet_replica.cc:333] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.460862 14139 raft_consensus.cc:2243] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.461750 14139 raft_consensus.cc:2272] T 8885eb6b7a02460fa90480e1c3a00907 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.465132 14139 tablet_replica.cc:333] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.466156 14139 raft_consensus.cc:2243] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.467283 14139 raft_consensus.cc:2272] T 8714f50868d24d89ad89615c1fe470b2 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:04.467686 27576 consensus_peers.cc:597] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 -> Peer 6133756cc28a47d491b159f8bd124060 (127.13.206.193:35339): Couldn't send request to peer 6133756cc28a47d491b159f8bd124060. Status: Network error: Client connection negotiation failed: client connection to 127.13.206.193:35339: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:04.469851 14139 tablet_replica.cc:333] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.470582 14139 raft_consensus.cc:2243] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.471138 14139 raft_consensus.cc:2272] T c503892b567043d5874be704fe436d70 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.473551 14139 tablet_replica.cc:333] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.474079 14139 raft_consensus.cc:2243] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.474948 14139 raft_consensus.cc:2272] T 6e3f5420ef3044d7bd996ffc7e270f66 P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.477061 14139 tablet_replica.cc:333] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.477566 14139 raft_consensus.cc:2243] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.477985 14139 raft_consensus.cc:2272] T a0832f611c88444f84f9c0791be88152 P a85d0c8e244c4191bb2a39f74b217f37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.480201 14139 tablet_replica.cc:333] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37: stopping tablet replica
I20260709 13:08:04.480661 14139 raft_consensus.cc:2243] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.481087 14139 raft_consensus.cc:2272] T 7a8972cf673b4bcf9590c1260354901a P a85d0c8e244c4191bb2a39f74b217f37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.511330 14139 tablet_server.cc:196] TabletServer@127.13.206.194:0 shutdown complete.
I20260709 13:08:04.547283 14139 tablet_server.cc:179] TabletServer@127.13.206.195:0 shutting down...
I20260709 13:08:04.581251 14139 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:04.582036 14139 tablet_replica.cc:333] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.582811 14139 raft_consensus.cc:2243] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.583402 14139 raft_consensus.cc:2272] T 678daad614014e7ab9313d6bf77345b8 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.585660 14139 tablet_replica.cc:333] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.586309 14139 raft_consensus.cc:2243] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.586815 14139 raft_consensus.cc:2272] T 1924e7444c624464bdb57bab0f2dde3f P da55bab8ad794364aa77430da1cf0bc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.588850 14139 tablet_replica.cc:333] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.589483 14139 raft_consensus.cc:2243] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.589970 14139 raft_consensus.cc:2272] T e7869f9006bd4c70861abc7805f5892d P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.591997 14139 tablet_replica.cc:333] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.592569 14139 raft_consensus.cc:2243] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.593418 14139 raft_consensus.cc:2272] T 8b0edf3f3eec46a9aa7741a0306309b9 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.595643 14139 tablet_replica.cc:333] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.596225 14139 raft_consensus.cc:2243] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.596719 14139 raft_consensus.cc:2272] T 9b96543c470a41e5b707cf0d5e6b7a15 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.598824 14139 tablet_replica.cc:333] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.599349 14139 raft_consensus.cc:2243] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.599802 14139 raft_consensus.cc:2272] T 2151f36a277a43a0a6282bffd280bfbb P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.602000 14139 tablet_replica.cc:333] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.602651 14139 raft_consensus.cc:2243] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.603122 14139 raft_consensus.cc:2272] T 15091c264fdc44fe80269b67ca37f4d0 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.605222 14139 tablet_replica.cc:333] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.605837 14139 raft_consensus.cc:2243] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.606451 14139 raft_consensus.cc:2272] T 15bd073603094e9e89099d89e23c71c7 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.608752 14139 tablet_replica.cc:333] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.609334 14139 raft_consensus.cc:2243] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.609935 14139 raft_consensus.cc:2272] T cda617f16b0b4900a2c1e421ff81aa84 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.612152 14139 tablet_replica.cc:333] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.612725 14139 raft_consensus.cc:2243] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.613206 14139 raft_consensus.cc:2272] T 6e3f5420ef3044d7bd996ffc7e270f66 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.615231 14139 tablet_replica.cc:333] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.615772 14139 raft_consensus.cc:2243] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.616660 14139 raft_consensus.cc:2272] T a0832f611c88444f84f9c0791be88152 P da55bab8ad794364aa77430da1cf0bc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.618940 14139 tablet_replica.cc:333] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.619482 14139 raft_consensus.cc:2243] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.619962 14139 raft_consensus.cc:2272] T 7a8972cf673b4bcf9590c1260354901a P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.622305 14139 tablet_replica.cc:333] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.622864 14139 raft_consensus.cc:2243] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.623333 14139 raft_consensus.cc:2272] T 8885eb6b7a02460fa90480e1c3a00907 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.625437 14139 tablet_replica.cc:333] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.625970 14139 raft_consensus.cc:2243] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.626842 14139 raft_consensus.cc:2272] T d8060b5b61484f78971bec004c171c0b P da55bab8ad794364aa77430da1cf0bc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.629899 14139 tablet_replica.cc:333] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.630584 14139 raft_consensus.cc:2243] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.631098 14139 raft_consensus.cc:2272] T e5ded325c85849a09dfad3c05f3bfe24 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.633217 14139 tablet_replica.cc:333] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.633747 14139 raft_consensus.cc:2243] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.634699 14139 raft_consensus.cc:2272] T 0ffe9b21b446483f969e15a1af04275a P da55bab8ad794364aa77430da1cf0bc8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.637217 14139 tablet_replica.cc:333] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.637815 14139 raft_consensus.cc:2243] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.638410 14139 raft_consensus.cc:2272] T 8714f50868d24d89ad89615c1fe470b2 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.640630 14139 tablet_replica.cc:333] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8: stopping tablet replica
I20260709 13:08:04.641100 14139 raft_consensus.cc:2243] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:04.641594 14139 raft_consensus.cc:2272] T c503892b567043d5874be704fe436d70 P da55bab8ad794364aa77430da1cf0bc8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.684024 14139 tablet_server.cc:196] TabletServer@127.13.206.195:0 shutdown complete.
I20260709 13:08:04.718891 14139 master.cc:562] Master@127.13.206.254:33029 shutting down...
I20260709 13:08:04.741014 14139 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:04.741605 14139 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:04.741981 14139 tablet_replica.cc:333] T 00000000000000000000000000000000 P ea80c6a5d6e14de490786d97c283beed: stopping tablet replica
I20260709 13:08:04.763293 14139 master.cc:584] Master@127.13.206.254:33029 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11734 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24760 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (385712 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:08:04.819468 14139 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 402 messages since previous log ~14 seconds ago
I20260709 13:08:04.819741 14139 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 405 messages since previous log ~14 seconds ago
I20260709 13:08:04.819904 14139 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 405 messages since previous log ~14 seconds ago
I20260709 13:08:04.820176 14139 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:08:04.820393 14139 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~33 seconds ago
I20260709 13:08:04.820577 14139 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 1 messages since previous log ~99 seconds ago
I20260709 13:08:04.820816 14139 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~142 seconds ago
I20260709 13:08:04.821110 14139 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 13:08:04.821436 14139 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 27 messages since previous log ~9 seconds ago
